The generator doesn't crawl and index your entire website. Instead, for llms.txt, it:
- analyzes your homepage to extract site information
- identifies and categorizes main navigation links
- creates a structured llms.txt file following the specification
This aligns with the llms.txt proposal.
For llms-full.txt, it fetches the content from the links on the homepage. It's a much more complete documentation of your site.
I'm trying to get some initial users via free channels like Reddit, HN, etc. That would help with getting feedback and improving the site. Beyond that, I'm not sure yet.
- analyzes your homepage to extract site information - identifies and categorizes main navigation links - creates a structured llms.txt file following the specification
This aligns with the llms.txt proposal.
For llms-full.txt, it fetches the content from the links on the homepage. It's a much more complete documentation of your site.
You can read more about it here: https://llms-txt.io/blog/what-are-llms-txt-files
Or see examples here: https://llms-txt.io/blog/companies-using-llms-txt-examples