The original title is "llms.txt: What It Actually Does, and Why It Rots"

Short summary

llms.txt is a markdown file at your site root that curates priority pages for LLM crawlers, unlike sitemaps which optimize for coverage. Every link needs a description so models can decide what to fetch, and you should omit aggressively — if a page doesn't answer a question, exclude it. The file rots quickly: automate link-liveness CI checks and regenerate on docs changes rather than hand-maintaining it.

• •llms.txt curates priority pages for LLM retrieval vs sitemaps optimized for coverage
• •Descriptions on every link are essential; bare link lists are barely useful
• •Automate validation and regeneration — hand-maintained files rot within months

Generated with AI, which can make mistakes.