llms.txt

What is llms.txt?

llms.txt is a proposed convention for a markdown file at the root of a website. It gives language models a plain-text map of what the site is, what it offers and where its important pages live.

It sits beside robots.txt and sitemap.xml but does a different job. Robots.txt says what may be crawled. A sitemap lists URLs. llms.txt describes what the site means.

It is a convention, not a standard. No engine has to read it and adoption is uneven.

Why it matters for product builders

The file lets you state how your site should be understood. That is useful only while the facts stay current. Old claims may be repeated just as easily as accurate ones.

**Source note**

Jeremy Howard of Answer.AI proposed llms.txt in September 2024.