llms.txt guide
llms.txt: what it is, and how to write one.
What the llms.txt proposal says, how to create and place the file, and what Google says about it.
Short answer
What is llms.txt?
llms.txt is a proposed markdown file at a site's root, at yourdomain.com/llms.txt. It gives language models a curated overview: a short summary and links to your key pages. People sometimes write it llm.txt. Google Search says it does not use the file.
In brief
Five things to know first.
A proposal, not a rule
llms.txt is a community proposal for a markdown file that gives language models a curated view of your site.
Only one part is required
A valid file needs just an H1 with the site name. Summary, notes and link lists are optional.
It complements, not replaces
A sitemap lists all pages and robots.txt sets access. llms.txt adds a curated overview.
Google does not use it
Google says you don't need llms.txt files to appear in Google Search, including its generative AI features.
Adoption is strongest in docs
Coding agents follow it to API references. Developer documentation is where it is used most.
The basics
What an llms.txt file is
llms.txt is a plain markdown file that tells AI tools what your site is and which pages matter most. You publish it at yourdomain.com/llms.txt.
Jeremy Howard proposed it in 2024. The proposal's v2 draws on two years of adoption, which its author says includes thousands of sites publishing a file.
A markdown file
It lives at your site root, written in plain markdown.
A curated overview
A short summary plus links to the pages that matter most.
Read on demand
The authors expected it to help with inference, not training.
The format
llms.txt format and specification
The specification keeps the structure small. Only the H1 is required. Everything after it is optional, and the order is fixed.
The proposal uses Markdown instead of XML because language models and agents read these files, yet standard tools can still parse them.
| Section | Required? | What it holds |
|---|---|---|
| H1 | Yes | Name of the project or site |
| Blockquote | No | Short summary with key information |
| Body text | No | Details in paragraphs or lists, no headings |
| H2 file lists | No | Links as [name](url), with optional notes |
| Optional H2 | No | Secondary links an agent can skip |
How it compares
llms.txt vs robots.txt and sitemaps
The proposal says this file complements existing ones. It does not set access rules or list every URL.
Mintlify, a docs platform vendor, puts it this way: sitemap.xml lists what exists, robots.txt controls access, and llms.txt signals what matters most.
| File | What it does | |
|---|---|---|
| robots.txt | robots.txt | Tells tools what access is acceptable |
| sitemap.xml | sitemap.xml | Lists all pages for search engines |
| llms.txt | AI text file | Gives LLMs a curated overview, read on demand |
Want to see how AI engines read your site?
Our free AI audit shows where your brand appears in ChatGPT, Claude, Perplexity and Gemini answers, and what blocks it.
How to create it
How to create llms.txt: 5 steps
You can write the file by hand in any text editor. Keep it short and curated, not a copy of your sitemap.
Name the site
Start with an H1 holding the name of your project or site. This is the only required part.Write a short summary
Add a blockquote with the key facts a reader needs to understand the rest of the file.List your key pages
Under H2 headings, add links as [name](url), each with a short note about the page.Mark secondary links
Put lower-priority links under an Optional H2, so agents can skip them for a shorter context.Publish at the root
Upload the file to your site root. The proposal also allows files at subpaths; the most specific one applies.
Where it goes
Where to put llms.txt and check it
The proposal places llms.txt at the site root, so it loads at yourdomain.com/llms.txt. It can also sit in a subpath and cover the pages under it.
To see any site's file, add /llms.txt to its domain in a browser. If plain text loads, the site publishes one. See real llms.txt examples for the shape to copy.
Create the file
Write it by hand, or start from a real example, then edit it down to your key pages.Upload it to the root
Place llms.txt in your site's top folder, where robots.txt lives, so it loads at /llms.txt.Open it in a browser
Visit yourdomain.com/llms.txt and check the plain text loads with every link working.
WordPress and others
llms.txt on WordPress, Shopify and more
Several platforms and plugins generate llms.txt automatically. The llmstxt.org proposal names Mintlify, GitBook, Yoast SEO, AIOSEO and Wix.
WordPress
Yoast SEO and AIOSEO can generate the file. You can also upload your own to the site root.
Shopify
Shopify gives no direct access to the root folder. Check your theme or app options, or ask a developer.
Docs platforms
Mintlify and GitBook generate llms.txt for documentation sites.
Wix
Wix is on the proposal's list of platforms that generate the file.
Fix the foundation first
We handle llms.txt, schema, crawler access and rendering as part of technical GEO, built from your audit findings.
Going deeper
llms-full.txt and .md pages
The proposal suggests pages also offer a clean markdown version: add .md to the URL or swap the extension for .md.
Some companies pair a slim index with a larger llms-full.txt export. Anthropic publishes both for its docs.
| llms.txt | llms-full.txt | |
|---|---|---|
| Content | A slim index with links | The full documentation in markdown |
| Best for | Real-time assistants such as ChatGPT and Claude | Ingestion pipelines, IDE indexing and RAG |
SEO and Google
Does Google use llms.txt?
Google's guide says: “You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search.” It adds that Google Search itself doesn't use them.
For SEO, Google's recap says that for Google Search you can ignore tactics like creating unnecessary AI text files. Google adds that SEO best practices stay relevant.
Google Search does not use it
Google says Search, including its generative AI features, does not use these files.
Foundations still apply
Its AI features are rooted in core Search ranking and quality systems.
Other engines may differ
These sources do not show how other assistants treat the file. Test rather than assume.
Adoption
Who publishes llms.txt today
OpenAI, Anthropic and Gemini publish llms.txt files for their developer docs. Chrome's Lighthouse also audits sites for one as part of its agentic browsing checks.
The file is used most for software documentation, where coding agents follow it to API references. It can also serve businesses, personal sites and schools.
AI labs
OpenAI, Anthropic and Gemini publish llms.txt files for their own developer documentation.
Lighthouse
Chrome's Lighthouse audits sites for an llms.txt file as part of its agentic browsing checks.
Platforms
Mintlify, GitBook, Yoast SEO, AIOSEO and Wix generate the file automatically.
FAQ
llms.txt: common questions.
Is llms.txt worth creating?
llms.txt is cheap to write and some AI tools read it, but Google says Search does not use it. The file helps most where agents read documentation. Treat it as a small addition to crawlable, useful pages, not a way to earn citations.
Is it llm.txt or llms.txt?
The proposal names the file llms.txt, with an s, at the site root. Tools that follow the proposal look for /llms.txt, so use that exact name. llm.txt is a common misspelling.
Does Google use llms.txt?
Google does not use llms.txt in Search. Its guide says you don't need AI text files or Markdown to appear in Google Search, including its generative AI features. Its recap tells site owners to ignore unnecessary files like these.
How do I add llms.txt to WordPress?
WordPress sites can upload llms.txt to the site root or use a plugin. The llmstxt.org proposal lists Yoast SEO and AIOSEO among the plugins that generate the file automatically. Check the result at yourdomain.com/llms.txt.
How do I add llms.txt on Shopify?
Shopify does not give direct access to a store's root folder. Check your theme or app options, or ask a developer to serve the file at your site root. Then confirm it loads in a browser.
What is the difference between llms.txt and llms-full.txt?
llms.txt is a slim index with a summary and links. llms-full.txt is a larger export holding the full documentation in markdown. Anthropic publishes both: the index suits real-time assistants, the full file suits ingestion pipelines such as RAG systems.
Is llms.txt an official standard?
llms.txt is a proposal published at llmstxt.org, not a ratified standard. No search engine is required to follow it, and Google says it doesn't use it. Some AI labs publish files for their own docs, and some tools read them.
Does llms.txt replace robots.txt?
llms.txt does not replace robots.txt. The proposal says it complements it: robots.txt tells tools what access is acceptable, while llms.txt gives context for allowed content. Neither file guarantees that an AI assistant will read or cite your pages.
Free AI Audit
Find out how AI engines read and cite your site.
You leave knowing where the gap is, what is causing it, and which changes would matter first, whether we work together or not.
What to expect
Audit
Before the call, we run your buyers' questions through ChatGPT, Claude, Perplexity and Gemini.
Map
On the call, we show you where competitors are cited and you are not, and what's causing it.
Decide
An honest read on whether the Citation Stack fits. If it doesn't, you'll hear it on the call.
Don't see a time that works? Email Karim directly: contact@llmreach.ai