Updated

llms.txt guide

llms.txt: what it is, and how to write one.

What the llms.txt proposal says, how to create and place the file, and what Google says about it.

Short answer

What is llms.txt?

llms.txt is a proposed markdown file at a site's root, at yourdomain.com/llms.txt. It gives language models a curated overview: a short summary and links to your key pages. People sometimes write it llm.txt. Google Search says it does not use the file.

In brief

Five things to know first.

  • A proposal, not a rule

    llms.txt is a community proposal for a markdown file that gives language models a curated view of your site.

  • Only one part is required

    A valid file needs just an H1 with the site name. Summary, notes and link lists are optional.

  • It complements, not replaces

    A sitemap lists all pages and robots.txt sets access. llms.txt adds a curated overview.

  • Google does not use it

    Google says you don't need llms.txt files to appear in Google Search, including its generative AI features.

  • Adoption is strongest in docs

    Coding agents follow it to API references. Developer documentation is where it is used most.

The basics

What an llms.txt file is

llms.txt is a plain markdown file that tells AI tools what your site is and which pages matter most. You publish it at yourdomain.com/llms.txt.

Jeremy Howard proposed it in 2024. The proposal's v2 draws on two years of adoption, which its author says includes thousands of sites publishing a file.

  • A markdown file

    It lives at your site root, written in plain markdown.

  • A curated overview

    A short summary plus links to the pages that matter most.

  • Read on demand

    The authors expected it to help with inference, not training.

The format

llms.txt format and specification

The specification keeps the structure small. Only the H1 is required. Everything after it is optional, and the order is fixed.

The proposal uses Markdown instead of XML because language models and agents read these files, yet standard tools can still parse them.

Sections of an llms.txt file, in order, per the llmstxt.org proposal
SectionRequired?What it holds
H1YesName of the project or site
BlockquoteNoShort summary with key information
Body textNoDetails in paragraphs or lists, no headings
H2 file listsNoLinks as [name](url), with optional notes
Optional H2NoSecondary links an agent can skip

How it compares

llms.txt vs robots.txt and sitemaps

The proposal says this file complements existing ones. It does not set access rules or list every URL.

Mintlify, a docs platform vendor, puts it this way: sitemap.xml lists what exists, robots.txt controls access, and llms.txt signals what matters most.

FileWhat it does
robots.txtrobots.txtTells tools what access is acceptable
sitemap.xmlsitemap.xmlLists all pages for search engines
llms.txtAI text fileGives LLMs a curated overview, read on demand

Want to see how AI engines read your site?

Our free AI audit shows where your brand appears in ChatGPT, Claude, Perplexity and Gemini answers, and what blocks it.

How to create it

How to create llms.txt: 5 steps

You can write the file by hand in any text editor. Keep it short and curated, not a copy of your sitemap.

  1. Name the site

    Start with an H1 holding the name of your project or site. This is the only required part.
  2. Write a short summary

    Add a blockquote with the key facts a reader needs to understand the rest of the file.
  3. List your key pages

    Under H2 headings, add links as [name](url), each with a short note about the page.
  4. Mark secondary links

    Put lower-priority links under an Optional H2, so agents can skip them for a shorter context.
  5. Publish at the root

    Upload the file to your site root. The proposal also allows files at subpaths; the most specific one applies.

Where it goes

Where to put llms.txt and check it

The proposal places llms.txt at the site root, so it loads at yourdomain.com/llms.txt. It can also sit in a subpath and cover the pages under it.

To see any site's file, add /llms.txt to its domain in a browser. If plain text loads, the site publishes one. See real llms.txt examples for the shape to copy.

  1. Create the file

    Write it by hand, or start from a real example, then edit it down to your key pages.
  2. Upload it to the root

    Place llms.txt in your site's top folder, where robots.txt lives, so it loads at /llms.txt.
  3. Open it in a browser

    Visit yourdomain.com/llms.txt and check the plain text loads with every link working.

WordPress and others

llms.txt on WordPress, Shopify and more

Several platforms and plugins generate llms.txt automatically. The llmstxt.org proposal names Mintlify, GitBook, Yoast SEO, AIOSEO and Wix.

  • WordPress

    Yoast SEO and AIOSEO can generate the file. You can also upload your own to the site root.

  • Shopify

    Shopify gives no direct access to the root folder. Check your theme or app options, or ask a developer.

  • Docs platforms

    Mintlify and GitBook generate llms.txt for documentation sites.

  • Wix

    Wix is on the proposal's list of platforms that generate the file.

Fix the foundation first

We handle llms.txt, schema, crawler access and rendering as part of technical GEO, built from your audit findings.

Going deeper

llms-full.txt and .md pages

The proposal suggests pages also offer a clean markdown version: add .md to the URL or swap the extension for .md.

Some companies pair a slim index with a larger llms-full.txt export. Anthropic publishes both for its docs.

llms.txtllms-full.txt
ContentA slim index with linksThe full documentation in markdown
Best forReal-time assistants such as ChatGPT and ClaudeIngestion pipelines, IDE indexing and RAG

SEO and Google

Does Google use llms.txt?

Google's guide says: “You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search.” It adds that Google Search itself doesn't use them.

For SEO, Google's recap says that for Google Search you can ignore tactics like creating unnecessary AI text files. Google adds that SEO best practices stay relevant.

  • Google Search does not use it

    Google says Search, including its generative AI features, does not use these files.

  • Foundations still apply

    Its AI features are rooted in core Search ranking and quality systems.

  • Other engines may differ

    These sources do not show how other assistants treat the file. Test rather than assume.

Adoption

Who publishes llms.txt today

OpenAI, Anthropic and Gemini publish llms.txt files for their developer docs. Chrome's Lighthouse also audits sites for one as part of its agentic browsing checks.

The file is used most for software documentation, where coding agents follow it to API references. It can also serve businesses, personal sites and schools.

  • AI labs

    OpenAI, Anthropic and Gemini publish llms.txt files for their own developer documentation.

  • Lighthouse

    Chrome's Lighthouse audits sites for an llms.txt file as part of its agentic browsing checks.

  • Platforms

    Mintlify, GitBook, Yoast SEO, AIOSEO and Wix generate the file automatically.

FAQ

llms.txt: common questions.

Is llms.txt worth creating?

llms.txt is cheap to write and some AI tools read it, but Google says Search does not use it. The file helps most where agents read documentation. Treat it as a small addition to crawlable, useful pages, not a way to earn citations.

Is it llm.txt or llms.txt?

The proposal names the file llms.txt, with an s, at the site root. Tools that follow the proposal look for /llms.txt, so use that exact name. llm.txt is a common misspelling.

Does Google use llms.txt?

Google does not use llms.txt in Search. Its guide says you don't need AI text files or Markdown to appear in Google Search, including its generative AI features. Its recap tells site owners to ignore unnecessary files like these.

How do I add llms.txt to WordPress?

WordPress sites can upload llms.txt to the site root or use a plugin. The llmstxt.org proposal lists Yoast SEO and AIOSEO among the plugins that generate the file automatically. Check the result at yourdomain.com/llms.txt.

How do I add llms.txt on Shopify?

Shopify does not give direct access to a store's root folder. Check your theme or app options, or ask a developer to serve the file at your site root. Then confirm it loads in a browser.

What is the difference between llms.txt and llms-full.txt?

llms.txt is a slim index with a summary and links. llms-full.txt is a larger export holding the full documentation in markdown. Anthropic publishes both: the index suits real-time assistants, the full file suits ingestion pipelines such as RAG systems.

Is llms.txt an official standard?

llms.txt is a proposal published at llmstxt.org, not a ratified standard. No search engine is required to follow it, and Google says it doesn't use it. Some AI labs publish files for their own docs, and some tools read them.

Does llms.txt replace robots.txt?

llms.txt does not replace robots.txt. The proposal says it complements it: robots.txt tells tools what access is acceptable, while llms.txt gives context for allowed content. Neither file guarantees that an AI assistant will read or cite your pages.

Free AI Audit

Find out how AI engines read and cite your site.

You leave knowing where the gap is, what is causing it, and which changes would matter first, whether we work together or not.

What to expect

  1. Audit

    Before the call, we run your buyers' questions through ChatGPT, Claude, Perplexity and Gemini.

  2. Map

    On the call, we show you where competitors are cited and you are not, and what's causing it.

  3. Decide

    An honest read on whether the Citation Stack fits. If it doesn't, you'll hear it on the call.

Don't see a time that works? Email Karim directly: contact@llmreach.ai