what is llms.txt?

last updated: July 18, 2026

llms.txt is a proposed standard, published at llmstxt.org, for a markdown file at a website's root that summarizes the site's most important content for large language models (LLMs). The file consists of the site name, a short summary and curated link sections. It is neither required nor a ranking factor: Google states its AI features need no additional files.

where the llms.txt standard came from

The proposal was published in September 2024 by Answer.AI co-founder Jeremy Howard via llmstxt.org. It addresses a practical problem: language models have limited context windows, and HTML pages — menus, ads, scripts — are noisy for machines. llms.txt serves the essence of a site in one clean markdown file so an AI assistant can understand it quickly at inference time.

It should not be confused with robots.txt or sitemap.xml: robots.txt tells crawlers what they may not crawl, sitemap.xml lists all URLs; llms.txt is a curated guide that selects and summarizes what actually matters.

the format: how the file is structured

The standard defines a markdown structure served at /llms.txt, written in a specific order:

  • An h1 heading: the site or project name (the only required field)
  • A blockquote (>): a one-paragraph summary of the site
  • Optional free-form paragraphs adding context
  • Link lists under h2 sections, formatted as "[title](url): short description"
  • An h2 section named "Optional": secondary links that can be skipped when context is tight
  • The llms-full.txt variant: all key content merged into a single markdown file instead of curated links

what it does — and does not — do

What it does: gives AI assistants and agents clean, low-cost access to site content — especially useful for documentation sites, libraries and content-heavy sites where a model needs to find and summarize the right page. Mintlify, Anthropic and many developer platforms publish llms.txt for their docs.

What it does not do: llms.txt is not a Google ranking factor; Google representatives have stated they do not use the file for Search or AI features, and that no extra file is required. Adding it guarantees no visibility in AI Overviews or classic rankings. It is a low-cost complement whose benefit is limited to tools that read content at inference time — it does not replace SEO and GEO fundamentals.

frequently asked questions

Does llms.txt affect Google rankings?
No. llms.txt is not a ranking factor; Google states no additional files are required for Search or its AI features. The file's value is for AI assistants and agents that read content at inference time.
What is the difference between llms.txt and robots.txt?
robots.txt is a rules file telling crawlers which sections they may not access; llms.txt is a curated guide suggesting to language models which content matters most. One restricts access, the other recommends content — they do not replace each other.
What is llms-full.txt?
llms-full.txt is the expanded variant of the standard: instead of a link list, it merges all of the site's key content into one markdown file. It lets large-context models read the whole site in one pass; file size is its drawback.
Should I add llms.txt to my site?
The cost is low and there is no risk. It is a sensible complement for content-heavy sites — documentation, glossaries, guides. But it produces no visibility on its own; answer-first content, structured data and solid SEO fundamentals come first.

sources

related terms

related guides

let's talk about your brand

tell us your goals and we'll map a route tailored to you. the first call is free.

get in touch