llms.txt in 2026: who actually reads it?
By Roshan, founder of SearchMaxx - - updated - 7 min read
Add an llms.txt file if you want one. It takes an hour and costs nothing. But do not expect it to get you named in ChatGPT, Claude, Perplexity or Google's AI answers, because none of those search products says it reads the file, and Google says plainly that its search ignores it.
That is our position, and the rest of this post is the evidence for it. The file is useful for a narrower job than most guides claim: helping coding tools and agents that are already on your site find the right pages.
What llms.txt is
llms.txt is a proposal, not a standard. Jeremy Howard published it on September 3, 2024, at llmstxt.org, with a companion post on Answer.AI's blog the same day. The proposal opens with one line: "We propose adding a /llms.txt markdown file to websites to provide LLM-friendly content."
The idea is simple. A web page is built for people. It has navigation, scripts, cookie banners and ads. A language model with a small context window does better with a short, clean summary and a list of links to the pages that matter.
The format, per llmstxt.org:
- A Markdown file at
/llms.txt. - One required element: an H1 with the name of the site or project.
- An optional blockquote with a short summary.
- Optional paragraphs with more detail.
- Optional H2 sections, each a list of links with a short note after each one.
- By convention, a section called "Optional" holds links an agent can skip when it is short on room.
The proposal also suggests offering a clean Markdown copy of each page at the same URL with .md added. Some sites also publish an llms-full.txt with the full text of their docs in one file. Anthropic, Cloudflare and Vercel do. That is a convention that grew up around the proposal, not part of the proposal page.
What the companies running AI search have said
This is the part that matters, and the record is short.
| Company | What it has said about llms.txt | Source |
|---|---|---|
| Google (Search) | Search "doesn't use" llms.txt or other AI text files. Adding one "will neither harm nor help" your visibility | Google Search Central, AI optimization guide, updated July 10, 2026 |
| Google (Chrome Lighthouse) | An experimental audit flags a server error on /llms.txt. A missing file is fine |
Chrome for Developers, llms.txt audit, updated May 5, 2026 |
| OpenAI | Its crawler docs cover robots.txt. We found no statement that its search crawler reads llms.txt | OpenAI crawler docs |
| Anthropic | We found no statement that Claude's crawlers read llms.txt | No public statement found |
| Perplexity | We found no statement that its crawler reads llms.txt | No public statement found |
Google Search: ignored, in writing
Google's guide to generative AI features in Search has a section called "Mythbusting generative AI search: what you don't need to do". It says: "You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in Google Search (including its generative AI capabilities), as Google Search itself doesn't use them."
It goes on: "It's completely fine if you decide to create and maintain LLMS.txt files (or other similar files) for other services or systems that use these files. Doing so will neither harm nor help your site's visibility or rankings in Google Search, as Google Search ignores them." The same guide lists "creating unnecessary AI text files (like llms.txt)" among tactics you can ignore. (Google Search Central, updated July 10, 2026)
That covers AI Overviews and AI Mode. It is as clear as Google gets.
Google's John Mueller said much the same on Reddit in April 2025, as reported by Search Engine Journal: "AFAIK none of the AI services have said they're using LLMs.txt (and you can tell when you look at your server logs that they don't even check for it). To me, it's comparable to the keywords meta tag, this is what a site-owner claims their site is about." (Search Engine Journal, April 17, 2025)
The keywords meta tag comparison is the useful one. A file where a site describes itself is easy to stuff. A search engine that wants honest answers has little reason to trust it over the pages themselves.
Google Chrome: a different answer
Google is not one voice here. Chrome's Lighthouse tool added an experimental "Agentic browsing" category, and one of its audits checks /llms.txt. Chrome's docs call the file an "emerging convention" and say that without it, agents "may need to crawl more of the site" to learn its structure. The audit only flags a server error. A 404 is marked "Not Applicable", because the file is optional. (Chrome for Developers, updated May 5, 2026)
Search Engine Journal covered the split in May 2026 under the headline "Google's llms.txt guidance depends on which product you ask." (Search Engine Journal, May 20, 2026) That headline is the honest summary. Search ignores the file. Chrome's agent tooling treats it as a hint for browsing agents, which are a different thing from search ranking.
OpenAI, Anthropic and Perplexity: silence
OpenAI's crawler docs explain how OAI-SearchBot, GPTBot and ChatGPT-User follow robots.txt, and how long changes take to apply. They do not mention llms.txt. (OpenAI) We also found no public statement from Anthropic or Perplexity saying their search crawlers fetch or weigh the file.
Silence is not a denial. Any of them could read the file without saying so. But we will not tell you a file drives citations when no company running an AI search engine has said it does, and when Google has said in writing that its search does not.
Who publishes one anyway
Plenty of companies publish llms.txt, and the pattern says a lot about who it is for. We checked these on October 18, 2026. Each returned a working file:
Most of these are developer documentation. That fits the real use. A developer pastes a docs link into a coding assistant, or an agent is told to "use the Stripe docs", and a clean index of pages helps it pull the right ones. That job starts after someone, or something, has already chosen your site. It is not the job of deciding which sites an AI engine finds in the first place.
We publish one too. You can see searchmaxx.link/llms.txt and the full-text version at /llms-full.txt. We added them because they were cheap and they help agents that land on the site. We do not count them as part of what gets a company named in AI answers.
Should you add one?
| If you are... | Our advice |
|---|---|
| A developer tool or API with public docs | Yes. Agents and coding assistants that are pointed at your docs can use it |
| A SaaS marketing site hoping to appear in AI answers | Optional. Add it if it takes under an hour. It will not move rankings |
| Choosing between llms.txt and fixing crawl access | Fix crawl access first. A blocked or empty page cannot be cited, with or without llms.txt |
If you only have an afternoon, spend it on the things engines have documented. Let the AI search crawlers in through robots.txt. Make sure your pages send real text without JavaScript. Then write pages that answer the questions buyers ask. Those affect whether you get cited. llms.txt, on the evidence today, does not.
A minimal llms.txt you can copy
Here is a short file for Paidwick, a made-up invoicing tool. Swap in your own name, summary and links. Keep it under a page.
# Paidwick
> Paidwick is invoicing software for freelancers and small agencies. It sends invoices, chases late payments and syncs with QuickBooks.
Plans start at $12 a month. There is a 14-day free trial with no card required.
## Product
- [Features](https://paidwick.com/features): What Paidwick does, page by page
- [Pricing](https://paidwick.com/pricing): Plans, limits and what each includes
- [Integrations](https://paidwick.com/integrations): QuickBooks, Xero, Stripe and Zapier
## Docs
- [Getting started](https://paidwick.com/docs/start): Send your first invoice in five minutes
- [API reference](https://paidwick.com/docs/api): REST endpoints and webhooks
## Optional
- [Changelog](https://paidwick.com/changelog)
- [Blog](https://paidwick.com/blog)
A few rules keep it useful:
- Serve it as plain text at the root, with a
200status. Lighthouse flags server errors, and a file behind a login or bot wall helps no one. - Link to pages that exist and render without JavaScript. An index that points to empty shells is worse than none.
- Keep facts in step with the site. If your pricing page changes, change the file. Stale numbers in a file that agents read are a real cost.
- Do not stuff it. A list of keywords is the keywords meta tag again, and it will be treated the same way.
Where this leaves you
llms.txt is a reasonable idea that the engines deciding AI search answers have not adopted. Google has said its search ignores it. OpenAI, Anthropic and Perplexity have not said they read it. Add one if it is cheap for you, mostly for agents and coding tools. Then put your real effort where the companies have documented what they do.
For the things that do decide whether ChatGPT can cite you, start with how ChatGPT search chooses which sites to cite. Our free check also tells you in about 10 seconds whether AI crawlers can reach and read your site, and whether you have an llms.txt.
Want this done for your site?
Every day we make one change to your website that helps AI engines name you, and a person checks each one. Email me your website and the question your buyers ask AI.