As more people turn to AI tools like ChatGPT and Perplexity for answers, website owners are scrambling to make sure AI understands their content. One idea getting a lot of buzz is llms.txt, a simple file that promises to help AI tools read your site more easily. But what exactly is it, who is actually using it, and is it worth your time?
The Short Answers
- What it is: A plain text file that gives AI tools a simple map of your website’s most important content.
- Where it came from: It was proposed in 2024 as an idea, not an official web standard.
- Who uses it: Mostly software companies and developer documentation sites, plus tools that create it automatically.
- Do AI tools read it? No major AI company has confirmed using it to decide what to show in answers.
- Should you use it? It’s quick and harmless to add, but don’t expect it to boost your AI visibility on its own.
1. What Is llms.txt?
llms.txt is a simple text file you place at the root of your website, at an address like yoursite.com/llms.txt. “LLM” stands for large language model, the technology behind tools like ChatGPT and Claude. The file gives these tools a short summary of who you are and a list of links to your most important pages, written in a clean, easy-to-read format.
The idea is that websites are messy for AI to read. Menus, ads, pop-ups, and code get in the way of the actual content. llms.txt cuts through that clutter and points AI straight to what matters. Here’s what a basic one might look like:
It’s easy to confuse llms.txt with robots.txt, but they do different jobs. robots.txt tells search engines and bots which pages they’re allowed to visit. llms.txt doesn’t block anything. It simply suggests where the good stuff is.
2. Where Did It Come From?
llms.txt was proposed in September 2024 by Jeremy Howard, co-founder of the AI research company Answer.AI. He suggested it as a simple, shared way for websites to help AI tools find and understand their content. There’s also a longer version, llms-full.txt, which puts the full text of your key pages into one file instead of just linking to them.
It’s important to know that llms.txt is a proposal, not an official standard. No standards body has approved it, and no AI company is required to follow it. It has spread mostly by word of mouth and through tools that add it for you, which is why you’ll hear very different opinions about how much it matters.
3. Who Uses It Today?
The biggest adopters so far are software companies with large help centers and developer documentation. Companies like Anthropic, Cloudflare, and Stripe publish llms.txt files for their docs. That makes sense: developers often paste documentation into AI coding tools, and a clean, organized file makes that much easier.
Adoption has also grown because some platforms create the file automatically. Documentation tools like Mintlify and GitBook can generate one for the sites they host, and the Yoast SEO plugin for WordPress added an llms.txt option too. Outside of tech, though, most small businesses, online stores, and local service companies still don’t have one, and few of their customers would notice either way.
4. Do AI Tools Actually Read It?
This is the big question, and the honest answer is: not in any way that’s been confirmed. None of the major AI companies, including OpenAI, Google, and Anthropic, have said they use llms.txt to decide which brands to mention or which sources to cite in their answers. Google has gone further and said publicly that it doesn’t use it, with one Google representative comparing it to the old “keywords” meta tag that search engines stopped paying attention to years ago.
Where llms.txt does help today is when someone points an AI tool at it on purpose. A developer might feed a company’s llms.txt file into an AI coding assistant so it can answer questions about that company’s software. That’s useful, but it’s a very different thing from AI tools finding and recommending your business on their own.
5. Should You Use It?
For most businesses, llms.txt is a “nice to have,” not a priority. It takes very little time to set up, especially if your website platform or SEO plugin can create it for you, and it won’t hurt your site in any way. If you run a software product with documentation, it’s worth doing now, since developers and AI coding tools already make use of it. And if AI companies do start reading it in the future, you’ll be ready.
Just don’t expect it to move the needle on its own. A file on your website won’t get ChatGPT to recommend you. What still matters most is what we covered in our AI visibility guide: real customers talking about you on Reddit, YouTube, review sites, and social media, plus a clear, accurate website that’s easy for AI to understand. If you add llms.txt, treat it as a small finishing touch on top of those bigger efforts, and remember to update it whenever your key pages change.