The short answer: llms.txt is a proposed plain text file, written in Markdown and placed at yourdomain.com/llms.txt, that gives AI tools a short summary of your site and links to its most useful pages. It was proposed in 2024 and has been picked up by many documentation sites, but no major AI search product has publicly said it uses llms.txt to choose or cite sources, and Google has said you don't need it for AI Overviews. For most small business websites it's optional. It won't hurt, it takes minutes, but it won't get you cited on its own. Your time is better spent on crawler access and clear pages.

I'm Rustam, and I run Frame the Pixel, a web design and WordPress studio in Kuala Lumpur. I build AI ready websites, so I get asked about llms.txt a lot, often after someone has been told it's essential. I'd rather give you the honest version.

Where llms.txt came from

The idea was published by Jeremy Howard of Answer.AI in September 2024 and is documented at llmstxt.org. The reasoning is sensible. Language models have limited context windows and web pages are full of navigation, scripts and adverts. A small, curated Markdown file could point a model straight to the content that matters, in a format it reads easily.

It's worth being clear about what it is not:

It is not a standard. It's a community proposal, not something agreed by a standards body or the major AI companies.
It is not robots.txt. It doesn't allow or block anything. Crawler access is still controlled by robots.txt.
It is not a sitemap. It's a short, hand picked guide, not a full list of URLs.

What goes in an llms.txt file

Hands rolling up a plain parchment scroll tied with cotton string, representing the simple llms.txt file format

The proposal on llmstxt.org describes a simple structure:

An H1 heading with the name of the site or project. This is the only required part.
A blockquote with a short summary.
Optional paragraphs or lists with more detail.
H2 sections containing lists of links, each with an optional short note.
An optional section titled "Optional" for links that can be skipped when space is short.

It also suggests offering Markdown versions of key pages by adding .md to the URL, and some sites publish a larger llms-full.txt with the full text of their docs.

A small business version might look like this:

# Example Dental Clinic

> Family dental clinic in Petaling Jaya, Selangor. Open Monday to Saturday.

## Services
- [General dentistry](https://example.com/services/general): check ups, cleaning, fillings
- [Orthodontics](https://example.com/services/braces): braces and clear aligners

## About
- [Our dentists](https://example.com/about)
- [Contact and directions](https://example.com/contact)

That's genuinely all there is to it.

Notice what's missing. There are no rules, no ranking hints and no instructions to the AI. The file only describes and links. Anything that matters for search, such as your actual service descriptions, opening hours and prices, still has to live on your real pages, where people and crawlers can both read it.

Who actually uses llms.txt in 2026?

This is where honesty matters, because a lot of tools and plugins sell llms.txt as the key to AI visibility.

Where it's clearly useful

Developer documentation. Many software companies publish llms.txt files so coding assistants and AI powered editors can pull accurate docs. OpenAI's own crawler documentation points readers to an llms.txt index of its docs, for example. If you publish technical docs or an API, it's a reasonable thing to add.

Where the evidence is thin

AI search and answer engines. None of the main crawler documentation I've read from OpenAI or Anthropic mentions llms.txt as a signal for search or citations. They talk about robots.txt and their named crawlers. Some site owners report seeing AI bots request the file in their logs, but a bot fetching a file isn't the same as a company saying it uses it to rank or cite.

What Google has said

Google is the most explicit. Its official guidance on AI features and your website says you don't need to create new machine readable files, AI text files or special markup to appear in AI Overviews or AI Mode. Pages just need to be indexed and eligible for a snippet in normal Search.

Google's John Mueller has gone further in public comments. As reported by Search Engine Journal, he described the file's benefit as purely speculative and said that although it has existed for years, none of the AI systems use it. In a later podcast, also reported by Search Engine Journal, he argued that because the file is self reported, an AI system can't use it to decide which website to trust over another, though it might help an agent already on your site find its way around.

That last point is fair, and it's the most useful way to think about llms.txt: a hallway map for a visitor who has already arrived, not a sign that brings visitors in.

So does your website need one?

A gravel garden path splitting in two between green hedges, representing deciding whether your website needs llms.txt

For most small business sites, my answer is: you don't need one, and you can add one if you like.

Add one if:

You publish documentation, an API or technical guides.
You have a large site and want to point AI agents to a handful of authoritative pages.
It takes you ten minutes and you'd rather be early than late if adoption grows.

Don't prioritise it if:

AI crawlers are blocked in your robots.txt or firewall. Fix that first, or nothing reads anything.
Your key pages aren't indexed in Google and Bing.
Your service pages don't clearly say what you do, where and for whom.

Those three things affect whether AI tools cite you today. I explain each in detail in how to get your business cited by ChatGPT, Claude, Gemini and Google AI Overviews.

Is there any downside?

Very little, but a few things to watch:

Keep it accurate. An out of date file listing old services or prices is worse than none.
Don't stuff it. Keyword lists and "we are the best" claims make no difference and look spammy.
Don't let it replace real pages. If the content only exists in llms.txt and not on your site, Google won't use it for AI Overviews.
Consider whether it needs indexing. Some SEOs suggest adding a noindex header so the plain text file doesn't appear in normal search results in place of your real pages.

How to add llms.txt to a WordPress site

You have three options:

Upload a file. Write it in any text editor, save it as llms.txt and upload it to the root folder of your site with the hosting file manager or SFTP, the same place as wp-config.php.
Use your SEO plugin. Several popular WordPress SEO plugins now include an llms.txt option that builds the file from your pages. Check what it generates. Auto generated files often list every post rather than the few that matter.
Ask your developer or maintainer. It's a five minute job for anyone with file access.

Then visit yourdomain.com/llms.txt in a browser to check it loads as plain text. If you can't reach your hosting files because someone else set the site up, my guide to the site takeover checklist explains what access you should have.

What I'd do instead, in order

If you have an hour to spend on AI visibility this month, here's where I'd put it:

Check robots.txt and your CDN or security plugin aren't blocking OAI-SearchBot, Claude-SearchBot, Claude-User or Googlebot.
Check your main pages are indexed in Google Search Console and Bing Webmaster Tools.
Rewrite the opening of your main service pages to answer "what do you do, where, for whom" in two sentences.
Add LocalBusiness or Organization structured data.
Then, if there's time left, add llms.txt.

If AI Overviews have already reduced your clicks, see has Google's AI Overviews cut your traffic? for what you can do about it. And because AI crawlers give up on slow or broken pages just as people do, a well maintained WordPress site matters more than any single file.

How I can help

My AI ready websites service covers the things that actually move AI visibility: crawler access, indexing, structured data and clear page structure, plus llms.txt if it suits your site. For the content and ranking side, see my search engine optimisation service. I work 9am to 5pm Malaysia time (GMT+8) with businesses in Malaysia, the UK, Europe and beyond. Get in touch here or email contact@framethepixel.com.

FAQ

What is llms.txt?

A proposed Markdown file at the root of a website that summarises the site and links to its most useful pages for large language models. It's described at llmstxt.org.

Does Google use llms.txt?

Google's documentation says no special AI files are needed for AI Overviews or AI Mode, and Google's John Mueller has said publicly that AI systems don't use it.

Does llms.txt help with SEO?

Not for Google rankings. Treat it as an optional extra for AI agents, not an SEO tactic.

Is llms.txt the same as robots.txt?

No. robots.txt tells crawlers what they may access. llms.txt only suggests what's worth reading and controls nothing.

Can llms.txt hurt my website?

Not in any meaningful way, as long as it's accurate. The main risk is wasting time on it while bigger problems, like blocked crawlers, go unfixed.