What llms.txt actually does for your website

What is llms.txt?

llms.txt is a Markdown file that sits at the root of a website. It starts with the name of the site and a one-paragraph summary, then lists the most important pages with a short note on each. Some sites also publish llms-full.txt, which puts the full text of the site in one file.

The idea is simple: give an AI assistant a clean, readable map of your site instead of making it dig through navigation, scripts and layout code.

Who actually reads it?

Coding assistants and AI tools that fetch documentation do look for llms.txt, which is why many developer-tool companies publish one. For search, the picture is weaker. Google has said plainly that you don’t need special AI files or markup to appear in its AI Overviews, and there’s no good evidence yet that having llms.txt makes ChatGPT or Perplexity cite you more often.

So why do I add it to client sites?

Because it costs almost nothing when it’s built correctly. On my sites, llms.txt is generated from the same data as the pages themselves, so the business name, services, locations and contact details can never drift out of sync. It’s a small, honest summary that helps any tool that does read it.

What I don’t do is sell it as a ranking trick. Anyone promising that llms.txt alone will get you into ChatGPT’s answers is overselling it.

What actually helps you show up in AI answers

These matter far more than any single file:

• Let AI search crawlers in. OAI-SearchBot (ChatGPT), Claude-SearchBot and PerplexityBot need to be allowed in robots.txt.
• Serve real HTML. AI crawlers handle JavaScript-heavy pages poorly, so pre-rendered or server-rendered pages are safer.
• Answer the question first. Lead each section with the direct answer, then explain.
• Be clear about who you are. Structured data for your business, the people behind it and your services helps systems connect the facts.
• Stay consistent. The same name, address and details everywhere they appear online.
• Keep it fresh. Show a real “last updated” date and keep facts current.

Does this site have one?

Yes. You can read it at michaelmooneydev.com/llms.txt, and the full version at /llms-full.txt. Both are built from the same data files as the pages you’re reading.