What Is llms.txt (And Should Your Site Have One)?

Last updated on September 10, 2026

If you’ve looked at your site’s root directory lately (or watched what AI crawlers request when they hit your domain), you may have come across llms.txt. It’s a new, still-informal standard, and there’s a fair amount of confusion about what it actually does. Here’s a straight answer, plus a real example from a working WordPress site.

What llms.txt Is

llms.txt is a plain-text file, served at the root of a domain (yoursite.com/llms.txt), that gives AI models and AI search tools a curated, markdown-formatted map of a site’s most important content: a summary of what the site is, plus links to the pages and posts worth reading first.

It’s modeled loosely on robots.txt and sitemap.xml, but it does a different job. robots.txt tells crawlers what they’re allowed to access. A sitemap lists everything that exists. llms.txt is curation, not permission or inventory: a short, opinionated list meant to be read by a language model rather than a person, pointing at the content that best represents the site.

It is not an official standard. No search engine or AI company has formally committed to using it, and there’s real debate in the SEO and dev community about how much it currently matters. It’s worth understanding regardless, because the underlying idea (giving AI tools a clean, structured entry point to a site’s best content) is directionally where AI search is heading, and it costs almost nothing to implement correctly.

A Real Example

Here’s what this looks like in practice. This site’s own llms.txt file (generated automatically by Yoast SEO):

# Alison Iddings: Custom WordPress Developer

> Custom-coded WordPress sites built for enterprise marketing teams. No page builders. Optimized for performance, SEO, and AI. Based in Raleigh, NC.

Generated by Yoast SEO v28.4, this is an llms.txt file, meant for consumption by LLMs.

## Pages
- [AI-Ready Website Architecture](https://alisoniddings.com/services/ai-ready-website-architecture/)
- [Frequently Asked Questions](https://alisoniddings.com/faqs/)
- [Custom WordPress Developer - Raleigh, NC](https://alisoniddings.com/)
- [About](https://alisoniddings.com/about/)
- [Insights](https://alisoniddings.com/insights/)

## Posts
- [AI Without Guardrails: The Hidden Cost of "Just Turn It On"](https://alisoniddings.com/insights/ai-without-guardrails/)
- [The Vibe Coding Trap: A Beautiful Website Nobody Can Find](https://alisoniddings.com/insights/vibe-coding-trap/)
- [How to Migrate from Page Builders to Custom WordPress (Complete Guide)](https://alisoniddings.com/insights/migrate-page-builders-custom-wordpress/)
- [How to Build AI-Ready Website Architecture](https://alisoniddings.com/insights/ai-ready-website-architecture/)
- [The Complete Guide to Core Web Vitals for WordPress (2026 Update)](https://alisoniddings.com/insights/core-web-vitals-wordpress-guide/)

## Optional
- [Sitemap index](https://alisoniddings.com/sitemap_index.xml)

That’s the whole format: an H1 with the site name, a one-line blockquote summary, and markdown link lists grouped under headings like Pages, Posts, and Optional. No schema, no metadata syntax: just clean markdown a language model can parse without any HTML to strip out.

Why It Exists

AI crawlers and chat-based search tools work differently than traditional search crawlers. A traditional crawler indexes everything and lets a ranking algorithm sort it out later. An AI tool answering a user’s question in real time is working under tighter constraints: it can’t necessarily crawl and parse an entire site’s HTML, with all its navigation, scripts, and boilerplate, to find the handful of paragraphs that actually answer the question.

llms.txt is a bet that giving these tools a shortcut: “here’s what this site is, and here’s the content that actually matters”, makes a site easier to cite accurately. Whether that bet pays off depends on adoption by the AI platforms themselves, which is still an open question. What’s not in question is the cost: for a WordPress site already running Yoast SEO, the file is generated automatically. There’s no real reason not to have one.

How to Get One on WordPress

If you’re running Yoast SEO (version 24.3 or later), llms.txt support is built in:

1. In wp-admin, go to Yoast SEO → Settings → Site features (or the LLMs.txt–specific settings panel, depending on your Yoast version).
2. Enable the llms.txt feature.
3. Yoast generates the file automatically at yoursite.com/llms.txt, built from your existing pages and posts.

The default version Yoast generates is a reasonable starting point, but it’s worth reviewing what actually made the list. Yoast pulls from your general page and post structure: it doesn’t necessarily know which specific pages you most want AI tools citing. If your most important service pages or your FAQ page aren’t showing up, that’s usually a sign to explicitly add them via a filter, or check whether they’re excluded from the sitemap Yoast is drawing from.

If you’re not on Yoast, or on a platform without native support, the fallback is straightforward: hand-write a markdown file in the same format and upload it to your site’s root directory.

What to Put In It (And What to Leave Out)

Treat it the way you’d treat a one-page site map handed to a very literal-minded new hire:

• Include: your homepage, your core service or product pages, your FAQ page if you have one, and your best evergreen guides: the content that actually explains what you do and answers the questions people (or AI tools) are likely to ask.
• Leave out: paginated archives, category or tag pages, thin or outdated posts, and anything noindexed for a reason. If a page isn’t good enough to rank, it’s not good enough to cite either.

Does llms.txt Actually Help AI Visibility?

Honestly: nobody has definitive proof yet. No major AI platform has publicly confirmed it uses llms.txt files to inform citations or answers. The realistic framing is that llms.txt is a low-cost, low-risk bet: it takes minutes to enable on a Yoast-powered WordPress site and costs nothing if it turns out not to matter. The larger, better-supported lever for AI visibility is still the fundamentals: semantic HTML, clean schema markup, and genuinely well-structured, citable content. llms.txt is a complement to that work, not a substitute for it. More on building an AI-ready site from the ground up →

Frequently Asked Questions

Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they’re allowed to access. llms.txt is a curated summary of a site’s best content, formatted for AI tools to read: permission versus curation.

Do I need llms.txt if I already have a sitemap?
They serve different purposes. A sitemap is a complete inventory for search engine crawlers. llms.txt is a short, opinionated list meant to be read by a language model, not a comprehensive index.

How do I add llms.txt to WordPress?
If you’re running Yoast SEO 24.3 or later, enable it in Yoast’s settings and it generates automatically from your site’s pages and posts. Otherwise, you can hand-write one and upload it to your site’s root directory.

Will llms.txt improve my rankings in Google?
No, it has no confirmed connection to traditional search rankings. Its relevance, if any, is to how AI search tools and chatbots find and cite content, which is a separate (and still evolving) channel from Google’s organic results.

Want your site structured so AI tools can actually find and cite it, llms.txt included? Let’s talk about what AI-ready architecture looks like for your site.