Understanding LLMs.txt
Learn what LLMs.txt is and how it helps AI assistants discover and recommend your content.
What is LLMs.txt?
llms.txt is a standardized file that helps AI assistants understand your website. Just as robots.txt guides search engine crawlers, llms.txt provides context for large language models (LLMs) like ChatGPT, Claude, and Perplexity.
The file lives at the root of your site:
https://yoursite.com/llms.txtWhy This Matters
llms.txt is the map an assistant reads first. Without it, a model has to guess which of
your pages matter and what your site is for. llms-full.txt carries the detail behind the
map, so an assistant can answer about your pages without fetching each one.
Why LLMs.txt Matters
AI Assistants Need Context
When someone asks an AI assistant about travel tours, local services, or products, the AI needs reliable information to make recommendations. Without proper context, AI might:
LLMs.txt Provides Context
Your LLMs.txt file tells AI assistants:
File Format
AIO Radar generates LLMs.txt following the standard format:
# Your Site Name
> A brief description of your business and what you offer.
## Pages
- Page Title: /url-path
AI-optimized summary of the page content...
- Another Page: /another-path
Description of what this page covers...
## Contact
- Email: contact@yoursite.com
- Phone: +1 (555) 123-4567Sections Explained
| Section | Purpose |
|---|---|
Header (#) | Your site/business name |
Blockquote (>) | Brief description of your business |
| Pages | List of pages with URLs and summaries |
| Contact | How to reach your business |
LLMs.txt vs LLMs-full.txt
AIO Radar generates two files:
llms.txt
llms-full.txt
Both are automatically served by the plugin.
Generation Process
When you generate LLMs.txt, AIO Radar:
Choosing an AI Provider
Generate with different providers at AIO Radar → LLMs.txt → Settings:
| Provider | Model | Best For |
|---|---|---|
| OpenAI | GPT-4o | General use, fast generation |
| Anthropic | Claude 3 | Detailed, nuanced summaries |
| Gemini Pro | Multilingual sites |
Managing LLMs.txt
Regenerate
Update your LLMs.txt when content changes significantly:
Or via WP-CLI:
wp aio llms-txt generate --forceAuto-Regeneration
Enable automatic updates at AIO Radar → Settings → LLMs.txt:
| Setting | Description |
|---|---|
| Auto-regenerate on sync | Update when content syncs |
| Cache duration | How long to cache content |
Exclude Pages
Exclude pages from LLMs.txt at AIO Radar → Settings → Content:
Viewing Your File
Browser Preview
Visit these URLs to see your generated files:
https://yoursite.com/llms.txthttps://yoursite.com/llms-full.txtAdmin Preview
Preview in WordPress at AIO Radar → LLMs.txt:
WP-CLI
# View LLMs.txt content
wp aio llms-txt show
# Get just the URL
wp aio llms-txt urlTroubleshooting
404 Error on /llms.txt
Solution: Flush rewrite rules
Or: wp rewrite flush
Empty or Missing Content
Possible causes:
Outdated Content
Solution: Force regeneration
wp aio llms-txt generate --forceOr click Regenerate in the admin panel.
Best Practices
Keep Content Current
Optimize Page Content
Better source content leads to better AI summaries:
Monitor AI Visibility
After implementing LLMs.txt: