Loading...
Preparing your content
Preparing your content
LLMS.txt Generator
Generate a valid LLMS.txt file for your website in seconds. Help AI assistants and large language models discover your content with an optimized LLMS.txt file—free and easy to use.
AI readiness
Generate a score for your site’s AI crawlability.
Policy options
Fine-tune training, attribution, and content sections.
Generation Status
Ready to start
Set your configuration and generate.
AI Score
0/100
AI readiness after generation.
Enter your site details and choose content options.
An llms.txt file is a plain Markdown file that gives large language models a clean, curated summary of your site's content — its purpose, key pages, and links to your most important documentation — so AI tools can understand and reference your site more accurately when answering questions about it. It was proposed in 2024 as a response to a real problem: LLMs struggle to parse JavaScript-heavy pages, navigation clutter, and ads the way a human reader skips over automatically.
The role of llms.txt is to act as a curated index specifically for AI systems, similar to how a sitemap.xml serves search engines but formatted for readability by language models rather than crawlers indexing every URL. It does not replace your sitemap — it supplements it with structured, human-written context that is easier for an LLM to summarize correctly.
Place your llms.txt file at the root of your domain, exactly like robots.txt:
https://yoursite.com/llms.txt
It must be accessible at the root path — not nested in a subfolder such as /docs/llms.txt — so that AI crawlers and tools checking for it by convention can find it without needing to be told the exact location.
An llms.txt file should be saved as plain UTF-8 encoded Markdown (.txt extension, Markdown syntax inside). Avoid:
# Project or Site Name > A one-sentence summary of what this site/product does. Optional longer description paragraph with context an LLM would need to accurately represent your site. ## Docs - [Getting Started](https://yoursite.com/docs/getting-started): Short description of this page - [API Reference](https://yoursite.com/docs/api): Short description of this page ## Optional - [Changelog](https://yoursite.com/changelog): Less critical but useful context
Key rules from the spec:
# H1 (the site/project name)>) summary sentence## sections grouping related links## Optional section signals lower-priority context an LLM can skip if it is summarizing with limited context length| File | Purpose | Format |
|---|---|---|
| robots.txt | Tells crawlers what they can and cannot crawl | Robots Exclusion Protocol |
| sitemap.xml | Lists all URLs for search engine discovery | XML |
| llms.txt | Curated summary plus key links for LLMs | Markdown |
| ai.txt | A less-adopted, competing proposal for AI-specific crawl permissions | Varies by implementation |
ai.txt and llms.txtsolve different problems: ai.txt proposals generally focus on permissions (can an AI use this content), while llms.txt focuses on content curation (here's what matters on this site). llms.txt has significantly wider adoption as of 2026.
Documentation-heavy platforms have been early adopters of llms.txt, including developer tools such as Supabase, which publishes an llms.txt file summarizing its documentation structure for AI coding assistants to reference accurately. Similarly, frameworks and design systems like Tailwind have published llms.txt files to help AI tools generate more accurate code suggestions based on current documentation rather than outdated training data.
Anthropic's Claude can read and use llms.txt files when they are accessible during web browsing or search — the file itself is simply structured Markdown any crawler or browsing tool can fetch, so support depends on whether a given AI product actively looks for it at the root path, not on a special format requirement.
For an online store, an llms.txt file typically summarizes:
This helps AI shopping assistants and answer engines describe your store accurately instead of guessing from scraped product pages.
https://yoursite.com/llms.txt with a 200 status[text](url) throughoutIs llms.txt an official web standard?
No — it is a community-proposed convention, not an IETF or W3C standard, but it has meaningful adoption among documentation and developer-tool sites.
Do I need both robots.txt and llms.txt?
Yes, they serve different purposes — robots.txt controls crawler access, llms.txt curates content for AI understanding.
Does llms.txt affect SEO rankings?
It does not directly influence traditional search rankings, but it can improve how accurately AI answer engines represent your content.
Can I generate llms.txt automatically?
Yes — tools like the generator above can create a base structure, though the summary and link descriptions benefit from manual review for accuracy.
Explore more tools