llms.txt File: What Is It and How to Prepare It for Your Website?
- News
- September 28, 2026
As AI-powered search and answer engines take a bigger share of how people find information, many businesses are asking how their websites should be presented to large language models (LLMs). One option that comes up often is llms.txt: a plain-text file written in Markdown and placed at the root of a website to highlight its most important pages. Before adding one, it helps to understand both what the file does and what it cannot do.
What Is llms.txt?
llms.txt is a proposed convention introduced by Jeremy Howard of Answer.AI in September 2024. The specification is published at llmstxt.org. The file sits at a predictable address, such as https://yourdomain.com/llms.txt, and gives AI systems a curated overview of a site: what the organization does, which pages matter most, and where to find key guides and case studies.
The proposal also suggests publishing Markdown versions of important pages, so systems can read the content without parsing full HTML. As The Decoder reports, the idea is to give models a guide that works alongside existing web files.
llms.txt vs. robots.txt and sitemap.xml
These files sit in the same location, but they serve different purposes:
| File | Primary purpose |
|---|---|
| robots.txt | Tells crawlers which areas of a site they may access |
| sitemap.xml | Helps search engines discover important URLs |
| llms.txt | Presents a curated, readable summary of key resources for AI systems |
So llms.txt complements the other two files rather than replacing them. A site still needs a clear robots.txt and an up-to-date sitemap.
What Google Has Said About llms.txt
This is the most important context for any business considering the file. Google’s Search documentation states that publishers do not need special AI files such as llms.txt to appear in generative AI search features, according to Search Engine Journal’s coverage. Google’s John Mueller has also compared the file to the deprecated keywords meta tag, arguing that because the file is self-reported, AI systems cannot rely on it to decide which sites to surface.
The picture is not one-sided. Google’s Chrome Lighthouse tool added an experimental Agentic Browsing audit that checks for llms.txt, since the file can help browser-based agents understand a site’s structure. In practice, llms.txt is a low-cost addition that may help automated agents, but it should not be expected to drive AI citations or search rankings.
How to Create an llms.txt File
Creating the file is simple. The harder task is deciding what it should contain.
Step 1: Identify Your Most Important Pages
Start with your homepage, About page, core services, case studies, and key guides. Do not list every URL on the site.
Step 2: Write Clear, Factual Descriptions
Use a simple Markdown structure: a title, a short factual summary, and grouped links with one-line descriptions:
# THE ONLE
> THE ONLE is a full-service digital marketing and strategic creative agency headquartered in Riyadh, Saudi Arabia.
## Services
- [SEO Services](https://theonle.com/seo/): Search engine optimization services focused on improving organic visibility.
Step 3: Save the File as llms.txt
Save it as UTF-8 Markdown with the exact lowercase file name.
Step 4: Upload It to the Site Root
The file should be accessible at https://yourdomain.com/llms.txt.
Step 5: Test It
Open the URL directly and confirm it loads without unnecessary redirects or access restrictions. Howard recommends testing the file with several AI systems to confirm they behave as expected.
Common llms.txt Mistakes to Avoid
- Listing every page without prioritizing the most valuable ones
- Using exaggerated marketing claims in the descriptions
- Including information that cannot be verified
- Treating the file as a guarantee of AI visibility
- Ignoring technical SEO or weak website content
Quick Takeaways
- llms.txt is a proposed Markdown file for organizing key website information for AI systems.
- It does not replace robots.txt or sitemap.xml.
- Google’s Search documentation says the file is not needed for generative AI search features.
- Chrome Lighthouse checks for it in an experimental audit, so it may help browser-based agents.
- Publishing the file does not guarantee visibility in AI-generated answers.
- Its value depends on accurate, well-structured content and strong technical foundations.
Frequently Asked Questions
Is llms.txt required for every website?
No. It is an optional convention, not a mandatory file.
Will llms.txt make my website appear in ChatGPT?
There is no guarantee. Publishing the file does not ensure that ChatGPT or any other AI system will use it when generating answers.
Does llms.txt replace robots.txt?
No. The two files serve different purposes and work best together.
Does llms.txt improve Google rankings?
Google’s Search documentation says special AI files are not needed for its generative AI search features, so the file should not be treated as a ranking tactic.
Do I also need llms-full.txt?
Not necessarily. It is an optional companion file with a more extensive version of your content, and there is no guarantee that AI systems will read it.
Conclusion
llms.txt can be a useful way to organize your most important pages and resources, and it costs little to publish. But the evidence points to one clear conclusion: it is an organizational layer, not a shortcut to AI visibility. Google has stated that its generative AI search features do not require the file, and its own search team has questioned how much weight AI systems can give a self-reported summary.
That makes the fundamentals the priority. Clear service pages, accurate and consistent brand information, a crawlable site structure, structured data, and credible references from third-party sites all shape how your business is understood, whether or not you publish an llms.txt file. Once those foundations are solid, the file can sit on top as one more way to point machines and agents toward the content that matters most.
If you want to understand where your website stands across search engines and AI-powered platforms, THE ONLE can review your current foundations and build a plan that combines SEO, GEO, and content. Explore our SEO services to see how we can help.