Suggestions
LLMs.txt Lab logo LLMs.txt Lab

llms.txt Tutorial

How to See the llms.txt File of a Website

A simple guide to checking whether a website has an llms.txt file and how to inspect it.

Short Answer

To see the llms.txt file of a website, open your browser and visit https://example.com/llms.txt. Replace example.com with the domain you want to check.

If the file exists, you should see a plain text or Markdown page. If you see a 404 error, login screen or unrelated page, the website probably has not published a root llms.txt file correctly.

Step-by-Step Check

You do not need a special tool for the first check. A browser is enough. The most common mistake is checking the wrong domain version, such as www versus non-www, or checking the homepage path instead of the root file path.

  1. Copy the website domain, such as example.com.
  2. Add /llms.txt after the domain.
  3. Open https://example.com/llms.txt in a browser.
  4. Check whether a Markdown text file loads.
  5. If it redirects, note the final URL.
  6. If it returns 404, the site probably has not published one at the root.

What a Good llms.txt File Looks Like

A useful file usually starts with an H1 site or project name, followed by a short summary and organized sections. The links should point to important pages, not random archives or every URL from the sitemap.

  • Clear project or website title.
  • Short description of the website.
  • Grouped sections such as Documentation, Product, API Reference and Support.
  • Descriptive Markdown links.
  • Optional section for secondary resources.

What If the File Is Missing?

If /llms.txt returns 404, the website may not use the convention yet. That is normal because llms.txt is still optional. You can still inspect the website through its sitemap, documentation or footer links, but you should not assume an llms.txt file exists somewhere else.

If it is your own website, create the file with the free llms.txt generator and upload it to the site root.

What If the File Exists but Looks Broken?

A file can load but still be low quality. It may have broken Markdown, duplicate URLs, unclear link titles, missing summaries or too many low-value pages. If the file is yours, paste it into the llms.txt Validator to check structure and quality.

If you are inspecting another website, be careful with conclusions. A messy file may still be intentionally simple, and different site owners may organize files differently.

Can You Check the Live File With a Tool?

Yes. If the file is public, you can use a validator or link checker to inspect it. A validator checks structure and Markdown quality. A link checker focuses on whether URLs are broken, redirected or duplicated.

For your own site, this is useful after every major documentation or product update. It catches small mistakes before AI agents or users run into them.

Can You See llms.txt for Any Website?

Only if the website owner has published it publicly. If a file requires authentication, is blocked by server rules or is not present at the root URL, normal visitors and most crawlers will not be able to see it.

Frequently Asked Questions

How do I see the llms.txt file of a website?
Visit the root URL followed by /llms.txt, such as https://example.com/llms.txt.
What does it mean if /llms.txt shows 404?
It usually means the website has not published a root llms.txt file.
Can I validate another website’s llms.txt file?
Yes, if it is publicly accessible, you can check its structure with an llms.txt validator.
Is every website required to have llms.txt?
No. It is optional and currently an emerging convention.
Can a site have llms.txt on a subdomain?
Yes. For example, documentation on docs.example.com may have its own file at https://docs.example.com/llms.txt.