Suggestions
LLMs.txt Lab logo LLMs.txt Lab
Examples Tutorials WordPress Plugin
All Tools
llms.txt Generator & Builder llms.txt Validator llms.txt Formatter llms.txt Converter llms.txt Link Checker llms.txt Analyzer & Previewer llms.txt Merge & Compare Tool llms.txt Split Tool

llms.txt Link Checker & URL Analyzer

Extract and check every link in an llms.txt file. Find broken URLs, redirects, duplicate resources, invalid links and inaccessible pages before publishing your file.

1
Input
2
Analyze
3
Live Check
4
Review
Paste your llms.txt content to extract and analyze URLs.

What Is the llms.txt Link Checker?

The Link Checker is a combined link-analysis workspace that extracts every resource link from an llms.txt file, checks whether each URL is usable, detects duplicates and redirects, and explains which links need attention. It does not merely send requests to every URL and label them "working" or "broken." It first understands the structure of the llms.txt file so it can show the link title, description, parent section, Optional status, line number, and URL health.

How the Link Checker Works

Our tool parses your file exactly as an AI would, breaking it down into distinct sections and lists. It identifies which links belong to introductory text and which act as strict resources, giving you an accurate map of your project's external dependencies.

What Links the Tool Extracts

The Link Checker captures standard Markdown links [Title](URL), bare URLs, and image links. It understands the specific list structure proposed in the llms.txt standard, extracting the title, URL, and any descriptive text following the colon.

How HTTP Status Checking Works

We process your URLs server-side for speed, using a smart HEAD fallback to GET strategy. This protects against SSRF while verifying live connections, returning robust statuses without downloading full web pages unnecessarily.

Understanding Link Status Codes

The tool reports standard HTTP codes: 200 (Available), 301/308 (Permanent Redirects), 302/307 (Temporary Redirects), 404 (Not Found), and 403 (Restricted). This helps you quickly differentiate between a page that no longer exists and a page that simply blocks bots.

How Duplicate URLs Are Detected

Duplicate detection goes beyond exact string matching. The tool normalizes URLs by stripping trailing slashes and ignoring case, intelligently grouping identical destinations together so you can consolidate redundant resources.

Internal vs External Links

Both internal relative links and external absolute links are evaluated. For relative links, the tool will attempt to resolve them based on the base domain of your project.

How Redirect Checking Works

When a URL redirects, the checker traces the hops and reveals the final destination URL. This is crucial for avoiding link rot and ensuring AI models aren't forced to waste processing time on redirect chains.

What the Optional Section Means

Links found under an ## Optional heading are flagged differently. These links are considered supplementary material that AI models may ignore if context limits are reached, helping you prioritize fixes on mandatory resources.

How to Fix Broken llms.txt Links

Once broken links are identified, you can use the inline Editor to update the URL directly from the review dashboard. Re-validate the link instantly to confirm the fix before exporting.

Link Checker vs Validator

While the Validator ensures your markdown complies with the llms.txt standard specifications (like having an H1 title), the Link Checker specifically focuses on the health, deduplication, and accessibility of the URLs within that file.

Related Components

llms.txt Generator & Builder Create an llms.txt file manually, from a sitemap or from a list of URLs. llms.txt Validator Check syntax, Markdown and structure. llms.txt Formatter Clean, beautify and reorder sections. llms.txt Converter Convert between CSV, JSON and HTML. llms.txt Analyzer & Previewer Preview, URLs, sections and word count. llms.txt Merge & Compare Tool Merge tool and diff checker.

Questions you might have

Does the tool modify my file automatically?
No. The initial analysis only reports problems. Any removal, redirect replacement or duplicate cleanup should require approval.
Is a 403 URL broken?
Not necessarily. A 403 means the server understood the request but refused access. The page may be available to normal browsers while blocking automated tools.
Are external links allowed?
Yes. Useful external resources may be included when they help explain the project.
Are descriptions required?
No. The link is required in a file-list record, while the colon and description are optional.
Does the tool delete duplicates?
Not by default. It should identify duplicate groups and let the user choose which record to retain.
Does a redirect need to be replaced?
A permanent redirect is a good candidate for replacement, but the user should review the final URL first. Temporary redirects should generally remain unchanged unless the user understands why they occur.
Does a 200 status guarantee that the page is correct?
No. A server can return 200 OK for a login screen, soft 404, security challenge or unrelated page. Optional content checks can help detect these cases.
Can the tool check relative links?
Yes, after the user supplies the base website URL.
Does the Link Checker validate the entire llms.txt structure?
It can report basic parsing issues, but complete structural validation belongs in the llms.txt Validator.
llms.txt Converter Convert between CSV, JSON and HTML. llms.txt Analyzer & Previewer Preview, URLs, sections and word count.