AI finding
The site gained a section after llms.txt was last changed
AI Info Severity: Low
Part of the audit llms.txt invites what robots.txt forbids. Finding id: ai.llmsTxtStale.
What it costs you
llms.txt is your list of pages for AI systems. A section added since is missing from that list.
What to do
Decide whether the section belongs in llms.txt, and add its main pages if it does.
What it checks
- Llms.txt is older than the site structure
How to fix it
Add the section to llms.txt or leave it out on purpose
- Open /llms.txt and the section [section] side by side.
- If the section should be offered to AI systems, add links to its main pages.
- If not, dismiss the finding.
How to check: Fetch /llms.txt, then run this rule again after the next crawl.
A real case
A user found 18 broken links among the 1,733 entries of vercel.com/llms.txt: eight were a generated address ending in 'undefined/no-summary' and the rest were pages that had moved while llms.txt kept the old paths. Any AI agent following those entries got a 404.
Thresholds
| Name | Default | Meaning |
|---|---|---|
min_section_pages | 10 | A section is reported when it has at least this many indexable pages. |
How to verify by hand
The owner: is the section meant for AI systems.
What this relies on
llms.txt was written once and not kept up with the site.