AI finding
The site has no llms.txt, or it lists no pages
AI Info Severity: Info
Part of the audit AI crawler access. Finding id: ai.llmsTxtMissing.
What it costs you
Possibly nothing. If an assistant does read the file, it gets no hint which pages you consider your best sources.
What to do
Decide whether you want one. If yes, publish /llms.txt with a short description of the site and links to the pages you want quoted.
What it checks
- Llms.txt file present
How to fix it
Publish a short llms.txt
- Create a plain text file in Markdown: a heading with the site name, one paragraph that says what the site offers, then a list of links to your most important pages.
- Serve it at /llms.txt on the main host.
- List only pages that answer 200, are not blocked in robots.txt and do not carry noindex.
How to check: Fetch /llms.txt and confirm it answers 200; run this rule again.