Skip to main content
sus.botdocs
  • SEO
  • AI
  • QA
  • Privacy
  • Accessibility
  • Security
  1. Docs
  2. AI
  3. Bots and people are served different content

AI audit

Bots and people are served different content

5 checks · 1 findings · scope: page

Audit id: ai.conflict.bot_vs_browser_content.

Checks

  • Text differs between bots and visitors text_differs_by_user_agent
  • Bots get a consent wall or challenge page bot_gets_consent_wall_or_challenge_page
  • Bots get a different language or region bot_gets_different_language_or_region
  • Text shown only to bots hidden_text_only_for_bots
  • Bots get only the paywall preview bot_gets_paywall_preview_only

Findings

  • A crawler is served different content from a browser

What this relies on

Differences are accidental (consent walls, geo rules, bot protection), not deliberate cloaking.

How to verify by hand

A person; and the cached or quoted text in search and AI results.

  • All audits
  • About sus.bot
  • Open the app
  • Contact support