Skip to main content
sus.botdocs
  • SEO
  • AI
  • QA
  • Privacy
  • Accessibility
  • Security
  1. Docs
  2. AI
  3. AI answers contradict the site
  4. A language model read an AI answer as describing the brand wrongly

AI finding

A language model read an AI answer as describing the brand wrongly

AI Info Severity: Medium

Part of the audit AI answers contradict the site. Finding id: ai.answerJudgement.

What it costs you

If the model is right, an assistant tells people something about you that is not so.

What to do

Read the stored answer next to your page. Act if you agree, dismiss the finding if you do not.

What it checks

  • AI describes a discontinued product as current
  • AI credits a competitor trait to your brand

How to fix it

Say on the page that the product is gone

  1. Open the page the answer cites ([subject url]) or the product's own page.
  2. State in plain text that the product is no longer sold and name its successor. Keep the page; a missing page says nothing.
  3. Set the availability in the Product markup to match.

How to check: A person has read the answer and the page. Ask the same prompt again after the engines have recrawled.

State your own facts where the answer looks

  1. Read the answer and note which property it gets wrong.
  2. State the correct property in plain text on the page that should answer the question.

How to check: A person has read the answer and the page. Ask the same prompt again after the engines have recrawled.

A real case

Air Canada's website chatbot told a customer he could claim a bereavement fare after travelling, while the airline's own bereavement page said the opposite. A tribunal held the airline to the chatbot's answer and ordered it to pay C$812.02.

Source: Moffatt v. Air Canada, 2024 BCCRT 149, British Columbia Civil Resolution Tribunal, 14 February 2024

  • All audits
  • About sus.bot
  • Open the app
  • Contact support