AI Workflow California

Is AI trustworthy? Check one answer before you use it

By Jeremy Kenerson, Founder at BreadHead.

Last updated

AI answers can be wrong, so check each answer before you rely on it. IBM says an AI hallucination is an output that sounds right but is wrong, off topic or made up. IBM says hallucinations can be reduced but not fully removed. So treat an AI answer as a draft until you've matched its claims to a source you trust.

Can AI be trusted?

Only after a check, one answer at a time. IBM says text-based large language models are trained to predict the next piece of text from patterns in a huge amount of writing. So each answer needs its own check, even from a tool that was right last time. Start with the claims in the draft claim check.

How do you check if an AI answer is right?

Find each claim, then match it to a source you trust. Use these steps on one answer.

  1. Pick the claims you'd act on. Names, dates, numbers and rules.
  2. Ask the AI for its source. Use the example below. If it can't name one, treat the claim as unchecked.
  3. Open that source yourself. Find the line it points to.
  4. Decide if you can rely on the answer. Use it if the claims you'd act on match. Fix or hold it if they don't.

Example

You wrote that the new rule begins next month. Show me the exact source and the line it comes from. If you can't find one, tell me.

Take BreadHead's free AI Honesty Test: six questions you ask inside the AI you already use. A 5-part email series comes with it.

Take the free AI Honesty Test

When should you not rely on an AI answer?

When the answer can't be checked, or when a mistake would cost more than the time saved. Use this check before you use the answer:

  • Is there a source you can open and read?
  • Can a wrong answer be caught before it reaches a customer, a contract or a payment?
  • Is a person named to check it before use?
  • Do you know what you'd do if it turned out to be wrong?

If any answer is no, hold it for a person to check. With BreadHead, you review and approve the work before it goes public or into use.

Want to test AI answers in a small trial first? Write your check on the pilot acceptance sheet.

Comparing platforms? See the best AI workflow automation tools.

Your team also needs rules for which tasks AI may help with. Set them with the task trust table.

Try the six questions in BreadHead's free AI Honesty Test inside the AI you already use. You'll also get the 5-part email series.

Take the free AI Honesty Test

Sources

IBM: What Are AI Hallucinations?

BreadHead's own pages: Home, AI Service Disclaimer, AI Honesty Test, AI Honesty Test watch page, Calendar.

Statements from BreadHead's founder.

This page states no outside numbers.

What changed

  • : First version. Facts checked.