Why AI makes mistakes (and how to catch them)
AI chatbots are useful, and they’re often wrong in ways that are hard to spot. Knowing why helps you know when to be careful.
Four reasons AI gets things wrong
- It predicts likely text, not true text. A chatbot writes what sounds right. Usually that matches the truth, but sometimes it invents a fact, a quote or a source that looks completely real. This is called a hallucination. (How chatbots work explains why.)
- Its knowledge has a cutoff. Unless it can search the web, it may not know about recent changes: new rules, prices, results or news.
- It learned from the internet, and the internet is wrong sometimes. Myths, outdated advice and biased views are in the training data too.
- It wants to be helpful. If your question assumes something false (“Why is X true?”), AI may go along with it instead of correcting you.
Danger signs
Be extra careful when the answer involves:
- Specific numbers: dates, statistics, prices, dosages
- Quotes and sources: “according to a 2021 study…”
- Recent events, or anything that changes often
- Health, money or legal decisions
- Very local information: your city’s rules, your school’s syllabus
The 4-step check
- Ask for sources. “Where does this come from? Give links.”
- Open the source. Make sure it exists and actually says what the AI claims.
- Cross-check with one trusted site: a government portal, an official website or your textbook.
- Ask a person when the stakes are high: a doctor, teacher, CA or lawyer.
The right mindset
Treat AI like a very well-read friend who sometimes bluffs. Great for ideas and explanations, but check before you act.
Check yourself
An AI gives you a quote "from a 2019 study". What should you do?
Which answer needs the MOST checking?
You ask "Why is the Great Wall of China visible from space?" What might go wrong?
Go deeper
- Official Fact Check Explorer: search claims already checked ↗ · Google
More for you: 🎒 Students · 💼 Office workers · 📊 Finance and accounts · 📰 Journalists and media · ✍️ Bloggers and writers · 🎬 Reel and YouTube creators · 🧭 Job seekers · 🏡 Homemakers · 👵 Seniors