‘A serious failure’: CPS prosecutor cites imaginary case to high court after AI search
TL;DR
A senior crown prosecutor cited a nonexistent legal precedent in a high court case, adding to concerns about AI hallucinations entering the justice system. According to court documents reported by the Guardian, Ravinder Dhillon, representing the Crown Prosecution Service, referenced an entirely made-up case that surfaced through an AI search. It came up in a dispute over whether a minor should be prosecuted in a child sexual abuse case.
Nauti's Take
The case also points to an opportunity: courts and law firms can pair AI research with automatic citation checks that match every reference against official databases. The risk is serious, since a fabricated precedent in a criminal case can affect real lives.
Legal teams benefit from AI when sifting large case files, yet a person has to look up every cited authority before anything is filed.
Sources