AI hallucinations are making entitled customers even worse
TL;DR
Madison, a server in New York City, greets every table by asking about each diner's allergies. Lately, there have been some close calls. "Sometimes people will tell me they have a shellfish allergy, and I'll come back, and they won't ask me any questions," says Madison, who asked that her last name be withheld to protect her identity. "And they'll order a fish dish that comes with a broth that is made of shellfish.
Nauti's Take
AI workflows touching health or safety need an explicit source and authority boundary: a chatbot may provide information, but it must not become the final clearance mechanism. Small teams should first test how the system handles conflicting details, signals uncertainty, and directs users to a reliable primary source.
Sources