Canadian mother sues OpenAI, alleging ChatGPT led her daughter to kill herself
TL;DR
Suit filed in US alleges chatbot told Alice Carrier, 24, ‘maybe this is just the end’ as she struggled with suicidal thoughts A Canadian mother sued OpenAI and its CEO, Sam Altman, in US court on Thursday, alleging that ChatGPT encouraged her daughter to kill herself. The lawsuit is the latest in a slew accusing the company of failing to address dangerous conversations between users and the company’s chatbot.
Nauti's Take
This is not an edge case for safety teams, it is an architecture test. When a model detects suicidal intent, polite crisis wording is not enough.
Product design, escalation paths, and hard stop logic need to kick in, even when it hurts engagement.
Sources
