‘Unbelievably dangerous’: experts sound alarm after ChatGPT Health fails to recognise medical emergencies
TL;DR
Study finds ChatGPT Health did not recommend a hospital visit when medically necessary in more than half of cases Follow our Australia news live blog for latest updates Get our breaking news email, free app or daily news podcast ChatGPT Health regularly misses the need for medical urgent care and frequently fails to detect suicidal ideation, a study of the AI platform has found, which experts worry could “feasibly lead to unnecessary harm and death”. OpenAI launched the “Health” feature of ChatGPTto limited audiences in January, which it promotes as a way for users to “securely connect medical records and wellness apps” to generate health advice and responses. More than 40 million people reportedly ask ChatGPT for health-related advice every day. Continue reading...
Nauti's Take
Relying on ChatGPT Health for triage means sending over half of serious cases away and downplaying explicit suicide plans because the model sees danger but soothes it. That isn’t random—it’s a product design that replaces clinical judgment without delivering it, so keep real clinicians in the loop.
([theguardian. theguardian.
com/technology/2026/feb/26/chatgpt-health-fails-recognise-medical-emergencies? utm_source=openai))
Summary
Study finds ChatGPT Health did not recommend a hospital visit when medically necessary in more than half of cases Follow our Australia news live blog for latest updates Get our breaking news email, free app or daily news podcast ChatGPT Health regularly misses the need for medical urgent care and frequently fails to detect suicidal ideation, a study of the AI platform has found, which experts worry could “feasibly lead to unnecessary harm and death”. OpenAI launched the “Health” feature of ChatGPTto limited audiences in January, which it promotes as a way for users to “securely connect medical records and wellness apps” to generate health advice and responses.
More than 40 million people reportedly ask ChatGPT for health-related advice every day. Continue reading...
Sources