Microsoft’s Mustafa Suleyman says its AI outperforms doctors on hard cases as he chases ‘medical superintelligence’
TL;DR
Microsoft’s new AI diagnostic system beat generalist doctors on hard cases, according to a study in Science. But most of the improvement seems to come from the AI models underneath, not from Microsoft’s system itself. Microsoft’s new AI diagnostic system beat generalist doctors on hard cases, according to a study in Science. But most of the improvement seems to come from the AI models underneath, not from Microsoft’s system itself.
Nauti's Take
Small teams should first inspect the original study and its test design: which cases were selected, which models competed, and how was physician performance measured? A practical pilot only makes sense afterward, using anonymized cases, explicit human oversight, and error-type tracking.
Microsoft’s name alone says little about the platform’s added value.
Sources