Microsoft’s Mustafa Suleyman says its AI outperforms doctors on hard cases as he chases ‘medical superintelligence’
TL;DR
Microsoft's new AI diagnostic system beat generalist doctors on hard cases, according to a study published in Science, TechCrunch reports. Microsoft AI chief Mustafa Suleyman says the system outperforms doctors on difficult diagnoses. But most of the improvement appears to come from the underlying AI models, with Microsoft's own orchestration system adding comparatively little on top. That raises the question of how much value the platform itself contributes beyond access to strong frontier models.
Nauti's Take
AI models outperforming generalist doctors on hard diagnoses is progress for medicine. The catch: according to the report, most of the gain comes from the underlying models, with little added by Microsoft's system.
Anyone testing AI for diagnostics should compare models directly and check the study's test cases before paying for a platform.
Sources