Artificial intelligence / news brief
Microsoft's sequential-diagnosis system outperforms generalist physicians in a text benchmark
- Event
- Published
A peer-reviewed Science paper reports that Microsoft's Diagnostic Orchestrator reached 83.2% accuracy on 304 complex cases and 80.3% on 325 emergency admissions, versus 36.1% and 46.8% for participating generalist physicians. The study used controlled text-only cases, did not compare specialist teams, and measured neither treatment safety nor patient outcomes.
Why it matters
The work tests diagnostic information gathering step by step rather than as a one-shot exam, while stopping well short of evidence for autonomous clinical use.
Sources
- Sequential diagnosis with language models (external site)Science · primary source ·
- Microsoft's Mustafa Suleyman says its AI outperforms doctors on hard cases as he chases medical superintelligence (external site)TechCrunch · coverage ·
- AI system outperforms physicians on diagnostic accuracy in Microsoft study (external site)Medical Economics · coverage ·