Microsoft's MAI-DxO hits 83% on hard NEJM diagnosis cases
Why it matters
In a Science paper published Oct 22, Microsoft AI tested MAI-DxO (AI Diagnostic Orchestrator) on SDBench, which turns 304 complex New England Journal of Medicine cases plus typical MIMIC-IV-ED emergency cases into step-by-step diagnosis challenges scored on accuracy and test cost. MAI-DxO, a model-agnostic orchestrator that works like a panel of virtual physicians weighing each test's value against its cost, reached 83.2% on the NEJM cases versus 36.1% for generalist physicians with references (22.3% without), and 80.3% vs 46.8% on emergency cases. One cost-optimized configuration reached 81% at less than half the cost of comparative systems, and gains held and improved with newer models including GPT-5.5. SDBench is being open-sourced for select NEJM cases. Caveat: a controlled, text-only benchmark, not compared with specialists or real clinical practice; MAI-DxO has only been tested on a benchmark so far, and a prospective hospital study in Boston is planned.
Read the source: Science / Microsoft AI (opens in a new tab)
All hits from 23 Oct 2026More ResearchGet the daily hits by email