Microsoft's MAI-DxO diagnostic orchestrator scores 83% vs 36% for doctors in Science paper
Microsoft AI says its diagnostic system MAI-DxO, published in Science, reached 83% diagnostic accuracy on 304 complex New England Journal of Medicine cases, while physicians scored 22% without external references and 36% with them. On more typical emergency-department cases from MIMIC-IV-ED, Microsoft says MAI-DxO reached 80% accuracy versus 47% for physicians. Rather than one model answering at once, MAI-DxO coordinates a panel of virtual physicians over several rounds, choosing questions and tests and weighing cost; Microsoft says one cost-focused setup kept 81% accuracy at less than half the cost of comparative systems. It is open-sourcing SDBench for select NEJM cases so others can reproduce the evaluation, and it plans prospective testing with Beth Israel Deaconess Medical Center. These figures are from Microsoft's paper.
Why it matters: If you build multi-step agents for any expert workflow, the pattern of several specialised agents debating and picking the next test is more transferable than the medical scores themselves; treat the percentages as one lab's result until others reproduce them.
Microsoft AI ↗AI-assisted, reviewed by Sorted AI
▲ 0
0 comments