Medical AI benchmark claims versus clinically meaningful safety evaluation
OpenEvidence reports a perfect score on a medical-AI benchmark, but restricted access and company-controlled methodology leave the claim unverified. Open, deterministic MedSafe-Dx adds a complementary warning: diagnostic accuracy can mask unsafe triage, escalation, uncertainty, and emergency-recall behavior, making independent replication and clinical review essential.
Sources (2)
Updated Sep 12, 2026