Evals and Safety: From Final Scores to System Reliability

Evaluation is broadening to execution paths, evidence grounding, omissions, calibration, complexity constraints, and actual task outcomes. DataSciBench, MARCH, and production security-triage workflows reinforce the value of executable verification and independent checking, while judge bias, uncertain ground truth, and weak transfer remain central risks.