Observability and evals boom — dynamic benches, meta-harnesses, and runtime graders
Evaluation is widening to trajectories, tool use, authoritative-state verification, recovery, and robustness. The RAG Compositionality study reports that component wins may not compose and rankings can shift with corpus size, reinforcing end-to-end evaluation; observability product claims and self-evolving harness listings remain insufficient evidence of efficacy.
Sources (23)
Updated Oct 23, 2026