Coding-agent benchmarks confront real-world reliability

Coding agents reportedly surpass 95% on SWE-bench, but AgentLens finds 10.7% lucky passes, while unreleased task variants can cause large pass@3 drops and ranking changes. Regressions, literal prompt following, poor repository hygiene, contamination, and review overhead are shifting attention from leaderboard scores to dependable software-workflow integration.