Bleeding Edge AI

Direct Weight Editing as Model Optimization

Direct Weight Editing as Model Optimization

Astra reportedly reads and directly edits model weights, claiming that changing 0.016% of Qwen3.5-0.8B’s weights raised math performance from 7.9% to 48.1%, with IFEval also improving. If robust, this challenges assumptions about weight optimization being primarily gradient-based; the early claims require full methods, controls, and independent replication.

Sources (2)
Updated Nov 3, 2026