Open MoE training infrastructure targets major efficiency gains
Ai2's OlmoCore 3 reports 2.7x throughput improvement, near-flat scaling as experts grow from 8 to 128, MXFP8 support, and trillion-parameter systems experiments. Its token-gerrymandering finding challenges standard routing diagnostics, but independent replication and quality-preserving end-to-end training evidence are still needed.
Sources (2)
Updated Oct 3, 2026