Cross-layer expert sharing targets MoE storage and retrieval costs

Meta Expert proposes sharing experts across MoE layers and claims to match vanilla-MoE performance with 70–80% of the experts, alongside lower redundancy and improved loss and downstream accuracy. The result could matter for efficient scaling, but evidence on model/task breadth, compute accounting, and reproducibility is needed.