The Ratio's Wrong Unit: GSPO Goes Sequence-Level

Qwen says GRPO’s token-level importance ratio misuses importance sampling and breaks MoE training. GSPO lifts ratio, clipping and updates to sequence level.

August 26, 2026 · 16 min · 3247 words · njx