“The Model Trains Itself”: RSI and Three Loops

RSI means different things to different people. Self-improvement splits into data, reward and system loops, each with its own conditions and failure modes.

September 1, 2026 · 4 min · 1851 words · njx

A 7-Turn Failure: Assigning Blame in GRPO/GSPO

Multi-turn agentic RL has one reward per trajectory. How to split it across turns: the formalism, the credit-assignment spectrum, and GSPO-token’s opening.

August 31, 2026 · 11 min · 2252 words · njx