“The Model Trains Itself”: RSI and Three Loops
RSI means different things to different people. Self-improvement splits into data, reward and system loops, each with its own conditions and failure modes.
RSI means different things to different people. Self-improvement splits into data, reward and system loops, each with its own conditions and failure modes.
Multi-turn agentic RL has one reward per trajectory. How to split it across turns: the formalism, the credit-assignment spectrum, and GSPO-token’s opening.