One Vote or Ten: token-mean vs sample-mean

Does a 5000-token answer outweigh a 500-token one? Sample-mean gives each response a vote, token-mean each token, and switching has a hidden cost.

August 30, 2026 · 9 min · 1843 words · njx

Judging Truncated Answers: DAPO's Overlong Fix

Scoring truncated responses as wrong injects reward noise into the advantage. DAPO either masks their loss or adds a linear penalty ramp before the length cap.

August 30, 2026 · 9 min · 1770 words · njx

Samples per Prompt: What GRPO's Group Size Buys

64, 8 or 2 samples per prompt? G is GRPO’s only baseline and its biggest compute knob. What it buys, and why dynamic sampling can stand in for a larger G.

August 29, 2026 · 11 min · 2324 words · njx

Entropy Collapse: What DAPO's Clip-Higher Fixes

Naive GRPO collapses entropy fast. DAPO’s Clip-Higher only lifts the upper clip bound from 0.2 to 0.28, and the reason is an asymmetry built into PPO-Clip.

August 26, 2026 · 20 min · 4196 words · njx