long-horizon reinforcement learning
Reinforcement learning on realistic coding tasks that take many steps: the model makes a group of attempts at each problem and is updated toward the better solutions. Cursor says Composer 2 can solve tasks that need hundreds of actions, and its Composer 2.5 post says rollouts can span hundreds of thousands of tokens.