1 min lesson
Long-horizon, sparse-reward agent-assisted RL
Use "Long-horizon, sparse-reward agent-assisted RL" to explain each part and the role it plays.
Step 1 of 3
A single completion is one decision. An agent-assisted coding episode is a hundred - read this file, grep that symbol, edit, run tests, read the error, edit again - and the reward shows up only at the very end.
That is the hardest problem in the role's charter: extending RL to longer-horizon agent-assisted tasks. The deep-dive will want you to reason about credit assignment when one terminal scalar has to be apportioned across dozens of tool-calls.