Skip to lesson
Exit
Evals & Production Reliability1 / 4

2 min lesson

Debugging real-world model failures

Work through this case: "An agent edits the wrong file on a refactor task. Walk through how you'd diagnose it and which layer you'd most likely fix." Say what you would do and why.

Step 1 of 4

When an agent does something wrong, the amateur reaction is to rewrite the prompt and hope. The professional reaction is to find out which of five things actually broke.