Skip to lesson
Exit
Bug Triage & Prioritization at Scale1 / 2

1 min lesson

The agent proposes, you verify

For each case in "The agent proposes, you verify", name the signal and the response you would use.

Step 1 of 2

What the agent is genuinely good atthe heavy lifting worth delegating

Delegate to the agent

Tagging area / severity / sentiment at volume

Clustering and dedup by semantic similarity

Drafting a candidate repro from a vague ticket

Summarizing a cluster's common thread for review

Keep on yourself

Confirming the repro actually reproduces

Final severity call on anything near S0

The number that goes in front of leadership

Deciding what to escalate and when

The agent proposes, you verify

An agent that guesses severity is a triage assistant. An agent whose guesses you accept blindly will mislabel an S0 as an S2 and bury it, for example by downgrading a data-loss report because the user was polite about it. You own the output the agent drafts, and that human-in-the-loop judgment is the bar the interview grades.

Watch the repro fail first

An agent will happily draft a repro or check that asserts nothing and passes green, or logs the failure instead of failing the run. A green check that proves nothing is worse than none. Give the agent the golden state, meaning the input and the expected output, read the code it generates, and run a validator step that executes the check and confirms a real failure surfaces before you trust it.