Skip to lesson
Exit
Reliability Analytics & Self-Serve Tooling1 / 2

1 min lesson

Regression detection frameworks

Connect "A detection framework has two halves that get confused in interviews" to the decision you would make.

Step 1 of 2

The reliability mandate at Cursor lives or dies on one question: do you find a regression from a screenshot a user posts or from your own alert that fired twenty minutes after the deploy? This section is about building the second world.

A detection framework has two halves that get confused in interviews. Pre-deploy catches the regression before it reaches everyone, on a slice of traffic you control. Post-deploy catches what slipped through, on the live time series of latency, error rate and agent success. You need both, because a canary that sees 1% of traffic for ten minutes cannot surface a regression that only bites the long tail of a particular model on a particular client.