Skip to lesson
Exit
Experimentation & Causal Inference1 / 3

1 min lesson

A/B testing fundamentals, done rigorously

Explain the practical point behind "An A/B test is a chain of decisions made before you ever see a number."

Step 1 of 3

An A/B test is a chain of decisions made before you ever see a number. The interviewer is checking whether you make those decisions in the right order and can defend each one.

At Cursor the unit of analysis is the user-AI interaction, billions per period and the product is non-deterministic. That changes the texture of experiment design but not its skeleton. A rigorous test starts from a sharp hypothesis and walks down to a duration you can name out loud: one primary metric you are powered to move, the guardrails you refuse to harm, a randomization unit and an MDE that fixes your sample size.

Learn more

Full explanation

The A/B Design Pipeline

THE A/B DESIGN PIPELINE

Interactive diagram. Step through it with the Next and Previous controls below, or Tab to a region to read its detail.

diagram: flow

Every decision is made before you see a number; the sanity gate is where you earn the right to read results.

Learn more

Optional practice

Practice: A/B testing fundamentals, done rigorously