Interview prep
Cursor Model Routing & Inference Engineer Interview Questions
Cursor's Software Engineer, Model Routing & Inference builds the inference platform every AI interaction in the product flows through: the gateway over every provider's API, cross-provider failover, and routing backpressure. The posting assesses high-throughput distributed-systems experience and judgment on cost, latency and reliability trade-offs. Cursor publishes the process: two to three short technicals, then an onsite with a small project.
On this page
What does a Cursor Model Routing & Inference engineer actually do?
The posting describes the team's scope in one sentence that is worth taking literally: it owns the full inference path, making Cursor's AI faster, more reliable and more cost-effective at a scale few teams in the world get to operate at. Every agent session, every tab completion and every chat message flows through this stack. As an engineer on it, you build the inference platform that powers every AI interaction in the product.
That is a backend-platform job, not a modeling one, and the distinction shapes everything below. The JD never mentions training a model or writing a prompt. It talks about provider API semantics, outages, traffic spikes and GPU utilization. If the word inference made you think of research, re-read the example projects, because they read like a traffic-engineering team that happens to be moving tokens.
- Team
- Engineering, on Model Routing & Inference.
- Locations
- New York; San Francisco.
- Employment
- Full-time.
- Shape
- Platform engineer on the inference path: gateway, failover, routing and admission control.
- Compensation
- Not published on the posting.
Cursor lists three example projects, and each one is a system rather than a feature. Read them as the three failure classes the team is paid to prevent: a new model that takes weeks to onboard, a provider outage that users can see, and a traffic spike that takes a provider down with it.
- Building and evolving the inference gateway, a single abstraction over every provider's API semantics, so model onboarding becomes a config change.
- Designing intelligent cross-provider failover so no single provider outage causes user-visible degradation.
- Designing routing backpressure and admission control so traffic spikes do not cascade into providers.
This is covered hands-on in Cursor Software Engineer, Infrastructure Interview Prep — 7 short Units, free to read.
Rather do it than read about it? Run 11 interactive Cursor walkthroughs in a simulated editor. Free, no account needed.
What does this role own, and what does it not?
The posting does not publish a you-will-not-own list the way some Cursor engineering JDs do, so the boundary has to be read from what it names. It names the gateway, failover and admission control. It does not name model quality, prompting, the agent harness or the client. Those live with other teams, including the Agent Harness seat that owns Auto's routing preferences and model launches on the product side.
- You own
- The inference path: the gateway over every provider, failover between providers, routing backpressure and admission control.
- Adjacent, not yours
- Model quality and prompting; which model a product surface picks; the agent harness; the client.
- Stated bar
- Production systems that handle millions of requests, and good calls in the gray area between reliability, cost, latency and user experience.
The gray-area line is the one to prepare against. The fourth fit bullet says you make good calls when there is not a single right answer, weighing reliability, cost, latency and user experience, and the phrasing is a tell: the team has argued about exactly this, probably recently. A system that fails over instantly is also a system that can thunder-herd onto the backup provider. A system that admits every request is also the one that cascades. Every example project has a version of that tension inside it.
Where does Cursor Router sit in this? The public product, which routes a request to a model based on task, is a product surface; the platform this team runs is what that choice executes on, along with every other model call. I would not assume the interview expects you to know the product's routing rules. I would assume it expects you to know what happens to a request after the routing decision is made.
The gateway's stated purpose is that model onboarding becomes a config change. That is a strong claim about abstraction: every provider's streaming format, tool-call schema, rate-limit semantics and error taxonomy has to fit behind one interface. Prepare to say where that abstraction leaks, because it always does somewhere.
What does the Model Routing & Inference interview assess?
Unlike most Cursor postings, this one publishes a process. If there appears to be a fit, Cursor reaches out to schedule two to three short technicals, then an onsite in the office where you work on a small project, discuss ideas and meet the team. That is the whole published statement, and this page does not extend it: no stage content, no take-home policy, no language list is given.
Deep experience building high-throughput, low-latency distributed systems, with inference serving, traffic routing and real-time data pipelines named as the specific flavors.
Comfort reasoning about cost and performance trade-offs at scale: GPU utilization, provider economics and capacity planning are the three examples the posting gives.
Strong software engineering fundamentals, a record of shipping production systems that handle millions of requests, and good calls in the gray area between reliability, cost, latency and user experience.
Two of the three are standard senior-backend criteria. The middle one is the unusual one, and I think it is where candidates with strong systems backgrounds and no inference exposure get caught. Provider economics means knowing that a token has a price that varies by provider, by cache hit, and by whether the request was fast or standard tier, and that a routing decision is therefore also a spend decision. You do not need Cursor's numbers. You need to show you have thought in those units before.
Cursor says the onsite includes a small project, discussing ideas and meeting the team. It does not say what the project is, how long it runs or what tooling is allowed. Prepare to build a small, working system under time pressure in a language you are fluent in, and check the live posting before assuming anything more specific.
What interview questions should I expect?
Each row takes one thing the posting states and turns it into the question shape it implies, plus what an interviewer would be listening for. Derived from the JD's example projects and fit bullets, not Cursor's verbatim questions.
- From the posting
- A single abstraction over every provider's API semantics
- Expect to be asked to...
- Design the gateway interface, then say which provider behaviors refuse to fit behind it.
- Strong answer vs weak
- Strong: names a concrete leak (streaming, tool calls, errors) and how it is contained. Weak: a clean interface with no leaks.
- From the posting
- Model onboarding becomes a config change
- Expect to be asked to...
- Walk through adding a new provider end to end and identify the step that is not config.
- Strong answer vs weak
- Strong: an honest non-config step, such as validating semantics. Weak: "it's just YAML."
- From the posting
- Cross-provider failover with no user-visible degradation
- Expect to be asked to...
- Decide when to fail over, how to detect the outage, and how to avoid stampeding the backup.
- Strong answer vs weak
- Strong: a detection signal, a budget and a ramp. Weak: "retry on the other provider."
- From the posting
- Routing backpressure and admission control
- Expect to be asked to...
- Handle a traffic spike so it does not cascade into providers; say who gets rejected first and why.
- Strong answer vs weak
- Strong: a priority order tied to user experience (tab vs chat vs agent). Weak: a global rate limit.
- From the posting
- GPU utilization, provider economics, capacity planning
- Expect to be asked to...
- Estimate the cost of a routing change and the capacity you would reserve for a launch.
- Strong answer vs weak
- Strong: a back-of-envelope with stated assumptions. Weak: "we'd monitor it."
- From the posting
- Millions of requests in production
- Expect to be asked to...
- Tell the story of an incident on a system you ran at scale and what changed afterwards.
- Strong answer vs weak
- Strong: a structural fix with a measured result. Weak: a postmortem with action items nobody owned.
- From the posting
- Good calls in the gray area
- Expect to be asked to...
- Pick between a faster and a more reliable configuration for a described workload, and defend it.
- Strong answer vs weak
- Strong: commits to one and names the condition that would flip it. Weak: "it depends" with no condition.
| From the posting | Expect to be asked to... | Strong answer vs weak |
|---|---|---|
| A single abstraction over every provider's API semantics | Design the gateway interface, then say which provider behaviors refuse to fit behind it. | Strong: names a concrete leak (streaming, tool calls, errors) and how it is contained. Weak: a clean interface with no leaks. |
| Model onboarding becomes a config change | Walk through adding a new provider end to end and identify the step that is not config. | Strong: an honest non-config step, such as validating semantics. Weak: "it's just YAML." |
| Cross-provider failover with no user-visible degradation | Decide when to fail over, how to detect the outage, and how to avoid stampeding the backup. | Strong: a detection signal, a budget and a ramp. Weak: "retry on the other provider." |
| Routing backpressure and admission control | Handle a traffic spike so it does not cascade into providers; say who gets rejected first and why. | Strong: a priority order tied to user experience (tab vs chat vs agent). Weak: a global rate limit. |
| GPU utilization, provider economics, capacity planning | Estimate the cost of a routing change and the capacity you would reserve for a launch. | Strong: a back-of-envelope with stated assumptions. Weak: "we'd monitor it." |
| Millions of requests in production | Tell the story of an incident on a system you ran at scale and what changed afterwards. | Strong: a structural fix with a measured result. Weak: a postmortem with action items nobody owned. |
| Good calls in the gray area | Pick between a faster and a more reliable configuration for a described workload, and defend it. | Strong: commits to one and names the condition that would flip it. Weak: "it depends" with no condition. |
Question types derived from the posting's example projects and fit criteria.
The last row is the one to rehearse out loud. It depends is a true answer and an empty one; the useful version names what it depends on and what you would do under each branch.
How do I prepare for the Cursor Model Routing & Inference interview?
Build a small version of the system the posting describes. A gateway that fronts two model providers, streams tokens, fails over when one returns errors, and sheds load when a queue grows is a weekend project, and having built one changes every answer you give from theory into something you watched happen. That is also, as it happens, roughly the shape of an onsite small project.
- 1Write a two-provider gateway that normalizes streaming and error semantics behind one interface, and keep a list of every place the two providers refused to look the same.
- 2Add failover with a budget. Detect provider failure from a rolling error rate, fail over with a ramp rather than a cliff, and write down the condition that moves traffic back.
- 3Add admission control with priorities. Decide which request class you would reject first under a spike and why; Cursor's own surfaces (tab completion, chat, agent sessions) are a good set to reason about.
- 4Do the economics on paper. Price a day of traffic through your gateway under two routing policies, using public provider list prices, and be ready to explain the assumptions.
- 5Prepare one incident story from a system you ran at scale, told as detection, decision, fix and the measurement that proved the fix.
The part most candidates skip is the capacity-planning bullet, because it sounds like a manager's job. It is not, on this team. The JD lists it alongside GPU utilization and provider economics as something you reason about, which means a launch that doubles agent traffic is your problem before it is anyone else's. Have an answer for how much headroom you would reserve for a model launch and what you would do when you were wrong.
For structure, the free interview-prep practice track schedules applied work and a mock loop so the reps happen on a calendar. It is scaffolding for the bar this posting sets, not Cursor's process, and the only process facts on this page are the ones the posting states.
Each day, take one routing or reliability decision from a system you know and write the trade-off in one sentence with a number in it: the latency you would accept for the reliability you would gain, or the spend you would add for the failover you would get. A week of those is the gray-area judgment the posting asks for, made legible.
Frequently asked questions
Does Cursor publish the interview process for this role?
Partly. The posting says that if there appears to be a fit, Cursor schedules two to three short technicals, then an onsite in the office where you work on a small project, discuss ideas and meet the team. It publishes nothing about the content of those stages.
Is the Model Routing & Inference role remote?
The posting lists New York and San Francisco, full-time, on the Engineering team, with an onsite stage in the office. No compensation range is published. Check the live posting for the current location policy.
Do I need ML research experience for this role?
The posting does not ask for it. Its fit criteria are high-throughput, low-latency distributed systems, cost and performance reasoning at scale, strong engineering fundamentals and judgment on reliability, cost, latency and user experience. Inference serving is named as a flavor of systems experience, not as research.
What does the Model Routing & Inference team own?
The full inference path, per the posting: the inference gateway over every provider's API, cross-provider failover, and routing backpressure and admission control. Every agent session, tab completion and chat message in Cursor flows through it.
Sources & last verified
Cursor ships frequently. Last updated August 22, 2026.