1 min lesson
Control work at admission
Match bounded queues, concurrency limits, token buckets and shedding to overload conditions.
Step 1 of 3
The current job description asks for backpressure and admission control so traffic spikes don't cascade into providers. The gateway must reject or delay excess work before it overloads workers or provider limits.
An unbounded queue can make overload worse. Requests wait past their useful latency, clients time out and retries add more work. Admission control decides what to accept before that cycle starts.