2 min lesson
Capacity forecasting & demand modeling
Start at the first move in "Capacity forecasting & demand modeling" and carry it through to the proof.
Step 1 of 2
A capacity forecast that starts from "how many GPUs do we want" is guessing. A credible one starts from product demand and derives the GPUs.
The chain runs from users to compute. Demand signals drive request volume, request volume and model choice drive GPU-seconds and GPU-seconds plus a utilization target drive the fleet size. Build it in that order and you can defend every number to ML and Finance, because each step is an assumption someone can challenge.
Interactive diagram. Step through it with the Next and Previous controls below, or Tab to a region to read its detail.
A credible forecast derives the fleet from demand - each step is an assumption ML or Finance can challenge.