Prepare for the Model Routing and Inference loop with gateway design, failover, backpressure, GPU cost tradeoffs and craft review.