Under the Endpoint Picker, Part 1: One Request, Five Prices
The same prompt can wait half a second or several seconds for its first token, on the same model and the same GPU type. The difference is where the request was sent, and that is decided before any GPU sees it.