1 Trillion function calls over 100,000 servers. Technically they say trillions over hundreds of thousands, but I went for the lower case.

1,000,000,000,000 / 100,000 = 10,000,000

10,000,000 / 24 / 3600 = 115.7

We don't know what the servers are; dual socket EPIC, i.e. 128cores, makes the number look beyond trivial.

So... 115.7 rps doesn't sound groundbreaking, right?

Was just trying to break the number down to something more easy to understand, I don’t know enough if this is impressive or not! Depends on the complexity of the request, and I guess the complexity of routing that many requests over such a large network. I’ve never worked at that scale.

This isn't unreasonable. ML workloads benefit from more computational time per request. Lower QPS = better results.