I am running into the perennial latency Vs throughout problem.
A batch of queue can hide latency problems. If you process 1 million per second (1 batch or 1 million separate requests) with 100 nanosecond latency or 10 microseconds per batch.
In XFaas do they run an interpreter in a thread ? Or a warm process?
I am a beginner hobbyist in server tech.
I am running into the perennial latency Vs throughout problem.
A batch of queue can hide latency problems. If you process 1 million per second (1 batch or 1 million separate requests) with 100 nanosecond latency or 10 microseconds per batch.
In XFaas do they run an interpreter in a thread ? Or a warm process?