latency - unders/mywiki GitHub Wiki

Tail Latency effects on a distributed system

Assume each microservice has 1 ms average latency, but the 99th percentile is 1s. A transaction touching just one of these services has a 1% chance to take ≥ 1s. A transaction touching 100 of these services has 1 – (1 – 0.01)*100 = 63% chance to take ≥ 1s.

Latency

Performance