Adaptive Hedged Requests Slash P99 Latency by 74% in Microservices
Adaptive hedged requests automatically issue parallel backup calls when a request becomes a straggler, cutting overall p99 latency by 74% in microservice fan‑out architectures. The technique uses DDSketch for real‑time latency quantiles and a token‑bucket budget to avoid load spikes during outages, providing a zero‑configuration solution for tail‑latency reduction.