Kueue cut AI21’s high-priority GPU wait by 83%
AI21 replaced manual GPU bargaining with automated queueing across a shared GKE cluster of around 10,000 GPUs, helping high-priority workloads start 83% sooner. Kueue, an open-source Kubernetes system, admits, prioritizes, and preempts jobs automatically, so teams no longer negotiate in a messaging channel or rely on ad hoc commands to free capacity. Its production use also fed features such as Admission Fair Sharing back into Kueue.