Amazon Elastic Kubernetes Service supports clusters up to 100,000 nodes, which with new EC2 accelerator instances equals 1.6 million Trainium chips or 800 k NVIDIA GPUs. This scale lets AI/ML teams train, fine‑tune, and serve massive models in a single Kubernetes cluster, cutting costs and simplifying operations.
SCHIP rewrote the infrastructure of 30 Kubernetes clusters, replacing a tangled mix of Sceptre, CloudFormation, and CDK with a modular Terraform codebase. By breaking the migration into tiny, automated steps and codifying architectural decisions in ADRs, they kept the platform stable while cutting future maintenance overhead. The playbook shows how disciplined iteration can tame massive IaC rewrites.