Retired GPUs, rebuilt: a $22K 128-GPU cluster that serves LLaMA-70B
Researchers built and ran a 128-GPU "DumpsterCluster" from second-hand datacenter hardware, serving LLaMA-70B at competitive throughput for $22K versus $600K for a B200 system. The catch: old GPUs burn far more energy per token, so the economics only work where electricity is cheap and clean.