Monarch now runs on AMD GPUs, making distributed training fault-tolerant
PyTorch Monarch’s runtime has been ported to AMD Instinct GPUs using ROCm, extending its single‑controller distributed training to non‑CUDA hardware. The new support lets massive LLM jobs keep running when a node crashes, avoiding costly checkpoint restarts and improving overall GPU utilization.