Nunchaku 4‑bit Quantization Slashes Diffusers Memory and Latency
Diffusers now supports Nunchaku’s 4‑bit SVDQuant inference, letting you run diffusion models with W4A4 weights and activations. The change halves GPU memory and cuts generation time to under 2 seconds for 1024×1024 images on a RTX 5090, removing the need for custom kernels.