LodeHQ
AI news for people who shipFree, by email

Data · huggingface.co · Friday, 24 July 2026

Nunchaku 4‑bit Quantization now powers Hugging Face Diffusers, halving memory and doubling speed

Hugging Face Diffusers now supports Nunchaku’s 4‑bit SVDQuant engine, letting you load a quantized checkpoint with a single from_pretrained() call. The NVFP4 kernels cut VRAM from ~24 GB to ~12 GB and generate 1024×1024 images in ~1.7 s on an RTX 5090, unlocking faster, cheaper diffusion inference.

Read the source: huggingface.co ↗In the 24 July issue →