Bringing Nunchaku 4-bit Diffusion Inference to Diffusers

In 30 Sekunden

Was passiert ist

Hugging Face integrated Nunchaku 4-bit quantization into Diffusers, enabling diffusion models to run with 4-bit weights and activations for faster inference and lower memory.

Warum es zählt

Engineers deploying text-to-image models on consumer GPUs need to reduce VRAM from 20-30GB to fit models like ERNIE or FLUX on hardware with limited memory.

Achtung

NVFP4 kernels require NVIDIA Blackwell GPUs; earlier generations must use INT4 variants. Speedup is about 30 percent, less than the original Nunchaku engine's model-specific optimizations.