Bringing Nunchaku 4-bit Diffusion Inference to Diffusers
Hugging Face has integrated Nunchaku, a 4-bit quantization method for diffusion models, into the Diffusers library. This allows for more efficient inference of models such as FLUX.1-dev and SD3.5, reducing memory usage and potentially speeding up generation. The integration is available as an open-source tool.
Why it matters: This development lowers hardware requirements for high-quality image generation by enabling efficient 4-bit quantized inference.
Full story at: Hugging Face Blog ↗