Skip to content
Hugging Face Blog·· 2023-05-25AI score22

Optimizing Stable Diffusion for Intel CPUs with NNCF and 🤗 Optimum

AI briefing

Using quantization-aware training (QAT) with OpenVINO NNCF combined with Token Merging, Stable Diffusion achieves a 5.1x inference speedup and a 4x reduction in model size on Intel CPUs. The optimization starts from a model fine-tuned on the Pokemons dataset, requires only 4096 iterations, completes within one day on a single GPU with 24GB of VRAM, and has been integrated into the Diffusers training scripts.

Open original huggingface.co