Skip to content
Hugging Face Blog·· 2023-03-28AI score22

How to accelerate Stable Diffusion inference on Intel CPUs

Accelerating Stable Diffusion Inference on Intel CPUs

AI briefing

On Sapphire Rapids Xeon CPUs, Stable Diffusion v1-5 with default float32 inference has an average latency of 32.3 seconds per image; switching to Optimum Intel and OpenVINO reduces this to 16.7 seconds, and fixing a static 512x512 shape further reduces it to 4.7 seconds.

Open original huggingface.co