Hugging Face Blog·· 2023-10-03AI score32
Hugging Face Diffusers supports accelerated Stable Diffusion XL inference with JAX on Cloud TPU v5e
🧨 Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e
AI briefing
Hugging Face Diffusers now supports running SDXL inference on Cloud TPU v5e via JAX, achieving high-performance, low-cost deployment with JIT compilation and XLA parallelism. The demo generates 4 images of 1024×1024 in parallel on multiple TPU v5e-4 instances in about 4 seconds, with pure generation time of about 2.3 seconds; TPU v5e costs less than half of TPU v4.
Open original huggingface.co