Skip to content
Hugging Face Blog·· 2024-02-03PicksAI score62

SegMoE Released: Building Mixture-of-Experts Diffusion Models from Scratch

SegMoE: Segmind Mixture of Diffusion Experts

AI briefing

Segmind releases the SegMoE framework, which can create Mixture-of-Experts (MoE) diffusion models from scratch and has been integrated into Hugging Face diffusers. This release includes three model versions—SegMoE-4x2, SegMoE-2x1, and SegMoE-SD4x2—along with the segmoe code package for building custom MoE models. The models are licensed under Apache 2.0.

Why it matters

The release provides code for building MoE diffusion models from scratch along with three merged versions, enabling creators to combine multiple pretrained models into new ones.

Open original huggingface.co