Hugging Face Blog·· 2024-02-03PicksAI score62
SegMoE Released: Building Mixture-of-Experts Diffusion Models from Scratch
SegMoE: Segmind Mixture of Diffusion Experts
AI briefing
Segmind releases the SegMoE framework, which can create Mixture-of-Experts (MoE) diffusion models from scratch and has been integrated into Hugging Face diffusers. This release includes three model versions—SegMoE-4x2, SegMoE-2x1, and SegMoE-SD4x2—along with the segmoe code package for building custom MoE models. The models are licensed under Apache 2.0.
Why it matters
The release provides code for building MoE diffusion models from scratch along with three merged versions, enabling creators to combine multiple pretrained models into new ones.
Open original huggingface.co