ComfyUI Multilingual AI Lip-Sync Dubbing Workflow Tutorial
AI Lip Sync Dubbing in ComfyUI: Same Take, Any Language
The ComfyUI team demonstrates a multilingual AI lip-sync dubbing workflow that can replace the language within the same shot, preserve the actor's cloned voice, and repaint only the mouth area. The process first uses ElevenLabs to separate and clone the voice and generate word-level timestamps, then uses an LLM to translate while matching the original duration, and finally uses MiniMax H3 to repaint within the mouth mask and composite the result back into the original footage. The workflow supports 24 fps, a single speaker, and about 15 seconds per run, taking about 10–12 minutes per language on Comfy Cloud.
The ComfyUI team demonstrates a dubbing workflow that modifies only the mouth area, allowing creators to assess the cost of multilingual video localization.
Open original youtube.com