Skip to content
Hugging Face Daily Papers·· 2026-10-17AI score38

UniAVC: unified audio-video creation via progressive training and asymmetric scheduling

UniAVC: Unified Audio-Video Creation via Progressive Training and Asymmetric Scheduling

AI briefing

UniAVC uses a single set of model weights to achieve text-conditioned joint generation, bidirectional cross-modal generation, and instruction-guided editing without task-specific adapters. It first trains each branch on unimodal data to full generation and editing capability, then uses paired data for cross-modal correspondence; a modality-decoupled scheduler independently transforms noise schedules from a shared timestep, and directly supervises the asymmetric configuration with unimodal clean samples. This enables intent-aware editing and post-inference self-refinement, regenerating only the unsatisfactory side.

Open original arxiv.org