Hugging Face Daily Papers·· 2026-10-17AI score38
UniAVC: unified audio-video creation via progressive training and asymmetric scheduling
UniAVC: Unified Audio-Video Creation via Progressive Training and Asymmetric Scheduling
AI briefing
UniAVC uses a single set of model weights to achieve text-conditioned joint generation, bidirectional cross-modal generation, and instruction-guided editing without task-specific adapters. It first trains each branch on unimodal data to full generation and editing capability, then uses paired data for cross-modal correspondence; a modality-decoupled scheduler independently transforms noise schedules from a shared timestep, and directly supervises the asymmetric configuration with unimodal clean samples. This enables intent-aware editing and post-inference self-refinement, regenerating only the unsatisfactory side.
Open original arxiv.org