Hugging Face Daily Papers·· 29 days agoAI score42
RealMe: Generating immersive volumetric video with minimal capture
RealMe: Immersive Volumetric Video from Minimal Captures
AI briefing
RealMe proposes a unified framework centered on a high-resolution video diffusion model that can enhance sparse, low-resolution multi-view captures into 2K, 4D-consistent video for volumetric video reconstruction. The model encodes auxiliary data as latents and combines them with layout-aware positional embeddings, adapts factorized spatiotemporal attention to multi-view capture layouts, and introduces a frequency loss in latent space to narrow the gap between generated video and real captures.
Open original arxiv.org