Hugging Face Daily Papers·· 2026-10-20AI score47
Joints, Camera, Action!: jointly generating 3D motion and video for arbitrary skeletons
Joints, Camera, Action! Co-Generating 3D Motion and Video for Arbitrary Rigs
AI briefing
Researchers propose a model that can directly jointly generate video and 3D motion for arbitrary skeleton rigs, and estimate the camera to register the motion into the 3D scene. It connects a 3D motion model supporting arbitrary skeletons with a pretrained video model through a small number of cross-attention layers, is trained on about 200K training pairs, and in evaluations drives multiple skeletons by text more faithfully than video-first pipelines, while supporting video-to-skeleton motion, skeleton motion-to-video, and keyframe control.
Open original arxiv.org