Hugging Face Daily Papers·· 7 days agoAI score37
How PixVid lifts latent-space video diffusion into pixel space
Back to Pixels: Lifting Latent Video Diffusion into Pixel Space
AI briefing
PixVid adapts a pretrained latent-space video model to generate directly frame-by-frame in pixel space, replacing the VAE decoder with a convolutional head. Fine-tuned from Wan2.1-14B, the method approaches the latent-space baseline with about 1.3M training clips and generates 2× higher resolution with the same number of tokens per frame. It maintains alignment for depth-conditioned editing under fast motion and can respond to each action in the next frame.
Open original arxiv.org