Skip to content
Hugging Face Daily Papers·· 2026-10-14AI score22

Speculative Sampling in interactive video generation

Speculative Sampling in Interactive Video Generation

AI briefing

Addressing the reliance of interactive video generation on small bidirectional chunks to reduce latency, researchers propose Speculative Sampling, which extends the modeling window by using noise latents as padding and caches predictions for reuse when conditions are unchanged, thereby combining the image quality of a large bidirectional window with the low interaction latency of small chunks. Latency analysis shows the method eliminates the lower bound on waiting time caused by chunk boundaries, making the bidirectional window size a decision variable that can jointly optimize image quality and sampling time, and enabling large bidirectional models to be served in interactive streaming systems without complex streaming post-training.

Open original arxiv.org