Skip to content
Hugging Face Daily Papers·· 28 days agoAI score30

Video as a lens: a survey unifying video understanding and generation through world modeling

Reading, Writing, Sharing, and Interacting with the World through Video

AI briefing

A 102-page survey proposes world modeling as a unified perspective, organizing research on video foundation models and video world models into four operations: read, write, share and interact. Read infers world properties from observed video; write synthesizes video under specified or learned world conditions; share integrates understanding and generation with common modeling mechanisms; interact predicts and updates world states under actions and evolving observations.

Open original arxiv.org