Hugging Face Daily Papers·· 28 days agoAI score30
Video as a lens: a survey unifying video understanding and generation through world modeling
Reading, Writing, Sharing, and Interacting with the World through Video
AI briefing
A 102-page survey proposes world modeling as a unified perspective, organizing research on video foundation models and video world models into four operations: read, write, share and interact. Read infers world properties from observed video; write synthesizes video under specified or learned world conditions; share integrates understanding and generation with common modeling mechanisms; interact predicts and updates world states under actions and evolving observations.
Open original arxiv.org