OpenAI News·· 2024-02-15PicksAI score82
OpenAI Research: Video Generation Models as World Simulators
Video generation models as world simulators
AI briefing
OpenAI explores large-scale training of generative models on video data, jointly training text-conditioned diffusion models on videos and images of varying durations, resolutions, and aspect ratios, using a transformer architecture that operates on spatiotemporal patches of video and image latent codes. Its largest model, Sora, can generate one-minute high-fidelity videos. Results indicate that scaling video generation models is a promising path toward building general-purpose physical world simulators.
Why it matters
OpenAI publicly reveals Sora's technical roadmap for the first time, explaining how video generation models can be scaled into physical world simulators.
Open original openai.com