Hugging Face Blog·· 2025-07-23AI score29
TimeScope: How Long of a Video Can Video Large Models Actually Understand?
TimeScope: How Long Can Your Video Large Multimodal Model Go?
AI briefing
The long-video understanding benchmark TimeScope has been open-sourced on Hugging Face. By inserting 5–10 second "needle" segments into videos ranging from 1 minute to 8 hours, it evaluates three capabilities: local retrieval, information synthesis, and fine-grained temporal awareness. Results show that leading vision-language models, including Gemini 2.5-Pro, still struggle significantly with true long-video temporal understanding, and performance degrades more noticeably as video length increases.
Open original huggingface.co