Skip to content
Hugging Face Daily Papers·· 2026-10-15AI score17

EVA-Cap: Optimizing audio-visual video captioning through event-centric alignment

EVA-Cap: Optimizing Audiovisual Video Captioning via Event-Centric Alignment

AI briefing

The EVA-Cap framework decomposes audio-visual captions into atomic-level audio-visual events, converts unstructured text supervision into event-centric alignment, and trains on the self-built dataset EVA-Data through SFT and GRPO. The GRPO stage optimizes around three objectives: global event completeness, intra-event attribution, and inter-event synchronization. On the event-centric evaluation of ChronusAV, it improves by an average of 9.0%, and on WorldSense by 3.3%. The paper has been accepted by NeurIPS 2026, and the code will be open-sourced.

Open original arxiv.org