Listening with the Eyes: Benchmarking Egocentric Co-Speech Grounding across Space and Time

Listening with the Eyes: Benchmarking Egocentric Co-Speech Grounding across Space and Time explores EcoG-Bench is a new benchmark for evaluating multimodal models on their ability to ground speech with co-speech gestures in egocentric videos, revealing a significant performance gap compared to human accuracy and highlighting the importance of temporal alignment cues.. Commercial viability score: 7/10 in Multimodal Understanding.