Arxiv paper - MINERVA: Evaluating Complex Video Reasoning

In this episode, we discuss MINERVA: Evaluating Complex Video Reasoning by Arsha Nagrani, Sachit Menon, Ahmet Iscen, Shyamal Buch, Ramin Mehran, Nilpa Jha, Anja Hauth, Yukun Zhu, Carl Vondrick, Mikhail Sirotenko, Cordelia Schmid, Tobias Weyand. The paper introduces MINERVA, a new video reasoning dataset featuring complex multi-step questions with detailed reasoning traces to evaluate multimodal models beyond final answers. It benchmarks state-of-the-art models, revealing challenges mainly in temporal localization and visual perception rather than logical reasoning. The dataset and evaluation tools are publicly released to advance research in interpretable video understanding.