Rodent-Bench

Thomas Heap, Adriana Casado Rodriguez, Emma N. Cahill, Laurence Aitchison · 2026

Read Rodent-Bench by Thomas Heap, Adriana Casado Rodriguez, Emma N. Cahill, Laurence Aitchison (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-18540.txt.

Description

Thomas Heap and three co-authors benchmark AI annotation of rodent behavior videos. Their 2026 paper presents Rodent-Bench, a novel benchmark testing whether Multimodal Large Language Models can annotate rodent footage. State-of-the-art models, including Qwen-VL-Max, Gemini-2.5-Pro, and Gemini-2.5-Flash, are evaluated, and none perform strongly enough to assist with this task.

The benchmark covers datasets spanning behavioral paradigms such as social interactions, grooming, scratching, and freezing, with videos ten to thirty-five minutes long. Two versions accommodate varying capabilities, with standardized metrics including second-wise accuracy, macro F1, and mean average precision. While some models do modestly on certain datasets, notably grooming detection, results reveal challenges in temporal segmentation, extended video sequences, and subtle behavioral states. Analysis identifies key limitations in current models for scientific video annotation. Rodent-Bench serves as a base for tracking progress toward reliable automated annotation in neuroscience research.

Catalog record

CREATORThomas Heap, Adriana Casado Rodriguez, Emma N. Cahill, Laurence Aitchison
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-18540

Browse the full library · About the Tower of Babel