Better, But Not Sufficient: Testing Video ANNs Against Macaque IT Dynamics

Matteo Dunnhofer, Christian Micheloni, Kohitij Kar · 2026

Read Better, But Not Sufficient: Testing Video ANNs Against Macaque IT Dynamics by Matteo Dunnhofer, Christian Micheloni, Kohitij Kar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03392.txt.

Description

Matteo Dunnhofer, Christian Micheloni, and Kohitij Kar test whether video-capable neural networks finally capture how the primate brain processes moving scenes. Networks trained on still images dominate models of the ventral visual stream, but real vision is dynamic, and the macaque inferior temporal cortex encodes object motion during natural videos. The authors compare brain responses to naturalistic videos against static, recurrent, and video-based network models.

Video models did predict the neural responses somewhat better, especially at later stages, but only modestly, hence the title's verdict. A stress test sharpened the question: decoders trained on natural videos were tried on appearance-free variants that keep the motion but strip shape and texture. The results probe whether the networks' advantage reflects real dynamic computation or just frame features pooled over time.

Catalog record

CREATORMatteo Dunnhofer, Christian Micheloni, Kohitij Kar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-03392

Browse the full library · About the Tower of Babel