Better, But Not Sufficient: Testing Video ANNs Against Macaque IT Dynamics
Matteo Dunnhofer, Christian Micheloni, Kohitij Kar · 2026
Read Better, But Not Sufficient: Testing Video ANNs Against Macaque IT Dynamics by Matteo Dunnhofer, Christian Micheloni, Kohitij Kar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03392.txt.
Description
Matteo Dunnhofer, Christian Micheloni, and Kohitij Kar test whether video-capable neural networks finally capture how the primate brain processes moving scenes. Networks trained on still images dominate models of the ventral visual stream, but real vision is dynamic, and the macaque inferior temporal cortex encodes object motion during natural videos. The authors compare brain responses to naturalistic videos against static, recurrent, and video-based network models.
Video models did predict the neural responses somewhat better, especially at later stages, but only modestly, hence the title's verdict. A stress test sharpened the question: decoders trained on natural videos were tried on appearance-free variants that keep the motion but strip shape and texture. The results probe whether the networks' advantage reflects real dynamic computation or just frame features pooled over time.
Catalog record
| CREATOR | Matteo Dunnhofer, Christian Micheloni, Kohitij Kar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03392