Predicting Brain Responses To Natural Movies With Multimodal LLMs
Cesar Kadir Torrico Villanueva, Jiaxin Cindy Tu, Mihir Tripathy, Connor Lane Rishab Iyer Paul S. Scotti · 2025
Read Predicting Brain Responses To Natural Movies With Multimodal LLMs by Cesar Kadir Torrico Villanueva, Jiaxin Cindy Tu, Mihir Tripathy, Connor Lane Rishab Iyer Paul S. Scotti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19956.txt.
Description
Forecasting brain activity while people watch films is the contest task behind a 2025 paper by Cesar Kadir Torrico Villanueva and co-authors. The team entered the Algonauts 2025 challenge, which scores how well a model predicts brain scans for movies the model has never seen. Their system draws on several pretrained AI models at once.
Separate models supplied features for video, speech, text, and mixed media. Those features were aligned in time with the brain scan series and mapped onto brain regions by a small encoder. The team trained hundreds of variants and combined the best into ensembles. Their entry placed fourth, and they describe a late fix that could have placed second.
Catalog record
| CREATOR | Cesar Kadir Torrico Villanueva, Jiaxin Cindy Tu, Mihir Tripathy, Connor Lane Rishab Iyer Paul S. Scotti |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19956