Learning Brain Representation with Hierarchical Visual Embeddings

Jiawen Zheng, Haonan Jia, Ming Li, Yuhui Zheng, Yufeng Zeng, Yang Gao, Chen Liang · 2026

Read Learning Brain Representation with Hierarchical Visual Embeddings by Jiawen Zheng, Haonan Jia, Ming Li, Yuhui Zheng, Yufeng Zeng, Yang Gao, Chen Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07495.txt.

Description

Decoding what the brain sees from neural signals is limited when models capture only high-level meaning and miss pixel-level detail. Jiawen Zheng and six co-authors propose a brain-image match strategy using several pre-trained visual encoders with other inductive biases to capture hierarchical, multi-scale representations.

A contrastive objective aligns brain signals with those visual embeddings. A Fusion Prior learned on large-scale visual data stabilizes the mapping before brain features are matched to it. Brain experts and AI teams get a decoding approach that respects both semantics and fine visual detail, clarifying how much visual information brain signals truly carry.

Catalog record

CREATORJiawen Zheng, Haonan Jia, Ming Li, Yuhui Zheng, Yufeng Zeng, Yang Gao, Chen Liang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07495

Browse the full library · About the Tower of Babel