Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry
Pablo Marcos-Manchón, Rishi Jha, Lluís Fuentemilla · 2026
Read Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry by Pablo Marcos-Manchón, Rishi Jha, Lluís Fuentemilla (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20496.txt.
Introduction
Marcos-Manchón and two co-workers test whether a universal geometry links brain representations across people. Their self-taught encoder learns per-person embeddings from fMRI brain data alone, using repeat stimulus shows. Spaces learned apart translate across subjects via unsupervised orthogonal rotations, with no paired cross-subject samples. Syncing pairwise rotations into one shared space improves cross-subject retrieval, supporting a shared visual-cortex geometry.
Catalog record
| CREATOR | Pablo Marcos-Manchón, Rishi Jha, Lluís Fuentemilla |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49190 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20496
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry Pablo Marcos-Manchón, Rishi Jha, Lluís Fuentemilla Abstract The Strong Platonic Representation Hypothesis suggests that representational convergence in artificial neural networks can be harnessed constructively: embeddings can be translated across models through a universal latent space without paired data. We ask whether an analogous geometry can be recovered across human brains. Using fMRI data from the Natural Scenes Dataset, we propose a self-supervised encoder that learns subject-specific embeddings from brain data alone by exploiting repeated stimulus presentations. We show that these independently learned spaces can be translated across subjects using unsupervised orthogonal rotations, without paired cross-subject samples or intermediate model representations. Synchronizing pairwise rotations into a single shared latent space further improves cross-subject retrieval, indicating that subject-specific spaces are mutually compatible with a common coordinate system. These results provide evidence for a shared neural geometry in the human visual cortex: subject-specific fMRI representations are approximately isometric across individuals and can be translated through purely geometric transformations. 1 Introduction The Platonic Representation Hypothesis posits that independently trained artificial neural networks converge toward geometrically similar representations by recovering shared latent structure in the world [ 36 , 45 , 27 , 51 , 22 ] . Recent constructive work pushes this hypothesis further: if representations share a common geometry, then embeddings from one model should be translatable into another model’s latent space without shared inputs or paired supervision [ 23 , 13 ] . However, evidence for this strong form of representational convergence has so far come almost entirely from artificial vision and language systems [ 22 , 4 , 34 ] . Whether the same principle extends to biological neural systems remains unknown. In neuroscience, a long line of work on inter-subject synchrony and representational similarity shows that neural responses, and the geometries they induce, can be preserved across individuals during shared stimulus processing [ 19 , 39 , 28 , 31 ] . However, existing evidence typically depends on shared stimuli, paired measurements, or external reference spaces. Functional alignment methods for fMRI, such as hyperalignment , map neural responses into common spaces by using shared stimuli to establish cross-subject correspondences [ 20 , 18 ] . Other approaches introduce anchors through model-derived feature spaces [ 61 ] or image-to-fMRI encoders [ 58 ] . What remains open is whether shared neural geometry can be recovered from independently learned brain representations alone. In this paper, we extend the Strong Platonic Representation Hypothesis [ 23 ] to the human visual cortex. We ask whether subject-specific fMRI embedding spaces, learned independently from neural data, can be translated across subjects using only the intrinsic geometry of neural responses. We evaluate this setting on the Natural Scenes Dataset (NSD) [ 1 ] , a canonical fMRI dataset of subjects viewing complex natural images. Our contributions are: 1. We introduce a self-supervised encoder that learns subject-specific fMRI embeddings from repeated stimulus presentations. 2. We show that independently learned subject embeddings are approximately isometric across brains: simple unsupervised orthogonal rotations recover accurate instance-level cross-subject correspondences. 3. We synchronize pairwise rotations into a single shared latent space, improving cross-subject retrieval and showing that independently learned subject spaces are mutually compatible with a common coordinate system. Our results support the existence of an approximately isometric shared neural geometry recoverable directly from fMRI data, with practical implications for cross-subject neural modeling. 2 Problem Setup Let s\in\{1,\dots,S\} represent a subject who provides fMRI responses to visual stimuli drawn from a distribution \mathcal{D} . X^{(s)}\in\mathbb{R}^{n_{s}\times v_{s}} denotes the subject’s neural activity matrix, where rows correspond to image presentations and columns to subject-specific voxel responses. Our goal is to test whether these independently observed fMRI responses can be mapped into a shared latent space \mathcal{Z} using only their intrinsic representational geometry, without paired cross-subject data for learning the mappings. Subjects observe disjoint image sets independently sampled from \mathcal{D} . No shared images or paired cross-subject correspondences are available for learning the translations. A held-out set of shared images, observed by all subjects, is used only for evaluation. Subject-specific embeddings. For each subject, we learn a mapping f_{s}:X^{(s)}\rightarrow Z^{(s)} , with Z^{(s)}\in\mathbb{R}^{n_{s}\times d} , that projects voxel responses into a low-dimensional subject-specific space \mathcal{Z}^{(s)}\subset\mathbb{R}^{d} . The mapping f_{s} is self-supervised from each subject’s neural activity alone, without external model features or cross-subject supervision. Thus, Z^{(s)} is intended to reflect the intrinsic organization of subject s ’s stimulus responses. Unpaired brain-to-brain translation. Given independently learned embeddings \{Z^{(s)}\}_{s=1}^{S} , we seek transformations that translate each subject space into a common latent space. Specifically, we learn one transformation R_{s}:\mathcal{Z}^{(s)}\rightarrow\mathcal{Z} per subject, such that embeddings evoked by the same image map to consistent coordinates, i.e., Z^{(s)}R_{s}\approx Z^{(t)}R_{t} for subjects s and t on held-out shared images. During training, no such paired images are available; the transformations must be inferred from the global geometry of the unpaired subject-specific spaces. We evaluate translation quality using cross-subject retrieval on the held-out shared images, following prior unsupervised mapping protocols [ 23 , 13 ] . Shared geometry hypothesis. We hypothesize that subject-specific spaces \mathcal{Z}^{(s)} are noisy instances of a shared latent geometry. Under this hypothesis, inter-subject differences should be captured by approximately isometric transformations. We therefore restrict transformations to orthogonal maps, R_{s}\in\mathcal{O}(d) , which preserve distances and inner products. This constraint prevents arbitrary geometric warping and provides a strong test of whether independently learned neural representations can be translated into a shared coordinate system using geometry alone. Figure 1: Method overview. (A) Subject encoder. For each subject, fMRI responses are mapped into a low-dimensional embedding space using voxel reliability weighting, PCA, and multi-view CCA (MCCA), followed by a residual nonlinear refinement trained from repeated stimulus presentations. (B) Pairwise brain-to-brain translation. Independently learned subject embeddings are translated between subject pairs by estimating orthogonal rotations R_{s\rightarrow t} from geometry-derived pseudo-correspondences. (C) Shared latent space. Pairwise rotations are synchronized to recover one orthogonal transformation R_{s} per subject, mapping all subject embeddings into a common space. 3 Method We proceed in three stages. First, for each subject, we learn a subject-specific encoder that maps fMRI responses into a lower-dimensional embedding space. Second, we translate embeddings between subject pairs by estimating unsupervised orthogonal rotations from their geometry. Finally, we synchronize the pairwise rotations to recover one transformation per subject, mapping all embeddings into a shared latent space. An overview is shown in Fig. 1 . 3.1 Learning geometry-preserving embeddings For each subject s , we learn a mapping f_{s} using repeated stimulus presentations as self-supervision. Each image is presented r times, yielding multiple measurements, or views, of the same underlying neural signal. For clarity, we drop the subject index (s) in this subsection. Let \{X_{i}\}_{i=1}^{r} , with X_{i}\in\mathbb{R}^{n_{s}\times v_{s}} , denote view-specific response matrices for the same stimuli, and let X\in\mathbb{R}^{rn_{s}\times v_{s}} denote their concatenation. To mitigate temporal drifts, repetitions are randomly assigned to views for each stimulus. Traditional fMRI denoising averages repeated measurements under independence assumptions [ 33 , 42 , 41 , 48 ] . In contrast, we treat repetitions as noisy views of a stable latent representation and optimize f_{s} for repetition invariance, such that for responses x_{i} and x_{j} to the same image, f_{s}(x_{i})\approx f_{s}(x_{j}) . Voxel reliability weighting. We first reweight voxels