Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI
Weichen Dai, Yuxuan Huang, Li Zhu, Dongjun Liu, Yu Zhang, Qibin Zhao, Andrzej Cichocki, Fabio Babiloni, Ke Li, Jianyu Qiu, Gangyong Jia, Wanzeng Kong, Qing Wu · 2025
Read Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI by Weichen Dai, Yuxuan Huang, Li Zhu, Dongjun Liu, Yu Zhang, Qibin Zhao, Andrzej Cichocki, Fabio Babiloni, Ke Li, Jianyu Qiu, Gangyong Jia, Wanzeng Kong, Qing Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12417.txt.
Introduction
Weichen Dai and co-authors show that the brain builds spatial maps even during passive viewing in this 2025 paper. Volunteers watched first-person videos while wearing a cap that records brain waves. A decoder read out their position and orientation in the scene, in full three-dimensional detail, from those noisy signals alone.
Decoding worked only when the video flowed in a smooth, structured way, which matched how engaged viewers felt. Showing frames at a brisk pace improved the readout, hinting at the brain's own timing. Tracing the decoder back highlighted different scalp channels for position and for orientation. The findings suggest spatial mapping runs on its own, without active exploring.
Catalog record
| CREATOR | Weichen Dai, Yuxuan Huang, Li Zhu, Dongjun Liu, Yu Zhang, Qibin Zhao, Andrzej Cichocki, Fabio Babiloni, Ke Li, Jianyu Qiu, Gangyong Jia, Wanzeng Kong, Qing Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12417
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI Weichen Dai, Yuxuan Huang, Li Zhu, Dongjun Liu, Yu Zhang, Qibin Zhao, Andrzej Cichocki, Fabio Babiloni, Ke Li, Jianyu Qiu, Gangyong Jia, Wanzeng Kong, Qing Wu Abstract Humans possess a remarkable capacity for spatial cognition, allowing for self-localization even in novel or unfamiliar environments. While hippocampal neurons encoding position and orientation are well documented, the large-scale neural dynamics supporting spatial representation—particularly during naturalistic, passive experience—remain poorly understood. Here, we demonstrate for the first time that non-invasive brain–computer interfaces (BCIs) based on electroencephalography (EEG) can decode spontaneous, fine-grained egocentric 6D pose—comprising three-dimensional position and orientation—during passive viewing of egocentric video. Despite EEG’s limited spatial resolution and high signal noise, we find that spatially coherent visual input (i.e., continuous and structured motion) reliably evokes decodable spatial representations, aligning with participants’ subjective sense of spatial engagement. Decoding performance further improves when visual input is presented at a frame rate of 100 ms per image, suggesting alignment with intrinsic neural temporal dynamics. Using gradient-based backpropagation through a neural decoding model, we identify distinct EEG channels contributing to position- and orientation-specific components, revealing a distributed yet complementary neural encoding scheme. These findings indicate that the brain’s spatial systems operate spontaneously and continuously, even under passive conditions, challenging traditional distinctions between active and passive spatial cognition. Our results offer a non-invasive window into the automatic construction of egocentric spatial maps and advance our understanding of how the human mind transforms everyday sensory experience into structured internal representations. 1 Introduction Humans and animals exhibit remarkable spatial cognition through vision, demonstrating a strong ability to sense and localize their positions in unknown environments DiCarlo et al. 2012 ; Killian et al. 2012 ; Finnie et al. 2021 ; Dotson and Yartsev 2021 . Through invasive techniques, the mammalian hippocampus Bohbot et al. 2017 ; Goyal et al. 2020 and associated brain regions have identified specialized neurons Alexander et al. 2023 ; Miller et al. 2018 , including spatial view cells Georges-François et al. 1999 ; Rolls and Stringer 2005 , place cells O’Keefe and Dostrovsky 1971 ; Bats 2008 , head direction cells Taube et al. 1990 ; Finkelstein et al. 2015 , grid cells Hafting et al. 2005 ; Ginosar et al. 2021 ; Wagner et al. 2023 , and time cells Tsao et al. 2018 ; Issa et al. 2020 ; Omer et al. 2023 , that related to spatial cognition. These cells provide a spatiotemporal representation of the environment, forming a continuous stream where each moment encodes information about the past, present, and future Dotson and Yartsev 2021 . This enables precise and robust navigation, allowing individuals to know where they are, where they want to go, and how to reach their destination Shao et al. 2024 . In addition to the level of neurons, the study of spatial cognition mechanisms by analyzing entire brain activities is a common approach Bonner and Epstein 2017 ; Delaux et al. 2021 . Compared to Electrocorticography (ECoG) and functional magnetic resonance imaging (fMRI) Taube et al. 2013 ; Duarte et al. 2016 ; Quan et al. 2024 , EEG stands out as a non-invasive technique that is simple, affordable, portable, and user-friendly for collecting physiological electrical signals Casson et al. 2018 . These signals reflect neuronal activity in the cerebral cortex and overall brain function, making EEG a subject of great interest. EEG is widely used in various applications, including emotion recognition Liu et al. 2023 ; Alarcao and Fonseca 2017 , brain to image Kavasidis et al. 2017 , event-related potentials Dietrich and Kanso 2010 , and motor imagery tasks Pfurtscheller et al. 2006 ; Ding et al. 2025 . In spatial behavior research, EEG has emerged as a complementary tool for neuroimaging Baker and Holroyd 2009 ; Plank et al. 2010 ; Lin et al. 2009 , especially under naturalistic conditions, such as indoor and outdoor walking Ladouce et al. 2017 ; Reiser et al. 2019 ; Maoz et al. 2023 . Most studies focus on event-related spectral perturbation (ERSP), particularly in the alpha and theta frequency bands, which are the most extensively studied oscillations Plank et al. 2010 ; Delaux et al. 2021 . These bands have consistently been shown to correlate with mental states, strategies, and stimulus characteristics. Researchers primarily rely on energy analysis to validate the relationship between specific brain regions and spatial cognition, demonstrating that the retrosplenial cortex (RSC) plays a crucial role in translating between egocentric and allocentric spatial information Gramann et al. 2010 ; Lin et al. 2015 ; Long et al. 2025 . Despite recent progress, several critical questions continue to hinder a deeper understanding of spatial cognition using EEG-based approaches Chrastil et al. 2022 ; Vavrečka et al. 2012 ; Delaux et al. 2021 . (1) It remains unclear whether spontaneous spatial representations are reflected in EEG during natural viewing conditions, as most existing studies rely on artificially designed stimuli that may fail to capture natural spatial processing. (2) It is still debated whether fine-grained 6D pose information is represented in scalp EEG signals, as current approaches often yield only coarse or superficial insights. (3) The temporal dynamics of spatial cognition in EEG are poorly understood—particularly, what temporal resolution of visual input is optimal for revealing clear spatial representations. (4) Little is known about the specific contributions of different EEG channels to position- versus orientation-related processing during self-localization, as most studies are constrained by predefined features or frequency-band EEG analyses. To address these questions, we propose a data-driven approach that directly decodes fine-grained spatial representations from non-invasive EEG signals evoked during passive viewing of egocentric videos with structured visual continuity. Rather than relying on artificial geometric shapes or synthetic visual stimuli, our paradigm leverages naturalistic visual input to engage spontaneous, subconscious spatial cognition. By decoding full 6D pose transformations, we aim to test whether such fine-grained latent spatial information is indeed embedded in EEG signals. The decoding of the 6D pose is conceptually similar to the localization of the pose in robotics, which involves estimating the position and orientation of a camera from one or more images, an allocentric representation of space Vavrečka et al. 2012 ; Bats 2008 . In our context, it involves regressing 6D poses from EEG signals while subjects view first-person videos as if situated within the scene. We further investigate the optimal temporal resolution of visual input for eliciting spatially informative EEG patterns, revealing how the brain encodes dynamic spatial context over time. To uncover the cortical basis of these representations, we apply gradient-based backpropagation to identify EEG channels contributing most to position- and orientation-specific decoding. Together, our study bridges low-SNR EEG recordings with fine-grained spatial representation and establishes a non-invasive framework for probing spontaneous spatial processing in naturalistic settings. Our findings demonstrate that EEG signals encode spatial cognition information, even in passive viewing scenarios. This suggests that individuals, even while seated and stationary, subconsciously engage in spatial reasoning and 3D localization in response to visual stimuli. This phenomenon aligns with common experiences, such as feeling disoriented when playing immersive 3D video games or using a smartphone in a moving vehicle, underscoring the automatic and continuous nature of spatial cognition in everyday