Doctoral Dissertation
Efficient Transformer-Integrated Deep Neural Architectures for Robust EEG Decoding of Complex Visual Imagery · 2025
Read Doctoral Dissertation by Efficient Transformer-Integrated Deep Neural Architectures for Robust EEG Decoding of Complex Visual Imagery (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-15218.txt.
Introduction
Byoung-Hee Kwon develops deep learning systems that decode complex imagined movements from scalp brain waves, aiming at richer brain-computer links. The work proposes complex visual imagery as the mental task. Instead of imagining one simple motion, the user pictures detailed upper limb movements. Richer imagery should carry more distinct signals for a control system to read.
Kwon's design fuses measures of how brain regions work together with a combined network tuned for EEG signals. It targets robust decoding of the imagined movements from recordings taken outside the skull. Success would stretch EEG systems toward tasks such as guiding a robotic arm by thought alone.
Catalog record
| CREATOR | Efficient Transformer-Integrated Deep Neural Architectures for Robust EEG Decoding of Complex Visual Imagery |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-15218
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Doctoral Dissertation Efficient Transformer-Integrated Deep Neural Architectures for Robust EEG Decoding of Complex Visual Imagery Abstract Efficient Transformer-Integrated Deep Neural Architectures for Robust EEG Decoding of Complex Visual Imagery by Byoung-Hee Kwon under the supervision of Professor Seong-Whan Lee A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy Department of Brain and Cognitive Engineering Graduate School Korea University December 2025 The dissertation of Byoung-Hee Kwon has been approved by the dissertation committee in partial fulfillment of the requirements for the degree of Doctor of Philosophy December 2025 Committee Chair: Seong-Whan Lee Committee Member: Wonzoo Chung Committee Member: Tae-Eui Kam Committee Member: Jichai Jeong Committee Member: Sanghoon Sull Efficient Transformer-Integrated Deep Neural Architectures for Robust EEG Decoding of Complex Visual Imagery by Byoung-Hee Kwon Department of Brain and Cognitive Engineering under the supervision of Professor Seong-Whan Lee Abstract This study introduces a pioneering approach in brain-computer interface (BCI) technology, featuring our novel concept of complex visual imagery for non-invasive electroencephalography (EEG)-based communication. Complex visual imagery, as proposed in our work, involves the user engaging in the mental visualization of complex upper limb movements. This innovative approach significantly enhances the BCI system, facilitating the extension of its applications to more sophisticated tasks such as EEG-based robotic arm control. By leveraging this advanced form of visual imagery, our study opens new horizons for intricate and intuitive mind-controlled interfaces. We developed an advanced deep learning architecture that integrates functional connectivity metrics with a convolutional neural network-image transformer. This framework is adept at decoding subtle user intentions, addressing the spatial variability in complex visual tasks, and effectively translating these into precise commands for robotic arm control. Our comprehensive offline and pseudo-online evaluations demonstrate the framework’s efficacy in real-time applications, including the nuanced control of robotic arms. The robustness of our approach is further validated through leave-one-subject-out cross-validation, marking a significant step towards versatile, subject-independent BCI applications. This research highlights the transformative impact of advanced visual imagery and deep learning in enhancing the usability and adaptability of BCI systems, particularly in robotic arm manipulation. Keywords : Brain–computer interface, Electroencephalogram, Transformer, Visual imagery 복잡한 시각 심상의 강인한 뇌파(EEG) 디코딩을 위한 효율적인 Transformer 통합 심층 신경망 권 병 희 뇌 공 학 과 지 도 교 수: 이 성 환 국문 초록 본 연구는 비침습적 뇌전도(EEG) 기반 의사소통을 위한 뇌-컴퓨터 인터페이스(BCI) 기술에서 선구적인 접근법을 소개하며, 복잡한 시각적 심상이라는 새로운 개념을 제시한다. 본 연구에서 제안하는 복잡한 시각적 심상은 사용자가 상지의 복잡한 움직임을 정신적으로 시각화하는 것을 포함한다. 이 혁신적인 접근은 BCI 시스템을 크게 향상시켜, EEG 기반 로봇 팔 제어와 같은 보다 정교한 작업으로 그 응용을 확장할 수 있도록 한다. 이러한 발전된 형태의 시각적 심상을 활용함으로써, 본 연구는 정교하고 직관적인 사고 제어 인터페이스를 위한 새로운 가능성을 제시한다. 우리는 기능적 연결성 지표를 합성곱 신경망과 이미지 트랜스포머와 통합한 고급 딥러닝 아키텍처를 개발하였다. 이 프레임워크는 사용자의 미세한 의도를 디코딩하고, 복잡한 시각 과제에서의 공간적 변동성을 처리하며, 이를 로봇 팔 제어를 위한 정확한 명령으로 효과적으로 변환한다. 포괄적인 오프라인 및 준실시간 평가를 통해 본 프레임워크의 실시간 응용에서의 효율성이 입증되었으며, 로봇 팔의 세밀한 제어에서도 그 성능이 확인되었다. 또한 leave-one-subject-out 교차검증을 통해 본 접근법의 견고성이 추가로 검증되었으며, 이는 사용자 독립적 BCI 응용으로의 중요한 진전을 의미한다. 본 연구는 고급 시각적 심상과 딥러닝이 BCI 시스템의 사용성과 적응성을 향상시키는 데 미치는 혁신적 영향을 강조하며, 특히 로봇 팔 조작에서 그 잠재력을 보여준다. 중심어 : 뇌-컴퓨터 인터페이스, 뇌 신호, Transformer, 시각 상상 Preface This dissertation is submitted for the degree of Doctor of Philosophy in the Department of Brain and Cognitive Engineering at Korea University. The research presented herein was conducted under the supervision of Professor Seong-Whan Lee in the Department of Artificial Intelligence at Korea University. The core content of this dissertation is based on the study published in Expert Systems with Applications , volume 294, 2025. Neither this dissertation, nor any substantially similar work, has been or is being submitted for any other degree, diploma, or academic qualification at any other university. Chapter 1. Introduction Brain-computer interfaces (BCIs) are an advanced technology that enables communication between machines and users, translating human brain signals into machine commands to reflect the user’s intentions. Non-invasive BCI is a practical technology as no surgical operation is required [ 1 , 2 , 3 ] . Electroencephalography (EEG) signals have the advantage of having better time resolution than comparable methods such as functional magnetic resonance imaging and near-infrared spectroscopy. Thus, EEG allows rapid communication between users and external devices which facilitates the technological improvement of rehabilitation systems for patients with tetraplegia or supporting the daily life activities of healthy people [ 4 , 5 , 6 , 7 ] . Using visual imagery, which is a type of intuitive BCI paradigm, users could control their avatars and robotic devices in virtual space and in the real-world environment by reflecting user intentions. Furthermore, it allows the creation of a new type of world in which communication in a 3D virtual space, without any spatial or physical restrictions, becomes possible by using only brain signals. Previous BCI studies have focused on a variety of BCI paradigms to identify users’ intent to move. Among the endogenous BCI paradigms to control BCI-based devices, motor imagery (MI) [ 8 , 9 , 2 , 10 ] is an effective option for controlling practical BCI applications such as robotic arms or wheelchairs. When a user performs MI, event-related desynchronization/synchronization (ERD/ERS), referred to as sensorimotor rhythm, is generated in the motor cortex [ 11 , 12 , 13 ] . ERD/ERS can be induced from the mu band ([8–12] Hz) and beta band ([13–30] Hz), respectively. However, despite its prevalence, the MI paradigm in BCI studies poses challenges in intuitiveness for users, especially when they imagine muscle movements. Although a user imagines the same muscle movement when performing the MI paradigm, it is difficult to detect the user’s intentions because the time and sequence of imagery in which the user imagines muscle movements are not constant. In addition, performing the MI task is accepted differently by users, and this phenomenon prevents users from having a uniform imagination [ 14 , 15 ] . This leads to motion-related signals in different brain regions for each person and degrades the practicality of BCI applications. Visual imagery is an endogenous BCI paradigm that allows users to use more intuitive imagination than MI when performing imagery tasks [ 16 ] , regardless of the complexity of the movement, reducing the difficulty of imagination and minimizing user fatigue. Additionally, it can be used to lead users to perform the visual imagery task uniformly. This effective BCI paradigm presents the possibility for the development of technologies that control avatars or robots by reflecting users’ intentions in 3D virtual reality and in the real-world by using only brain signals. To decode user intention, we used neural response patterns that included delta, theta, and alpha frequency bands. Brain activities based on visual imagery induce delta and theta bands in the prefrontal lobe and the alpha band in the occipital lobe, which includes the visual cortex [ 17 , 18 ] . Previous studies proved that the brain signals generated by visual imagery can be analyzed by specific brain regions and frequencies [ 19 ] to control BCI-related devices. However, most previous visual imagery paradigms for