Linear stimulus reconstruction works on the KU Leuven audiovisual, gaze-controlled auditory attention decoding dataset
Simon Geirnaert, Iustina Rotaru, Tom Francart, Alexander Bertrand · 2024
Read Linear stimulus reconstruction works on the KU Leuven audiovisual, gaze-controlled auditory attention decoding dataset by Simon Geirnaert, Iustina Rotaru, Tom Francart, Alexander Bertrand (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01401.txt.
Description
Hearing aids of the future may read brain waves to learn which speaker a listener is following. Simon Geirnaert, Iustina Rotaru, Tom Francart, and Alexander Bertrand test a simple decoding method in 2024 on a data set built to separate eye gaze from true listening focus.
Earlier spatial methods failed on this data set, which hinted that their past success came from eye movements rather than hearing. The linear reconstruction method studied here takes a different route, rebuilding the speech signal from brain recordings. It reached high accuracy within each test condition and carried over to new conditions and new listeners. The result shows the data set can support real attention decoding once gaze shortcuts are removed.
Catalog record
| CREATOR | Simon Geirnaert, Iustina Rotaru, Tom Francart, Alexander Bertrand |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-01401