Linear stimulus reconstruction works on the KU Leuven audiovisual, gaze-controlled auditory attention decoding dataset

Simon Geirnaert, Iustina Rotaru, Tom Francart, Alexander Bertrand · 2024

Read Linear stimulus reconstruction works on the KU Leuven audiovisual, gaze-controlled auditory attention decoding dataset by Simon Geirnaert, Iustina Rotaru, Tom Francart, Alexander Bertrand (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01401.txt.

Description

Hearing aids of the future may read brain waves to learn which speaker a listener is following. Simon Geirnaert, Iustina Rotaru, Tom Francart, and Alexander Bertrand test a simple decoding method in 2024 on a data set built to separate eye gaze from true listening focus.

Earlier spatial methods failed on this data set, which hinted that their past success came from eye movements rather than hearing. The linear reconstruction method studied here takes a different route, rebuilding the speech signal from brain recordings. It reached high accuracy within each test condition and carried over to new conditions and new listeners. The result shows the data set can support real attention decoding once gaze shortcuts are removed.

Catalog record

CREATORSimon Geirnaert, Iustina Rotaru, Tom Francart, Alexander Bertrand
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01401

Browse the full library · About the Tower of Babel