Simultaneous speech and gesture decoding for multimodal communication in paralysis
Samantha C. Brosler, Jessie R. Liu, Alexander B. Silva, Irina P. Hallinan, Cady M. Kurtz-Miott, Jonah F. B. Dunkel Wilker, Adelyn Tu-Chan, Karunesh Ganguly, Edward F. Chang · 2026
Read Simultaneous speech and gesture decoding for multimodal communication in paralysis by Samantha C. Brosler, Jessie R. Liu, Alexander B. Silva, Irina P. Hallinan, Cady M. Kurtz-Miott, Jonah F. B. Dunkel Wilker, Adelyn Tu-Chan, Karunesh Ganguly, Edward F. Chang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13633112.txt.
Description
Samantha Brosler and co-authors wrote a 2026 study on decoding speech and gesture at the same time for people with paralysis. Stroke and degenerative disease can rob people of both speech and hand movement. Brain-computer interfaces translate brain signals into device commands, but past work decoded speech or gesture alone, not both together.
Signals came from a single dense electrode grid on the brain surface of three participants. Isolated arm and face movements decoded reliably. Parallel decoders then let participants drive a personal virtual avatar by attempting speech and gestures, together or apart. Training on both isolated and combined attempts improved accuracy in all settings. The results point toward richer, more natural communication aids from one implant.
Catalog record
| CREATOR | Samantha C. Brosler, Jessie R. Liu, Alexander B. Silva, Irina P. Hallinan, Cady M. Kurtz-Miott, Jonah F. B. Dunkel Wilker, Adelyn Tu-Chan, Karunesh Ganguly, Edward F. Chang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 98 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |