Music, body, and machine: gesture-based synchronization in human-robot musical interaction

Xuedan Gao, Amit Rogel, Raghavasimhan Sankaranarayanan, Brody Dowling, Gil Weinberg · 2024

Read Music, body, and machine: gesture-based synchronization in human-robot musical interaction by Xuedan Gao, Amit Rogel, Raghavasimhan Sankaranarayanan, Brody Dowling, Gil Weinberg (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-11655300.txt.

Description

Xuedan Gao and four co-authors study how a music robot's body language helps human players stay in sync. Human musicians read mood, expression, and tempo cues from each other's gestures. The robot here is Shimon, a marimba player built at Georgia Tech, which uses head and arm movements to signal expected notes, tempo, and beat. Piano players were asked to play along with Shimon.

Players had to follow tempo changes they did not know in advance, as cued by Shimon's gestures. Non-instrumental gestures clearly aided synchronization, the team found. Players also felt more positive when the robot used ancillary and social gestures, which underlines their role in joint music making.

Catalog record

CREATORXuedan Gao, Amit Rogel, Raghavasimhan Sankaranarayanan, Brody Dowling, Gil Weinberg
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC11655300

Browse the full library · About the Tower of Babel