A Survey on 30+ Years of Automatic Singing Assessment and Singing Information Processing
Arthur N. dos Santos, Bruno S. Masiero · 2026
Read A Survey on 30+ Years of Automatic Singing Assessment and Singing Information Processing by Arthur N. dos Santos, Bruno S. Masiero (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12153.txt.
Introduction
Arthur N. dos Santos and Bruno S. Masiero survey more than thirty years of automatic singing assessment and singing information processing. Both fields aim to aid singing teaching, performance study, and vocal training with computers.
One strand grades a singer by firm metrics, from live visual feedback to pitch tracking and spectral checks. The other matches a singer's voice to a target to read fine traits. The survey maps how both strands grew. Teachers and tool builders gain a full view of what works. The survey spans work from the early days to now.
Catalog record
| CREATOR | Arthur N. dos Santos, Bruno S. Masiero |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-12153
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Survey on 30+ Years of Automatic Singing Assessment and Singing Information Processing Arthur N. dos Santos, Bruno S. Masiero Abstract Automatic Singing Assessment and Singing Information Processing have evolved over the past three decades to support singing pedagogy, performance analysis, and vocal training. While the first approach objectively evaluates a singer’s performance through computational metrics ranging from real-time visual feedback and acoustical biofeedback to sophisticated pitch tracking and spectral analysis, the latter method compares a predictor vocal signal with a target reference to capture nuanced data embedded in the singing voice. Notable advancements include the development of interactive systems that have significantly improved real-time visual feedback, and the integration of machine learning and deep neural network architectures that enhance the precision of vocal signal processing. This survey critically examines the literature to map the historical evolution of these technologies, while identifying and discussing key gaps. The analysis reveals persistent challenges, such as the lack of standardized evaluation frameworks, difficulties in reliably separating vocal signals from various noise sources, and the underutilization of advanced digital signal processing and artificial intelligence methodologies for capturing artistic expressivity. By detailing these limitations and the corresponding technological advances, this review demonstrates how addressing these issues can bridge the gap between objective computational assessments and subjective human-like evaluations of singing performance, ultimately enhancing both the technical accuracy and pedagogical relevance of automated singing evaluation systems. Keywords automatic singing assessment \cdot real-time visual feedback \cdot acoustical biofeedback \cdot singing information processing \cdot karaoke scoring 1 Introduction A singing assessment evaluates a singer’s performance based on both technical and expressive criteria. Traditionally performed by human evaluators, computational approaches now enable objective and accessible evaluation of singing performance. In addition, these methods provide real-time Visual Feedback (VFB) through displays, which guides singers to adjust their performance. Systems that incorporate biological sensors further enhance this process by capturing physiological signals and translating them into visual cues, thereby allowing singers to perceive aspects of their vocal apparatus that are otherwise imperceptible 44 ; 55 . Despite these advantages, ASA predominantly relies on metadata-based analysis, such as extracting and comparing pitch values, rather than processing raw vocal signals. These systems neither enhance nor isolate the singer’s voice from the recorded audio, nor facilitate direct comparison with reference vocal tracks, such as original vocals from commercially available songs. Consequently, the emergence of Singing Information Processing (SIP) 20 marks a paradigm shift, treating singing as data by analyzing the actual vocal signal rather than relying solely on the extracted parameters. This transition introduces significant challenges, particularly in voice separation, in which algorithms must accurately isolate a singer’s voice while minimizing artifacts. Errors such as the misclassification of instrumental accompaniment as vocals, overlapping vocal sources, and residual interference from the original track can substantially impact the analytical accuracy 48 ; 3 . In this survey, a structured framework was adopted to analyze the development of ASA and SIP. The historical analysis focuses on the period 1988–2010. During this time, the seminal contributions by Welch et al. 63 ; 61 ; 62 ; 29 ; 26 ; 15 , Rossiter et al. 31 ; 53 ; 52 ; 54 , Howard et al. 32 ; 25 ; 28 ; 30 ; 28 ; 60 ; 22 ; 27 ; 24 , and Goto et al. 21 ; 42 ; 20 constitute nearly 40% of the entire body of literature on this topic. Their work is of paramount importance, as it establishes the early methodological and technological foundations of the fields under significant technical constraints. These pioneering studies not only defined the scope of research during that period, but also paved the way for subsequent developments that expanded these initial approaches to a broader range of applications while incorporating contemporary technological advancements. Subsequently, the remaining literature, spanning up to 2022, is reviewed within a broader scope. Rather than conducting an in-depth historical analysis, this stage focuses on identifying trends by examining key aspects, such as intended applications, feature extraction methods, types of target variables, and assessment methodologies. This shift in approach prioritizes the identification of emerging patterns over their historical significance, thereby facilitating the recognition of potential gaps and future research directions within these fields. The remainder of this paper is structured as follows: Section 2 outlines the methodology adopted, including the timeframe, keywords, sources, exclusion criteria, and guiding research questions. Section 3 presents a historical analysis, and Section 4 examines the contemporary state of research in ASA and SIP. Section 5 discusses emerging trends and potential research gaps in these fields and Section 6 provides concluding remarks. 2 Methodology This survey investigates the development of ASA and SIP systems from their inception to the most recent advancements in the field. The review period spans from late 1980s, corresponding to the earliest documented ASA system, to the early 2020s, with the most recent studies found in this analysis. A comprehensive literature review was conducted using a keyword-based search strategy in which the following search terms were employed: ‘‘automatic singing assessment’’, ‘‘real-time visual feedback’’, ‘‘acoustical biofeedback’’, ‘‘singing information processing’’, and ‘‘karaoke scoring’’. These keywords facilitated the retrieval of relevant scholarly works, including journal articles, conference proceedings, and advanced degree dissertations, from databases such as Google Scholar 1 1 1 https://scholar.google.com/ , Scopus 2 2 2 https://www.scopus.com/home.uri , ResearchGate 3 3 3 https://www.researchgate.net/ , and Academia 4 4 4 https://www.academia.edu/ . Although ResearchGate and Academia index some non-peer-reviewed materials, only rigorously peer-reviewed publications were included in the final review. The literature surveyed spans multiple disciplines, including music education, psychology, acoustics, speech communication, and computational learning. Notable journals include the Canadian Journal of Music Education , Psychology of Music 5 5 5 https://us.sagepub.com/en-us/nam/psychology-of-music/journal201640 , Music Education Research 6 6 6 https://www.tandfonline.com/journals/cmue20 , Applied Acoustics 7 7 7 https://www.sciencedirect.com/journal/applied-acoustics , The Journal of the Acoustical Society of America 8 8 8 https://pubs.aip.org/asa/jasa , Speech Communication 9 9 9 https://www.sciencedirect.com/journal/speech-communication , and IEEE Transactions on Audio, Speech, and Language Processing 10 10 10 https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=10376 . Additionally, interdisciplinary and computational sources were examined, including the Journal of Computer Assisted Learning 11 11 11 https://onlinelibrary.wiley.com/journal/13652729 , Logopedics Phoniatrics Vocology 12 12 12 https://www.tandfonline.com/journals/ilog20 , Journal of Voice 13 13 13 https://voicefoundation.org/ , and Journal of Music, Technology & Education (JMTE) 14 14 14 https://www.atmimusic.com/journal-of-music-technology-and-education/ . Key conference proceedings relevant to acoustics, speech processing, music technology, and artificial intelligence are also included. These include the Institute of Acoustics Proceedings 15 15 15 https://www.ioa.org.uk/conference-series/institute-acoustics-proceedings , International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 16 16 16 https://ieeexplore.ieee.org/xpl/conhome/1000002/all-proceedings , INTERSPEECH 17 17 17 https://www.isca-speech.org/ , Audio Engineering Society (AES) Convention 18 18 18 https://aes2.org/event/conventions/ , and the International Society for Music Information Retrieval Conference (ISMIR) 19 19 19 https://www.ismir.net/ . Furthermore, multidisciplinary conferences such as the International Symposium on Computer Music Multidisciplinary Research (CMMR) 20 20 20 https://link.springer.com/conference/cmmr , Sound and Music Computing Conference (SMC) 21 21 21 https://smcnetwork.org/ , IEEE Visual Communications and Image Processing (VCIP) 22 22 22 https://ieeexplore.ieee.org/xpl/conhome/1800602/all-proceedings , and International Conference on New Interfaces for Musical Expression (NIME) 23 23 23 https://nime.org/ were also reviewed. This study also considered M.Sc. and Ph.D. dissertations from institutions known for their contributions to music technology and acoustics, such as the University of York 24