DEMUN: Fast and accurate discovery of music notation in very large collections
Vojtěch Dvořák, Filip Bím, Jiří Mayer, Martina Dvořáková, Markéta Herzanová Vlková, Pavel Pecina, Petr Žabička, Jan Hajič jr · 2026
Read DEMUN: Fast and accurate discovery of music notation in very large collections by Vojtěch Dvořák, Filip Bím, Jiří Mayer, Martina Dvořáková, Markéta Herzanová Vlková, Pavel Pecina, Petr Žabička, Jan Hajič jr (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31956.txt.
Introduction
Dvořák and seven colleagues present DEMUN, a detector that finds music notation hiding in huge digitized library collections. Sheet music often sits inside textbooks, newspapers and pamphlets that catalogues never marked as music. Such pages are extraordinarily sparse in national collections, so any finder needs a near-zero false positive rate and real speed.
A two-stage lightweight detector reaches a false positive rate of 0.015 percent in the reported test, low enough to stay useful at scale. Four million images from a national-scale library were processed, turning up 1,500 pages with music notation. The team estimates the full collection may hold 20,000 to 30,000 unmarked documents bearing on everyday musical life.
Catalog record
| CREATOR | Vojtěch Dvořák, Filip Bím, Jiří Mayer, Martina Dvořáková, Markéta Herzanová Vlková, Pavel Pecina, Petr Žabička, Jan Hajič jr |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.31956
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DEMUN: Fast and accurate discovery of music notation in very large collections Vojtěch Dvořák, Filip Bím, Jiří Mayer, Martina Dvořáková, Markéta Herzanová Vlková, Pavel Pecina, Petr Žabička, Jan Hajič jr Abstract Much of written musical heritage is preserved and digitised at memory institutions: libraries, museums, and archives. Owing to their collection structures, sheet music tends to be concentrated in large subsets that are defined as collections of music, with corresponding metadata that makes the music findable. However, when studying musical life as opposed to individual works, relevant documents often lie outside of these specialised collections: in textbooks, newspapers, other periodicals, pamphlets, and other documents with extensive circulation. But these documents are typically not catalogued as musical documents, and though there may be a lot of such documents overall, in large library collections, they are still extremely sparse. Manual discovery is thus unfeasible. Automated discovery requires an extremely low false positive rate in order to be useful, and must also operate quickly. We present DEMUN: a two-stage lightweight detector of music notation with a false positive rate of 0.015 %. In the test scenario, 4 million images of a national-scale library were processed, out of which 1,500 pages with music notation were discovered, suggesting the entire collection may contain up to 20-30,000 unmarked documents of musical life. 1 Introduction Optical Music Recognition (OMR) systems start from a document containing music notation [ 7 ] , and it is the user’s responsibility to feed such images to the system. However, an unknown but possibly significant portion of sheet music in archival and library collections is not marked as music notation in its metadata, so it will never be presented to an OMR system, and will remain undiscoverable. This probably does not concern important music, in the sense that one would discover new gems of repertoire among such unmarked pages: these would likely have been parts of musical collections before the digitization process started, and therefore would have been a priori marked as sheet music. However, these documents may be spread around textbooks, songbooks, magazines, pamphlets, or newspapers, and they represent an untapped source of insight into musical life outside its formal centres (orchestras or opera houses), especially as the urban and musically literate population grew in the late 18th and throughout the 19th centuries. Furthermore, fragments of notation from earlier documents are often found as material re-used for bindings of newer books, which has the potential to entirely change perspectives on musical life in earlier periods: for example, a fragment of Notre Dame polyphony was accidentally discovered in a 14th-century book on horticulture from Prague that opens the possibility that this French repertoire was actually known and practised in the eastern reaches of the Holy Roman Empire [ 32 ] . A complete medieval chant book from Hungary has been reconstructed this way from fragments found in different book bindings in the library of Zagreb [ 1 ] . A collection of documents with music notation discovered throughout gathering data for this work is shown in Figure 1 . Figure 1: Examples of music notation found outside of documents with metadata marking them as sheet music. From the point of view of machine learning, discovering such documents is low-hanging fruit. European notations that use the staff are especially visually distinct, but other systems such as jianpu, suzipu, or jeongganbo are rather distinct as well. Document image classification with deep learning is by now an undergraduate-level exercise. The challenge, however, is scale and sparsity. By definition, we want to discover sheet music anywhere. In the case of the Moravian Library, this means processing over 70.000.000 images. If thousands of musical documents remain to be discovered, which has the potential to significantly influence the overall picture of musical life, this is still less than 0.1 % of the total number of pages: the classification problem is extremely unbalanced. This means that the false positive rate (FPR) must be extremely low, otherwise results will be swamped with false positive results. Each 1 % of FPR at 10^{7} pages means 100.000 spurious results: 99 % precision is not good enough. At the same time, even if the entire pipeline — from sending a request to the library’s image servers to producing a result — averaged 0.1 s per image, processing the Moravian Library collection would still take 80–90 days. Much could be parallelised, but libraries typically do not have the in-house computing resources with capacity for such a task; therefore, networking introduces an additional potential bottleneck. In this work, we present DEMUN: a real-world music notation discovery system that works at library scales. With a two-stage classification architecture that decreases networking load by two orders of magnitude, we increase the concentration of music notation in the system output from an estimated 1:2600 to 3:1, achieving a false positive rate of 0.015 %. The false negative rate is hard to quantify, but we estimate it at no more than 10 %. Additionally, we contribute the OMRA dataset for classifying music notation. The detection results indicate that more than 20.000 pages with music notation remain to be discovered; processing the entire Moravian Library collection is ongoing. 2 Related work Document image classification for digital libraries has long been known as an important task [ 4 ] , but it has come to its own primarily with the advent of deep learning [ 20 ] ; it was known to be of interest [ 10 ] , but prior to DL, production-ready results were very difficult to obtain (with the notable exception of invoice region classification by HMMs on XY-trees [ 12 ] , illustrating how domain-dependent accuracy has been). Earlier work on document classification in libraries primarily focused on classifying documents into genres based on their text, especially for scientific libraries [ 27 , 8 , 34 ] , not necessarily what the pages looked like; combination of OCR and image processing for document classification has since also been performed [ 18 , 2 ] . Speed has also been a concern: already in 2017, a throughput over 800 images per second at inference time was achieved with a pre-trained CNN [ 21 ] , though only on a GPU and not at the production-level accuracy required by the sparsity of music notation data. In the broader cultural heritage domain, image classification has been applied to various materials: architectural images [ 23 ] , archaeological photos [ 5 ] , artistic images [ 9 ] , or detecting rail and building objects on old maps [ 16 ] . Digitised books have been classified by print type classification [ 17 ] . The increased focus on image data rather than texts has been termed the “visual turn” in the digital humanities [ 33 ] . We have conspicuously left out images of music notation so far. Why? Because surprisingly little has actually been done on this task. In the context of OMR, it is left out of scope by the seminal Understanding OMR paper [ 7 ] by the definition of OMR as “reading music notation from documents” provided there: but the document must first be supplied, which is barely mentioned. In library settings, OMR has focused more