Surface-Form Neural Sparse Retrieval: Robust Fuzzy Matching for Industrial Music Search Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3808414 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Retrieval models and ranking
Paul Greyson, Zhichao Geng, Wei Zhang, Yang Yang · 2026
Read Surface-Form Neural Sparse Retrieval: Robust Fuzzy Matching for Industrial Music Search Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3808414 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Retrieval models and ranking by Paul Greyson, Zhichao Geng, Wei Zhang, Yang Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17762.txt.
Introduction
Paul Greyson, Zhichao Geng, Wei Zhang, and Yang Yang rebuild music search for misspelled, transposed, and phonetically varied queries under millisecond latency limits. Adapting an inference-free sparse retrieval design with short subword tokens of at most three characters, they precompute embeddings offline so live queries need only tokenization and weighting. On a six-million-document Amazon Music corpus, recall at ten jumps to 91.4% from 57.7% for trigrams, with comparable speed and better exploration in the live feedback loop.
Catalog record
| CREATOR | Paul Greyson, Zhichao Geng, Wei Zhang, Yang Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23973 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17762
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Surface-Form Neural Sparse Retrieval: Robust Fuzzy Matching for Industrial Music Search Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3808414 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Retrieval models and ranking Paul Greyson, Zhichao Geng, Wei Zhang, Yang Yang Abstract . Music search at the scale of Amazon Music presents a unique challenge: queries frequently deviate from indexed metadata due to misspellings, transpositions, and phonetic variations, yet the retrieval system must operate under strict millisecond-level latency constraints. Our existing learning-to-retrieve system, the High Confidence Index (HCI), learns query-entity associations from customer behavior, relying on continual “exploration” to choose candidates. Traditional n-gram matching enables this exploration but suffers from poor semantic robustness and high noise, limiting the system’s ability to learn from long-tail queries. In this work, we present a robust neural sparse retrieval system designed to maximize exploration efficiency. We adapt a state-of-the-art inference-free sparse retrieval architecture to the music domain, combining it with an effective domain-specific granular subword tokenization strategy . Our approach utilizes short-length token constraints (max 3 chars) to enforce the learning of surface-form robustness over lexical memorization. By pre-computing the neural embeddings and term expansions during the offline indexing phase, online processing is reduced to minimal tokenization and IDF weighting, achieving effectively zero latency overhead for query encoding. Evaluations on a 6M-document production corpus show an aggregate 91.4% recall@10 (vs. 57.7% for trigrams) at comparable throughput. Simulation of the HCI feedback loop demonstrates improved exploration efficiency, with +0.8% higher stabilized recall than production trigrams. Ablation studies indicate that our sparse training methodology drives the performance gains, while domain-specific pretraining provides a cost-effective alternative to large-scale general-purpose pretraining. † † cc-license: by 1. Introduction Music search queries frequently deviate from indexed metadata due to “query misspecifications” ranging from phonetic misspellings (“tayler” vs. “taylor”) to character variations and transpositions ( 4 ; 20 ) . As illustrated in Table 1 , these deviations present a dual challenge: the system must be robust enough to bridge significant lexical gaps yet efficient enough to meet strict millisecond-level latency budgets. Table 1. Common cases of query misspecifications in music search. Category User Query Target Entity Simple Misspelling tayler swift Taylor Swift Character Variation p!nk Pink Transposition carpenter sabrina Sabrina Carpenter Incidental Terms taylor swift songs Taylor Swift Storage Search Query “tayler swift songs” ‘‘taylor swift’’ \to Taylor Swift ‘‘tayler swift songs’’ \to Taylor Swift HCI Index Neural Sparse Fuzzy Match “tayler…” \approx “taylor…” Result Taylor Swift Customer Engagement (Click/Play) Learns Association Figure 1. HCI exploration feedback loop. Neural sparse fuzzy matching (green) enables the system to bridge the gap between misspelled queries and canonical entities. Successful customer engagement (orange) creates a permanent record in the index (dashed box), converting future fuzzy matches into exact matches. One method that Amazon Music uses to address relevance is the High Confidence Index (HCI), a learning-to-retrieve system that effectively memorizes query-entity affinities from historical engagement. However, HCI’s learning depends critically on exploration —successfully matching a query to a candidate for the first time. Currently, exploration relies on traditional trigram matching. These methods are semantically brittle and technically constrained. For instance, OpenSearch’s trigram configurations enforce minimum token lengths, discarding critical short terms such as "me". On the other hand, avoiding this loss by including whitespace tokens introduces order sensitivity that hinders matching transposed queries. As illustrated in Table 2 , they often fail to distinguish incidental terms such as “songs” in “taylor swift songs” or break under structural variations like “p!nk”, returning only exact matches or unrelated extensions. These limitations hinder the system’s ability to efficiently explore and learn from long-tail queries. Learned Sparse Retrieval (LSR) has emerged as a compelling solution to these challenges ( 10 ; 5 ) . By predicting sparse weight distributions over a vocabulary, LSR combines the contextual surface-form understanding of neural models with the efficiency of exact matching. Crucially, unlike dense retrieval ( 15 ) which requires specialized vector databases (ANN) ( 19 ; 14 ) and adds latency from online inference, LSR retains compatibility with standard inverted indices ( 2 ; 27 ) . This ensures high cost-effectiveness, seamless integration with existing production infrastructure, and inherent interpretability of matching features. Building on this paradigm, we present a robust neural sparse retrieval system optimized for strict industrial latency. While standard LSR models (e.g., SPLADE ( 10 ) ) often require costly online inference, we adopt an inference-free asymmetric architecture ( 8 ; 11 ; 26 ) . By pre-computing document representations via neural expansion during offline indexing, and using lightweight IDF weighting for online queries, we maintain the benefits of LSR with effectively zero latency overhead for query encoding. To further address query misspecifications, we adopt a data-driven granular tokenization strategy . Instead of relying on rigid n-grams, our approach learns granular sub-word patterns ( 3 ; 16 ; 25 ) directly from search logs ( 23 ; 13 ) , enabling the model to capture surface-form robustness. This allows the system to recognize the structural equivalence between variations without exact lexical matching. As demonstrated in the neural sparse column of Table 2 , this strategy robustly handles complex variations like “p!nk” and “tayler swift” that typically fail with traditional methods. Table 2. Comparison of neural sparse vs trigram matching on music queries. Scores shown in parentheses. Query Neural Sparse Trigram p!nk p!nk (22.4), p nk (20.1), pnk (18.3) p!nk (398), million dreams p!nk (28.9) tayler swift tayler swift (24.6), taylor swift (19.9), tyler swift (19.3) tayler swift (458), tayler swift & post malone (89.1) Our main contributions are: • The successful adaptation and deployment of an inference-free sparse retrieval architecture (SPLADE) to industrial music search, requiring no online neural encoding. • An empirical validation of a domain-specific, granular tokenization strategy that outperforms traditional trigrams in robust fuzzy matching. • Offline multilingual evaluations on a 6M-document production corpus showing 91.4% aggregate recall@10 (vs. 57.7% for trigrams) at comparable throughput, effectively achieving zero latency overhead for query encoding, alongside simulations demonstrating improved exploration efficiency. • Ablation studies revealing that our sparse training pipeline is the primary performance driver, and that a modest domain-specific pretraining effectively replaces large-scale general-purpose pretraining. 2. System Overview A key mechanism for fuzzy music search is the High Confidence Index (HCI), a probabilistic retrieval framework that ranks entities based on historical query-entity affinity. The system estimates the relevance score between a user query Q and an entity E through a factorization over previously observed queries Q^{\prime} : (1) \text{Score}(Q,E)\approx\sum_{Q^{\prime}\in\mathcal{I}}\underbrace{P(Q^{\prime}|Q)}_{\text{Query Sim.}}\cdot\underbrace{P(E|Q^{\prime})}_{\text{Behavioral}} Here, P(E|Q^{\prime}) represents the historical engagement probability stored in the index. Our work targets the Query Similarity term P(Q^{\prime}|Q) . Although HCI effectively serves frequent queries via exact matching, it relies on an exploration mechanism to handle novel or misspecified queries (e.g., Q= “tayler”, Q^{\prime}= “taylor”). As illustrated in Figure 1 , the system operates as a continuous feedback loop. Our Neural Sparse Retrieval module acts as the exploration engine, designed to robustly estimate P(Q^{\prime}|Q) . To meet strict latency budgets, we use an asymmetric inference-free architecture ( 11 ) :