Ranking-based Fusion Algorithms for Extreme Multi-label Text Classification (XMTC) DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Retrieval mod
Celso França, Gestefane Rabbi, Thiago Salles, Washington Cunha, Leonardo Rocha, Marcos André Gonçalves · 2025
Read Ranking-based Fusion Algorithms for Extreme Multi-label Text Classification (XMTC) DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Retrieval mod by Celso França, Gestefane Rabbi, Thiago Salles, Washington Cunha, Leonardo Rocha, Marcos André Gonçalves (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03761.txt.
Introduction
Celso França and five co-authors improve extreme multi-label text classification by fusing the rankings of different retrievers. Assigning labels from a huge vocabulary runs into a long tail: a few head labels cover most documents, while countless tail labels appear rarely. Any single method tends to serve one end of that split.
Sparse retrievers like BM25 match words precisely, while dense retrievers over embeddings capture meaning and generalize to rare labels. Rank-based fusion merges their ordered lists, keeping exact-match strength for head labels and semantic reach for the tail. The authors develop fusion algorithms aimed at lifting effectiveness across both groups at once. The work targets applications from product tagging to document indexing.
Catalog record
| CREATOR | Celso França, Gestefane Rabbi, Thiago Salles, Washington Cunha, Leonardo Rocha, Marcos André Gonçalves |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03761
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Ranking-based Fusion Algorithms for Extreme Multi-label Text Classification (XMTC) DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Retrieval models and ranking Celso França, Gestefane Rabbi, Thiago Salles, Washington Cunha, Leonardo Rocha, Marcos André Gonçalves Abstract . In the context of Extreme Multi-label Text Classification (XMTC), where labels are assigned to text instances from a large label space, the long-tail distribution of labels presents a significant challenge. Labels can be broadly categorized into frequent, high-coverage head labels and infrequent, low-coverage tail labels , complicating the task of balancing effectiveness across all labels. To address this, combining predictions from multiple retrieval methods, such as sparse retrievers (e.g., BM25) and dense retrievers (e.g., fine-tuned BERT), offers a promising solution. The fusion of sparse and dense retrievers is motivated by the complementary ranking characteristics of these methods. Sparse retrievers compute relevance scores based on high-dimensional, bag-of-words representations, while dense retrievers utilize approximate nearest neighbor (ANN) algorithms on dense text and label embeddings within a shared embedding space. Rank-based fusion algorithms leverage these differences by combining the precise matching capabilities of sparse retrievers with the semantic richness of dense retrievers, thereby producing a final ranking that improves the effectiveness across both head and tail labels. 1. Introduction Rank-based fusion algorithms ( Bassani 2023 ) aim to assemble rankings from multiple retrieval systems to produce a unified and optimized final ranking. These algorithms perform under the assumption that aggregating evidence from diverse sources can enhance retrieval effectiveness, emphasizing consensus and mitigating individual system weaknesses. Rank-based fusion is particularly effective when the strengths of different retrieval methods are complementary. In the context of Extreme Multi-label Text Classification (XMTC), which involves assigning labels to text instances from an extremely large label space, the long-tail distribution of labels poses a significant challenge. Specifically, labels can be broadly categorized into frequent, high-coverage head labels and infrequent, low-coverage tail labels, making it challenging to balance effectiveness across all labels. Therefore, combining predictions from multiple retrieval methods, such as sparse retrievers (e.g., BM25) and dense retrievers (e.g., fine-tuned BERT), has proven effective. The fusion process enables improved label ranking by leveraging the complementary strengths of sparse and dense methods, ensuring better coverage of both head and tail labels while maintaining overall ranking quality. 2. Normalization Strategies The first step in fusing the results from multiple retrieval systems using score-based fusion methods is score normalization. This step ensures that relevance scores, which can vary significantly across retrieval models, are comparable. Normalization is crucial because different retrieval models compute relevance scores using diverse scales, intervals, and distributions. For instance, the classical probabilistic retrieval model BM25 ( Askari et al. 2023 ) generates unbounded positive relevance scores. In contrast, modern deep learning-based retrieval systems, which rely on dot products or cosine similarity to compute relevance, often produce scores that are either unbounded or constrained within a fixed interval, such as [-1,1] . To address these discrepancies, we leverage six normalization strategies: Min-Max Norm, Max Norm, Sum Norm, ZMUV Norm, Rank Norm, and Borda Norm ( Renda and Straccia 2003 ; Bassani and Romelli 2022 ; Bassani 2023 ) . Min-Max Norm Min-Max Norm scales the ranking scores to the interval [0,1] , where the minimum score is transformed to 0 and the maximum score is scaled to 1 . Max Norm Max Norm set the maximum score in the ranking to 1 with all other scores scalled proportionally. Sum Norm Sum Norm adjusts ranking scores to ensure they are proportional and sum to 1 . It achieves this by first shifting all scores such that the minimum score becomes 0 . Then, the total sum of the adjusted scores is calculated, and each score is divided by this sum. ZMUV Norm ZMUV Norm (Zero-Mean, Unit-Variance) normalizes ranking scores by transforming them into a standard normal distribution with a mean of 0 and a variance of 1 . This is achieved by first calculating the mean and standard deviation of the scores. Each score is then adjusted by subtracting the mean and dividing by the standard deviation. Rank Norm Rank Norm normalizes ranking scores by assigning values based on their position in the ranked list. The top-ranked result is assigned a score of 1, while the bottom-ranked result gets a score of \frac{1}{N} , where N is the total number of results. Borda Norm Borda Norm normalizes ranking scores by assigning decreasing points to results based on their position in the ranking. The top position receives N-1 points, the next N-2 , and so on, down to 0 points for the last position. The scores are then normalized by dividing by N-1 . 3. Fusion Algorithms We categorized the fusion algorithms into three categories: score-based methods ( Fox and Shaw 1993 ) , rank-based methods ( Mourão et al. 2015 ) and voting-based methods ( Aslam and Montague 2001 ; Montague and Aslam 2002 ) . 3.1. Score-Based Methods CombMIN CombMIN selects the minimum ranking score assigned to each document across different ranking sources. The primary rationale behind this method is to reduce the likelihood of non-relevant documents being ranked highly, as it prioritizes caution by relying on the least favorable assessment from the contributing systems. CombMAX CombMAX identifies the maximum ranking score assigned to each document across all retrieval results. This method ensures that relevant documents, even if highly ranked by only one retrieval system, are not overlooked due to poor performance by other systems. CombMED CombMED calculates the median ranking score for each document across all retrieval results. By using the median, this method provides a robust central tendency measure, mitigating the impact of extreme scores and ensuring a balanced evaluation of relevance. CombSUM CombSUM aggregates the ranking scores for each document by summing them across all retrieval systems. This straightforward approach assumes that higher cumulative scores correlate with higher relevance, thereby leveraging the collective contributions of multiple retrieval systems. CombANZ CombANZ refines CombSUM by normalizing the summed ranking scores with the number of non-zero scores for each document. This normalization ensures fairness by accounting for differences in the number of retrieval systems contributing to the document’s score. CombMNZ CombMNZ builds upon CombSUM by multiplying the summed ranking score of each document by the count of non-zero scores. This method amplifies the influence of documents supported by multiple retrieval systems, highlighting consensus among diverse retrieval strategies. 3.2. Rank-Based Methods ISR Information Synthesis Ranking (ISR) is a rank-based fusion method designed to aggregate evidence from multiple retrieval systems by assigning weights to documents proportional to their frequency of retrieval. The central assumption of ISR is that a document’s relevance is positively correlated with the number of systems that identify it as relevant. By emphasizing consensus among systems, ISR aims to improve retrieval effectiveness by leveraging the collective agreement of diverse retrieval methods. Log-ISR Log-Information Synthesis Ranking (Log-ISR) extends ISR by incorporating a logarithmic transformation into the weighting process. Instead of assigning weights directly proportional to retrieval frequency, Log-ISR scales these weights logarithmically. This adjustment mitigates the dominance of documents retrieved with exceptionally high frequency while preserving the relative importance of consensus across systems. The logarithmic scaling promotes