Semantic Centroids and Hierarchical Density-Based Clustering for Cross-Document Software Coreference Resolution
2026
Read Semantic Centroids and Hierarchical Density-Based Clustering for Cross-Document Software Coreference Resolution (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24246.txt.
Introduction
Matela and Krüger describe a system for matching software mentions across scientific documents. The system entered the SOMD 2026 shared task on cross-document coreference. It mixes dense embeddings from a Sentence-BERT model with a knowledge base lookup built from training cluster centers. FAISS speeds retrieval, and HDBSCAN clusters mentions that match nothing with confidence. Name normalization and abbreviation handling improve matching. A blocking strategy adapts the pipeline to the largest subtask. It scores CoNLL F1 of 98, 98, and 96 percent on the three subtasks.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14336 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24246
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semantic Centroids and Hierarchical Density-Based Clustering for Cross-Document Software Coreference Resolution Abstract This paper describes the system submitted to the SOMD 2026 Shared Task for Cross-Document Coreference Resolution (CDCR) of software mentions. Our approach addresses the challenge of identifying and clustering inconsistent software mentions across scientific corpora. We propose a hybrid framework that combines dense semantic embeddings from a pre-trained Sentence-BERT model, Knowledge Base (KB) lookup strategy built from training-set cluster centroids using FAISS for efficient retrieval, and HDBSCAN density-based clustering for mentions that cannot be confidently assigned to existing clusters. Surface-form normalization and abbreviation resolution are applied to improve canonical name matching. The same core pipeline is applied to Subtasks 1 and 2. To address the large scale settings of Subtask 3, the pipeline was adapted by utilising a blocking strategy based on entity types and canonicalized surface forms. Our system achieved CoNLL F1 scores of 0.98, 0.98, and 0.96 on Subtasks 1, 2, and 3 respectively. Keywords: Software Mention Detection, Cross-Document Coreference Resolution, Sentence Embeddings, HDBSCAN, Scalable NLP Semantic Centroids and Hierarchical Density-Based Clustering for Cross-Document Software Coreference Resolution Julia Matela, Frank Krüger Department of Electrical Engineering and Computer Science, Wismar University of Applied Sciences Wismar, Germany [email protected] Abstract content 1. Task and Data The SOMD 2026 Shared Task addresses an issue of cross-document coreference resolution (CDCR). The task is structured into three subtasks. For each subtask participants are provided with a set of software mentions that were extracted from SoMeSci 7 and SoftwareKG 8 . The objective is to partition them into clusters such that each cluster contains mentions that refer to the same underlying software. The dataset for Subtask 1 consists of gold-standard annotated mentions. The training set contains 2974 mentions partitioned into 733 clusters and the test set contains 743 mentions. Subtask 2 and 3 both use automatically predicted mentions from an upstream extraction pipeline, introducing potential noise. The training set contains 2860 mentions assigned in 699 clusters and is identical for Subtask 2 and 3. The test set for Subtask 2 contains 12516 mentions. Subtask 3 creates additional computational challenges with a 219950-mention test set. 2. System Description Our pipeline follows a three-stage architecture: (1) semantic representation and KB centroid construction from training data, (2) test-mention assignment to existing KB clusters via FAISS ( 2 ) retrieval and exact string matching, and (3) density-based clustering of unmatched mentions via HDBSCAN. Figure 1 illustrates the complete pipeline. Figure 1: System Description 2.1. Semantic Representation The semantic representation stage of our pipeline transforms each software mention into a normalized 384-dimensional embedding that captures both the surface-form identity and the structured context of the mention. 2.1.1. Context String Construction Software entities in scientific text are highly ambiguous. The same tool may be referred to by its full name ( Statistical Package for the Social Sciences ), an acronym ( SPSS ), or a version-qualified variant ( SPSS 28 ). The surface form itself is therefore insufficient for the task of cross-document coreference resolution. For that reason, we construct a short, structured context string c(m) for each mention m : c(m)=\underbrace{\text{mention}\parallel\text{mention}}_{\text{weighted anchor}}\parallel\text{type}\parallel\underbrace{\text{rel}_{1}\parallel\text{rel}_{2}\parallel\cdots}_{\text{relational context}} (1) where \parallel denotes whitespace-separated concatenation. The string is built from three components. First, the mention surface form is lowercased and duplicated. Second, the entity type label (e.g., application , plugin ) is appended in its original casing. Third, the surface forms of all relational mentions present in the metadata are appended. Since the software name is the primary coreference signal, the embedding must be anchored to it rather than to surrounding metadata. Mean-pooling distributes representational weight evenly across all input tokens, so a long metadata-heavy string risks diluting the name’s contribution and causing so called semantic drift . We counteract this by duplicating the surface form mention token 10 , effectively increasing its weight in the final embedding. 2.1.2. Sentence Embedding with all-MiniLM-L6-v2 Context strings are encoded with the all-MiniLM-L6-v2 Sentence-BERT model ( 6 ) . The all-MiniLM-L6-v2 checkpoint combines this fine-tuning strategy with the MiniLM compression method ( 9 ) , which distills a 12-layer BERT teacher into a compact 6-layer, 384-dimensional student by mimicking the teacher’s self-attention distributions in the final layer. The result is a model of approximately 22 million parameters, roughly five times smaller than BERT-base, that retains competitive semantic similarity performance while encoding around 14,000 sentences per second on a standard CPU as stated by the developers ( 4 ) . This throughput is decisive for Subtask 3, where the mention inventory is an order of magnitude larger than in Subtasks 1 and 2. Pooling and normalization. Token representations from the final Transformer layer are aggregated by attention-mask-weighted mean pooling: \mathbf{e}(m)=\frac{\sum_{i}a_{i}\mathbf{h}_{i}}{\sum_{i}a_{i}} (2) where \mathbf{h}_{i}\in\mathbb{R}^{384} is the i -th token representation and a_{i}\in\{0,1\} is its attention mask value. The pooled vector is then L_{2} -normalized to unit length, converting cosine similarity into an inner product and enabling efficient search via the FAISS IndexFlatIP index ( 2 ) . 2.2. Knowledge Base Centroid Construction For the training set, we compute a single L_{2} -normalized centroid vector for each gold cluster by averaging the embeddings of all member mentions and re-normalizing. These centroids form a Knowledge Base (KB) of known software identities. During inference, test mentions are queried against these centroids using FAISS for efficient Inner Product (cosine) similarity search. 2.3. Test-Mention Assignment Each test mention is either assigned to a KB cluster, or flagged as unmatched following the procedure: 1. Exact string match (Subtask 3). If the lowercase and stripped canonical name of a test mention is found within the KB string dictionary derived from training data, the corresponding cluster is assigned. 2. High-confidence semantic match. If the cosine similarity to the closest KB centroid exceeds a threshold of \theta=0.7 , the mention is allocated to that cluster. This threshold was determined through empirical evaluation of various values on the training data. 3. Medium-confidence string-corroborated match (Subtasks 1 and 2) If the similarity is lower than a threshold of 0.7, but higher than 0.5 and the mention’s canonical name is present in the KB string dictionary, the existing cluster is prioritized. This handles mentions where a canonical name match is present, but the embedding similarity is reduced due to too much contextual noise in the embedding. 4. Flagging as unmatched. All mentions that do not meet the criteria in the preceding steps are passed to the density clustering stage. 2.4. Normalization and Abbreviation Handling To handle variations like SPSS vs Statistical Package for Social Sciences , we implement a canonicalization step. We extract Abbreviation relations from the metadata to build a mapping from short-form to long-form names. Surface forms are then normalized by lowercasing and removing non-alphanumeric characters. 2.5. Clustering Unmatched Mentions Mentions that fail to match the KB are processed via HDBSCAN 1 , a density-based algorithm that does not require a pre-specified number of clusters and handles outliers by assigning them to singleton clusters. To ensure scalability in Subtask 3, we utilize a blocking strategy before clustering. Mentions are first partitioned by the entity type. For blocks exceeding 20,000 mentions, we further partition by the first letter of the canonical name. This reduces the complexity of distance-matrix computation from O(n^{2}) over the full unmatched set to O\left(\sum_{k}n_{k}^{2}\right) over smaller