Institute Disambiguation using Author-Institution Co-Occurrence
Achal Agrawal, Jeet Mukherjee · 2025
Read Institute Disambiguation using Author-Institution Co-Occurrence by Achal Agrawal, Jeet Mukherjee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16407.txt.
Introduction
Achal Agrawal and Jeet Mukherjee tackle a clerical headache in research data: the same institute appears under many name forms. Sorting out which forms mean the same place is called institute disambiguation, and string matching alone misses many aliases. Their method ignores the names' spelling entirely and clusters by people instead.
The clue is co-occurrence: if the same authors keep appearing with two name forms, those forms likely name one institute. Working only from author and affiliation records in fifty thousand Crossref articles, the clustering gives encouraging results. Its catches differ from a leading string-matching method, so the two complement each other. Combined, they can supply aliases exactly where string matching fails. The code is open source, and the authors expect scale to sharpen it further.
Catalog record
| CREATOR | Achal Agrawal, Jeet Mukherjee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 9 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16407
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Institute Disambiguation using Author-Institution Co-Occurrence Achal Agrawal, Jeet Mukherjee Abstract In this article we propose a novel method to perform unsupervised clustering of different forms of Institute names. We use only author and affiliation metadata to perform the clustering without any string or pattern matching. After analysing only 50000 articles from Crossref database, we see encouraging results which can be scaled up to provide even better results. We compare our clustering with what a well-known method using string matching does and found that the results were complementary. This can help perform institute disambiguation better when integrated with existing systems, especially to provide aliases for cases where traditional string matching fails. The code of this open-source methodology can be found at: Github keywords Institute Disambiguation, MetaScience, Affiliation Mapping, Publication Statistics, Bibliometrics 1 Introduction Institute Name Disambiguation (IND) has traditionally been a challenging problem. There have been multiple approaches towards solving this problem but most methods incorporate some sort of string comparisons like in Huang Huang et al. 2014 and Adam 2025 . In this paper, we depart somewhat from the norm by using the contextual information present in the Author-Institute co-occurrence. The rationale behind it is quite simple. Same author can write the affiliation in different ways. By using authors as the context, we can link the institutes which have the same author. This method might seem somewhat crude as it can potentially have noise due to same author having published with different affiliations. Moreover, two different authors could share the same name and their institutes might again get linked. However, with a sample of just author-institution pairs of 50000 papers and a few elementary filters, we show that this method is remarkably effective. It’s unreasonable effectiveness merits further investigation and refinement. This method is inspired from word2vec, which found similarity between words occurring in the same context. In this case, we are also using authors as context and assigning similarity based on affiliations which co-occur with the same authors. As a proof of concept, we concentrated on disambiguating Universities in India. This is challenging for most databases as this region usually has less coverage. 2 Data and Methodology For this study, we considered Crossref metadata of 50000 papers from India published in 2025. Overall there were 150604 unique author names and 77484 unique affiliation names. We did very basic cleaning of institution names by removing any leading numbers that might have crept in the metadata. The method itself comprises of four minor steps outlined in Fig. . • Creation of Author-Affiliation Matrix : Firstly we convert the unstructured metadata into structured data where Authors are the rows and the affiliations in the papers are the columns. This matrix merely records which author used which affiliation string how many times. • Creation of Binary Mask : Next, we create a binary mask of the Author-Affiliation matrix. This is to ensure that prolific authors do not skew the calculations. • Parallelized Calculation of Co-Occurrence Matrix : This is the most crucial step as it requires a lot of computation. To make it efficient, we simplify the calculation as a mere matrix multiplication and leverage parallelization of TPUs to be able to process 50,000 papers in the free tier. • Threshold Based Graph Analysis : In this step we consider a graph based on the co-occurrence matrix where each string is a node and the weight is the co-occurrence of the two strings. The threshold helps in controlling the precision of the results of the method. Creation of Author–Affiliation Matrix Create a Binary Mask Parallelised Calculation of Co-Occurrence Matrix Threshold Based Graph Analysis Univ A Univ B Univ C Author 1 2 1 0 Author 2 0 0 3 Univ A Univ B Univ C Author 1 1 1 0 Author 2 0 0 1 Univ A Univ B Univ C Univ A 1 1 0 Univ B 1 1 0 Univ C 0 0 1 Univ A Univ B Univ C Figure 1: Steps involved to perform the clustering. This is different from most Institute Disambiguation Methods as it does not perform any string matching 3 Results To cluster the various strings, we perform graph analysis and each connected component corresponds to a cluster. One can check out the results for different thresholds. https://postpub.netlify.app . 3.1 Effect of Threshold We see that threshold, i.e. the number of times different forms of the university co-occur, is an important parameter while forming the graph. To see the effect of the threshold, In Fig. 2 and Fig. 3 we plot the biggest cluster in the graph for two different thresholds. In Fig. 2 we see that while for a smaller threshold of three, we have many more nodes in the cluster, there are a few errors too. Notably two clusters of different branches of the same university got clustered with it. When the threshold is increased to 4 (Fig. 3 ), the errors disappear. However the cluster also becomes smaller. This shows the tradeoff between precision and recall. With a much bigger dataset, it will be possible to create more robust graphs. Figure 2: Threshold 3 : In this figure, we see that the different forms of writing AIIMS New Delhi neatly cluster together. However, there are a few errors marked in red. These are clusters of different branch of the same university. AIIMS Jodhpur and AIIMS Rishikesh. This can be mitigated by increasing the threshold to 4, it performs better with many more forms of AIIMS New Delhi identified. Figure 3: Threshold 4 : Higher threshold leads to fewer connected nodes, which is to be expected. However, it also leads to no errors. It shows that threshold forms an important parameter to control the performance of the algorithm. Higher Threshold leads to higher precision but lower recall. 3.2 Ability to distinguish between different branches of the same institute A lot of institute disambiguation algorithms fail to differentiate between different branches of the same institute as most of the strings and words match. Using our method however, it automatically manages to put different branches in different clusters as seen in Fig. 4 . This is quite useful as doing so manually could be quite tedious. Figure 4: Threshold 4 : In this figure, we see the third biggest connected component. It is another branch of AIIMS located in another city. The algorithm manages to distinguish between the two as it is not based on string matching. 3.3 Comparison with String Matching Algorithms One of the more popular algorithm for IND is Huang et al. 2014 which uses string matching to create clusters. To check the complementarity of the approaches, we passed the biggest connected component from our algorithm with threshold 3 (99 entries in total). 27 correct strings of the 99 strings were not clustered by this method at all. Even the ones which were clustered were broken into smaller clusters by the algorithm. The biggest cluster created by this algorithm had only 13 components which is much lesser than 28 components for our algorithm with a greater threshold. However, the clusters made by Huang et al. 2014 had very high precision with almost no false positive. It shows that the two approaches are complementary