Improving Community Detection in Academic Networks by Handling Publication Bias

Md Asaduzzaman Noor, John Sheppard, Jason Clark · 2025

Read Improving Community Detection in Academic Networks by Handling Publication Bias by Md Asaduzzaman Noor, John Sheppard, Jason Clark (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20449.txt.

Introduction

Noor and co-authors build a network for matching researchers with collaborators, based on what people write about rather than whom they cite. Their topic-based network uses a topic model with a science-tuned language model to link researchers across fields by shared interests. A distortion worries them: prolific authors publish across many topics, so their minor interests drown under their main ones and the network misses links.

Their fix is cloning. Each author's publications are clustered by topic, and every cluster becomes its own node, letting one person belong to several communities at once. Judged on the resulting groups, the cloned network produced more meaningful communities than the plain one. It also surfaced a wider range of possible collaborations, which the authors offer as the practical payoff for interdisciplinary teams.

Catalog record

CREATORMd Asaduzzaman Noor, John Sheppard, Jason Clark
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20449

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improving Community Detection in Academic Networks by Handling Publication Bias Thanks: This paper is an extended version of a work accepted at ASONAM 2025. Md Asaduzzaman Noor, John Sheppard, Jason Clark Abstract Finding potential research collaborators is a challenging task, especially in today’s fast-growing and interdisciplinary research landscape. While traditional methods often rely on observable relationships such as co-authorships and citations to construct the research network, in this work, we focus solely on publication content to build a topic-based research network using BERTopic with a fine-tuned SciBERT model that connects and recommends researchers across disciplines based on shared topical interests. A major challenge we address is publication imbalance, where some researchers publish much more than others, often across several topics. Without careful handling, their less frequent interests are hidden under dominant topics, limiting the network’s ability to detect their full research scope. To tackle this, we introduce a cloning strategy that clusters a researcher’s publications and treats each cluster as a separate node. This allows researchers to be part of multiple communities, improving the detection of interdisciplinary links. Evaluation on the proposed method shows that the cloned network structure leads to more meaningful communities and uncovers a broader set of collaboration opportunities. Keywords: Community detection, Collaboration recommendation, Topic-based scholarly network, BERTopic, Social network analysis 1 Introduction Research collaboration plays a crucial role in advancing scientific discovery, often leading to more impactful and interdisciplinary outcomes. As the volume of scholarly publications continues to grow, recommending meaningful collaborations has become an increasingly challenging problem in the research community. Most existing approaches rely on observable relationships, such as co-authorship or citation networks, to recommend collaborators. While effective to some extent, these methods tend to reinforce known connections, missing opportunities to connect researchers based on shared topical interests. We argue that topical similarity, which can be derived from publication content, is a powerful relation for identifying potential collaborations. Two researchers working on similar themes may never have co-authored a paper or even be aware of each other’s work. By looking at what researchers are actually publishing, we can uncover hidden connections and make collaboration recommendations that are more diverse, going beyond the usual disciplinary lines. Although prior work has leveraged publication data, most focus narrowly on ranking collaboration candidates based on content similarity scores. These models typically provide limited interpretability, offering little beyond a top- k list with abstract relevance scores. In contrast, social network analysis (SNA) offers a broader perspective. Not only does it enable content-based recommendations, but it also reveals how researchers are organized around shared interests, highlights influential nodes, and offers more interpretable, community-driven insights through network structures and visualizations. In this work, we construct a scholarly network entirely based on topic similarity, using basic metadata (publication titles and abstracts) to group researchers by shared research themes. This builds on our prior work [ 14 , 15 ] , where we demonstrated that content-based networks can enhance the novelty and diversity of collaboration recommendations. However, one key challenge we address in this paper is possible imbalance in publication counts across researchers. High-output researchers often work on multiple topics, but their less frequent interests are overshadowed by their dominant ones when building similarity-based networks. As a result, meaningful connections between those smaller topics can be missed. To address this, we introduce a cloning strategy for highly productive researchers. By clustering their publications into coherent topical groups, we create multiple “clones” that represent distinct research areas. This allows these researchers to participate in multiple communities, improving the detection of diverse and interdisciplinary collaborations. Our key contributions are: • We propose a cloning-based strategy to handle publication imbalance, enabling more accurate and diverse community detection. • We construct a topic-based researcher similarity matrix with clones using BERTopic applied to publication titles and abstracts. • We evaluate the quality of the resulting communities empirically and demonstrate the benefits of our approach for collaboration recommendations. 2 Related Work One of the key goals of researcher social network analysis is to provide potential research collaboration recommendations. Most existing work in this area relies heavily on direct relationships between researchers, such as co-authorship or citation links, to suggest collaborators or identify research communities. While effective to some extent, these approaches often overlook the topical diversity of individual researchers, limiting the ability to connect them based on shared research interests. Earlier work often considered collaboration recommendation as a link prediction problem, where the goal is to infer new or future connections within the network. For instance, Nowell et al. [ 12 ] constructed co-authorship networks and proposed prediction methods based on vertex neighborhoods and network path ensembles. Later, Backstrom et al. [ 1 ] introduced supervised random walks on co-authorship networks to improve link prediction. Several hybrid approaches were also proposed that combined direct relationships with content-based features to improve recommendation quality. Yang et al. [ 21 ] integrated research expertise, co-authorship, and institutional ties, using a language model for semantic similarity and an SVM-Rank framework for matching. Kong et al. [ 10 ] built a co-authorship network, applied Word2Vec to publication titles, and used clustering and cosine similarity within a Random Walk model. Zhou et al. [ 22 ] created a multidimensional academic network using ResearchGate data and introduced time-aware edge weights, favoring recent collaborations with an improved Random Walk algorithm. All of the above hybrid methods rely on some form of direct link to construct the network, which limits their ability to identify entirely new, interdisciplinary collaborations. They tend to reinforce existing connections rather than explore potential new connections. Other work has used only publication data to drive recommendations. Liang et al. [ 11 ] used LDA to model research fields and compared topic vectors to suggest cross-disciplinary collaborations. Kong et al. [ 9 ] proposed the BCR model, incorporating evolving interests and academic influence via time-weighted topic distributions and cosine similarity. Existing content-based approaches often focus on document similarity to generate top- k recommendations. However, we argue that such models can lack interpretability, providing only similarity scores without much explanation. By integrating social network analysis into content-based data, we aim to make the recommendation process more transparent and informative. Community detection, in particular, goes beyond isolated suggestions, offering a structural view of researcher clusters, topic distributions, and key participants. In this work, we construct a research network using topic-based similarity between researchers while accounting for publication count imbalance to ensure fairer and more meaningful community detection. To our knowledge, this is the first effort to address publication imbalance explicitly in topic-based community detection for research collaboration. 3 Dataset To build the researcher dataset, we used Montana State University’s (MSU) current faculty list and retrieved their publication history using OpenAlex [ 17 ] , an open source API for accessing scholarly metadata. We collected publication titles, abstracts, and author IDs from 2004 to 2025 for papers affiliated with MSU faculty. In total, we extracted metadata for 9,768 publications. To ensure meaningful topic distributions for our network construction, we excluded researchers with fewer than five publications. This resulted in a final dataset of 296 faculty members, with a maximum of 190 publications for a single researcher and mean and median publication counts of 33 and 22 , respectively.

Read the complete text