How Do We Engage with Other Disciplines? A Framework to Study Meaningful Interdisciplinary Discourse in Scholarly Publications

Bagyasree Sudharsan Alexandria Leto Maria Leonor Pacheco · 2026

Read How Do We Engage with Other Disciplines? A Framework to Study Meaningful Interdisciplinary Discourse in Scholarly Publications by Bagyasree Sudharsan Alexandria Leto Maria Leonor Pacheco (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17020.txt.

Introduction

Bagyasree Sudharsan, Alexandria Leto, and Maria Pacheco ask how papers reach past their own field. Cross-field work grows as schools push for it. Past gauges count who wrote a paper, or its words. Those gauges miss how cites are used in the text. A cite may back a claim or be mere decor. Their 2026 preprint builds a frame for that use.

The frame reads what each cite does for the host work. It sorts cites by their role in the chain of proof. Roles show if fields truly blend or just touch. Such reads can guide funds for cross-field work. They may also show which blends bear real fruit.

Catalog record

CREATORBagyasree Sudharsan Alexandria Leto Maria Leonor Pacheco
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17020

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

How Do We Engage with Other Disciplines? A Framework to Study Meaningful Interdisciplinary Discourse in Scholarly Publications Bagyasree Sudharsan Alexandria Leto Maria Leonor Pacheco Abstract With the rising popularity of interdisciplinary work and increasing institutional incentives in this direction, there is a growing need to understand how resulting publications incorporate ideas from multiple disciplines. Existing computational approaches, such as affiliation diversity, keywords, and citation patterns, do not account for how individual citations are used to advance the citing work. Although, in line with addressing this gap, prior studies have proposed taxonomies to classify citation purpose, these frameworks are not well-suited to interdisciplinary research and do not provide quantitative measures of citation engagement quality. To address these limitations, we propose a framework for the evaluation of citation engagement in interdisciplinary Natural Language Processing (NLP) publications. Our approach introduces a citation purpose taxonomy tailored to interdisciplinary work, supported by an annotation study. We demonstrate the utility of this framework through a thorough analysis of publications at the intersection of NLP and Computational Social Science. 1 Introduction Interdisciplinary research involves the integration of concepts, perspectives, theories, methods, and data from two or more bodies of specialized knowledge to construct creative solutions National Academy of Sciences et al. 2005 . Meta-analyses of how interdisciplinarity manifests in the scientific literature are therefore essential for understanding the convergence of, and interplay between, different fields. This definition highlights knowledge integration as a central component of interdisciplinarity, suggesting that it should be assessed not only in terms of its extent but also the quality with which ideas are meaningfully combined. However, much of the existing meta-analytic work has focused on broad, scalable indicators (e.g., diversity and entropy of citations) Porter and Rafols 2009 ; Van Noorden 2015 ; Cassi et al. 2017 ; Qun and Menghui 2023 that emphasize the quantity and diversity of knowledge sources, but offer limited insight into how deeply or substantively those sources are integrated. For example, an article may cite a broad set of disciplines in its Introduction or Related Work sections without substantively engaging with them, such as by explicitly building on their ideas or using them to inform methodological choices. To truly understand the depth of engagement across fields, it is necessary to look beyond traditional measures and assess the role of interdisciplinary citations within the context of the citing work. Figure 1: Framework for evaluating a publication’s level of engagement with citing work. Motivated by these challenges, we propose an approach to derive meaningful insights into the nature of interdisciplinary citations building on the framework of Leto et al. 2024 . Starting from the hypothesis that the section in which a citation appears signals different levels of engagement, their framework extracts in-text citations from interdisciplinary papers along with the section in which they occur and an indicator of whether the cited work is out-of-discipline relative to the citing paper. We extend this framework by introducing a novel taxonomy to represent the purpose of an author in including a given citation. Although numerous citation-purpose classification schemes have been proposed Jurgens et al. 2018 ; Abu-Jbara et al. 2013 ; Lauscher et al. 2022 ; Cohan et al. 2019 ; Teufel et al. 2006 ; Pride and Knoth 2020 , existing taxonomies are insufficient for analyzing interdisciplinary citations, either because they lack relevant categories, include categories that are ill-suited to cross-disciplinary contexts, or fail to incorporate adequate contextual information. Our taxonomy addresses these limitations by situating each citation within its local argumentative context and characterizing citation purpose through categories designed to reflect the different forms of interdisciplinary engagement that arise when authors draw on work beyond their primary field. The taxonomy was developed from the ground up through an inductive annotation study, allowing categories to emerge from close analysis of real citation practices rather than being imposed a priori. We ground our taxonomy development, annotation study, and analysis in the context of Natural Language Processing (NLP) research, positioning these contributions as a first step toward a broader framework for studying interdisciplinary engagement. We focus specifically on work at the intersection of NLP and Computational Social Science (CSS). Although research in this area has grown substantially over the past decade Grimmer and Stewart 2013 , the quality of NLP+CSS publications has been questioned, with critiques arguing that such work often falls short of social science standards of rigor Baden et al. 2022 and makes limited substantive contributions to those fields McCarthy and Dore 2023 . In this work, we use our framework to further examine these concerns and to evaluate the extent to which citation engagement can be reliably studied at scale, including through the use of automated methods. We make the following contributions 1 1 1 Data can be found here . : (1) We develop a novel annotation framework designed to capture citation purpose in interdisciplinary NLP work. (2) We present an annotation study of the citation purpose taxonomy and a resulting annotated dataset of 394 annotated in-text citations taken from NLP+CSS work. (3) We demonstrate the usefulness of our annotation framework through an analysis of our manually-annotated dataset. (4) We evaluate the capacity of state-of-the-art language models to automatically annotate citations according to our taxonomy and identify key limitations that must be addressed to enable a fully automated pipeline for studying interdisciplinary engagement. 2 Related Work Numerous studies have introduced frameworks for classifying citation purpose or intent, but these approaches are not designed to capture how authors engage with references from outside their primary discipline. For example, Jurgens et al. 2018 and Pride and Knoth 2020 introduce datasets that are heavily dominated by a Background category designed to denote when a reference provides relevant information for the domain of the article. By treating all background citations as equivalent, this definition fails to distinguish between references that provide foundational knowledge necessary for interpreting the work and those that merely provide general or loosely related context. Similarly, their Extension category is narrowly defined to apply only when authors directly extend a method or dataset; a scenario that is relatively rare in interdisciplinary contexts, where engagement often takes other forms. In addition, their framework relies on a fixed citation context of approximately 300 surrounding characters, which may be insufficient to capture the broader argumentative role needed to accurately determine citation purpose. Lauscher et al. 2022 and Abu-Jbara et al. 2013 address this limitation by considering a window of sentences surrounding each citation — an approach that we adopt in this work. Teufel et al. 2006 propose a highly fine-grained scheme for classifying citation function, with multiple sub-categories that distinguish forms of comparison and contrast. While this level of detail can be valuable, the resulting categories primarily capture evaluative stance and intra-discipline relations such as direct comparison and contrast. Additionally, their dataset labels over 60% of citations as Neutral , limiting its usefulness to distinguish meaningful forms of engagement. In contrast, our scheme places only 33% of citations into similar general categories, allowing for finer differentiation among types of interdisciplinary use. At the opposite side of the spectrum, Cohan et al. 2019 introduce a taxonomy with only three high-level categories, which are too coarse-grained to adequately capture variation in the depth of citation engagement

Read the complete text