Nested Named Entity Recognition in Plasma Physics Research Articles
Muhammad Haris, Hans Höft, Markus M. Becker, Markus Stocker · 2026
Read Nested Named Entity Recognition in Plasma Physics Research Articles by Muhammad Haris, Hans Höft, Markus M. Becker, Markus Stocker (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11163.txt.
Introduction
Plasma physics papers hide entities that ordinary tools miss. Muhammad Haris and three co-authors apply nested named entity recognition to plasma physics articles, where entities nest inside one another and context runs dense. Their approach pairs encoder models with conditional random fields.
They annotate a plasma corpus with sixteen entity classes built for nesting, train separate models per entity type, and tune hyperparameters in a systematic sweep. The result is a lightweight pipeline for advanced search and literature navigation in plasma science. The paper also lays a foundation for researchers who need to find and compare specialized entities across many papers.
Catalog record
| CREATOR | Muhammad Haris, Hans Höft, Markus M. Becker, Markus Stocker |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-11163
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nested Named Entity Recognition in Plasma Physics Research Articles Muhammad Haris, Hans Höft, Markus M. Becker, Markus Stocker Abstract Named Entity Recognition (NER) is an important task in natural language processing that aims to identify and extract key entities from unstructured text. We present a novel application of NER in plasma physics research articles and address the challenges of extracting specialized entities from scientific text in this domain. Research articles in plasma physics often contain highly complex and context-rich content that must be extracted to enable, e.g., advanced search. We propose a lightweight approach based on encoder-transformers and conditional random fields to extract (nested) named entities from plasma physics research articles. First, we annotate a plasma physics corpus with 16 classes specifically designed for the nested NER task. Second, we evaluate an entity-specific model specialization approach, where independent BERT–CRF models are trained to recognize individual entity types in plasma physics text. Third, we integrate an optimization process to systematically fine-tune hyperparameters and enhance model performance. Our work contributes to the advancement of entity recognition in plasma physics and also provides a foundation to support researchers in navigating and analyzing scientific literature. 1 Introduction Named Entity Recognition (NER), a branch of natural language processing (NLP), provides a promising solution to automatically identify and classify named entities in unstructured text into predefined categories such as locations, organization, persons etc [ 25 ] . This technology is widely adopted in several academic fields including, computer science [ 4 ] , life sciences [ 23 ] , agriculture [ 5 ] , and biodiversity [ 1 ] . Plasma physics, a research field that studies the physical properties of plasmas, reports scientific findings about complex phenomena with rich contextual information including experimental details. The specialized, complex and context-rich terminology used in plasma physics research articles makes it difficult for systems to efficiently support researchers in searching and analyzing relevant information. NER offers a solution to automatically identify and classify terminology and thus support researchers with more efficient information retrieval and knowledge discovery. In this work, we employ Nested NER (NNER), because in addition to being complex and context-rich, terminology used in plasma physics often carries multiple meanings or belongs to overlapping categories, two challenges that NNER can address. Several frameworks have been developed to extract nested entities from natural language text, including span-based methods [ 28 , 21 ] , hypergraph models [ 16 , 11 , 29 ] , and layered approaches [ 10 , 27 , 19 ] . While these techniques show potential, applying NER to plasma physics texts remains a significant challenge. The diversity of entity classes, the complexity of domain-specific terminology, and uneven data distribution requires a specialized approach. Most existing NER systems are designed for general or biomedical text and they struggle to accurately capture the important entities/mentions from plasma physics literature, specifically. Even with the advent of advanced models, such as layered approaches and hypergraph models, satisfactory performance on domain-specific datasets cannot be guaranteed. Underrepresented classes are often overlooked, which leads to less stable prediction performance. Given that manual data annotation is both time-consuming and labor-intensive, there is a pressing need for methods that can effectively handle imbalanced data while maintaining high accuracy, as this is essential for ensuring the usability of extracted information in real-world applications. This paper addresses these challenges by developing a NNER model specifically designed for plasma physics. Our contributions are summarized as follows: 1. We annotate and publish a domain-specific plasma physics dataset comprising 16 entity classes created for Named Entity Recognition (NER) tasks. 2. We address the problem of NNER in the plasma physics domain by proposing a lightweight BERT-CRF-based model. Our approach employs entity-specific specialization, in which independent BERT–CRF models are trained for individual entity types and their predictions are subsequently aggregated to produce the final outputs. Fine-tuning a pretrained language model (e.g., BERT) with this architecture allows the system to learn class-specific patterns while leveraging shared knowledge across all entity types. 3. To further enhance model performance, we incorporate Bayesian Optimization (BO) to automatically fine-tune the hyperparameters of our NER model, which leads to improved evaluation metrics. 4. We evaluate the proposed approach and also experiment with several baseline models on our annotated dataset to demonstrate the reliability of our approach. To further assess the generalizability of our method, we also evaluate it on publicly available datasets, namely GENIA and the Chilean Waiting List corpus. 2 Related Work Ju et al. [ 10 ] have introduced a dynamic neural model for NNER that operates without the need for external knowledge resources or handcrafted linguistic features. This approach enables the sequential stacking of flat NER layers from bottom to top, which allows for end-to-end identification of nested entities. Pyramid et al. [ 27 ] , a layered model designed for NNER, is another notable approach. This architecture is composed of a stack of interconnected layers, where each layer is responsible for predicting whether a text span corresponds to a complete entity mention. Fu et al. [ 7 ] frame NNER as a constituency parsing task with partially observed trees that leverages a partially observed TreeCRF to model this structure. In this approach, all labeled entity spans are treated as observed nodes within a constituency tree, while the remaining spans are considered latent. The use of TreeCRFs provides a unified framework for jointly modeling both the observed and latent nodes, enabling effective handling of the hierarchical structure inherent in nested entities. Rehana et al. [ 19 ] present a BERT-based approach for NNER, specifically leveraging the pretrained PubMedBERT model to address the challenges posed by nested entities in biomedical texts. The method integrates rich contextual embeddings from PubMedBERT with a multilayer tagging strategy, enabling the model to effectively distinguish overlapping entity mentions. To address the challenge of limited overlap between the training and test sets, the approach by Wan et al. [ 26 ] focuses on enhancing span representations through retrieval-based span-level graphs. This method constructs global entity-entity and span-entity graphs by leveraging n-gram similarity, effectively linking spans in the input with semantically similar entities from the training data. A novel sequence-to-set neural framework [ 24 ] has also been proposed for NNER, an approach that aims to move beyond predefined candidate spans. This approach introduces a fixed set of learnable vectors that are trained to capture patterns associated with meaningful spans. By employing a non-autoregressive decoder, the model predicts the entire set of entities in a single forward pass. Yang et al. [ 30 ] proposed an NNER approach that models all nested entities within a sentence as a unified, holistic structure. The authors proposed a holistic structure parsing algorithm to extract the complete set of entities in a single pass. A study by Rojas et al. [ 20 ] revisits LSTM-CRF and proposed Multiple LSTM-CRF (MLC) model, a straightforward yet under-explored approach that trains separate sequence labeling models independently for each entity type. The extensive experiments conducted on three NNER datasets demonstrate that MLC achieves competitive performance. Finally, Lu and Roth [ 16 ] introduced a hypergraph representation for extracting entity mentions. Katiyar and Cardie [ 11 ] proposed a directed hypergraph model leveraging LSTM-based features to learn nesting