ArcBERT: An LLM-based Search Engine for Exploring Integrated Multi-Omics Metadata
Gajendra Doniparthi 1 , Shashank Balu Pandhare 2 , Stefan Deßloch 1 and Timo Mühlhaus 3 · 2025
Read ArcBERT: An LLM-based Search Engine for Exploring Integrated Multi-Omics Metadata by Gajendra Doniparthi 1 , Shashank Balu Pandhare 2 , Stefan Deßloch 1 and Timo Mühlhaus 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-15365.txt.
Introduction
Gajendra Doniparthi and three coauthors build ArcBERT, a search engine that lets researchers explore biological metadata in plain language. Research data management systems hold structured metadata for huge collections of multi omics datasets. Classic search tools demand keyword queries, which forces users to guess the exact terms in the records.
ArcBERT uses a large language model trained for the domain, so it matches meaning rather than keywords. It also understands the structure and hierarchies inside the metadata, not just the text. That lets it handle many styles of user questions about integrated datasets. The system points to a shift in how scientists find data: ask naturally, and let semantic matching do the digging. For data stewards, it offers a template for smarter discovery across research repositories.
Catalog record
| CREATOR | Gajendra Doniparthi 1 , Shashank Balu Pandhare 2 , Stefan Deßloch 1 and Timo Mühlhaus 3 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-15365
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ArcBERT: An LLM-based Search Engine for Exploring Integrated Multi-Omics Metadata Gajendra Doniparthi 1 , Shashank Balu Pandhare 2 , Stefan Deßloch 1 and Timo Mühlhaus 3 Abstract Traditional search applications within Research Data Management (RDM) ecosystems are crucial in helping users discover and explore the structured metadata from the research datasets. Typically, text search engines require users to submit keyword-based queries rather than using natural language. However, using Large Language Models (LLMs) trained on domain-specific content for specialized natural language processing (NLP) tasks is becoming increasingly common. We present ArcBERT, an LLM-based system designed for integrated metadata exploration. ArcBERT understands natural language queries and relies on semantic matching, unlike traditional search applications. Notably, ArcBERT also understands the structure and hierarchies within the metadata, enabling it to handle diverse user querying patterns effectively. I Introduction It is widely accepted in the bio-science research community that an effective Research Data Management (RDM) platform based on FAIRness (i.e., data that is findable, accessible, interoperable, and reusable) is essential to improve the reproducibility, visibility, and accessibility of their heterogeneous research data [ 13 , 17 , 10 , 22 ] . The search & exploration applications play a pivotal role in fully integrating the standardized experimental metadata within and across various RDM eco-systems. They are expected to provide a near real-time consolidated view of the metadata while hiding the heterogeneity of the data model and data exchange methodologies among the participating groups. Exploratory query processing techniques enable scientists to interactively explore the metadata and associated datasets, identify patterns, and generate data-driven insights. Popular open-source endpoint repositories, such as MetaboLights [ 9 , 8 ] and PRIDE [ 11 ] , enable users to conduct direct free-text metadata searches. They also offer search facets, allowing users to filter results by specific studies or organisms. As large language models (LLMs) gain popularity in bioscience research, they represent a promising alternative to traditional text search engines for exploring standardized research data [ 14 ] . Modern language models comprehend search keywords and the semantics behind user queries, allowing for more accurate results. LLMs can potentially transform how we analyze integrated experimental metadata, providing a more powerful and insightful tool than conventional text search engines. A comprehensive list of large language models (LLMs) trained on extensive biological corpora [ 23 ] exists for the bioscience domain. Domain-specific LLMs such as BioBERT [ 15 ] and SciBERT [ 2 ] have demonstrated effectiveness in tasks like question answering and text mining. These models are developed by initially pre-training a BERT [ 5 ] model on general domain corpora (for instance, Wikipedia) and further training it on specific domain corpora. BioBERT is fine-tuned with biomedical texts from sources like PubMed and PMC, whereas SciBERT is fine-tuned with scientific literature from Semantic Scholar. Fine-tuning the models on particular biological natural language processing (NLP) tasks leads to a significantly improved understanding of biological terminology. There are three key aspects to consider when using LLMs to develop a system to explore multi-omics metadata in plant sciences. First, leveraging the RDM solution and its features is essential to building a comprehensive corpus of integrated omics metadata. Second, the model needs to be fine-tuned; this involves using a pre-trained model based on plant science literature and adapting it with the omics metadata corpus to enhance its ability to understand user queries in natural language. Lastly, since the metadata specifications follow a hierarchical structure, the model must grasp these layers to match user queries meaningfully. This paper presents the following contributions. • We revisit our RDM approach ( PLANTdataHUB ) and the existing metadata search application, ARC Metadata Registry , describing how our RDM solution structures and integrates the multi-omics metadata. • We introduce ArcBERT , a Sentence-BERT [ 18 ] -based language model for integrated metadata exploration. The model is pre-trained using plant science literature from PubMed [ 16 ] and fine-tuned with integrated omics metadata. • We propose using an indexing mechanism to index the vector embeddings from ArcBERT and leverage the FAISS library for fast nearest neighbor searches. • We evaluate the effectiveness of using ArcBERT for metadata exploration compared to traditional text search engines. The following section briefly describes our PLANTdataHUB ecosystem and its core components. Sec. III outlines how the ARC Metadata Registry application connects with multiple dataHUBs and integrates the omics metadata. In Sec. IV , we introduce ArcBERT, its pre-training and fine-tuning with the omics metadata from the registry application, and indexing the ARC document and structure embeddings. Lastly, in the experiments section (Sec. V ), we evaluate ArcBERT against Elasticsearch in finding how effective ArcBERT is for metadata exploration. II PLANTdataHUB PLANTdataHUB is a comprehensive FAIR solution designed for managing research data in plant science [ 21 ] . In this RDM solution, the units of research output are referred to as Annotated Research Contexts , in short, ARCs, which are FAIR digital objects. ARCs are self-contained, interoperable, and reproducible with unique digital object identifier (DOI). The PLANTdataHUB solution leverages a distributed version control system (GitLab) to store and version individual ARCs. It provides flexibility in maintaining each iteration of a laboratory experiment’s design-test-repeat cycle, thus avoiding the need for a new customized versioning tool. Fig. 1: ARC folder specification packaging standard format metadata with workflows, scripts for computational pipelines, and result files/artifacts from workflow executions. II-A Annotated Research Context The core idea behind Annotated Research Contexts (ARC) is to follow a fixed folder and file layout to organize the experimental metadata, measurement data, workflows, software, external files, etc., in a generic and interoperable format to ensure the reproducibility of each experiment within a research project [ 6 ] . As shown in Figure. 1 , the format of ARC is standardized and flexible to adapt and accommodate simple to complex project scenarios across any omics studies. The ARC specification is designed to be flexible and can accommodate the experimental metadata to be represented in any known metadata standard [ 4 ] . The initial ARC specification for plant research data, in particular, allows for well-known standards such as ISA. The abstract model for the ISA standard is implemented in hierarchical ISA-JSON file format [ 19 ] . The ARC specification also uses a common workflow language for the workflows and scripts to build the computation pipelines. The artifacts from workflows and computational analysis go into their respective run folders. The ARC can also be compiled to other packing methods, such as RO-Crate [ 20 ] . II-B DataHUBs In the PLANTdataHUB model, centralized repositories are known as DataHUBs . DataHUBs can be deployed on-premise or remotely, depending on the research groups’ data sharing and security policies. They offer versioning of ARCs and make it easy to search and discover through standardized API access. Additionally, PLANTdataHUB provides various supporting tools to enable easy curation, collaboration, and maintenance of ARCs on-premise and in remote dataHUBs. III Integrating Metadata ARC Metadata Registry is a cloud-native application for integrated search and analysis of experimental metadata within the plant science community. The registry application within the PLANTdataHUB solution is designed to integrate multiple DataHUBs at once and provide a consolidated real-time view of the data from the top layers of the ARCs