MITRA: An AI Assistant for Knowledge Retrieval in Physics Collaborations
Abhishikth Mallampalli, Sridhara Dasu · 2026
Read MITRA: An AI Assistant for Knowledge Retrieval in Physics Collaborations by Abhishikth Mallampalli, Sridhara Dasu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09800.txt.
Introduction
Abhishikth Mallampalli and Sridhara Dasu built MITRA, a prototype aide that answers questions from the internal papers of the CMS physics team at CERN. New and senior members alike struggle to search that huge, growing store. MITRA gathers files itself, reads them with layout aware OCR, and keeps every model on site for privacy. Its two tier search first finds the right analysis, then reads closely.
Catalog record
| CREATOR | Abhishikth Mallampalli, Sridhara Dasu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18661 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.09800
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MITRA: An AI Assistant for Knowledge Retrieval in Physics Collaborations Abhishikth Mallampalli, Sridhara Dasu Abstract Large-scale scientific collaborations, such as the Compact Muon Solenoid (CMS) at CERN, produce a vast and ever-growing corpus of internal documentation. Navigating this complex information landscape presents a significant challenge for both new and experienced researchers, hindering knowledge sharing and slowing down the pace of scientific discovery. To address this, we present a prototype of MITRA, a Retrieval-Augmented Generation (RAG) based system, designed to answer specific, context-aware questions about physics analyses. MITRA employs a novel, automated pipeline using Selenium for document retrieval from internal databases and Optical Character Recognition (OCR) with layout parsing for high-fidelity text extraction. Crucially, MITRA’s entire framework, from the embedding model to the Large Language Model (LLM), is hosted on-premise, ensuring that sensitive collaboration data remains private. We introduce a two-tiered vector database architecture that first identifies the relevant analysis from abstracts before focusing on the full documentation, resolving potential ambiguities between different analyses. We demonstrate the prototype’s superior retrieval performance against a standard keyword-based baseline on realistic queries and discuss future work towards developing a comprehensive research agent for large experimental collaborations. 1 Introduction Experimental physics collaborations today are larger and more productive than ever, leading to an incredible and accelerating pace of scientific discovery. This success, however, brings a new challenge: managing an ever-growing mountain of internal knowledge. Collaborations like CMS consist of thousands of members who generate terabytes of data and a corresponding volume of documentation, including analysis notes, internal wikis, and procedural guidelines. For a new PhD student joining an analysis group or an expert seeking to quickly understand the nuances of a specific measurement, finding precise information can be a time-consuming and often frustrating endeavor. Traditional keyword-based search tools often fail to capture the semantic context of a query and and are heavily dependent on the exact phrasing match between query and the language in the text. A significant amount of expert effort is invested in producing these detailed documents, yet their contents are often underutilized due to inefficient information retrieval. To address this challenge, this work introduces a prototype of MITRA (a Sanskrit word meaning ’friend’), a conversational AI system designed to serve as an expert assistant for members of a large physics collaboration. We leverage the power of Retrieval-Augmented Generation (RAG) [ 7 ] to build a system that can provide accurate, cited answers to natural language questions about specific physics analyses. Concurrent with our work, other collaborations are also exploring similar solutions. For instance, the ATLAS collaboration is developing a system that relies on external, API-based services (e.g., OpenAI’s GPT-4o mini [ 8 ] ), citing cost-versus-quality considerations [ 3 ] . While this API model is highly cost-effective for individual queries, the cumulative operational expense for a collaboration with thousands of members over several years can become substantial. Our work presents a complementary, privacy-first alternative that also offers a more sustainable financial model. By demonstrating a fully on-premise framework that leverages existing institutional hardware, we avoid ongoing per-token costs and, most critically, ensure that no proprietary research data ever leaves the local servers. Our primary contributions are: • A modular and automated pipeline for ingesting and processing internal analysis documents, designed to support extensibility and version-aware updates. • A design philosophy centered on a two-tiered database system to maintain context and avoid cross-analysis confusion. • A fully on-premise deployment model that guarantees the privacy and security of proprietary collaboration data. 2 Methodology: An Automated and Private Pipeline MITRA is built on a robust pipeline that transforms raw documents from a database into a queryable knowledge base. Since analysis documents are frequently updated, this RAG architecture allows for the knowledge base to be refreshed by simply re-embedding the updated documents — a process far more efficient than the costly retraining required for monolithic language models. 2.1 Automated Document Acquisition and Extraction To access the analysis documents, which are often stored in databases with web interfaces, we utilize Selenium [ 14 ] , a browser automation tool. Scripts are developed to log into the system, navigate to the relevant sections, and download the analysis notes, typically in PDF format. Once retrieved, the documents are processed. Instead of relying on standard PDF-to-text libraries (e.g., PyPDF [ 10 ] , PDFPlumber [ 15 ] ), which can struggle with complex layouts, we employ advanced Optical Character Recognition (OCR) engines (e.g., Surya [ 9 ] and Tesseract [ 16 ] ). Modern OCR tools offer superior layout parsing capabilities, allowing us to accurately extract text while preserving the distinction between main content, figure captions, page numbers, line numbers and tables. This high-fidelity extraction is critical for creating a high-quality knowledge base. 2.2 Embedding, Retrieval, and Reranking The extracted text is segmented into manageable chunks (e.g., paragraphs or sections). For our prototype, we chose to chunk by paragraph, as this often aligns with the logical separation of ideas in the source documents. To create a searchable knowledge base, we use a Dense Passage Retrieval (DPR) model to encode these document chunks into a 768-dimensional vector space. We specifically use the facebook/dpr-question_encoder-multiset-base model [ 5 ] , which has demonstrated strong performance on public benchmarks, via the Transformers library [ 20 ] . These embeddings are then stored in a lightweight and efficient open-source vector database such as Chroma DB [ 2 ] . When a user asks a question, the same DPR model encodes the query. The initial retrieval step performs a similarity search, using cosine similarity [ 13 ] , to find the top-k most relevant passages from the database, where k is a tunable parameter. A larger k increases the computational load of the subsequent reranking step but raises the probability of capturing the most relevant passage. These candidates are then passed to a more computationally intensive but accurate reranking step. For this, we use a cross-encoder model ( cross-encoder/ms-marco-MiniLM-L-6-v2 ) [ 11 , 1 , 19 ] , which scores the relevance of each passage to the query with higher accuracy. While computationally expensive, this two-stage process is necessary because cross-encoders, which jointly process query and passage pairs, are too slow for an initial search over the entire database. The final ranked list of passages is then used as context for the LLM. To mitigate the risk of model hallucination, the LLM is explicitly prompted to ground its answers strictly within the retrieved context passages. 2.3 On-Premise LLM for Privacy A core principle of our design is data privacy. All components of MITRA are hosted on local collaboration GPU servers (e.g., NVIDIA Tesla T4 with 15GB of memory). This includes the embedding model and, most importantly, the LLM. We use a 4-bit quantized version of Mistral-7B model [ 4 ] , which allows the 7.2B parameter model to run efficiently on our hardware while maintaining strong performance. The LLM is served locally using Ollama [ 18 ] and integrated into our application pipeline with the LangChain framework [ 6 ] . This on-premise approach provides two key benefits. First, for a large collaboration with thousands of members, it avoids the substantial cumulative cost that API-based services would incur over time. Second, and most critically, it