Retrieval-Augmented Multi-LLM Ensemble for Industrial Part Specification Extraction
Muzakkiruddin A. Mohammed ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] John R. Talburt ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] · 2026
Read Retrieval-Augmented Multi-LLM Ensemble for Industrial Part Specification Extraction by Muzakkiruddin A. Mohammed ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] John R. Talburt ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05266.txt.
Introduction
Muzakkiruddin Ahmed Mohammed and 3 co-authors pull the specs of factory parts out of loose text with a team of language models in a 2026 paper. Part specs hide in guides, mails, and data sheets across plants, shops, and yards. To pull them out by hand is slow, and slip-ups are rife. A lone model can miss a spec or read a form wrong, where a mate model of a next breed might catch it.
Their build pairs a search step with a crew of nine top language models, run in a three-phase pipe. The search step grounds the work in the source files. The crew's pooled strengths cut the miss rate. True, fast pulls of this kind could trim buy times and cut the slip-ups that idle a line when a wrong part shows up.
Catalog record
| CREATOR | Muzakkiruddin A. Mohammed ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] John R. Talburt ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05266
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Retrieval-Augmented Multi-LLM Ensemble for Industrial Part Specification Extraction Thanks: Muzakkiruddin A. Mohammed ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] John R. Talburt ERIQ Research Center University of Arkansas - Little Rock Little Rock, Arkansas, USA [email protected] Abstract Industrial part specification extraction from unstructured text remains a persistent challenge in manufacturing, procurement, and maintenance, where manual processing is both time-consuming and error-prone. This paper introduces RAGsemble , a retrieval-augmented multi-LLM ensemble framework that orchestrates nine state-of-the-art Large Language Models (LLMs) within a structured three-phase pipeline. RAGsemble addresses key limitations of single-model systems by combining the complementary strengths of model families including Gemini (2.0, 2.5, 1.5), OpenAI (GPT-4o, o4-mini), Mistral Large, and Gemma (1B, 4B, 3n-e4b), while grounding outputs in factual data using FAISS-based semantic retrieval. The system architecture consists of three stages: (1) parallel extraction by diverse LLMs, (2) targeted research augmentation leveraging high-performing models, and (3) intelligent synthesis with conflict resolution and confidence-aware scoring. RAG integration provides real-time access to structured part databases, enabling the system to validate, refine, and enrich outputs through similarity-based reference retrieval. Experimental results using real industrial datasets demonstrate significant gains in extraction accuracy, technical completeness, and structured output quality compared to leading single-LLM baselines. Key contributions include a scalable ensemble architecture for industrial domains, seamless RAG integration throughout the pipeline, comprehensive quality assessment mechanisms, and a production-ready solution suitable for deployment in knowledge-intensive manufacturing environments. I Introduction Industrial manufacturing, procurement, and maintenance operations produce vast volumes of unstructured part descriptions embedded in procurement documents, maintenance logs, technical specifications, and supplier catalogs. Extracting and standardizing this information remains a significant bottleneck, often requiring manual processing that is both time-consuming and error-prone. Traditional rule-based and early machine learning approaches fall short in handling the linguistic complexity, domain-specific terminology, and nuanced context typical of industrial part data [ 16 , 17 ] . While recent advances in Large Language Models (LLMs) have opened new possibilities for automating complex extraction tasks, relying on a single model poses substantial risks in industrial settings. These include hallucination of technical specifications, uneven performance across part categories, limited domain adaptation, and a lack of transparency in confidence estimation [ 22 , 18 ] . In mission-critical environments, such issues can lead to costly misidentifications, safety risks, and operational inefficiencies. This paper introduces a novel, production-ready multi-LLM ensemble system designed specifically for high-accuracy extraction of industrial part specifications. The proposed architecture orchestrates nine state-of-the-art LLMs from four major model families, namely Gemini, OpenAI, Mistral, and Gemma, and integrates them within a structured three-phase pipeline that includes parallel extraction, context-aware research enhancement, and intelligent synthesis. Retrieval-Augmented Generation (RAG) is seamlessly integrated throughout all phases, providing semantic access to historical part databases via FAISS-based similarity search [ 21 , 23 ] , which significantly improves grounding and reduces hallucination. Our system offers several key contributions: • A scalable ensemble architecture that systematically leverages complementary model strengths for robust, high-quality part information extraction. • First-of-its-kind integration of RAG with a multi-LLM pipeline for industrial specification grounding, enabling context enrichment and real-time validation. • Transparent quality assessment, including confidence scores, consensus metrics, and RAG validation indicators, to support informed decision-making. • A complete, deployable implementation with modular design, configurable model selection, robust error handling, and practical applicability across various industrial domains. By shifting from a single-model paradigm to a collaborative multi-model approach, our work establishes a new direction for industrial information systems. The architecture is adaptable across sectors such as aerospace, automotive, electronics, and chemical manufacturing, offering the reliability, transparency, and scalability required for mission-critical deployment. II Literature Review Ensemble learning has become a key strategy in improving the robustness and generalization of large language models (LLMs). Techniques are typically categorized into ensemble-before-inference, ensemble-during-inference, and ensemble-after-inference strategies, which leverage multiple models to reduce variance and capitalize on their complementary strengths [ 4 ] . Recent work such as LLM-Synergy demonstrates how ensemble voting and dynamic selection approaches can improve domain-specific performance, particularly in high-stakes tasks like medical question answering [ 8 ] . Confidence-aware ensemble strategies further contribute to reliable deployment by offering calibrated uncertainty estimates in LLM classification tasks [ 18 ] . Additionally, new applications of ensemble methods using advanced models such as Gemini-1.5 have been shown to handle complex industrial tasks such as entity resolution in unstructured datasets [ 19 , 20 ] . A recent comprehensive review highlights that ensemble deep learning approaches consistently improve performance across classification, generation, and information extraction tasks, while also acknowledging the cost and integration trade-offs [ 13 ] . Retrieval-Augmented Generation (RAG) methods have shown great promise in grounding LLM outputs in factual knowledge, addressing the hallucination problem and limitations in model memory. The original RAG architecture introduced in [ 7 ] combines parametric generation with non-parametric memory to boost performance on knowledge-intensive tasks. A comprehensive survey [ 6 ] categorizes recent RAG strategies and highlights their role in enhancing factual consistency, transparency, and retrieval-guided reasoning in domain-specific applications. These principles are now being extended into multimodal domains, enabling systems to incorporate not only text but also visual and structured data as part of the retrieval context [ 12 ] . Semantic similarity search engines such as FAISS have become integral to scalable RAG applications, allowing real-time, dense vector-based retrieval across billions of documents [ 23 ] . In the industrial domain, traditional rule-based information extraction systems have been used for tasks like mechanical-electrical-plumbing document processing, but they fall short in capturing nuanced semantics and diverse terminology [ 16 ] . As a result, there has been a clear shift toward neural approaches for information extraction from technical text [ 17 ] . Broader reviews show that machine learning in smart manufacturing is increasingly focused on structured knowledge generation from unstructured records and the integration of data across systems. Foundational work in manufacturing-specific entity recognition highlighted the challenges in capturing part-specific data from heterogeneous documents [ 1 , 2 ] , while later studies emphasized the importance of structured data and standardization in product lifecycle management [ 5 ] . Efforts like the NIST KEA project [ 9 ] and related research focus on synthesizing incompatible information sources to improve manufacturing decision systems. Formal ontologies and enterprise modeling frameworks are central to enabling interoperable systems that align with Industry 4.0 objectives [ 24 , 10 ] . In parallel, knowledge management systems have been shown to reduce redundancy and improve efficiency in manufacturing environments through centralization and documentation consistency [ 3 ] . Predictive maintenance applications also rely heavily on structured knowledge, including historical diagnostics, operating conditions, and equipment metadata [ 11 ] . While prior work has demonstrated the value of either LLM ensembles or RAG individually, few approaches have unified these paradigms into a cohesive architecture designed for production-scale industrial deployment. This paper fills that gap by integrating nine LLMs into a collaborative pipeline that includes RAG-enhanced contextual grounding and confidence-aware synthesis, offering a scalable, transparent, and accurate solution for extracting industrial part specifications from unstructured data. III System Architecture Fig. 1: System architecture of the multi-LLM industrial part extraction framework, showing modular components and model organization. The proposed system is a modular, production-oriented architecture that integrates multiple Large