MADP: A Multi-Agent Pipeline for Sustainable Document Processing with Human-in-the-Loop
Diego Gosmar, Giovanni Zenezini · 2026
Read MADP: A Multi-Agent Pipeline for Sustainable Document Processing with Human-in-the-Loop by Diego Gosmar, Giovanni Zenezini (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17159.txt.
Introduction
Gosmar and Zenezini describe MADP, a five-agent pipeline that classifies, splits, parses and extracts business documents, calling in a human only for selected checks. A feedback method lets prompts improve from corrections over time. In live use on 955 documents it automated 97 percent of the pipeline, and modeling suggests large cuts in staff time and energy use.
Catalog record
| CREATOR | Diego Gosmar, Giovanni Zenezini |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35336 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17159
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MADP: A Multi-Agent Pipeline for Sustainable Document Processing with Human-in-the-Loop Diego Gosmar, Giovanni Zenezini Abstract Document processing automation remains a critical challenge in enterprise environments, where traditional manual approaches are labor-intensive and error-prone. We present MADP, a multi-agent architecture that addresses the challenge of automating document processing in enterprise settings by combining deep learning-based classification and parsing with large language model extraction, while maintaining accuracy through selective human validation. Our system integrates five specialized agents—Classificator, Splitter, Parser, Extraction, and Validator—with a Human-in-the-Loop (HITL) mechanism and a novel Prompt Fine Tuning with Feedback Inheritance (PFTFI) approach. The operational analysis on a production use-case scenario of 100,000 invoices per year indicates a potential reduction of Full-Time Equivalent (FTE) requirements by approximately 70%. Production deployment on 955 real-world documents processed through January 2026 achieves a 97.0% full-pipeline automation rate, with only 3% requiring non-AI fallback. Ablation evaluation on a stratified 100-document subset (5 documents per each of 20 supplier/document-type categories) demonstrates that the full MADP configuration with Human-in-the-Loop supervision attains 98.5% document-level accuracy. Additionally, we present a comprehensive sustainability analysis showing that our hybrid AI+HITL approach reduces CO 2 emissions by 69%, energy consumption by 69%, and water usage by 63% compared to traditional manual processing. Benchmark comparisons of multiple LLM backends (Granite-Docling, Mistral-Small, DeepSeek-OCR) provide practical insights for deployment in production environments. 1 Introduction The digital transformation of document-intensive business processes presents significant challenges in information extraction, validation, and automated decision-making [ 35 ] . Traditional Optical Character Recognition (OCR) systems struggle with complex document layouts, multi-page structures, and domain-specific terminology, often requiring extensive manual verification [ 2 ] . Recent advances in Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and extracting structured information from unstructured documents [ 4 ] . However, deploying LLMs in production environments faces three critical challenges: (1) hallucinations and non-deterministic accuracy concerns in mission-critical applications [ 36 , 8 , 10 ] , (2) computational and environmental costs of large-scale inference [ 27 ] , and (3) lack of interpretability and auditability in regulated industries [ 3 ] . To address these challenges, we propose MADP, a multi-agent architecture that orchestrates specialised AI agents under human oversight for end-to-end document processing. The framework combines convolutional neural networks and large language models within a modular pipeline and introduces a Prompt Fine Tuning with Feedback Inheritance (PFTFI) mechanism that leverages human corrections to refine extraction behaviour over time without retraining the underlying models. We evaluate MADP on a production dataset of 955 real-world documents processed through January 2026, achieving a 97.0% full-pipeline automation rate. Ablation evaluation on a stratified 100-document subset (5 documents per each of 20 supplier/document-type categories) demonstrates that the full configuration with Human-in-the-Loop supervision attains 98.5% document-level accuracy. We further analyze operational efficiency through a use-case scenario involving 100,000 invoices per year, demonstrating a potential FTE reduction of approximately 70%. In addition to operational metrics, we provide what is, to the best of our knowledge, the first detailed sustainability analysis of AI-assisted document processing, quantifying reductions in CO 2 emissions, energy consumption, and water usage relative to a fully manual baseline. Finally, we report a comparative benchmark of multiple LLM backends for document analysis tasks, highlighting the trade-offs between accuracy, latency, and resource footprint in production-like conditions. Our results demonstrate that intelligent orchestration of AI agents with strategic human intervention achieves superior accuracy while significantly reducing both operational costs and environmental impact compared to fully manual or fully automated approaches. 2 Related Work 2.1 Document Analysis and Recognition Traditional document analysis relies on rule-based systems and classical machine learning approaches [ 24 ] . Deep learning has transformed the field, with CNNs achieving state-of-the-art performance in document classification [ 13 ] and layout analysis [ 33 ] . LayoutLM [ 33 ] and its successors combine text, layout, and visual features for document understanding, while Donut [ 17 ] proposes an OCR-free approach using vision transformers. Recent work on document parsing has focused on handling complex layouts [ 37 ] . ParseBench [ 34 ] evaluates 14 parsing methods on {\sim} 2,000 enterprise pages across five capability dimensions, finding that no single parser dominates across document types — a result consistent with our pragmatic choice of Docling. For invoice-specific extraction, Liu et al. [ 20 ] propose MATRIX, a memory-augmented agent that outperforms direct LLM prompting by over 30% on 764 real invoice documents; unlike MADP, MATRIX does not incorporate HITL validation or sustainability analysis. Most approaches lack robustness to diverse document formats and require extensive training data for domain adaptation. 2.2 Multi-Agent Systems for NLP Multi-agent systems decompose complex tasks into specialized sub-tasks handled by coordinated agents [ 32 , 15 , 8 , 10 ] . AutoGEN [ 32 ] enables building LLM applications through conversational agents, while MetaGPT [ 15 ] incorporates human workflows into agent orchestration. Emerging open standards such as the Open Voice Interoperability specifications [ 1 ] further address agent communication interoperability across heterogeneous systems. Kulkarni and Kulkarni [ 18 ] benchmark four orchestration architectures on 10,000 SEC filings, finding that reflexive self-correcting loops achieve the highest F1 (0.943) but at 2.3 \times the cost of sequential baselines; MADP’s PFTFI achieves analogous iterative correction while controlling costs through selective HITL intervention. In document processing, recent benchmarks for OCR and document understanding [ 21 ] have revealed performance gaps in handling multilingual and handwritten text, while systematic evaluation on production-scale datasets and environmental impact assessment remains limited. 2.3 Human-in-the-Loop Systems Human-in-the-Loop (HITL) approaches combine automated processing with strategic human intervention [ 23 ] . Active learning frameworks [ 29 ] minimize labeling costs by selectively querying human annotators for uncertain predictions. However, existing HITL systems for document processing lack mechanisms for continuous learning from human feedback. 2.4 Sustainability of AI Systems The environmental impact of AI has received increasing attention [ 27 , 30 ] . Recent work quantifies the carbon footprint of LLM training [ 22 ] and inference [ 28 ] , as well as water consumption for data center cooling [ 19 ] . However, no prior work has analyzed the full sustainability impact of AI-assisted document processing compared to manual alternatives. 3 MADP Architecture 3.1 System Overview MADP implements a specialized-module pipeline with five components orchestrated sequentially (Figure 1 ). Each component performs a specific subtask, with intermediate results passed to downstream stages. The PFTFI feedback loop introduces bidirectional agentic behaviour across the pipeline, enabling continuous improvement without model retraining. The architecture provides inherent security benefits through validation at each stage [ 6 ] and supports both fully automated processing and Human-in-the-Loop validation at critical decision points. Figure 1: MADP pipeline: five sequential components (Classificator, Splitter, Parser, Extraction, Validator) with PFTFI feedback loop. 3.2 Classificator Agent The Classificator Agent uses a Convolutional Neural Network trained to identify document types and supplier categories. For invoice processing, the CNN classifies documents by supplier, enabling supplier-specific extraction templates. The CNN architecture uses ResNet-18 [ 14 ] pretrained on ImageNet. ResNet-18 was selected deliberately over deeper variants (ResNet-50, ResNet-101) to minimise classification latency and computational footprint, while maintaining sufficient representational capacity for document header classification. The first three convolutional blocks remain frozen to preserve general visual features, while