GuidaPA: Privacy-Preserving Chatbot for Public Administration via Federated Learning

Daniel M. Jimenez-Gutierrez 1 , Albenzio Cirillo 2 , Raffaele Nicolussi 2 , Alessio Beltrame 2 , Andrea Vitaletti 1 · 2026

Read GuidaPA: Privacy-Preserving Chatbot for Public Administration via Federated Learning by Daniel M. Jimenez-Gutierrez 1 , Albenzio Cirillo 2 , Raffaele Nicolussi 2 , Alessio Beltrame 2 , Andrea Vitaletti 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01386.txt.

Introduction

Jimenez-Gutierrez and co-authors build a privacy-preserving chatbot for Italian offices. GuidaPA serves the Italian Public Administration. It trains via federated learning, so data stay on site. Source texts come from two national PA platforms. SIGESON and SIDFORS manuals and FAQs form the corpus. Public documents act as a safe proxy in this study. Real deployment would extend to restricted internal sources.

Role-based access control guards who can query what. Secure client-side preprocessing adds another layer of care. Parameter-efficient federated fine-tuning adapts the language model. QLoRA runs over 15 federated rounds in their tests. Scores on ROUGE and BLEU near private centralized training. Data never pool centrally, which suits regulatory limits.

Catalog record

CREATORDaniel M. Jimenez-Gutierrez 1 , Albenzio Cirillo 2 , Raffaele Nicolussi 2 , Alessio Beltrame 2 , Andrea Vitaletti 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01386

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GuidaPA: Privacy-Preserving Chatbot for Public Administration via Federated Learning Daniel M. Jimenez-Gutierrez 1 , Albenzio Cirillo 2 , Raffaele Nicolussi 2 , Alessio Beltrame 2 , Andrea Vitaletti 1 Abstract We present GuidaPA , a privacy-preserving chatbot for the Italian Public Administration (PA) trained via Federated Learning (FL) on documentation from two national PA platforms, SIGESON and SIDFORS. Our corpus includes approximately 8 pages of SIGESON manuals and 31 pages of SIDFORS manuals/FAQs; while this study uses public documentation as a safe proxy, the intended deployment extends to restricted internal sources (e.g., tickets, officer manuals, database extracts) that can not be centrally pooled due to regulatory and organizational constraints. GuidaPA integrates role-based access control, secure client-side preprocessing, explicit monitoring of non-IID effects, and parameter-efficient federated fine-tuning of large language models. Using QLoRA (4-bit) over 15 federated rounds with an 80/20 train–test split per client, we evaluate answer quality with ROUGE, BLEU-4, and METEOR. The best federated model achieves ROUGE-1/2/L of 61.10/55.77/59.44, BLEU-4 of 45.02, and METEOR of 63.94—close to private centralized fine-tuning while keeping data on-site. Compared to the general-purpose baseline, domain fine-tuning improves ROUGE-1 from 41.45 to 62.18 and BLEU-4 from 26.97 to 50.90. Overall, the results indicate that FL can deliver high-quality conversational AI for public services without centralized data sharing. I Introduction The rapid diffusion of Large Language Models (LLMs) is enabling wider adoption of NLP components based on Generative AI (GenAI) within public services [ 6 , 1 ] . Public Administration (PA)—the set of governmental institutions responsible for delivering public services and enforcing regulations [ 16 ] —can benefit from LLM-based assistants to automate repetitive requests and improve access to information [ 34 ] . However, PA constraints make conventional centralized training impractical and often undesirable from a privacy and governance perspective [ 42 , 18 ] . Fig. 1 : Alternative architectures for integrating an LLM within PA. Internet-centralized approaches transfer data to third parties; private centralized approaches keep data within PA but still require inter-entity sharing; Federated Learning (FL) exchanges only model updates, preserving data sovereignty. Figure 1 summarizes three deployment options. Internet-centralized solutions are technically convenient but require sending sensitive information to external providers, introducing privacy risks. A Private Centralized model keeps data within PA infrastructure and aligns with the principle that PAs should make data available to other PAs when required for institutional tasks, under legal and privacy constraints [ 40 ] . A centralized architecture within PA serves as a unified knowledge aggregator, effectively mitigating the inconsistencies generated by siloed workflows and ensuring seamless interoperability across all administrative sectors. Nonetheless, inter-office pooling still increases governance burden and exposure. FL strengthens privacy by keeping data local and sharing only model updates, enabling collaborative learning across institutional silos while preserving data sovereignty. I-A Motivation Deploying chatbots in PA is challenging due to organizational and regulatory constraints [ 12 , 14 ] . In our case study, these constraints arise in two operational PA platforms: SIDFORS and SIGESON. Their documentation includes end-user manuals, FAQs, and procedural guidance for administrative workflows such as enrollment, authorization requests, access to company accounting positions, annual declarations, and payment of administrative fees. Although this study uses only public documentation as a safe proxy, these sources reflect the structured and procedural nature of PA knowledge and represent the broader institutional material that a deployed system may need to support, including internal manuals, support tickets, and curated database extracts. Key challenges include: (i) protecting sensitive data ( C_{1} ), (ii) adapting foundation models to PA-specific procedures and terminology ( C_{2} ), and (iii) integration with heterogeneous systems and operational scalability ( C_{3} ). Fine-tuning and Retrieval-Augmented Generation (RAG) can improve domain knowledge [ 26 , 24 ] , but they do not remove the need for an infrastructure that preserves privacy and supports distributed governance. As noted by the Italian Ministry of Economy and Finance’s Treasury Department (MEF–DT) [ 31 ] , AI in PA requires robust infrastructure and data management; yet interoperability remains incomplete [ 8 ] , making centralized data pooling unrealistic. Fully local ad hoc solutions are possible but costly and fragmented, potentially leading to inconsistent behavior across offices. I-B Research Objectives This study investigates whether FL can enable effective, privacy-preserving LLM-based chatbots in PA settings where data are distributed across institutional silos and cannot be centrally aggregated. We pursue: (i) designing a federated architecture with role-based access control (RBAC) and secure client-side data handling, (ii) evaluating whether federated fine-tuning matches private centralized quality while preserving locality, and (iii) assessing robustness under client heterogeneity and quantifying non-IID effects on global and local performance [ 23 , 28 ] . I-C Contribution We introduce GuidaPA , a privacy-preserving PA chatbot trained via FL to address C_{1} – C_{3} . Unlike prior FL applications that mainly focus on privacy-preserving model training alone, GuidaPA combines federated LLM adaptation with PA-specific deployment mechanisms that are directly relevant in practice: role-based access control, secure client-side preprocessing, and explicit monitoring of non-IID effects. Its main technical contribution, therefore, goes beyond applying FL to chatbot adaptation by integrating these components into a practical framework for institutional settings and showing empirically that this design can achieve near-centralized quality without centralizing the underlying documents. Using real documentation from the SIDFORS and SIGESON platforms, federated fine-tuning achieves quality comparable to a private centralized approach (Section VI-A ) while keeping data local, and consistently improves over the general-purpose baseline (Table IV ), demonstrating effective domain adaptation. Since PA documentation follows shared standards and regulatory structures, cross-client non-independent and identically distributed (non-IID) data is limited but non-zero, allowing federated training to converge while capturing realistic non-IID effects [ 23 , 28 ] . More broadly, this work shows how privacy-preserving learning architectures can support controlled dissemination and access to institutional knowledge in public-sector information systems. I-D Paper Structure Section II reviews related work. Section III describes the data sources and dataset. Section IV presents the architecture. Sections V and VI report the experimental setup and results, followed by discussion (Section VII ), limitations (Section VIII ), and conclusions (Section IX ). II Related Work The use of chatbots in the context of PA remains relatively limited compared to commercial and open-domain applications, where large-scale conversational systems benefit from abundant centralized data and rapid iteration cycles. To the best of our knowledge, no prior work has applied FL to the development of LLM–based chatbots in the PA domain in Italy. Prior research spans (i) centralized chatbots for e-government and public services, (ii) federated chatbot approaches in privacy-sensitive domains, and (iii) federated fine-tuning of LLMs, which provides methodological foundations for privacy-preserving adaptation. Centralized PA chatbots have been proposed for citizen support and information access, including Italian public-service conversational frameworks and domain assistants [ 36 , 7 ] , as well as systems for navigating governmental open data and improving transparency and responsiveness [ 10 , 3 ] . While these works demonstrate the potential of conversational interfaces to reduce friction in citizen–government interactions, they typically assume that training data can be collected and maintained in a single location, which is often unrealistic in PA environments characterized by organizational silos and constrained data governance. In privacy-sensitive domains such as healthcare and education,

Read the complete text