BOE-XSUM: Extreme Summarization in Clear Language of Spanish Legal Decrees and Notifications
Andrés Fernández García, Javier de la Rosa, Julio Gonzalo, Roser Morante, Enrique Amigó, Alejandro Benito-Santos, Jorge Carrillo-de-Albornoz, Víctor Fresno, Adrian Ghajari, Guillermo Marco, Laura Plaza, Eva Sánchez Salido · 2025
Read BOE-XSUM: Extreme Summarization in Clear Language of Spanish Legal Decrees and Notifications by Andrés Fernández García, Javier de la Rosa, Julio Gonzalo, Roser Morante, Enrique Amigó, Alejandro Benito-Santos, Jorge Carrillo-de-Albornoz, Víctor Fresno, Adrian Ghajari, Guillermo Marco, Laura Plaza, Eva Sánchez Salido (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24908.txt.
Introduction
Andrés Fernández García and co-authors release, in a 2025 paper, a data set of plain-language micro-summaries for Spain's official gazette, where laws and notices are published in dense legal Spanish. Short, clear summaries are scarce for Spanish texts and nearly absent for legal ones. The team curated more than thirty-six hundred gazette documents, each paired with a concise summary and a document type label.
They then fine-tuned mid-sized language models on the set and compared them with big general models answering cold. The tuned models won clearly, and the best gained about a quarter over the top cold model on accuracy. The authors offer the corpus, called BOE-XSUM, as training ground for legal summarization. Clearer official summaries, they argue, help citizens actually read what the state publishes.
Catalog record
| CREATOR | Andrés Fernández García, Javier de la Rosa, Julio Gonzalo, Roser Morante, Enrique Amigó, Alejandro Benito-Santos, Jorge Carrillo-de-Albornoz, Víctor Fresno, Adrian Ghajari, Guillermo Marco, Laura Plaza, Eva Sánchez Salido |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-24908
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BOE-XSUM: Extreme Summarization in Clear Language of Spanish Legal Decrees and Notifications Andrés Fernández García, Javier de la Rosa, Julio Gonzalo, Roser Morante, Enrique Amigó, Alejandro Benito-Santos, Jorge Carrillo-de-Albornoz, Víctor Fresno, Adrian Ghajari, Guillermo Marco, Laura Plaza, Eva Sánchez Salido Abstract 1 1 footnotetext: These authors contributed equally to this work. 1 Introduction Among the many capabilities of large language models (LLMs), summarization stands out as one of the most widely used and valued by end users [ Budhiraja et al.,2024 , Brachman et al.,2025 ] . Recent advances in LLMs have made it possible to summarize extremely long documents with remarkable accuracy and coherence. These breakthroughs have been driven in large part by the availability of large-scale, high-quality summarization datasets—particularly in English. However, this progress has not been evenly distributed across languages. Spanish, despite being the second most widely spoken native language in the world with over 485 million speakers [ Ethnologue,2023 ] , remains significantly under-resourced in Natural Language Processing (NLP) [ Conde et al.,2024 ] . This scarcity is especially pronounced in summarization tasks: a search on Hugging Face reveals 963 summarization datasets in English, 1 1 1 https://huggingface.co/datasets?task_categories=task_categories:summarization&language=language:en&sort=trending , accessed on April 1st, 2025. compared to only 75 in Spanish. 2 2 2 https://huggingface.co/datasets?task_categories=task_categories:summarization&language=language:es&sort=trending , accessed on April 1st, 2025. Moreover, domain-specific resources—such as those tailored for administrative or legal document summarization—are virtually non-existent in Spanish, further limiting the development and applicability of LLMs in these critical areas. In this work, we introduce BOE-XSUM, a curated dataset comprising 3,648 clear and extremely concise summaries of entries from Spain’s ‘‘Boletín Oficial del Estado” (BOE) 3 3 3 https://www.boe.es/ , the country’s State Official Gazette, along with their original texts. This gazette serves as the primary platform for disseminating legislative decrees, legal notifications, and various official documents, predominantly originating from the national government, but including contributions from regional and local authorities. This is the first dataset of its kind in Spanish and is characterized by two key features: first, it addresses the important challenge of adapting complex domain-specific language, such as legal or administrative texts, into clear, everyday language; and second, it provides extremely concise summaries that are manually curated and verified. The extreme summaries are built upon social media posts by a Spanish journalist specialized in the analysis and treatment of public information. 4 4 4 Eva Belmonte is a journalist and co-director of Civio Foundation (see https://civio.es/ ) an independent, non-profit organization that monitors public authorities through data journalism, and works on three lines of action: journalism, public advocacy and transparency services for public administrations. Belmonte is part of a multidisciplinary group of people who work to improve the democratic quality in Spain. She publishes concise daily summaries of the BOE in X (see https://x.com/evabelmonte ). This is a socially relevant task for the control of governments, whether they are central, autonomous, or municipalities, and other public agencies such as the Constitutional and the Supreme Court. For example, in the context of the floods that devastated several regions in Spain in late 2024, 5 5 5 https://en.wikipedia.org/wiki/2024_Spanish_floods . these posts contributed to inform the population about how central and regional governments were managing public resources to alleviate the effects of the disaster. By compiling and making available the BOE-XSUM dataset, we aim to fill the gap in NLP resources for Spanish, offering a valuable resource for both academic research and practical applications. In addition, we present experiments with generative language models. This allows us to answer the following research question: to what extent can generative language models produce extreme summaries of legal texts, not only capturing their complex meaning but also adapting them into clear language in a manner comparable to that of a human expert? Our contribution is twofold. First, we release a new publicly available dataset of extreme summaries in Spanish within the legal and administrative domain. 6 6 6 https://huggingface.co/datasets/bertin-project/BOE-XSUM Second, we conduct experiments with generative text models, revealing that current systems still struggle to produce high-quality extreme summaries. However, a qualitative analysis shows that in some cases, the generated summaries resemble those written by humans. This paper is organized as follows. In Section 2 we present the related work. In Section 3 we describe the BOE-XSUM dataset and provide a qualitative analysis of its extreme summaries. Section 4 focuses on the experiments, the results of which are discussed in Section 5 . Finally, the conclusions are presented in Section 6 . 2 Related work In general, there are two main approaches to summarization: extractive and abstractive summarization [ Cajueiro et al.,2023 ] . Within the extractive works, we can find those that compute frequencies, such as those based on spatial vectors [ Baeza-Yates et al.,1999 , Belwal, Rai, and Gupta,2021 ] , matrix factorization [ Gong and Liu,2001 ] , graphs [ Mihalcea and Tarau,2004 ] , topics [ Haghighi and Vanderwende,2009 ] and neural word embeddings [ Kågebäck et al.,2014 ] . In addition to frequency-based methods, there are also approaches based on heuristics [ Edmundson,1969 ] , [ Dalal and Zaveri,2011 ] , linguistics [ Edmundson and Wyllys,1961 ] , [ Mohamed,2016 ] , supervised machine learning [ Mao et al.,2019 ] , and reinforcement learning [ Ryang and Abekawa,2012 , Hyun et al.,2022 ] . Extreme summarization is a form of single-document summarization that aims to generate highly concise summaries—often a single sentence—that capture the core meaning of the source text [ Narayan, Cohen, and Lapata,2018a , Cachola et al.,2020a ] . Unlike extractive methods, it requires abstractive generation to synthesize information from the input, making it particularly useful in domains like scientific literature and news media [ Mao, Zhong, and Han,2022 ] . There exist datasets of summaries in many languages such as English [ Grusky, Naaman, and Artzi,2018 ] , Spanish and Catalan [ Segarra Soriano et al.,2022 ] , Indonesian [ Koto, Lau, and Baldwin,2020 ] , and Bengali [ Khan et al.,2023 ] among others. And while there are multilingual datasets available, such as MLSUM [ Scialom et al.,2020 ] , WikiLingua [ Ladhak et al.,2020 ] , EUR-Lex-Sum [ Aumiller, Chouhan, and Gertz,2022 ] , XL-SUM [ Hasan et al.,2021 ] and HumSet [ Fekih et al.,2022 ] , they usually share certain characteristics that are not optimal for their use in training generative models. For instance, summaries may be provided as titles preceding the text, or they might conclude with a link to the full text, making it very easy for language models to match the original text and its summary. Such features, particularly given the public nature of these texts, enhance the effectiveness of generative models, which, in the end, perform a memorization task, instead of a meaning abstraction task. As for extreme summarization datasets in Spanish, the availability of resources is severely limited, with only one available dataset, NoticIA [ García-Ferrero and Altuna,2024 ] , which consists of 850 Spanish news articles with clickbait headlines, each paired with a human-written, single-sentence generative summary. This dataset assesses the ability of models to understand and summarize texts, addressing the challenge of interpreting complex information generated by clickbait headlines. Finding datasets of extreme summaries in languages other than English or Chinese is really difficult