RELexED: Retrieval-Enhanced Legal Summarization with Exemplar Diversity

Santosh T.Y.S.S, Chen Jia, Patrick Goroncy, Matthias Grabmair · 2025

Read RELexED: Retrieval-Enhanced Legal Summarization with Exemplar Diversity by Santosh T.Y.S.S, Chen Jia, Patrick Goroncy, Matthias Grabmair (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14113.txt.

Introduction

Santosh, Jia, Goroncy, and Grabmair present RELexED in a 2025 arXiv paper. Legal summarization squeezes long documents into short, coherent summaries. Models that read only the source often drift off theme or shift style.

RELexED guides the model with exemplar summaries fetched from other cases. A two-stage selection balances how close exemplars sit to the query against how varied they are among themselves. Scores come from influence functions, and a point process enforces the balance. On two legal datasets, RELexED beat models without exemplars and those picking exemplars by similarity alone.

Catalog record

CREATORSantosh T.Y.S.S, Chen Jia, Patrick Goroncy, Matthias Grabmair
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-14113

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RELexED: Retrieval-Enhanced Legal Summarization with Exemplar Diversity Santosh T.Y.S.S, Chen Jia, Patrick Goroncy, Matthias Grabmair Abstract This paper addresses the task of legal summarization, which involves distilling complex legal documents into concise, coherent summaries. Current approaches often struggle with content theme deviation and inconsistent writing styles due to their reliance solely on source documents. We propose RELexED, a retrieval-augmented framework that utilizes exemplar summaries along with the source document to guide the model. RELexED employs a two-stage exemplar selection strategy, leveraging a determinantal point process to balance the trade-off between similarity of exemplars to the query and diversity among exemplars, with scores computed via influence functions. Experimental results on two legal summarization datasets demonstrate that RELexED significantly outperforms models that do not utilize exemplars and those that rely solely on similarity-based exemplar selection. 1 Introduction Legal summarization is an essential task, aimed at distilling complex legal documents, such as court rulings and case judgments, into concise summaries Farzindar 2004 ; Saravanan et al. 2006 . These summaries assist legal professionals in quickly grasping the core information, saving time and enhancing decision-making efficiency Grover et al. 2003a ; Grover et al. 2003b . However, summarizing legal texts is uniquely challenging due to the highly structured and formalized nature of legal writing. Legal summaries must maintain factual accuracy, adhere to specific terminologies, and follow established patterns that reflect the reasoning and argumentation typical in legal documents Bhattacharya et al. 2019 ; Bhattacharya et al. 2021 ; Deroy et al. 2023 . Current approaches to legal summarization often rely solely on the content of the source document, leading to problems such as content deviation, where generated summaries stray from the central themes of the case and inconsistent writing style, failing to match the rigor and formality required in legal contexts Shukla et al. 2022 ; Moro and Ragazzi 2022 ; Elaraby and Litman 2022 ; Shen et al. 2022 ; Santosh et al. 2024b ; Santosh et al. 2024d . This occurs because existing models are expected to implicitly learn the templatization process during training, which is prevalent in legal writing where they follow specific templates or writing structures. To address this, it is essential to introduce writing templates as exemplars that can bring not only guidance of writing format but also additional background knowledge necessary Oya et al. 2014 ; Gao et al. 2019 . Rather than manually creating templates for each scenario which turns expensive to obtain from domain experts, one scalable way is to use reference summaries in the training corpus as exemplars An et al. 2021 ; Wang et al. 2022 . To the best of our knowledge, there has been no exploration of retrieval-enhanced exemplars for legal summarization task. This approach consists of two modules: Retriever and Summarizer. Given a query document, the Retriever is asked to retrieve the most related exemplars from the training corpus. The second module Summarizer generates the summary not only relying on source document but also the retrieved exemplars. This method bears resemblance to recent works of in-context learning Brown 2020 ; Dong et al. 2022 which appends a few demonstration examples to the query to form a prompt which is then fed into the language model for prediction. In this work, we are mainly interested in supervised learning where the model parameters are fine-tuned to learn from given examples than in-context learning which does not perform parameter updates and expects the model to learn the pattern using the demonstration examples in the prompt. The success of retrieval-enhanced methods in supervised learning demonstrates that, even with vast numbers of parameters, models are unable to memorize every pattern from the training data and hence by retrieving relevant examples and explicitly providing them to the model can enhance its performance Wang et al. 2022 ; Tyss et al. 2024 . This approach suggests that rather than constantly scaling models to larger sizes, we can achieve high-quality results by equipping a moderately sized model with training data that closely matches the current instance, thereby not only boosts performance but also significantly reduces computational costs An et al. 2021 . The main crucial link of retrieval-enhanced summarization are the chosen exemplars. Previous approaches generally rely on retrieving examples based on the similarity between the input and the examples based on traditional lexical-based BM25 Cao et al. 2018 ; Wang et al. 2022 or embeddings An et al. 2021 . Despite the improved performance, we posit that similarity based exemplar selection do not always take into account the inter-relationship between different exemplars. For instance, the ignorance of redundancy among examples can result in almost identical examples, providing no additional information to the model. In this paper, we propose a two-stage exemplar selection strategy for legal summarization, RELexED which balances both the quality and the diversity among the selected exemplars. In the first stage, we rely on semantic similarity to filter out unrelated examples and then in the second stage, instead of selecting each example independently, RELexED captures the inter-relationship between selected examples. To model the joint probability of selected set of examples given a specific input, we leverage determinantal point process (DPP) Kulesza et al. 2012 that learns to select relevant yet the most diverse example set. To measure the quality or similarity criterion, we resort to recent instance-based explanation methods Koh and Liang 2017 ; Pruthi et al. 2020 which aim to quantify how a training example affects the prediction of a test example after training. Our experiments on two legal summarization datasets, SuperSCOTUS and CivilSum demonstrate the effectiveness of retrieval-enhanced summarization and specifically, our proposed exemplar selection method, RELexED which goes beyond using similarity-based selection only. 2 RELexED: Our Method We first introduce the framework for retrieval-enhanced summarization and the background of the Determinantal Point Process (DPP). Then, we introduce the our two-stage exemplar selection strategy, RELexED, balancing quality and diversity. 2.1 Preliminaries Retrieval-enhanced Summarization First, we index the training corpus of document-summary pairs into a list of key-value pairs where the document serves as the key and its summary as the value. Given the input x, the retriever returns the k exemplars from the training corpus. Then, these retrieved results are combined with the input x to feed into the summarization model to generate the summary. Given that legal documents tend to be lengthy, we only incorporate the values (summaries) from the exemplars alongside the query input to the summarization model. DPP DPP is a probabilistic model to express interactions between items and could helps us to select a representative subset while keeping high diversity among different items Kulesza et al. 2012 ; Chen et al. 2018 . Formally, let S=\{1,\ldots,|S|\} denote a finite set of items and DPP defines a probability distribution over an exponential number of sets (all 2^{|S|} subsets of S ), parameterized by a single |S|\times|S| positive semi-definite kernel matrix, denoted as L . If k is a random set of elements drawn from S , then the probability of selecting that subset is given by determinants of sub-matrix of L : p(k;L)=\frac{\text{det}(L_{k})}{\text{det}(L+I)}\quad\sum_{k}\text{det}(L_{k})=\text{det}(L+I) (1) Here, \text{det}(.) is the determinant of a matrix, I is the identity matrix and L_{k} is a sub-matrix of L containing only entries indexed by elements of

Read the complete text