Exploring Lightweight Large Language Models for Court View Generation

Zhitian Hou, Tianyong Hao, Nanli Zeng, Zhixiong Chao, Kun Zeng · 2026

Read Exploring Lightweight Large Language Models for Court View Generation by Zhitian Hou, Tianyong Hao, Nanli Zeng, Zhixiong Chao, Kun Zeng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16770.txt.

Introduction

Hou and colleagues explore lightweight language models, under 2 billion parameters, for criminal court view generation. That task drafts a court's view from case facts. They ask how architecture and size affect generation quality and charge prediction, and how small models compare with deep neural networks. They also test whether predicting the charge from a generated court view beats direct prediction. With an evaluation kit spanning three public datasets, experiments map trade-offs among architecture, size, and task interaction. The results show real potential for small models in judicial AI.

Catalog record

CREATORZhitian Hou, Tianyong Hao, Nanli Zeng, Zhixiong Chao, Kun Zeng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28883
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16770

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploring Lightweight Large Language Models for Court View Generation Zhitian Hou, Tianyong Hao, Nanli Zeng, Zhixiong Chao, Kun Zeng Abstract Criminal Court View Generation (CVG) is a critical task in Legal Artificial Intelligence (Legal AI), involving the generation of court view based on case facts. In this work, we systematically explore the capabilities of lightweight (smaller than 2B) large language models (LLMs) in CVG and their impact on charge prediction. Our study addresses four key questions: (1) how does different architecture of LLMs affect the CVG quality and charge prediction. (2) how does LLMs size contribute to the performance, (3) how do lightweight LLMs compare with Deep Neural Networks (DNNs) in these tasks, and (4) how does predicting charge by court view generation first compare with predicting it directly. Additionally, we also develop CVGEvalKit, an evaluation framework including three public available datasets for CVG tasks, as well as predicting their charges. Comprehensive experiments are conducted on this framework, where models are trained on a mixed training set and evaluated on each dataset’s test set. Experimental results provide new insights into the trade-offs between model architecture, model size, and the influence between different tasks, highlighting the potential of lightweight LLMs in judicial AI applications. The source code is anonymously available at https://github.com/ZhitianHou/CVGEvalKit Figure 1: The average ROUGE-L of CVG of each test dataset of each model after fine-tuning. 1 Introduction In recent years, methods from the field of artificial intelligence have been increasingly applied to the legal domain ( 3 ; 4 ; 5 ; 6 ) . Criminal Court View Generation (CVG) is a crucial task in the field of legal artificial intelligence (Legal AI), aiming to automatically produce court view based on the fact description of a case ( 20 ) . In the legal system, a court view not only justifies the final judgment but also provides transparency and interpretability, ensuring that legal decisions are understandable and consistent. Traditionally, drafting court view requires significant human expertise and effort, which motivates the development of automated CVG systems. Beyond simply generating text, CVG plays a vital role in downstream applications, such as charge prediction, where the quality of court view directly affects the accuracy of subsequent decisions. Despite its importance, CVG remains a challenging problem due to the complexity of legal language, the need for logical consistency, and the necessity to incorporate statutory knowledge and factual details accurately. Recent advances in natural language processing (NLP) have introduced Deep Neural Networks (DNNs) that can capture complex linguistic patterns and domain knowledge, and they have been applied to various legal tasks, including CVG ( 21 ; 18 ; 22 ) . For example, Yue et al. ( 21 ) designed a circumstances-enhanced framework that separately generates adjudicating and sentencing reasoning. Xu et al. ( 18 ) proposed LeGen, which is a legal concept-guided framework for criminal CVG that incorporates key legal concepts such as recidivism, confession, and robbery. Yue et al. ( 22 ) proposed Event Grounded Generation (EGG), which integrates fine-grained event information extracted from case facts into CVG. While DNNs have shown promise in language tasks, they often struggle to capture complex legal reasoning and long-range dependencies in case facts, which are crucial for generating accurate court views. On the other hand, Large Language Models (LLMs) exhibit stronger generative and reasoning capabilities, even in lightweight versions with moderate parameter scales, making them attractive candidates for CVG. As shown in Figure 1 , the open-source models can achieve better scores with bigger size after fine-tuning. However, systematic studies comparing successive LLM generations are scarce, and the effects of model architecture and size on both CVG quality and downstream applications, like charge prediction, remain underexplored. Additionally, the potential benefits of generating court reasoning before predicting charges versus direct charge prediction have not been thoroughly investigated, and comparative analyses between DNNs and LLMs on CVG tasks are largely missing. Addressing these gaps is essential to better understand the trade-offs in model design, scale, and task integration for judicial AI systems. To address these gaps, this work conducts a systematic study on lightweight LLMs for CVG. Specifically, we investigate different models at diverse architectures and sizes to analyze their impacts on CVG task. We further examine how CVG affects downstream charge prediction by comparing two approaches: generating court reasoning before predicting charges versus direct charge prediction. Finally, we provide a comparative analysis of DNNs and LLMs on CVG tasks to highlight the advantages and limitations of lightweight LLMs in legal AI. Our contributions are fourfold: • Analyzing the performance differences between different LLMs architecture. • Studying the effect of LLMs size on CVG quality and charge prediction. • Comparing DNNs and LLMs on CVG tasks, providing insights for the design of judicial AI systems. • Evaluating the impact of court view generation on charge prediction accuracy. Figure 2: Overview of the research methodology and the four research questions investigated in this study. Subfigure (a) compares the performance across different model architectures (Llama-3.2-1B-Instruct, Gemma3-1B-IT, Qwen3-1.7B, and InternLM2.5-1.8B-Chat), addressing the effect of architecture. Subfigure (b) relects the impact of model size by contrasting Qwen3-0.6B and Qwen3-1.7B. Subfigure (c) compares the performance of DNN models and lightweight LLMs. Subfigure (d) compares two strategies for charge prediction, CVG First and Directly , where dark blue and gray bars represent the two settings respectively. All subfigures use ROUGE-L as the evaluation metric. 2 Related Work 2.1 Structured Approaches for Court View Generation Recent research efforts have increasingly focused on enhancing CVG through the explicit modeling of legal structures and the integration of domain-specific knowledge. Earlier works enhance generation quality by extracting detailed legal attributes, such as adjudicating and sentencing circumstances or domain-related legal concepts, from fact descriptions to enrich the relevance and factual grounding of generated court views ( 21 ; 18 ) . Other studies incorporate external legal knowledge, for instance by embedding law articles, charges, or claim information into the generation process ( 20 ; 12 ) , or by leveraging legal knowledge bases through prompt engineering and model guidance techniques ( 11 ) . In addition, to improve interpretability and fairness, several methods adopt causality-driven reasoning frameworks, including counterfactual text generation ( 17 ; 9 ) , or employ modular generation pipelines with question–answer-based slot filling strategies ( 10 ) . Collectively, these efforts demonstrate that integrating structured legal knowledge and reasoning mechanisms can substantially enhance the coherence and reliability of CVG. 2.2 Leveraging LLMs for Court View Generation. With the rapid development of LLMs, recent studies have begun exploring their potential for CVG and related legal reasoning tasks. Some research leverages general-purpose LLMs to identify intermediate legal structures from case facts ( 22 ) , while others attempt to activate internal legal knowledge or incorporate external supervision signals to better adapt LLMs to legal text generation ( 13 ) . More recently, Hou et al. ( 7 ) introduces the first large language model, ShiZhi, specifically designed for CVG, demonstrating that even compact LLMs can produce coherent and legally grounded reasoning when trained on domain-specific data. However, though these works show that LLMs can be adapted for CVG, systematic analyses of lightweight LLMs and their performance on CVG tasks remain limited. In particular, there is

Read the complete text