LLM-Assisted Causal Structure Disambiguation and Factor Extraction for Legal Judgment Prediction
Yuzhi Liang, Lixiang Ma, Xinrong Zhu · 2026
Read LLM-Assisted Causal Structure Disambiguation and Factor Extraction for Legal Judgment Prediction by Yuzhi Liang, Lixiang Ma, Xinrong Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11446.txt.
Introduction
Liang, Ma, and Zhu aim to make legal judgment prediction rest on legal logic, not word patterns alone. Older models lean on fact-outcome links, so they can learn false links and break under change. The team's fix mixes language model priors with statistical causal discovery. A coarse-to-fine step first pulls clean legal factors from noisy case text. The model then helps prune unclear causal directions into candidate graphs. Those graphs steer attention in the final model, which beats best prior systems on three data sets.
Catalog record
| CREATOR | Yuzhi Liang, Lixiang Ma, Xinrong Zhu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55719 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11446
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LLM-Assisted Causal Structure Disambiguation and Factor Extraction for Legal Judgment Prediction Yuzhi Liang, Lixiang Ma, Xinrong Zhu Abstract Mainstream methods for Legal Judgment Prediction (LJP) based on Pre-trained Language Models (PLMs) heavily rely on the statistical correlation between case facts and judgment results. This paradigm lacks explicit modeling of legal constituent elements and underlying causal logic, making models prone to learning spurious correlations and suffering from poor robustness. While introducing causal inference can mitigate this issue, existing causal LJP methods face two critical bottlenecks in real-world legal texts: inaccurate legal factor extraction with severe noise, and significant uncertainty in causal structure discovery due to Markov equivalence under sparse features. To address these challenges, we propose an enhanced causal inference framework that integrates Large Language Model (LLM) priors with statistical causal discovery. First, we design a coarse-to-fine hybrid extraction mechanism combining statistical sampling and LLM semantic reasoning to accurately identify and purify standard legal constituent elements. Second, to resolve structural uncertainty, we introduce an LLM-assisted causal structure disambiguation mechanism. By utilizing the LLM as a constrained prior knowledge base, we conduct probabilistic evaluation and pruning on ambiguous causal directions to generate legally compliant candidate causal graphs. Finally, a causal-aware judgment prediction model is constructed by explicitly constraining text attention intensity via the generated causal graphs. Extensive experiments on multiple benchmark datasets, including LEVEN , QA, and CAIL, demonstrate that our proposed method significantly outperforms state-of-the-art baselines in both predictive accuracy and robustness, particularly in distinguishing confusing charges. 1 Introduction Legal Judgment Prediction (LJP) aims to automatically predict court rulings based on case fact descriptions, representing one of the most representative core tasks in the field of legal artificial intelligence. In recent years, with the rapid advancement of pre-trained language models (PLMs), fine-tuning approaches based on BERT and its variants have become the mainstream paradigm in LJP research. These methods typically model judgment prediction as a text classification problem, leveraging PLMs’ powerful contextual semantic representation capabilities to automatically learn discriminative features related to judicial outcomes from case facts. They have achieved significant performance improvements across multiple authoritative benchmark datasets. However, from a legal theory perspective, sentencing is not a simple semantic matching or correlation assessment. It is a rigorous reasoning process that strictly follows legal elements and unfolds based on fact-norm causal logic. Existing PLM-based fine-tuning models primarily rely on statistical correlations between case facts and judicial outcomes, lacking explicit modeling of legal elements and their inherent causal structures. Consequently, they are prone to learning spurious correlations unrelated to the adjudicated conclusions. Previous studies have demonstrated that even minor perturbations to punctuation within input factual descriptions—without altering underlying semantics—can significantly alter predictions from state-of-the-art models( 6 ). This phenomenon exposes fundamental limitations in correlation-driven approaches regarding robustness and reasoning credibility. To address these shortcomings, integrating causal inference into the LJP task has emerged as a key research direction in recent years. Related work seeks to transcend superficial statistical correlations by uncovering more legally meaningful causal mechanisms linking case facts to judicial outcomes. For instance, 22 extracted latent causal relationships from case facts and constructed causal graphs to assist in distinguishing easily confused criminal charges; 6 systematically analyzed bias sources in legal data using Structural Causal Models (SCM) and proposed bias-reduction learning strategies. These studies demonstrate the potential advantages of causal modeling in enhancing model interpretability and robustness. Despite progress, reliably constructing causal structures within authentic legal text remains a critical bottleneck constraining the practical application of LJP causal methods. Specifically, existing approaches face two primary challenges: (1) Difficulty in accurately identifying legal factors. Keyword extraction methods based on statistical features or unsupervised rules (e.g., YAKE) struggle to distinguish high-frequency narrative components from substantive legal elements, often introducing noise such as names, place names, or template expressions. Methods relying on general open-information extraction tools face severe domain transfer issues, frequently resulting in omissions or errors in extracting key elements within syntactically complex, highly formalized legal texts. (2) Significant uncertainty in causal structures. Traditional causal discovery algorithms rely on observational data. Under the highly sparse conditions of legal text features, statistical independence tests often lack sufficient support. Simultaneously, due to the existence of Markov equivalence, methods like GFCI can only output partial ancestor graphs containing numerous directionally uncertain edges when lacking temporal or intervention information. This forces subsequent models to introduce heuristics or random assumptions, weakening the legal interpretability of causal structures. To address these challenges, this paper proposes an enhanced inference framework that integrates large language model (LLM) prior knowledge with statistical causal discovery. This approach aims to maintain the rigor of causal inference while leveraging the legal common sense and reasoning capabilities inherent in LLMs. It mitigates noise interference and structural disambiguation issues, achieving a complete closed-loop process from unstructured case facts to causally informed judgment prediction. Specifically, at the legal factor level, we propose a “coarse-to-fine” hybrid extraction mechanism. This mechanism generates candidate legal factor sets using statistical methods, enhancing coverage of long-tail critical evidence through uniform sampling in word frequency space. Subsequently, by integrating retrieval-enhanced generation and reasoning chain techniques, we guide the LLM to map candidate factors to standard legal elements while systematically filtering non-element noise, thereby constructing a semantically pure, jurisprudentially consistent causal variable space. Secondly, at the causal structure level, we propose an LLM-assisted probabilistic disambiguation and multi-graph sampling strategy. Addressing ambiguous causal edges in the PAG output by GFCI, this paper avoids deterministic or random assumptions. Instead, it employs the LLM as a constrained “soft legal knowledge base.” Under explicit case details and legal provision prompts, the LLM performs prior probability assessments on uncertain causal directions. Combined with judicial logic constraints and fundamental temporal constraints for pruning and sampling, this generates a set of candidate causal graphs consistent with legal principles, thereby preserving and explicitly modeling causal uncertainty. After generating causal graphs, we constrain text attention weights based on graph information to achieve effective integration between causal inference and pre-trained language models. In summary, the main contributions of this paper can be summarized in three points: 1. Proposed a legal factor identification paradigm integrating statistical screening with LLM semantic reasoning, achieving high-precision extraction of legal elements; 2. Designed an LLM-assisted causal structure disambiguation mechanism to mitigate structural uncertainty caused by Markov equivalence in observational causal discovery; 3. Constructs a causality-aware judgment prediction model that guides attention mechanisms through explicit causal effects, significantly enhancing accuracy and robustness in distinguishing similar criminal charges. Experimental results demonstrate that our proposed method achieves significantly higher prediction accuracy than existing mainstream baseline models across multiple legal datasets, including LEVEN, QA, CAIL, LEDGAR, and Overruling. 2 Related work Early research on legal text classification primarily relied on traditional machine learning methods such as Support Vector Machines (SVM) and Random Forests, combined with feature engineering techniques like TF-IDF and Bag-of-Words for text vectorization. 8 employed an SVM classifier for multi-label legal text classification. While emphasizing computational simplicity, this approach captures only superficial information through shallow features, resulting in insufficient generalization for large-scale long documents. 5 compared concept-feature-based Random Forests with deep learning models in legal text classification, finding traditional models retain certain advantages under specific settings. 2 explored the application of machine learning techniques (including random forests and XGBoost) in crime category classification