Towards Intelligent Legal Document Analysis: CNN-Driven Classification of Case Law Texts

Moinul Hossain, Sourav Rabi Das, Zikrul Shariar Ayon, Sadia Afrin Promi, Ahnaf Atef Choudhury, Shakila Rahman, Jia Uddin · 2026

Read Towards Intelligent Legal Document Analysis: CNN-Driven Classification of Case Law Texts by Moinul Hossain, Sourav Rabi Das, Zikrul Shariar Ayon, Sadia Afrin Promi, Ahnaf Atef Choudhury, Shakila Rahman, Jia Uddin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17674.txt.

Introduction

Hossain and six colleagues present a lightweight, high-accuracy framework for citation-treatment classification of case law. Legal documents feature formal language, long sentences, and specialized terms, making manual triage slow and error-prone. The system pairs lemmatisation-based preprocessing and subword-aware FastText embeddings with a multi-kernel convolutional neural network. On 25,000 annotated legal documents split 75/25, the system reaches 97.26 percent accuracy and a 96.82 percent macro F1 score, beating fine-tuned BERT, FastText LSTM, random-embedding CNN, and TF-IDF nearest-neighbour baselines.

Catalog record

CREATORMoinul Hossain, Sourav Rabi Das, Zikrul Shariar Ayon, Sadia Afrin Promi, Ahnaf Atef Choudhury, Shakila Rahman, Jia Uddin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29472
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17674

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Intelligent Legal Document Analysis: CNN-Driven Classification of Case Law Texts Moinul Hossain, Sourav Rabi Das, Zikrul Shariar Ayon, Sadia Afrin Promi, Ahnaf Atef Choudhury, Shakila Rahman, Jia Uddin Abstract Legal practitioners and judicial institutions face an ever-growing volume of case-law documents characterised by formalised language, lengthy sentence structures, and highly specialised terminology, making manual triage both time-consuming and error-prone. This work presents a lightweight yet high-accuracy framework for citation-treatment classification that pairs lemmatisation-based preprocessing with subword-aware FastText embeddings and a multi-kernel one-dimensional Convolutional Neural Network (CNN). Evaluated on a publicly available corpus of 25,000 annotated legal documents with a 75/25 training–test partition, the proposed system achieves 97.26% classification accuracy and a macro F1-score of 96.82%, surpassing established baselines including fine-tuned BERT, Long Short-Term Memory (LSTM) with FastText, CNN with random embeddings, and a Term Frequency–Inverse Document Frequency (TF-IDF) k k -Nearest Neighbour (KNN) classifier. The model also attains the highest Area Under the Receiver Operating Characteristic (AUC-ROC) curve of 97.83% among all compared systems while operating with only 5.1 million parameters and an inference latency of 0.31 ms per document — more than 13 times faster than BERT. Ablation experiments confirm the individual contribution of each pipeline component, and the confusion matrix reveals that residual errors are confined to semantically adjacent citation categories. These findings indicate that carefully designed convolutional architectures represent a scalable, resource-efficient alternative to heavyweight transformers for intelligent legal document analysis. 1 Introduction With the advent of rapid digitalisation of judicial systems around the world, the number of case law archives has grown exponentially. Given the formalised register, complex syntactic structures, and the use of domain-specific Latin jargons and citation styles, the process of automated classification of these documents poses a number of challenges that cannot be entirely met by the standard Natural Language Processing (NLP) paradigm. This has given birth to a specialized branch of intelligent legal document analysis, where cutting-edge Artificial Intelligence (AI) and Natural Language Processing technologies are being leveraged for the automated analysis of case law documents. Apart from alleviating the cognitive burden on legal professionals, the processing power offered by the application of AI may also be used to improve the transparency and efficiency of legal information and processes. There are several recent studies that highlight the extent of the current research activity. Li et al. [ 1 ] have proposed a knowledge augmented model for the task of Legal Judgment Prediction (LJP) using the concept of "multi-task and multi-label learning." The model uses label-level and task-level knowledge to improve the precision of the predictions. McCarroll et al. [ 2 ] have compared the relative merits of shallow and deep learning techniques for the task of clause classification in Non-Disclosure Agreements, using the example of hybrid word representations performing better than the traditional TF-IDF method. A general-purpose legal article prediction system was proposed by Chi et al. [ 3 ] , where supervised classifiers and LLMs were combined for generalisation across different jurisdictions. Retrieval-augmented approaches have also gained traction. Nigam et al. [ 4 ] introduced NyayaRAG, a Retrieval-Augmented Generation (RAG) framework for legal judgment prediction under Indian common law. Arvin [ 5 ] systematically evaluated LLMs for extracting legal holdings from judicial opinions. Koenecke et al. [ 6 ] examined data curation, annotation, and evaluation challenges specific to legal AI datasets, while Hou et al. [ 7 ] surveyed domain adaptation strategies for LLMs in legal applications. Despite these advances, persistent limitations remain. Most competitive systems depend on fine-tuned BERT variants or large pre-trained LLMs, which demand substantial domain-specific training data and significant computational resources [ 8 ] . Legal texts also exhibit pronounced morphological variability, repetitive citation formulae, and out-of-vocabulary Latin terms that large-scale transformers do not always normalise reliably. The result is inconsistent cross-dataset performance and a notable absence of lightweight models that simultaneously achieve strong accuracy, interpretability, and deployment efficiency. This paper addresses that gap by proposing a pipeline that combines lemmatisation-based preprocessing, FastText subword embeddings, and a multi-kernel 1D-CNN to capture legal semantics at low computational cost. The principal contributions are as follows. • Novel lightweight pipeline: A CNN + FastText + Lemmatisation architecture for citation-treatment classification that achieves near-transformer accuracy (97.26%) while reducing inference latency by more than 13 \times compared with BERT. • Effective handling of legal morphology: Empirical validation that lemmatisation combined with subword-level FastText embeddings handles morphological variants, out-of-vocabulary legal terms, and citation-specific phrasing more reliably than standard deep learning baselines. • Domain-specific preprocessing strategy: A reusable preprocessing pipeline tailored to case-law semantics that generalises to other citation-treatment corpora without task-specific manual feature engineering. The remainder of this paper is structured as follows. Section 2 surveys related work on legal text classification. Section 3 describes the dataset, preprocessing pipeline, baseline configurations, and the proposed CNN-based methodology. Section 4 presents experimental results, comparative evaluation, and error analysis. Section 5 concludes the paper and outlines future research directions. 2 Literature Review Legal text classification has seen significant improvements over the past few years, thanks to advancements in deep learning models, data augmentation, and hybrid models. In a study by Guo et al. [ 9 ] , a hybrid BERT-CNN model was presented, which uses a multi-label legal case classification approach and employs shallow convolutional filters to extract localised text features, along with BERT. The hybrid model was able to perform better than a single transformer model in terms of F1 score. It was evident from the study that a combination of deep contextual models and convolutional features could be advantageous in text classification models. Kim et al., in their study on temporal-aware interfaces for Korean legal research [ 10 ] , specifically examined the potential of utilizing inter-case relevance signals to improve the effectiveness of the process of retrieval, which is highly relevant to the task of citation-based classification. Duffy et al., in a study on the evaluation of rule-based and generative methods of data augmentation for the task of legal document classification [ 11 ] , observed improvements in accuracy and the mitigation of overfitting on small training sets at institutions with limited access to large-scale pre-training datasets. Another domain where retrieval-augmented generation has been used is legal reasoning. In the paper by Barron et al. [ 12 ] , the authors used the combination of LLM and precedent text for the purpose of legal argumentation. The use of this method is to ensure grounding and interpretability. Sargeant et al. [ 13 ] have developed a novel taxonomy for United Kingdom case law and have shown that LLMs can be used to reliably map judicial opinions to topic categories. The logic-augmented neural models can be seen as an alternative research direction. Zhang et al. [ 14 ] introduced the RLJP model, which combines first-order logic rules with neural LJP to achieve more transparent and generalizable predictions, but at the expense of raw classification performance compared to data-driven approaches. This research direction indicates the rising need for interpretability and fairness in judicial AI research. Survey-based studies have also contributed to the relevant background. Singh et al. [ 15 ] have developed an exhaustive taxonomy of classification problems, evaluation schemes, and datasets for legal contracts, indicating imbalance problems and domain adaptation as the major unsolved

Read the complete text