LLMPR : A Novel LLM-Driven Transfer Learning based Petition Ranking Model

Avijit Gayen, Somyajit Chakraborty, Mainak Sen, Soham Paul, Angshuman Jana · 2025

Read LLMPR : A Novel LLM-Driven Transfer Learning based Petition Ranking Model by Avijit Gayen, Somyajit Chakraborty, Mainak Sen, Soham Paul, Angshuman Jana (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21689.txt.

Introduction

Five researchers wrote a computer science paper in two thousand twenty-five on ranking court petitions in India. A huge backlog of unresolved cases slows the delivery of justice. Sorting petitions by hand can be slow and shaped by personal bias, which adds to the delay.

Their system, called LLMPR, ranks petitions by how urgent their content seems. It learns from a data set of more than seven thousand annotated petitions. Text is turned into number form by three language models, then joined with simple counts such as days elapsed and word count. Among the models they trained, random forest and decision tree methods gave the best results.

Catalog record

CREATORAvijit Gayen, Somyajit Chakraborty, Mainak Sen, Soham Paul, Angshuman Jana
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-21689

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMPR : A Novel LLM-Driven Transfer Learning based Petition Ranking Model Avijit Gayen, Somyajit Chakraborty, Mainak Sen, Soham Paul, Angshuman Jana Abstract The persistent accumulation of unresolved legal cases, especially within the Indian judiciary, significantly hampers the timely delivery of justice. Manual methods of prioritizing petitions are often prone to inefficiencies and subjective biases, further exacerbating delays. To address this issue, we propose LLMPR (Large Language Model-based Petition Ranking), an automated framework that utilizes transfer learning and machine learning to assign priority rankings to legal petitions based on their contextual urgency. Leveraging the ILDC dataset comprising 7,593 annotated petitions, we process unstructured legal text and extract features through various embedding techniques, including DistilBERT, LegalBERT, and MiniLM. These textual embeddings are combined with quantitative indicators such as gap days, rank scores, and word counts to train multiple machine learning models, including Random Forest, Decision Tree, XGBoost, LightGBM, and CatBoost. Our experiments demonstrate that Random Forest and Decision Tree models yield superior performance, with accuracy exceeding 99% and a Spearman rank correlation of 0.99. Notably, models using only numerical features achieve nearly optimal ranking results (R 2 = 0.988, ρ \rho = 0.998), while LLM-based embeddings offer only marginal gains. These findings suggest that automated petition ranking can effectively streamline judicial workflows, reduce case backlog, and improve fairness in legal prioritization. keywords Petition Ranking, Legal Dataset, Transfer Learning, Large Language Model(LLM), Judiciary System 1 Introduction The judiciary system has been a part of any nation since ancient times. Historically, it was controlled and served by a monarch of a kingdom or an empire. Since then, the judiciary system has become a separate, independent part of any nation, irrespective of the nature of the government. It not only serves as a protector of the constitution of the nation but also ensures the fundamental rights of the citizens of the country. The function of the judiciary system is to provide timely justice to its citizens, irrespective of their caste, colour, and financial status. The smooth functioning of the judiciary system ensures the prosperity of the nation. The timely availability of legitimate justice enhances the morale of society, hence it reduces corruption as well as improves the social systems. On the other hand, the delayed process of the judiciary system deprives the common citizen of their deserved justice [ 1 ] . [ 2 ] examines the factors like legal infrastructure, out-of-date laws which influence the delay in judiciary decisions. The backlog in the judiciary system has been observed as one of the major issues. It is an open truth that delayed justice is always compromised due to lack of evidence which is abolished over time. In the Indian judiciary system, currently, around 30 million cases are pending. According to statistics, approximately 73000 cases are pending per judge [ 3 ] . The existing complicated paperwork and rigid rules of assessing justice make it a more time-consuming process. Thus, the accessibility of justice for the common marginal people of society is far off. On the other hand, this delayed process of justice is capitalised on by the rich people for their own self-interest [ 4 ] . This situation develops partiality in the judicial system. Moreover, political and rich people disrupt the independence of the judiciary system [ 5 ] . Also, the lack of coherent data across the different courts and such fixed deadline for the completion of cases makes this situation worse. Along with the large set of adjourned cases, the increasing crime rate over the years and increasing count of new Public interest litigation (PILs) 1 1 1 PIL is type of legal action where an individual or group initiates a case to protect the rights and interests of the general public or a marginalized group, even if they haven’t been directly harmed. Essentially, it’s using the legal system to address issues of public concern and social change [ 6 ] . overload the judiciary system day-by-day [ 7 ] . Finally, the grey area of the constitution majorly hinders the fast judgment process in those cases which deal with the fundamental rights of the citizens. There are fast-track courts and separate courts, tribunals, etc. that have been set to prioritise and quickly settle cases by expert judges. However, the introduction of technology became indispensable to handle backlogs, data coherency, etc, in the judiciary system. According to the Indian Law Commission [ 8 ] , it has been suggested to reduce the oral argument time in court proceedings by the introduction of technology-based proceedings to improve the backlogs. In this context, legal judgment prediction has become a point of interest for researchers in the last few years in the domain of machine learning and artificial intelligence. In [ 9 ] , the authors mainly focused on predicting judgment in the context of various cases. The ever-increasing new petitions overloads the judiciary system and becomes the main issue of the backlog of this system. This backlog not only overloads the entire judiciary system but also delays important cases due to the long list of comparatively trivial cases. The manual ranking of petitions often faces biases which hinder the urgency and fast decision of the petitions of sensitive and concurrent issues. Fast-track courts exist to address the high-priority cases; however, a quick and automated ranking system of the petitions can negate the manual biases. Introduction of such a system not only negates the manual biases but also identifies the importance of the petition to rank them, which in turn accelerates the entire judiciary system to reduce the existing backlogs. There are very few works [ 10 , 11 , 12 ] that are related to the above issue, we could not find any such work that could address the issue. Thus, there is a strong requirement for the development of such a petition ranking system, which will reduce the backlogs by prioritising the petitions which help them to get a quick final decision on petitions. In this work, we predict the rank of petitions’ which has been initially accepted for further legal proceedings. Specifically, we predict the rank of accepted petitions filed based on the statement of the petition framed by the legal practitioner. This ranking system would work as an automated system that identifies the importance based on contextual sensitivity and fundamental judicial priority of the petitions filed, but also helps to automatically negate the pressure of trivial cases, cases with the least legal basis, etc. Hence, precious court time is being saved and allowing discussion of more important cases that are relevant to social improvements. The major challenges of this work could be • petitions are unstructured, i.e., these are different from one case to another. • The languages could be different • There exists a large corpus of data Therefore, predicting the rank of initially accepted petitions is challenging as well as indispensable to developing a decision support system in this context. This system would not only reduce the backlog of the judiciary system but also provide a fair and unbiased judiciary system. To predict the ranking of accepted petitions, we proposed the following methodology that leverages a structured framework using machine learning techniques. In our work, we have used the

Read the complete text