Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning

Olivia Peiyu Wang, Leilani H. Gilpin · 2026

Read Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning by Olivia Peiyu Wang, Leilani H. Gilpin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14049.txt.

Introduction

Wang and Gilpin bridge legal reading and formal logic to make AI legal reasoning more faithful. Language models now help read contracts, draft papers and weigh sources at scale, yet legal work demands rigor current systems lack. The core flaw is not mere hallucination: models draw inferences past what sources support, then dress assumption-heavy conclusions as logically grounded. The proposal pairs model fluency with formal verification checks, aiming for AI legal help that is both able and trustworthy.

Catalog record

CREATOROlivia Peiyu Wang, Leilani H. Gilpin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE7958
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14049

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging Legal Interpretation and Formal Logic: Faithfulness, Assumption, and the Future of AI Legal Reasoning
Olivia Peiyu Wang, Leilani H. Gilpin

Abstract
The growing adoption of large language models in legal practice brings both significant promise and serious risk. Legal professionals stand to benefit from AI that can reason over contracts, draft documents, and analyze sources at scale, yet the high-stakes nature of legal work demands a level of rigor that current AI systems do not provide. The central problem is not simply that LLMs hallucinate facts and references; it is that they systematically draw inferences that go beyond what the source text actually supports, presenting assumption-laden conclusions as if they were logically grounded. This proposal presents a neuro-symbolic approach to legal AI that combines the expressive power of large language models with the rigor of formal verification, aiming to make AI-assisted legal reasoning both capable and trustworthy, thus reducing the burden of manual verification without sacrificing the accountability that legal practice demands.



1
Problem Statement: Two Kinds of Correctness

Legal professionals and AI researchers share the goal of deriving trustworthy, verifiable reasoning over legal text, but approach it through fundamentally different frameworks. Legal interpretation draws on background knowledge and contextual inference, while formal logic demands that all inferences be explicitly grounded in the text.

These frameworks are not different levels of rigor, but different modes of reasoning. A legally sound conclusion may be formally invalid because that norm is nowhere stated in the contract. This gap is largely invisible in legal AI research because most systems either mimic legal interpretation through language model training or enforce formal validity through symbolic methods, without acknowledging that the two regularly diverge. We argue that making this gap explicit, measurable, and addressable is one of the most important open problems in legal AI.

2
Research Contribution: Measuring the Gap

Dataset and re-annotation.

We investigate this gap using ContractNLI
10
, one of the few benchmarks grounded in authentic contract language. Its original labels, produced by legally trained annotators, largely reflect legal interpretation. We do not dispute this. We re-annotate the same examples under a strict formal definition - a hypothesis
H
is entailed by premise
P
if and only if
P\wedge\neg H
is unsatisfiable, contradicted if and only if
P\wedge H
is unsatisfiable, and neutral otherwise.

The result is striking - there is a substantial proportion of label shifts, primarily from
Entailment
to
Neutral
. These are not errors. There are cases where the original conclusion depends on background legal knowledge or contextual assumptions reasonable for a lawyer to invoke but absent from the text. This predominant
Entailment
\to
Neutral
transition reveals a systematic gap between pragmatic legal interpretation and strict formal entailment. We further construct minimal pairs - for each divergent case, a minimally modified hypothesis that becomes formally entailed by supplying the missing assumption explicitly. This approach transforms an opaque gap into a tractable, analyzable object.

Experimental findings.

We evaluate three paradigms across five LLMs (GPT
1
, Claude
4
, LLaMA
3
, DeepSeek
11
, Qwen
14
): pure LLM classification, LLM reasoning over formal logical representations, and a neuro-symbolic pipeline combining LLM formalization with an SMT solver
5
. Formal structure improves accuracy, but
accuracy does not imply faithful reasoning
. High-performing models succeed by mimicking legal interpretation, including its implicit assumptions, rather than by reasoning formally. The SMT pipeline is more conservative, returning neutral classification whenever explicit grounding is lacking, and surfacing the gap rather than papering over it.

We identify three recurring failure modes

•

Assumption Injection:
the reasoning silently bridges gaps with unstated inferences.

•

Scope Laundering:
the reasoning presents informal conclusions as formally grounded.

•

Implicit Constraint Blindness:
the reasoning overlooks constraints present in formal representations

The dominant error across all models is
Neutral

\to

Entailment
misclassification, reflecting systematic assumption injection. The
Entailment

\leftrightarrow

Contradiction
confusions are rare, which indicates that the challenge is insufficient grounding, not logical inconsistency.

Minimal axiom framework.

Furthermore, the
Neutral
classification does not necessarily need to be a dead end. Rather than stopping at a neutral classification, the system computes the
minimal set of additional axioms
sufficient to shift the classification to
Entailment
or
Contradiction
, and presents them to a legal reviewer with a targeted question - does standard contract law or the contractual context implicitly establish this assumption? A lawyer answering
yes
validates the implicit norm that formal logic cannot capture alone; a lawyer answering
no
confirms the case is genuinely underspecified. In both cases, legal expertise is applied precisely where formal methods reach their limit. The complexity of the minimal axiom set is also diagnostic - many or complex axioms signal genuine interpretive difficulty, while few and simple axioms suggest confident automated classification.

3
Research Agenda: Bridging the Gap

The legal interpretation-formal logic gap is not unique to contract entailment. It arises wherever AI systems cite sources to support legal claims, which is increasingly common in LLM-assisted drafting, regulatory analysis, and litigation support
12
;
8
. Prior work addresses
fabricated citations
such as references that do not exist, a problem now largely tractable through retrieval verification
2
;
cohan2019scicite
. The more difficult and consequential problem is
stance misrepresentation
where the source exists and is retrieved correctly, but the claim overstates, understates, or mischaracterizes what the source says
13
. A model trained to reason like a lawyer will routinely infer more from a cited source than it strictly supports, because that is what legal interpretation does. Between 50 and 80 percent of LLM responses in legal and medical domains are not fully supported by their cited sources
2
, yet no formal detection framework exists for this failure mode.

We propose two contributions to address this -

•

A Benchmark Dataset:
The benchmark dataset should consist of LLM-generated legal and academic text annotated for stance misrepresentation at the claim level, using the three-way framework and minimal pair methodology from our research contribution.

•

Solver-in-the-Loop Training:
Rather than using LLM judges or human preferences as feedback, we will use a formal verification tool as a reward signal, teaching the model to distinguish formally supportable inferences from assumption-laden ones. When the solver flags an insufficiently grounded claim, it also computes the minimal axioms required to ground it, feeding directly into targeted human review at exactly the points where legal interpretation and formal grounding diverge.

Vision.

The long-term goal is AI legal reasoning that operates transparently across both frameworks. It should be capable of legal interpretation when appropriate, formal grounding when required, and able to surface the minimal assumptions connecting the two for targeted legal review
9
;
7
. We argue that understanding where and why current legal AI systems break is not a limitation but the foundation of this agenda. Only by honestly characterizing failure modes can we identify where AI assistance can be responsibly applied and build systems that proactively surface interpretive uncertainty rather than asking lawyers to verify conclusions after the fact
6

Read the complete text