MorphNLI: A Stepwise Approach to Natural Language Inference Using Text Morphing
Vlad-Andrei Negru, Robert Vacareanu, Camelia Lemnaru, Mihai Surdeanu, Rodica Potolea · 2025
Read MorphNLI: A Stepwise Approach to Natural Language Inference Using Text Morphing by Vlad-Andrei Negru, Robert Vacareanu, Camelia Lemnaru, Mihai Surdeanu, Rodica Potolea (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09567.txt.
Introduction
Negru and co-authors present MorphNLI, a step-by-step method for judging how two sentences relate. The task sorts pairs into entailment, contradiction, or neutral. Their system asks a language model to edit the first sentence, step by step, into the second.
A standard inference model then tracks how the label shifts after each small edit. Those step labels are pooled into the final call. In cross-domain tests, the method always beat strong baselines, with gains up to 12.6 percent. The edit trail also explains the verdict, since each atomic change can be inspected.
Catalog record
| CREATOR | Vlad-Andrei Negru, Robert Vacareanu, Camelia Lemnaru, Mihai Surdeanu, Rodica Potolea |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-09567
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MorphNLI: A Stepwise Approach to Natural Language Inference Using Text Morphing Vlad-Andrei Negru, Robert Vacareanu, Camelia Lemnaru, Mihai Surdeanu, Rodica Potolea Abstract We introduce MorphNLI, a modular step-by-step approach to natural language inference (NLI). When classifying the premise-hypothesis pairs into { entailment , contradiction , neutral }, we use a language model to generate the necessary edits to incrementally transform (i.e., morph ) the premise into the hypothesis. Then, using an off-the-shelf NLI model we track how the entailment progresses with these atomic changes, aggregating these intermediate labels into a final output. We demonstrate the advantages of our proposed method particularly in realistic cross-domain settings, where our method always outperforms strong baselines, with improvements up to 12.6% (relative). Further, our proposed approach is explainable as the atomic edits can be used to understand the overall NLI label. 1 Introduction Figure 1: Natural language inference example where both a state-of-the-art encoder-decoder model – BART (left) and a LLM – GPT-4o (middle) predict the incorrect label. Our approach (right) incrementally morphs the premise into the hypothesis, which decomposes the inference process into several simpler steps. This allows it to generate the correct label, which is also associated with an intuitive explanation that falls naturally from the morphing steps. In contrast, both the encoder-decoder model and the LLM produce the incorrect label. The LLM’s explanation suggests overfitting on annotation artifacts from SNLI, which assumes coreference between participants and concepts in the two texts Jiang and de Marneffe (2022) . Natural Language Inference (NLI), i.e., the task that determines whether a text hypothesis is true, false, or undetermined given a text premise Condoravdi et al. (2003) ; Dagan et al. (2005) ; Bowman et al. (2015) , is an important building block of many applications such as question answering, summarization, and dialogue systems, where understanding the logical connection between different pieces of information is essential Yin et al. (2019) ; Sainz et al. (2021) ; Sainz et al. (2022) . Despite the fact that NLI has received significant attention lately Raffel et al. (2019) ; Jiang et al. (2019) ; Sun et al. (2020) ; Wang et al. (2021) , several analyses have indicated that neural NLI methods fail to capture important semantic features of logic such as monotonicity, and more granular aspects like negation, universal vs. existential quantifiers, and concept modifiers Rozanova et al. (2022) ; Akoju et al. (2023) . Other significant limitations of current models are caused by task artifacts that oversimplify the NLI problem Williams et al. (2018) ; Jiang and de Marneffe (2022) . Large Language Models (LLMs) are prone to contamination Golchin and Surdeanu (2024) ; Sainz et al. (2024) , which causes overfitting on these task artifacts (see Section 4.4 ). LLMs also tend to “not say what they think” Turpin et al. (2024) , which reduces the quality and faithfulness of their explanations. To address the above drawbacks, we propose a cautious NLI strategy that decomposes the NLI decision into several simpler and more explainable steps. Specifically, our approach: (a) incrementally transforms the premise into the hypothesis using text morphing Huang et al. (2018) ; (b) applies an off-the-shelf NLI model on each morphing iteration; and (c) aggregates the individual NLI labels into an overall label for the given premise-hypothesis pair. We call our method MorphNLI. Figure 1 provides a walk-through example of our approach, contrasted with a state-of-the-art encoder-decoder model and an LLM. The advantages of our direction are two fold. First, it performs better out of domain because its individual, smaller decisions reduce the chance of overfitting. Second, it naturally produces an explainable reasoning chain that traces the morphing transformations. Our approach is inspired by Natural Logic (NL) MacCartney and Manning (2009a) ; MacCartney and Manning (2014) but is more flexible. First, rather than relying on a formal alignment algorithm between premise and hypothesis, which continues to be a pain point in the development of NL systems Krishna et al. (2022) , we use a more nimble morphing algorithm Huang et al. (2018) that is trained on synthetic data. Second, instead of using the seven NL logic operators and a relatively complex finite-state automaton to aggregate them, we rely just on the three standard NLI labels (entailment, contradiction, neutral) and on a straightforward, robust aggregation decision that performs well in practice: pick the first non-entailment label in the sequence of NLI decisions. The contributions of our paper are: (1) We introduce MorphNLI, a modular approach for NLI that combines text morphing with neural NLI. Our method does not require any additional supervision, i.e., the text morphing model is trained using synthetic data; the neural NLI engine is an off-the-shelf model. (2) We evaluate our proposed method in multiple scenarios, including two cross-domain settings: from MNLI Williams et al. (2018) to SICK Marelli et al. (2014) , and from SICK to MNLI. Our empirical evaluation indicates that MorphNLI outperforms other state-of-the-art NLI models in all cross-domain experiments. Further, morphing improves the decisions of GPT-4o in the SICK dataset, further highlighting that LLMs do not capture well the semantics of logic Rozanova et al. (2022) ; Akoju et al. (2023) . (3) We perform a qualitative analysis of the explanations generated by MorphNLI, and show that they are better than GPT-4o’s on SICK, despite the fact that our model sizes are orders of magnitude smaller. However, both NLI performance and explanation quality of MorphNLI are worse on MNLI, which we suspect is due to the LLM’s contamination with the MNLI dataset. Figure 2: Training (top) and inference (bottom) for MorphNLI, including synthetic data generation for morphing. For the teacher model we use GPT-4; for the student model we use GPT-4o-mini. 2 Related work Our work draws inspiration from Natural Logic Lakoff (1970) , which is a form of reasoning aiming to draw logic inferences by operating directly over linguistic structures. Over the years, this has been implemented for natural language processing in various forms MacCartney and Manning (2007) ; Krishna et al. (2021) ; Rozanova et al. (2022) ; Feng et al. (2022) ; Korakakis and Vlachos (2023) . MacCartney and Manning (2007) introduced one of the first computational models for natural logic, which has been subsequently extended and improved in follow up work MacCartney and Manning (2008) ; MacCartney and Manning (2009b) . Natural logic can be useful beyond natural language inference, for tasks such as commonsense reasoning Angeli and Manning (2014) , fact verification Krishna et al. (2022) ; Strong et al. (2024) , or polarity tracking Hu and Moss (2018) . One drawback of natural logic is that it is too strict. For example, natural logic cannot readily accommodate paraphrases or temporal reasoning. Our proposed approach relaxes the strict requirements of natural logic formalism, relying instead on text morphing Huang et al. (2018) and off-the-shelf NLI models. Our work is also related to explainable NLI ( Camburu et al., 2018 ; Thorne et al., 2019 ; Camburu et al., 2020 , inter alia) . Importantly, in our proposed approach, the explanations are guaranteed to be faithful Kumar and Talukdar (2020) , as they are constructed based on the atomic edits produced by the morphing model. Tangentially, our proposed approach resembles work on modeling