Rule-Based Approaches to Atomic Sentence Extraction

Lineesha Kamana, Akshita Ananda Subramanian, Mehuli Ghosh, Suman Saha · 2026

Read Rule-Based Approaches to Atomic Sentence Extraction by Lineesha Kamana, Akshita Ananda Subramanian, Mehuli Ghosh, Suman Saha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00506.txt.

Introduction

Lineesha Kamana, Akshita Ananda Subramanian, Mehuli Ghosh, and Suman Saha study atomic sentence extraction, the task of splitting a complex sentence into simple ones that each carry a single idea. Simpler sentences help search, question answering, and automated reasoning. Language models have improved extraction accuracy, but they hide why failures happen.

Earlier rule-based work extracted subject-verb-object patterns, yet nobody had systematically mapped which clause structures cause trouble. The authors analyze how relative clauses, adverbial clauses, coordination patterns, and passive forms affect extraction difficulty. Their rule-based approach keeps the process interpretable, so each failure can be traced to a concrete linguistic structure. That diagnostic view is meant to guide better extractors, whether rule-based or model-based.

Catalog record

CREATORLineesha Kamana, Akshita Ananda Subramanian, Mehuli Ghosh, Suman Saha
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-00506

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rule-Based Approaches to Atomic Sentence Extraction Lineesha Kamana, Akshita Ananda Subramanian, Mehuli Ghosh, Suman Saha Abstract Natural language often combines multiple ideas into complex sentences. Atomic sentence extraction, the task of decomposing complex sentences into simpler sentences that each express a single idea, improves performance in information retrieval, question answering, and automated reasoning systems. Previous work has formalized the “split-and-rephrase” task and established evaluation metrics, and machine learning approaches using large language models have improved extraction accuracy. However, these methods lack interpretability and provide limited insight into which linguistic structures cause extraction failures. Although some studies have explored dependency-based extraction of subject-verb-object triples and clauses, no principled analysis has examined which specific clause structures and dependencies lead to extraction difficulties. This study addresses this gap by analyzing how complex sentence structures—including relative clauses, adverbial clauses, coordination patterns, and passive constructions—affect rule-based atomic sentence extraction performance. Using the WikiSplit dataset, we implemented dependency-based extraction rules in spaCy, generated 100 gold-standard atomic sentence sets, and evaluated performance using ROUGE and BERTScore. The system achieved ROUGE-1 F1 = 0.6714 , ROUGE-2 F1 = 0.478 , ROUGE-L F1 = 0.650 , and BERTScore F1 = 0.5898 , indicating moderate to high lexical, structural, and semantic alignment. Challenging structures included relative clauses, appositions, coordinated predicates, adverbial clauses, and passive constructions. Overall, rule-based extraction is reasonably accurate but sensitive to syntactic complexity. 1 Introduction Many natural language sentences contain multiple propositions expressed through embedded clauses and other complex linguistic structures. For tasks such as question answering and automated reasoning, these sentences can contain too many ideas packed together, which makes it harder for computer systems to understand the meaning clearly. This can make them perform worse on such tasks. Atomic sentence extraction can help bypass this challenge. It unpacks complex sentences into simple substances that each convey a single idea. These smaller “atomic” units are easier for systems to interpret as they make relationships between subjects, verbs, and prediction more clear. Previous work has explored this sector through the split-and-rephrase problem and relies heavily on large neural models trained on datasets. While these models perform well, they do not explain why they choose certain splits, and it is hard to understand which linguistic structures cause them to fail. Rule-based and dependency-based approaches, on the other hand, provide far more transparency as they rely on the syntax itself. To explore which specific linguistic structures cause the most problems for rule-based atomic sentence extraction systems, two research questions will be answered: What types of sentence structures (such as relative clauses, conditionals, or negations) are the hardest to split correctly? How accurate are the sentence extractions? To answer these questions, we built a rule-based extraction system using spaCy’s dependency parser and evaluated it on a subset of the WikiSplit dataset. The goal of this is to pinpoint which features lead to errors and determine how future systems can better handle even more complex sentences. 2 Background and Literature Review Research on splitting up complex sentences into simpler, atomic units, emerged from the split-and-rephrase task. Narayan et al. (2017) formalized this approach. Their work introduced evaluation metrics such as BLEU and SARI for measuring accuracy and usefulness of the split sentences. This has established a strong foundation for future studies then adopted. Building on this framework, Botha et al. (2018) introduced WikiSplit, which is a large dataset that was created from naturally occurring sentence splits found in Wikipedia edit histories. This work has helped demonstrate that a large-scale dataset can significantly improve AI models for the split-and-rephrase approach. The WikiSplit dataset also offered a more diverse set of sentence structures compared to datasets used in previous work. This makes it a very valuable benchmark for evaluating real-world splitting. In comparison to a neural network approach, dependency-based extraction methods focus on the interpretability of the sentence structures’ syntax. Nikalus et al. (2018) provided a survey of Open Information Extraction (OpenIE) systems and highlighted how dependency parses can be used to extract subject-verb-object tropes and clause-like units. The discussion of static relations, such as nsubj, dobj, advcl, and elcl directly influences how we formulated rules for identifying atomic sentences. Their survey also emphasized the strengths and limitations of rule-based systems, which reinforced the need for detailed analysis of which linguistic structures cause problems for dependency-based extraction. Syntactic simplification research has shown that reducing grammatical complexity by operations such as disembedding relative clauses, separating subordinate clauses, and splitting coordinated verb phrases can substantially improve text comprehensibility for readers and downstream NLP systems (Siddharthan, 2006). Liu, Cohen, and Lapata (2018) introduced the methods for parsing Discourse Representation Structures (DRS). This has emphasized interpretable and rule-based derivations. Their work demonstrated the value behind structured representations for semantic sentences. This has supported our decision to build a rule-based extraction model rather than a neural model, ensuring we can trace back how specific syntax influences the extraction success. These studies provide the conceptual and methodological abscess for our work. Prior research had helped to identify datasets and evaluation frameworks as well as demonstrating the usefulness of dependency information and highlighting the importance of interpretability. However, none of these studies examine which clause types cause challenges with rule-based atomic sentence extraction. 3 Methodology 3.1 Dataset Selection We sampled 100 complex sentences from the WikiSplit dataset, which is a large-scale corpus built for the purpose of the split-and-rephrase task. WikiSplit, however, only provides two-way splits, which are insufficient for evaluating the success of multi-clause atomic decomposition. Because our goal was to break up a sentence into all propositions that express a single idea, we treated the complex sentences as a base for developing more granular atomic sentences. 3.2 Gold-Standard Annotation Procedure Each of the 100 sentences that were selected were manually split into 2-5 atomic sentences, depending on the number of separate ideas in the overall complex sentence. During annotation, guidelines were strictly followed to ensure that splitting was consistent across all sentences. • Each atomic sentence must express only one state or event. • Relative clauses such as (“Diana, who served as mayor…”) were split into separate atoms. • Coordinated predicates such as (“Alic sang and danced”) were split into multiple sentences, such as “Alice sang” and “Alice danced.” • Adverbial clauses such as “before” and “although” were split into their own separate sentences. 3.3 Data Cleaning and Tokenization To prepare the dataset for splitting, and eventually evaluation, duplicate sentences were first removed using Pandas. Then, all sentences were made lowercase for matching, so that lack of capitalization would not skew the original sentence splitting rules, and later on, the ROUGE or BERT Scores. Then, spaCy’s “en_core_web_sm” model was used because it is efficient and lightweight. It was used to tokenize, tag for part of speech, and parse for dependency. 3.4 Rules-Based Splitting A rules-based extraction system attempted to split each sentence by detecting coordinating conjunctions using the words themselves (“and” and “or”), or the part of speech (“conj”). It also identified clauses that were tagged as being subordinate, such as adverbial and relative clauses (“advcl” and “relcl”). It also attempted to, based on dependency parsing, assign the correct subject to a phrase. “Anna ate an apple and a banana” → “Anna ate an apple,” “Anna ate a

Read the complete text