Refining Syntactic Distinctions Using Decision Trees: A Paper on Postnominal ’That’ in Complement vs. Relative Clauses
Hamady GACKOU · 2025
Read Refining Syntactic Distinctions Using Decision Trees: A Paper on Postnominal ’That’ in Complement vs. Relative Clauses by Hamady GACKOU (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14261.txt.
Introduction
Hamady Gackou, writing alone in 2025, works on a small grammar puzzle in English: the word that after a noun. Sometimes that starts a relative clause describing the noun, and sometimes it starts a complement clause giving the noun content. Automatic taggers often mix the two uses up.
Gackou first tested the TreeTagger English model built by Helmut Schmid on the task, then relabelled a corpus first parsed under the Universal Dependencies scheme. Retraining TreeTagger on the corrected data gave a model that separated the two uses more cleanly. The study also varied how much training data the model saw and checked how well the treebank files used stand in for English more broadly. Gains were modest but consistent for the harder distinction.
Catalog record
| CREATOR | Hamady GACKOU |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-14261
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Refining Syntactic Distinctions Using Decision Trees: A Paper on Postnominal ’That’ in Complement vs. Relative Clauses Hamady GACKOU Abstract In this study, we first tested the performance of the TreeTagger English model developed by Helmut Schmid with test files at our disposal, using this model to analyze relative clauses and noun complement clauses in English. We distinguished between the two uses of "that," both as a relative pronoun and as a complementizer. To achieve this, we employed an algorithm to reannotate a corpus that had originally been parsed using the Universal Dependency framework with the EWT Treebank. In the next phase, we proposed an improved model by retraining TreeTagger and compared the newly trained model with Schmid’s baseline model. This process allowed us to fine-tune the model’s performance to more accurately capture the subtle distinctions in the use of "that" as a complementizer and as a nominal. We also examined the impact of varying the training dataset size on TreeTagger’s accuracy and assessed the representativeness of the EWT Treebank files for the structures under investigation. Additionally, we analyzed some of the linguistic and structural factors influencing the ability to effectively learn this distinction. 1 Introduction 1.1 Aim of the Study This study aims to explore the syntactic distinctions in the usage of the postnominal "that" in English subordinate clauses, focusing specifically on complement and relative clauses. Our primary objective is to refine the understanding of how "that" functions in these two distinct syntactic contexts—first as a relative pronoun in relative clauses, and second as a complementizer in noun complement clauses. 1.2 Context and Motivation Understanding the syntactic behavior of "that" is crucial for computational linguistics and natural language processing (NLP) as it enables more accurate syntactic parsing and semantic interpretation. While previous research has investigated the syntactic roles of various linguistic markers, the distinction between complementizer and relative pronoun use of "that" remains a nuanced challenge Ballier 2003 , Ballier 2010 , Schmid 2023 , Doe and Smith 2022 , Johnson and Thompson 2018 . Current syntactic models, including those built on frameworks such as Universal Dependencies and Treebank annotations, struggle with accurately distinguishing between these two roles in real-world data. This gap in linguistic modeling is addressed by applying an enhanced algorithm to reannotate corpora and improve parsing accuracy. Moreover, research on NLP models, such as the TreeTagger English model developed by Schmid Schmid 2023 , highlights the limitations of existing tools when applied to complex syntactic structures. The motivation behind this study lies in optimizing these tools to achieve a finer granularity of analysis for syntactic distinctions, particularly in ambiguous contexts involving postnominal "that." 1.3 Research Questions Understanding the syntactic distinction between the relative pronoun and complementizer uses of that in English subordinate clauses remains a challenge for automated parsing systems. This study investigates: • How can we reliably distinguish between the relative pronoun and complementizer uses of that in English subordinate clauses? • What impact does retraining the TreeTagger model have on its ability to differentiate these two syntactic roles? • How does the size and quality of the training dataset influence the accuracy of syntactic parsing for these structures? • Is the EWT Treebank a representative dataset for capturing the subtleties in the use of that ? Linguistic research has shown that dependency patterns in complex sentences can provide insights into syntactic role assignment Yamamoto et al. 2022 . Previous studies have examined the ambiguity of postnominal that and proposed computational models for its disambiguation Ballier 2010 , Tighidet and Ballier 2022 . Additionally, the use of decision trees in probabilistic part-of-speech tagging has demonstrated improvements in syntactic analysis Schmid 1994 , Schmid 1995 . Retraining taggers like TreeTagger Schmid 2023 with annotated corpora, such as those used in dependency parsing studies Zeldes 2017 , may enhance disambiguation performance. However, the representativeness of corpora like the EWT Treebank for such distinctions remains an open question Ballier 2003 , Johnson and Thompson 2018 . 1.4 Theoretical Background In English, the word that plays a crucial role in forming subordinate clauses, particularly as a relative pronoun introducing relative clauses and as a complementizer in nominal complement clauses. For example, in the sentence "The book that I read was fascinating" , that is a relative pronoun introducing a relative clause modifying book . Conversely, in "She believes that he is honest" , that functions as a complementizer introducing a nominal complement clause. Although both structures involve that , they differ in their syntactic and semantic properties. Relative clauses generally modify a noun and provide additional information, whereas nominal complement clauses act as complements to a verb, noun, or adjective, expressing the content of a belief, statement, or perception. 1.5 Problem of Reannotation Distinguishing that as a relative pronoun from that as a complementizer presents significant challenges in syntactic annotation, particularly in corpora following the Universal Dependencies (UD) framework Zeldes 2017 , Johnson and Thompson 2018 . In UD, relative clauses are typically annotated with the relation acl:relcl (adnominal clause: relative clause), while nominal complement clauses are annotated with relations such as ccomp (clausal complement). However, the distinction between these two uses of that is not always clear, especially in complex or ambiguous sentences Tighidet and Ballier 2022 , Ballier 2010 . Several studies have highlighted the difficulties of maintaining annotation consistency in large-scale corpora, particularly for postnominal that Johnson and Thompson 2018 , Gaillat 2016 . This ambiguity poses challenges not only for human annotators but also for dependency parsers, leading to inconsistencies that affect downstream NLP applications such as syntactic parsing, machine translation, and information retrieval Yamamoto et al. 2022 . While probabilistic models and decision-tree-based part-of-speech tagging have shown promise in refining these distinctions Schmid 1994 , Schmid 1995 , annotation quality remains a crucial bottleneck. To address these issues, this study investigates how retraining a part-of-speech tagger like TreeTagger on a specifically annotated corpus can improve the distinction between these two syntactic roles. By refining syntactic annotation and leveraging decision-tree-based approaches, we aim to enhance the robustness of parsing systems when dealing with postnominal that . 1.6 Previous Work on "That" Analysis and Reannotation Several studies have examined the distinction between that as a relative pronoun and as a complementizer. For example, Tighidet and Ballier (2022) explored two methods to analyze relative and nominal complement clauses in English, using distinct labels for that based on its function. They applied an algorithm to relabel a corpus annotated with the GUM Treebank under Universal Dependencies and used TreeTagger to train a model to distinguish between the two uses of that . Their study demonstrated that reannotation and model training with clearer function-based distinctions could enhance syntactic parsing accuracy Tighidet and Ballier 2022 . Furthermore, Gaillat (2016) investigated constructions involving this and that among French- and Spanish-speaking learners of English, emphasizing the need for more refined reannotation using functional labels and semantic positions. This research highlighted the importance of functional distinction in analyzing deictic and proform constructions and proposed a multi-level annotation framework for different corpora Gaillat 2016 . 1.7 Tagging Schemes: CLAWS8 and Penn Treebank The CLAWS8 tagging system and the Penn Treebank are widely used resources for syntactic annotation in English. CLAWS8 is a grammatical tagging system