Proposing TAGbank as a Corpus of Tree-Adjoining Grammar Derivations
Jungyeul Park · 2025
Read Proposing TAGbank as a Corpus of Tree-Adjoining Grammar Derivations by Jungyeul Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05226.txt.
Introduction
Jungyeul Park put forth a new syntax corpus in a 2025 paper called TAGbank. Tree-Adjoining Grammar builds sentences by snapping small lexical trees jointly, exposing derivation histories that phrase-form and dependency banks do not record. No large corpus existed in that formalism, so Park extracted TAG derivations on its own from current treebanks. Mapping their annotations onto TAG's tool set, following the path CCGbank pioneered for a cousin grammar.
The method must reconcile unlike treebank schemes and language quirks while keeping derivations consistent. Planned extensions target Korean and Chinese treebanks for a multilingual resource. A derivation bank would support TAG parsing, grammar induction, and semantic studies that current corpora cannot serve straight.
Catalog record
| CREATOR | Jungyeul Park |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05226
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Proposing TAGbank as a Corpus of Tree-Adjoining Grammar Derivations Jungyeul Park Abstract The development of lexicalized grammars, particularly Tree-Adjoining Grammar (TAG), has significantly advanced our understanding of syntax and semantics in natural language processing (NLP). While existing syntactic resources like the Penn Treebank and Universal Dependencies offer extensive annotations for phrase-structure and dependency parsing, there is a lack of large-scale corpora grounded in lexicalized grammar formalisms. To address this gap, we introduce TAGbank, a corpus of TAG derivations automatically extracted from existing syntactic treebanks. This paper outlines a methodology for mapping phrase-structure annotations to TAG derivations, leveraging the generative power of TAG to support parsing, grammar induction, and semantic analysis. Our approach builds on the work of CCGbank, extending it to incorporate the unique structural properties of TAG, including its transparent derivation trees and its ability to capture long-distance dependencies. We also discuss the challenges involved in the extraction process, including ensuring consistency across treebank schemes and dealing with language-specific syntactic idiosyncrasies. Finally, we propose the future extension of TAGbank to include multilingual corpora, focusing on the Penn Korean and Penn Chinese Treebanks, to explore the cross-linguistic application of TAG’s formalism. By providing a robust, derivation-based resource, TAGbank aims to support a wide range of computational tasks and contribute to the theoretical understanding of TAG’s generative capacity. 1 Introduction The development of syntactic resources has played a pivotal role in advancing natural language processing (NLP), particularly in parsing and grammar-based applications. While widely used resources such as the Penn Treebank Marcus et al. 1993 ; Taylor et al. 2003 and Universal Dependencies de Marneffe et al. 2021 provide valuable annotations for phrase-structure and dependency syntax, there remains a lack of large-scale corpora grounded in lexicalized grammar formalisms. To address this gap, we introduce TAGbank, a corpus of TAG ( Joshi et al. 1975 ; Joshi 1985 ; Joshi 1987 ) derivations derived from existing syntactic annotations. Lexicalized grammars such as TAG and Combinatory Categorial Grammar (CCG) ( Steedman 2000 ; Steedman and Baldridge 2011 ) offer a richer interface between syntax and semantics compared to more traditional context-free grammar (CFG)-based approaches. Unlike Probabilistic CFGs (PCFGs), which rely heavily on constituent structure with limited lexical information, lexicalized formalisms encode dependencies through lexically anchored elementary structures. TAG, in particular, offers extended domain of locality ( Joshi et al. 1975 ) and a transparent derivation structure ( Joshi and Schabes 1997 ) , making it suitable for capturing long-distance dependencies ( Joshi 1985 ) and compositional semantics ( Joshi and Vijay-Shanker 2001 ) . TAGbank is building on the precedent set by CCGbank Hockenmaier and Steedman 2007 , which translates the Penn Treebank into a corpus of CCG derivations. Building on this idea, our work extracts TAG derived and derivation structures from phrase-structure and dependency treebanks, resulting in a new syntactic resource that supports robust, cross-linguistic grammar-based processing and semantic interpretation. TAGbank is designed to bridge the gap between existing syntactic resources and lexicalized grammar formalisms, while also facilitating grammar induction, parser evaluation, and formal grammar research. The contributions of this paper are twofold. First, we propose a methodology for deriving TAG structures from existing syntactic annotations, enabling the systematic transformation of phrase-structure representations into TAG derivations. Second, in the course of this transformation, we identify and analyze key linguistic and computational challenges inherent in the extraction process, including issues related to lexical anchoring, structural decomposition, and formal consistency with TAG’s derivational requirements. 2 Background and Related Work TAG was first introduced by Joshi et al. 1975 and later formalized as a grammar formalism that balances computational tractability with linguistic expressiveness ( Joshi 1985 ) . A TAG is defined as a five-tuple ( \Sigma , NT , I , A , S ), where \Sigma is a finite set of terminal symbols, NT is a set of nonterminal symbols, I is a finite set of initial trees, A is a finite set of auxiliary trees, and S is a distinguished start symbol. The sets I and A together constitute the elementary trees of the grammar—the core building blocks from which larger syntactic structures are derived. Initial trees ( \alpha trees) represent the predicate-argument structure of lexical items, typically encoding subcategorization frames of verbs or other syntactic heads. They are complete, well-formed trees except for designated frontier nodes marked for substitution. Auxiliary trees ( \beta trees), by contrast, capture recursive or modifying constructions such as adverbial adjuncts, relative clauses, or topicalization. Each auxiliary tree contains a distinguished foot node, which is identical in label to its root, thereby allowing adjunction into other trees. 1 1 1 Because each elementary tree is anchored to a lexical item and encodes its argument structure locally, TAG naturally represents long-distance dependencies and complex syntactic constructions. This property has made TAG particularly effective for analyzing phenomena such as wh-movement, relativization, and coordination, while maintaining a clear connection between syntax and semantics. TAG operates with two core tree-composition mechanisms: substitution, which inserts an initial tree at a frontier node labeled by a nonterminal, and adjunction, which inserts an auxiliary tree at an internal node where the root and foot labels match. These operations support the construction of both the derived tree (representing the surface syntactic structure) and the derivation tree (which records the hierarchical history of tree combinations). The derivation tree is particularly important in TAG, as it closely corresponds to both syntactic dependencies and compositional semantic interpretation. A central linguistic motivation for TAG lies in its ability to capture long-distance dependencies and to model predicate-argument relations within its elementary trees, which is made possible by its extended domain of locality ( Kroch and Joshi 1985 ; Kroch 1987 ) . This property allows subcategorization frames and argument structure to be encoded directly within each elementary tree, yielding a highly lexicalized view of grammar. Importantly, the derivation tree in TAG encodes a transparent syntactic history that corresponds closely to compositional semantic interpretation ( Joshi and Schabes 1997 ) . Each node in the derivation tree is annotated with a tree address that specifies the location where substitution or adjunction occurred—excluding the root—enabling a tight coupling between syntactic composition and semantic interpretation. From a formal perspective, TAG has been extensively studied for its mathematical properties. TAG is a mildly context-sensitive grammar (MCSG) formalism that admits polynomial-time parsing complexity ( Vijay-Shanker and Joshi 1986 ) . Its generative capacity exceeds that of context-free grammars (CFGs) while remaining computationally tractable, making it well-suited for modeling a range of natural language phenomena. Subsequent work has clarified TAG’s position within the broader class of mildly context-sensitive formalisms. It has been shown to be closely related in generative power to Linear Indexed Grammars and Head Grammars, while also distinct from them in structural assumptions and derivational mechanisms ( Joshi et al. 1991 ; Vijay-Shanker and Weir 1994 ) . CCG also falls within the mildly context-sensitive class and provides an alternative lexicalized approach to capturing unbounded dependencies and argument structure. While TAG and CCG differ in their formal mechanisms—tree adjunction versus combinatory function application—they are often compared in terms of their expressive power and suitability for computational parsing and grammar induction. Together, these studies have solidified TAG’s theoretical foundations and emphasized its strength in capturing