A Scalable Tool for Measuring Manner and Result Verbs in Developmental Language Research

Divyesh Pratap Singh, Dakshesh Gusain, Federica Bulgarelli, Alison Eisel Hendricks, John Beavers, Nathan M. Beers, Ifeoma Nwogu · 2026

Read A Scalable Tool for Measuring Manner and Result Verbs in Developmental Language Research by Divyesh Pratap Singh, Dakshesh Gusain, Federica Bulgarelli, Alison Eisel Hendricks, John Beavers, Nathan M. Beers, Ifeoma Nwogu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16654.txt.

Introduction

Singh and colleagues build a scalable tool for telling manner verbs from result verbs in developmental language research. Lacking large annotated resources, they generate sentence-level labels with large language models over MASC and InterCorp data, covering 436 VerbNet classes. A RoBERTa classifier trained on those labels reaches up to 89.6% average accuracy on three held-out gold sets. The authors caution that borderline cases, mixed verbs, and downstream uses still need further validation.

Catalog record

CREATORDivyesh Pratap Singh, Dakshesh Gusain, Federica Bulgarelli, Alison Eisel Hendricks, John Beavers, Nathan M. Beers, Ifeoma Nwogu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38594
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16654

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Scalable Tool for Measuring Manner and Result Verbs in Developmental Language Research Divyesh Pratap Singh, Dakshesh Gusain, Federica Bulgarelli, Alison Eisel Hendricks, John Beavers, Nathan M. Beers, Ifeoma Nwogu Abstract Manner and result verbs encode different aspects of event structure and have been discussed in developmental work as a potentially informative distinction for studying early verb learning. However, this distinction remains difficult to measure at scale because large annotated resources for manner and result classification are not currently available. We present a computational approach for identifying manner and result verbs in sentence context. Using linguistically informed prompts, we generate sentence-level annotations with large language models over data drawn from MASC and InterCorp, extending coverage from previously annotated portions of VerbNet to 436 classes. We then train a RoBERTa-based classifier on these annotations and evaluate it on three held-out gold-standard datasets, including previously annotated items and a new expert-annotated set. Across these evaluations, the model shows promising performance, with average accuracy up to 89.6%. We present this work as a scalable measurement tool that can support future research on verb semantics in developmental and other language datasets, while noting that further validation is needed for borderline cases, mixed manner/result verbs, and downstream developmental applications. 1 Introduction Early language development depends not only on how much language children hear, but also on the kinds of meanings encoded in the words they learn. Verbs are especially important because they support children’s transition to multiword speech and later grammatical development. Verb vocabulary around age two predicts later grammatical outcomes and, for some developmental questions, may be more informative than noun vocabulary Hadley et al. 2016 . These issues are especially relevant for late talkers, whose early language trajectories are heterogeneous and whose later outcomes are difficult to predict from broad lexical measures alone. One semantic distinction that has become relevant in this literature is the contrast between manner and result verbs. Manner verbs encode how an action is carried out (e.g., rub , scribble , run ), whereas result verbs encode an outcome or change of state (e.g., clean , fill , open ) Hovav and Levin 2010 ; Levin 2008 . Developmental work suggests that this distinction may be informative for understanding variation in early verb learning. For example, Horvath et al. 2022 report that the relative proportions of manner and result verbs differ between late talkers and typically developing children, and that children who produce more manner verbs also tend to produce more verbs overall Horvath et al. 2019 ; Horvath et al. 2022 . Because a substantial proportion of children with early language delay later meet the criteria for Developmental Language Disorder (DLD), the task of identifying finer-grained semantic properties of children’s early vocabularies may help clarify which aspects of early language are associated with these later outcomes. At the same time, this distinction remains difficult to study at scale. Although computational linguistics has made substantial progress on grammatical annotation tasks such as part-of-speech tagging DeRose 1988 , fine-grained semantic categorization is generally more challenging. Prior work on related event-semantic distinctions suggests that verb meaning is difficult to classify automatically in context Friedrich et al. 2022 ; Friedrich and Gateva 2017 ; Metheniti et al. 2022 ; Friedrich et al. 2016 . As a result, theoretically important contrasts such as manner versus result verbs still lack broad, scalable annotation resources, limiting their use in developmental language research. To address this gap, we present a computational approach for identifying manner and result verbs in context. We use large language models (LLMs) as informed annotators, drawing on established linguistic definitions of manner and result verbs together with a small set of illustrative examples. We prompt LLMs to label sentences from the Manually Annotated Sub-Corpus (MASC; Ide et al. 2008 ) and the InterCorp parallel corpus ( ek Čermák and Rosen 2012 ), expanding coverage from 151 previously annotated VerbNet classes to 436 classes ( Brown et al. 2019 ; Kipper et al. 2008 ) . We then fine-tune a pretrained RoBERTa classifier ( Liu et al. 2019 ) on these labels and evaluate it on three held-out gold-standard datasets. We position this system as a scalable measurement tool that can support research on verb semantics in larger corpora, including developmental language data. In summary, our contributions are: • We present a scalable computational framework for identifying manner and result verbs in sentence context, enabling this theoretically important distinction to be measured in larger language datasets. • We introduce an annotation pipeline that leverages large language models to generate training data for this task in the absence of large-scale gold-standard resources. • We show that a RoBERTa-based classifier trained on these annotations can reliably distinguish manner and result verbs in context. • We will publicly release our code and annotated dataset, extending coverage to 436 VerbNet classes, to support future research. 2 Understanding Verb Root Meaning Figure 1: Hierarchy of verb classification, with manner and result verbs as subdivisions of non-stative verbs Figure 1 shows the hierarchy of verb classifications relevant to our proposed task. At a high level, lexical verbs can be categorized into stative and non-stative verbs. • Stative verbs describe a continuous or unchanging state rather than an action or event, e.g. love in the sentence “She loves her dog,” • Non-stative verbs , on the other hand, describe actions or events that unfold over time and can lead to changes in state. Non-stative verbs can be further classified based on different linguistic properties, such as aspectual features (e.g., telicity, durativity) and argument realization patterns (e.g., causative-inchoative alternation),etc. However, a fundamental classification based on the inherent meaning stored in the verb root is the difference between manner verbs and result verbs Levin and Hovav 1991 ; Hovav and Levin 2010 ; Levin 2008 ; This distinction plays a significant role in both language acquisition Gentner and Boroditsky 2001 and the way verbs encode event semantics. • Manner verbs specify how an action is performed but do not encode its outcome (e.g., scribble, rub, sweep, flutter ). • Result verbs specify what change or outcome occurs, without specifying how the action is carried out (e.g., clean, melt, fill, arrive ). Unlike classifications such as telicity, which are determined at the clause level Friedrich and Gateva 2017 , the manner/result distinction is typically analyzed as a property of the verb root Levin 2008 , meaning that it is expected to remain relatively stable across contexts. 2.1 Illustrating the difference between manner and result verbs To understand this complementarity, consider the following pair of sentences: 1. Anna shoveled the snow. 2. Anna cleared the snow. In (1), the verb shoveled focuses on how the action was performed, i.e. the process of moving the snow with a shovel, but does not guarantee that the snow was removed. In contrast, in (2), the verb cleared encodes the outcome, that the snow was removed, but does not specify how Anna accomplished this (she could have used a shovel, a snowblower, or even melted it). This distinction is crucial because it shows that result verbs inherently encode a outcome, while manner verbs focus on the process. One way to test whether a verb encodes a result or

Read the complete text