Aligning Sentence Simplification with ESL Learner’s Proficiency for Language Acquisition
Guanlin Li, Yuki Arase, Noël Crespi · 2025
Read Aligning Sentence Simplification with ESL Learner’s Proficiency for Language Acquisition by Guanlin Li, Yuki Arase, Noël Crespi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11457.txt.
Introduction
Guanlin Li, Yuki Arase, and Noel Crespi present a method to simplify sentences so they match the skill level of people learning English as a second language, in a 2025 paper. Plain text helps learners read, but this team aim higher: they want the simpler text to also help learners gain words at their target level. That dual goal shapes the whole design.
They train a large language model by reward learning, with no paired corpus of hard and easy texts. Rewards act at both word and sentence level. The model trains on its own outputs in rounds, which guides it toward texts that fit the target. Tests on two data sets show word range and frequency at the target level rose by more than a fifth over base models, while the texts stayed clear.
Catalog record
| CREATOR | Guanlin Li, Yuki Arase, Noël Crespi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11457
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Aligning Sentence Simplification with ESL Learner’s Proficiency for Language Acquisition Guanlin Li, Yuki Arase, Noël Crespi Abstract Text simplification is crucial for improving accessibility and comprehension for English as a Second Language (ESL) learners. This study goes a step further and aims to facilitate ESL learners’ language acquisition by simplification. Specifically, we propose simplifying complex sentences to appropriate levels for learners while also increasing vocabulary coverage of the target level in the simplifications. We achieve this without a parallel corpus by conducting reinforcement learning on a large language model. Our method employs token-level and sentence-level rewards, and iteratively trains the model on its self-generated outputs to guide the model to search for simplification hypotheses that satisfy the target attributes. Experiment results on CEFR-SP and TurkCorpus datasets show that the proposed method can effectively increase the frequency and diversity of vocabulary of the target level by more than 20 % 20\% compared to baseline models, while maintaining high simplification quality. 1 1 1 Codes available at https://github.com/JumpyPizza/align-sentence-simplification-with-ESL-learner 1 Introduction Controlled text simplification considers audience-targeted attributes when generating simplified texts, so that the generated texts do not only meet the criteria of simplicity, but also preserve desired attributes for the targeted audiences. Recent studies on controlled text simplification aimed to help reading comprehension for language learners and employed school grade levels annotated in the training corpus as the simplification target Scarton and Specia 2018 ; Sheang and Saggion 2021 ; Agrawal and Carpuat 2023 or text features (number of words, character-level Levenshtein similarity etc.) between source and target sentences Nishihara et al. 2019 ; Martin et al. 2020 . Different from these studies, we aim to aid language learning and education for English as a Second Language (ESL) learners by simplifying sentences while preserving desirable attributes for language acquisition. We use the Common European Framework of Reference for Languages (CEFR), the world standard definition of language proficiency. Our method is motivated by two classic L2 learning theories: the input hypothesis Krashen 1981 and frequency effect Ellis 2002 . The input hypothesis stated that in order for the language acquisition to happen, the textual input which is either too simple or too complex for learner comprehension will not be useful for acquisition. If a learner’s current competence is i , then comprehensible input should contain both i and (i+1) content Mitchell et al. 2019 . Frequency theory holds that the frequency of the words and phrases in the input is a key determinant of acquisition, and words with higher frequency in the usage tend to be easier to acquire Ellis and Ferreira-Junior 2009 . The key challenge here is the lack of a parallel corpus for training that should provide complex-simple sentence pairs labelled their levels. Parallel sentences of this kind are naturally scarce, and worse, annotation of difficulty levels, in particular, CEFR, is non-trivial and requires language education experts Arase et al. 2022 . To achieve sentence simplification for aiding language learning without a parallel corpus, we propose reinforcement learning on a pre-trained large language model (LLM). Based on the aforementioned L2 learning theories, the proposed method simplifies the complex sentences to the one corresponding to the learner’s proficiency level or one level higher ( i and i+1 levels) and increases the coverage (frequency and diversity) of the corresponding level’s vocabulary in the generated simplifications. Specifically, we reformulate the controlled simplification task as a lookahead search problem: in the decoding step t , the model searches for the token that satisfies the target vocabulary constraint while also ensuring that future tokens increase the target vocabulary coverage as much as possible, and the final hypothesis falls into the desired CEFR level. We combine a simple word-match-based heuristic with the supervised sentence-level signal to guide decoding and train the model iteratively using gradient policy optimization to memorize the search strategy that maximizes the overall reward. Remarkably, we eliminate the need for a parallel corpus by utilizing LLMs’ language generation capacity for simplification via reinforcement learning. Experimental results show that the method significantly increases the coverage and diversity of the target vocabulary in the outputs by up to 20\% compared to the baselines, while maintaining high simplification quality. Our primary contributions are twofold. First, we propose the sentence simplification method that aligns generated simplifications with ESL learners’ proficiency level on word, phrase and sentence levels and preserves attributes effective for facilitating language learning. Second, our method is easy to deploy and does not require a parallel corpus that is often expensive to create. 2 Related Work We briefly summarize two lines of simplification methods, controlled simplification and reinforcement learning based simplification. Controlled Simplification attaches tokens or prompts to the input to control the simplification-related attributes during generation Yang et al. 2023 ; Agrawal and Carpuat 2023 ; Sheang and Saggion 2021 ; Martin et al. 2020 ; Martin et al. 2022 ; Scarton and Specia 2018 ; Chi et al. 2023 . While these methods learn to control levels of simplified sentences using a parallel corpus with annotated difficulties, our method controls attributes useful for language learning without a parallel corpus. As opposed to the training-time controlling, Kew and Ebling 2022 adopted FUDGE Yang and Klein 2021 , which adjusts the logits of the text generation model during decoding using a classifier, to directly control the attribute of the simplification in the decoding time. Reinforcement Learning based Simplification has explored controllability by defining rewards based on simplicity-related criteria Zhang and Lapata 2017 ; Guo et al. 2018 ; Nakamachi et al. 2020 ; Laban et al. 2021 . The rewards for the objectives are constructed using supervised or unsupervised evaluation metrics for simplicity, adequacy and fluency. In contrast, we aim to control attributes useful for language learning and education. Furthermore, while RL tends to suffer from unstable training and sensitivity to the choice of hyperparameters, our method achieves training stability by adopting entropy regularization in the model optimization process and introducing a dynamic reward that adjusts based on the data distribution. 3 Problem Definition We aim to facilitate language learning by simplification targeted at ESL learners. In this study, we use CEFR levels as a representative measure for the learners’ proficiency and model the target level based on the vocabulary 2 2 2 https://www.englishprofile.org/wordlists/evp (words, phrases, idioms) and sentence CEFR levels 3 3 3 https://www.coe.int/en/web/common-european-framework-reference-languages/table-1-cefr-3.3-common-reference-levels-global-scale . Our problem is thus defined as follows. We assume that learners know their own CEFR level i . Given a sentence above the learner’s level i , we generate its simplified version that (a) contains as much vocabulary of the level i and i+1 as possible, and (b) corresponds to the target (learner’s) level i at the sentence level. 3.1 Constraint Formalization Generating simplified texts subject to vocabulary constraints can be approached as a lexical-constrained text generation task Zetsu et al. 2022 . Traditionally, lexical constraints in text generation involve a short list of required words, which Lu et al. 2021 expressed as a Conjunctive Normal Form (CNF), such as \underbrace{(D_{1}\lor D_{2}\lor\cdots)}_{C_{1}}\land\cdots\land\underbrace{(D_{m-1}\lor D_{m})}_{C_{m}} in which D_{m} stands for a single constraint, and all clauses must be satisfied, imposing hard constraints on the generation process. In our setting, however, this formulation is no longer applicable because the vocabulary constraint is