A Training-free LLM-based Approach to General Chinese Character Error Correction

Houquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan , Min Zhang · 2025

Read A Training-free LLM-based Approach to General Chinese Character Error Correction by Houquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan , Min Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15266.txt.

Introduction

Houquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan, and Min Zhang broaden Chinese character correction to cover missing and extra characters, not just swapped ones, in work from 2025. Classic correction tools fix characters typed in place of others. Real texts also drop characters or add stray ones, and data sets often strip those cases out.

The team built a benchmark by joining and hand checking two data sets. Their method needs no training. It extends a prompt free approach with an edit distance step that handles length changes. A second, prompt based model adds further gains. The work aims at correction that fits real writing errors.

Catalog record

CREATORHouquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan , Min Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-15266

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Training-free LLM-based Approach to General Chinese Character Error Correction Houquan Zhou, Bo Zhang, Zhenghua Li, Ming Yan , Min Zhang Abstract Chinese spelling correction (CSC) is a crucial task that aims to correct character errors in Chinese text. While conventional CSC focuses on character substitution errors caused by mistyping, two other common types of character errors, missing and redundant characters, have received less attention. These errors are often excluded from CSC datasets during the annotation process or ignored during evaluation, even when they have been annotated. This issue limits the practicality of the CSC task. To address this issue, we introduce the task of General Chinese Character Error Correction (C2EC), which focuses on all three types of character errors. We construct a high-quality C2EC benchmark by combining and manually verifying data from CCTC and Lemon datasets. We extend the training-free prompt-free CSC method to C2EC by using Levenshtein distance for handling length changes and leveraging an additional prompt-based large language model (LLM) to improve performance. Experiments show that our method enables a 14B-parameter LLM to be on par with models nearly 50 times larger on both conventional CSC and C2EC tasks, without any fine-tuning . † † footnotetext: ​​B Zhenghua Li is the corresponding author. 1 Introduction Given an input sentence {\bm{x}}=x_{1},x_{2}\cdots x_{n} , the task of conventional Chinese spelling correction (CSC) aims to produce a new sentence of the same length, denoted as {\bm{y}}=y_{1},y_{2}\cdots y_{n} , where each misspelled character ( e.g., x_{i} ) is replaced with a correct one ( e.g., y_{i} ). Spelling errors in text can cause misunderstandings, damage authenticity, and even lead to unnecessary financial losses, making automatic correction a crucial task in Chinese Natural Language Processing (NLP) Wu et al. 2023 ; Zhou et al. 2024 ; Li et al. 2024 ; Dong et al. 2024 ; Liu et al. 2024a . Spelling errors mainly arise from two sources: The first source is typing mistakes. Chinese characters often have multiple visually or phonetically similar variants, making it easy to select an incorrect one when using input methods Hu et al. 2024 . The second source is automatic text conversion errors. When using automatic speech recognition (ASR) or optical character recognition (OCR), systems may also introduce incorrect characters during the conversion process Wang et al. 2018 . General Chinese Character Error Correction Misspelling Character ( Conventional Chinese Spelling Correction ) 我这学期选修了[ 羽矛球 \rightarrow 羽毛球 ]课。 Missing Character ( New ) 我这学期选修了[ 羽球 \rightarrow 羽毛球 ]课。 Redundant Character ( New ) 我这学期选修了[ 羽矛毛球 \rightarrow 羽毛球 ]课。 Figure 1: Scope of the general Chinese character error correction. The correct sentence should be “我这学期选修了羽毛球课。” ( I have taken badminton as an elective this semester. ). Beyond spelling errors, character errors involving missing and redundant characters are also common He et al. 2023 . These errors can be caused by the same reasons as spelling errors. For instance, when typing “曲安” ( qū ān ) in “醋酸曲安奈德” ( Triamcinolone Acetonide ), the input method might consider “ qū ān ” as a single character “圈” ( quān ), resulting in a misspelled and missing character error. 1 1 1 A real case from the Lemon Mec subset. Additionally, repetitive sentence editing, such as when revising messages, social media posts, or emails, can easily introduce missing and redundant errors. Consider this example: “我参加的项目是 羽球 。” ( The project I participated in is badmton ), where “毛” was omitted from “羽毛球” ( badminton ). The missing “毛” likely occurred during editing: when correcting a mistyped “求” to “球”, the user accidentally deleted two characters before retyping “球”. Such errors often go unnoticed without thorough proofreading. For clarity, we refer to misspelling, missing, and redundant errors as General Chinese Character Errors (C2E). Recent Chinese text correction competitions, CTC 2021 Zhao et al. 2022 , Midu-CTC 2 2 2 https://aistudio.baidu.com/competition/detail/404/0/introduction , and Kingsoft-CTC 3 3 3 https://datastudio.wps.cn/matchcenter/competition/1/introduction , have designed error distributions to reflect real-world scenarios. In these competitions, C2E constitute 79.4% to 87.3% of errors (Table 1 ). This indicates that C2E are more common than complex errors like grammatical mistakes, logical inconsistencies, or ambiguity. Compared to conventional CSC, addressing C2E is more practical as it covers a broader range of common errors. Thus, we believe that General Chinese Character Error Correction (C2EC) deserves more attention from the Chinese text correction community. While He et al. 2023 previously studied C2EC, they created synthetic ECMR-2023 by placing random errors into correct sentences. There is a lack of a dataset specifically focusing on C2E with real-world errors. To fill this gap, we build a new C2EC dataset using two existing datasets containing real-world errors: CCTC Wang et al. 2022 and Lemon Wu et al. 2023 . We carefully verified the data to ensure data quality and annotation consistency, resulting in 1,995 sentences for development and 5,711 for testing. Recent work has shown the power of large language models (LLMs) for CSC Dong et al. 2024 ; Li et al. 2024 ; Zhou et al. 2024 . Notably, by combining an LLM, which evaluates fluency, with a Hamming distance to prevent over-correction, the training-free prompt-free framework ( TfPf ) Zhou et al. 2024 achieves strong results without any training. We extend this approach to C2EC by using Levenshtein distance to handle missing and redundant errors, and incorporating prompt-based probability scoring for better performance. Experiments show that our approach achieves large improvements over the TfPf baseline on both conventional CSC and C2EC datasets, and even outperforms the supervised fine-tuned counterparts on various domains. It is also worth mentioning that our approach enables a 14B parameter model to achieve competitive performance with models nearly 50 times larger without any training. Our code is available at https://github.com/Jacob-Zhou/simple-csc/tree/v2.0.0 . 2 The C2EC Task † † nicematrix-placeholder: NiceTabular (nicematrix) Table 1: The statistics of the datasets. Numbers in the parentheses “()” are the percentages of the total number of character errors. Numbers in the brackets “[]” are the percentages of the total number of all errors. 2.1 Task Definition Given an input sentence {\bm{x}}=x_{1},x_{2}\cdots{}x_{n} , the task of C2EC aims to correct character errors and produce a corrected sentence {\bm{y}}=y_{1},y_{2}\cdots{}y_{m} . Unlike conventional CSC, where input and output lengths must match, C2EC allows {\bm{y}} to have a different length from {\bm{x}} . In addition to character substitutions, C2EC addresses two additional error types: a) Missing Character : where characters are missing from the input, e.g., “羽球” missing “毛” from “羽毛球” ( badminton ). b) Redundant Character : where unexpected extra characters appear in the input, e.g., the extra “矛” in “羽 矛 毛球”. 2.2 Construction of C2EC Dataset Rather than using rule-based synthesis like He et al. 2023 , we construct our dataset from existing datasets to better reflect real-world error patterns. Data Selection and Division We build the C2EC dataset from two high-quality sources: a) CCTC Wang et al. 2022 : A comprehensive dataset of ~25,000 sentences covering both character errors and complex errors from diverse sources. While this dataset includes C2E errors, it was not specifically designed to focus on C2EC. b) Lemon Wu et al. 2023 : A CSC dataset containing ~500 sentences with missing and redundant character errors. Although it contains sentences with C2E errors,

Read the complete text