Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables Journal: PACMMOD Volume: 3 3 (SIGMOD) 133 6 DOI: 10.1145/3725396 CCS: Information systems Data cleaning CCS: Information systems Enterprise information systems

Qixu Chen, Yeye He, Raymond Chi-Wing Wong, Weiwei Cui, Song Ge, Haidong Zhang, Dongmei Zhang, Surajit Chaudhuri · 2025

Read Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables Journal: PACMMOD Volume: 3 3 (SIGMOD) 133 6 DOI: 10.1145/3725396 CCS: Information systems Data cleaning CCS: Information systems Enterprise information systems by Qixu Chen, Yeye He, Raymond Chi-Wing Wong, Weiwei Cui, Song Ge, Haidong Zhang, Dongmei Zhang, Surajit Chaudhuri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10762.txt.

Introduction

Qixu Chen and colleagues present Auto-Test, a way to learn data-quality rules for tables without expert input. Their 2025 arXiv paper addresses a long-standing cleaning problem. Classic tools need experts to write rules for each table by hand. That manual step slows cleaning for new datasets. The team defines a new class of rules called semantic-domain constraints.

These rules can be inferred reliably from table collections at scale. Large statistical tests drive the learning process. An optimization step then distills the rules into a core set. Quality guarantees back that distillation step. Tests show the rules can flag errors in real tables directly. They can also support repair steps that follow. The work aims to automate the front end of data cleaning.

Catalog record

CREATORQixu Chen, Yeye He, Raymond Chi-Wing Wong, Weiwei Cui, Song Ge, Haidong Zhang, Dongmei Zhang, Surajit Chaudhuri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE115 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-10762

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Auto-Test: Learning Semantic-Domain Constraints for Unsupervised Error Detection in Tables Journal: PACMMOD Volume: 3 3 (SIGMOD) 133 6 DOI: 10.1145/3725396 CCS: Information systems Data cleaning CCS: Information systems Enterprise information systems Qixu Chen, Yeye He, Raymond Chi-Wing Wong, Weiwei Cui, Song Ge, Haidong Zhang, Dongmei Zhang, Surajit Chaudhuri Abstract . Data cleaning is a long-standing challenge in data management. While powerful logic and statistical algorithms have been developed to detect and repair data errors in tables, existing algorithms predominantly rely on domain-experts to first manually specify data-quality constraints specific to a given table, before data cleaning algorithms can be applied. In this work, we propose a new class of data-quality constraints that we call Semantic-Domain Constraints , which can be reliably inferred and automatically applied to any tables , without requiring domain-experts to manually specify on a per-table basis. We develop a principled framework to systematically learn such constraints from table corpora using large-scale statistical tests, which can further be distilled into a core set of constraints using our optimization framework, with provable quality guarantees. Extensive evaluations show that this new class of constraints can be used to both (1) directly detect errors on real tables in the wild, and (2) augment existing expert-driven data-cleaning techniques as a new class of complementary constraints. Our extensively labeled benchmark dataset with 2400 real data columns, as well as our code are available at https://github.com/qixuchen/AutoTest to facilitate future research. † † cc-license: by 1. Introduction Data cleaning is a long-standing challenge in the data management community. While there is a long and fruitful line of research that developed powerful techniques using data-quality constraints (e.g., FD, CFD, etc.) to detect and repair data errors in tables ( Beskales et al. 2013 ; Chu et al. 2013 ; Ge et al. 2020 ; Khayyat et al. 2015 ; Mahdavi and Abedjan 2020 ; Rekatsinas et al. 2017 ; Yakout et al. 2013 ; Khayyat et al. 2015 ) , existing methods largely depend on domain-experts to first specify data-quality constraints that are specific to a given table, before data-cleaning algorithms can be performed (while constraint discovery methods also exist, they are mainly intended to discover candidate rules that still require humans to verify ( Chu et al. 2014 ; Fan et al. 2010 ; Huhtala et al. 1999 ; Wyss et al. 2001 ; Berti-Équille et al. 2018 ) ). We term this class of sophisticated and powerful approaches as “ expert-driven data cleaning ”. Figure 1 . Example data cleaning feature for end-users in Microsoft Excel. Data quality issues in user tables are automatically detected using techniques such as ( Huang and He 2018 ; Wang and He 2019 ; Chakrabarti et al. 2016 ; Xing et al. 2024 ) , and are presented as intuitive “suggestion cards” on the side-pane (right), for users to review and accept. [ This link ] ( cle [n. d.] ) gives an end-to-end demo of how users can leverage such automated capabilities to easily clean data (without needing to define any constraints first), while staying in full control over any suggested changes that may be applied to their data. While such expert-driven approaches to data cleaning are extremely powerful, when experts are available to inspect each table and define relevant constraints, we observe that there is an emerging class of “ end-user data-cleaning ” use cases that aim to democratize data-cleaning for the average non-technical users, by working out-of-the-box and without requiring experts to be involved. For example, in end-user spreadsheet tools such as Microsoft Excel ( Exc [n. d.] ) and Google Sheets ( Goo [n. d.] ) that are used by billions of non-technical users, there is a growing need to automatically detect and repair data errors in user tables out-of-the-box, without requiring users to define constraints or provide labeled data first . Figure 1 shows a screenshot of such a feature in Excel, which uses techniques such as ( Huang and He 2018 ; Wang and He 2019 ; Chakrabarti et al. 2016 ; Xing et al. 2024 ) to automatically detected data-quality issues are presented as “suggestion cards” shown on the side-pane, that users can easily review and accept with the click of a button (without needing to define any constraints first). Google Sheets has a similar feature for error-detection ( goo [n. d.] ) . In this work, we study a new class of data-quality constraints previously overlooked in the literature, which we call Semantic-Domain Constraints ( SDC ) . Importantly, such constraints can be reliably applied to in a generic fashion to relevant tables, without needing human experts, making them suitable for both “end-user data cleaning” (e.g., in spreadsheets), and “expert-driven data cleaning” (as they serve as a new class of constraints to complement existing constraints). Figure 2 . Real examples of table columns, each representing a distinct “semantic domain” (annotated in the column header). Each column C_{i} has a real data error (which may be a typo, or a semantically incompatible value), that is detected by a corresponding “semantic domain constraint” r_{i} in Table 1 , which are constraints automatically learned from running Auto-Test . Table 1. Example Semantic-Domain Constraints ( SDCs ), instantiated using CTA-classifiers (in r_{1},r_{2} ), text-embedding ( r_{3},r_{4} ), regex-patterns ( r_{5},r_{6} ), and program functions ( r_{7},r_{8} ), all sharing the same SDC structure. Each SDC has a (a) Pre-condition : if matching-percentage% of column values in column C , evaluated using a domain evaluation function satisfy inner-distance threshold , we recognize that constraint r should apply to column C , and (b) Post-condition : any value evaluated using the same domain evaluation function satisfy outer-distance threshold , are predicted as data errors. Each example constraint r_{i} in this table would trigger the detection of a real data error shown in column C_{i} of Figure 2 . All color-coded components (matching-percentage, evaluation function, etc.) are parameters to SDC that are learned using Auto-Test . ID Type Pre-condition P : (on what columns should this constraint apply) Post-condition S : (what values will be predicted as errors) Conf. r_{1} CTA 85% col vals have their country-classifier scores > 0.75 values whose country-classifier scores < 0.01 … r_{2} CTA 90% col vals have their state-classifier scores > 0.55 values whose state-classifier scores < 0.05 … r_{3} Embedding 85% col vals have their Glove distances to “january” < 4.0 values whose Glove distances to “january” > 5.5 … r_{4} Embedding 80% col vals have their S-BERT distances to “seattle” < 1.2 values whose S-BERT distances to “seattle” > 1.35 0.88 r_{4}^{\prime} Embedding 90% col vals have their S-BERT distances to “seattle” < 1.1 values whose S-BERT distances to “seattle” > 1.4 0.93 r_{5} Pattern 95% col vals match pattern “ \backslash [a-zA-Z]+ \backslash d+” (match = 1 ) values not matching pattern “ \backslash [a-zA-Z]+ \backslash d+” (match = 0 ) … r_{6} Pattern 95% col vals match pattern “ \backslash d+ \ \backslash [a-zA-Z]+” (match = 1 ) values not matching pattern “ \backslash d+ \ \backslash [a-zA-Z]+” (match = 0 ) … r_{7} Function 98% col vals return true on function validate_date() (ret = 1 ) values return false on function validate_date() (ret = 0 )

Read the complete text