Towards Reliable Testing of Machine Unlearning Conference: 34th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering; July 5–9, 2026; Montreal, QC, Canada 34th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE Companion ’26), July 5–9, 2026, Montreal, QC, Canada DOI: 10.1145/3803437.3805557 ISBN: 979-8-4007-2636-1/26/07
Anna Mazhar, Sainyam Galhotra · 2026
Read Towards Reliable Testing of Machine Unlearning Conference: 34th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering; July 5–9, 2026; Montreal, QC, Canada 34th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE Companion ’26), July 5–9, 2026, Montreal, QC, Canada DOI: 10.1145/3803437.3805557 ISBN: 979-8-4007-2636-1/26/07 by Anna Mazhar, Sainyam Galhotra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16536.txt.
Introduction
Mazhar and Galhotra frame unlearning testing as a first-class software problem. As rules require cutting sensitive data from models, it offers a choice over full retraining. Tests need scope over proxy paths, checks finding leakage, cheap runs under query budgets, and black-box use. Their causal fuzzing makes capped probes to estimate leftover effects and produce leakage reports. Standard tracing checks can miss hidden influence from proxies, wipeout and subgroup masking.
Catalog record
| CREATOR | Anna Mazhar, Sainyam Galhotra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25216 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16536
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Reliable Testing of Machine Unlearning Conference: 34th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering; July 5–9, 2026; Montreal, QC, Canada 34th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE Companion ’26), July 5–9, 2026, Montreal, QC, Canada DOI: 10.1145/3803437.3805557 ISBN: 979-8-4007-2636-1/26/07 Anna Mazhar, Sainyam Galhotra Abstract . Machine learning components are now central to AI-infused software systems, from recommendations and code assistants to clinical decision support. As regulations and governance frameworks increasingly require deleting sensitive data from deployed models, machine unlearning is emerging as a practical alternative to full retraining. However, unlearning introduces a software quality-assurance challenge: under realistic deployment constraints and imperfect oracles, how can we test that a model no longer relies on targeted information? This paper frames unlearning testing as a first-class software engineering problem. We argue that practical unlearning tests must provide (i) thorough coverage over proxy and mediated influence pathways, (ii) debuggable diagnostics that localize where leakage persists, (iii) cost-effective regression-style execution under query budgets, and (iv) black-box applicability for API-deployed models. We outline a causal, pathway-centric perspective, causal fuzzing , that generates budgeted interventions to estimate residual direct and indirect effects and produce actionable “leakage reports”. Proof-of-concept results illustrate that standard attribution checks can miss residual influence due to proxy pathways, cancellation effects, and subgroup masking, motivating causal testing as a promising direction for unlearning testing. † † cc-license: by 1. Introduction Machine learning models increasingly power features in AI-infused software systems including user-facing and backend capabilities such as search, recommendations, code assistants, and clinical triage. Engineering these systems differs from traditional software because model behavior depends on data, training pipelines, and deployment constraints that evolve over time ( 2 ) . Testing and quality assurance for ML components has consequently become an active topic in software engineering research, spanning test generation, adequacy criteria, and oracle challenges ( 50 ; 3 ) . These systems are often trained on proprietary and user-generated data that often contains sensitive information. Regulations such as the GDPR and CCPA now empower users to request the removal of their data ( 17 ; 41 ) , forcing organizations to ensure that models can truly “forget” specified information. Beyond regulatory compliance, robust unlearning is vital for mitigating bias that undermines trust and safety, and it plays a key role in post-deployment debugging by exposing and correcting spurious correlations. Retraining models from scratch after every deletion request is often impractical for large-scale systems. ( 7 ) This motivates the community to study approximate unlearning methods that update model parameters to (approximately) erase targeted information. While these methods can be more efficient than full retraining, they introduce a fundamental software quality-assurance challenge: under realistic deployment constraints, how can we test that unlearning has eliminated all relevant traces of the forgotten data? This question is hard for the same reason many testing problems are hard: the desired property (“the model has forgotten Z ”) rarely has a perfect oracle, so practitioners must rely on systematic, indirect evidence ( 3 ) . Existing unlearning checks largely rely on data-sample removal or feature-level attribution. While useful, these approaches focus on surface associations and often fail to detect residual influence that persists indirectly through correlated proxies or mediated pathways, precisely the failure modes that matter in post-deployment testing. Example 1.1. Consider a lung disease diagnosis model trained on patient data including X-rays, patient metadata, and clinical notes. Suppose the model learns to associate Hospital A with higher disease risk because that hospital tends to treat more severe cases. A regulator subsequently mandates unlearning of hospital identifiers to prevent institutional bias. After unlearning, the model no longer reads visible hospital IDs or metadata. Leakage through structured data. Even after removing hospital identifiers, the model may still infer institutional affiliation from correlated demographic attributes. For instance, features such as residential zip-code or employment history often indirectly encode where a patient is likely to receive care, As a result, the model continues to exhibit biased predictions, even though direct identifiers have been stripped away. Leakage through unstructured data. A similar issue may arise with imaging data. Hospitals may configure their scanners differently, for example, using distinct grid settings, contrast levels, or reconstruction parameters. Even after unlearning hospital identifiers, the model may still recognize these scanner-specific signatures and associate them with higher disease risk. Prior work on feature attribution and leakage analysis, including Shapley values and influence functions ( 30 ; 28 ; 20 ) , can expose direct associations, but it does not verify whether residual influence persists through mediated or proxy pathways. These findings suggest that indirect signals, both structured or unstructured, can still encode residual influence, undermining the goal of unlearning. Figure 1 . Causal fuzzing workflow: from unlearning request to actionable leakage report via path-guided input generation This paper envisions a causal unlearning testing framework that moves beyond binary pass/fail judgments to form a feedback loop for improving unlearning methods. To be viable within routine software quality-assurance pipelines, such testing must satisfy four tightly coupled properties. Thoroughness requires detecting all practically relevant residual influence of the targeted information, including indirect effects that persist through correlated proxies or mediated causal pathways. Debuggability ensures that when residual influence is detected, tests explain where and how unlearning failed to help localize the features or causal pathways responsible for leakage to enable targeted remediation. Cost-effectiveness makes this process sustainable in practice, allowing tests to run repeatedly (e.g., per deletion batch or model release) by prioritizing high-yield tests and reusing artifacts without incurring prohibitive computational or human cost. Finally, black-box applicability ensures deployability in real systems by relying only on input–output behavior, even when model internals are inaccessible, as in common API-based settings. These four properties follow directly from unlearning constraints in deployed ML systems. To achieve these objectives, we propose framing unlearning testing as a causal influence problem: the claim “ Z is forgotten” should mean that both its direct and indirect effects on predictions are negligible. Specifically, we propose a “causal fuzzing” mechanism to systematically test models and produce actionable, pathway-centric diagnostic insights under black-box access (Figure 1 ). Our preliminary evidence on structured data shows that path-specific testing detects residual leakage that other methods miss, while remaining black-box. Looking ahead, we plan to extend the notion of mediator paths to natural language and image data using modality-specific perturbations. More broadly, we highlight a range of open research questions (§ 5 ) that call for community effort to advance rigorous, efficient, and generalizable unlearning testing. 2. Background and Related Work SE has studied systematic testing of ML components using metamorphic relations and test generation, including DeepXplore ( 32 ) , DeepTest ( 44 ) , DeepHunter ( 46 ) . Recent work motivates black-box testing under deployment constraints, e.g., via test-case diversity ( 1 ) , and advances metamorphic and contrastive testing for modern ML services ( 10 ; 26 ; 31 ; 45 ) . These techniques motivate our emphasis on efficiency and black-box applicability, but they do not target forgetting . Unlearning Evaluation and Verification. Machine unlearning aims to update a model as if certain training data had never been used (