Cross-Domain Data Selection and Augmentation for Automatic Compliance Detection
Fariz Ikhwantri 1 , Dusica Marijan 1 · 2026
Read Cross-Domain Data Selection and Augmentation for Automatic Compliance Detection by Fariz Ikhwantri 1 , Dusica Marijan 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21469.txt.
Introduction
Fariz Ikhwantri and Dusica Marijan study data picking for compliance checks across rules, framed as natural language inference, where models trained on one rule often fail on others. They compare four ways to pick extra data from a larger source domain: random sampling, Moore-Lewis cross-entropy difference, importance weighting, and embedding-based retrieval, varying the picked share. Targeted picking cuts negative transfer a lot. The work offers a practical path toward scalable, reliable compliance automation across varied rules.
Catalog record
| CREATOR | Fariz Ikhwantri 1 , Dusica Marijan 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34883 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21469
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cross-Domain Data Selection and Augmentation for Automatic Compliance Detection Fariz Ikhwantri 1 , Dusica Marijan 1 Abstract Automating the detection of regulatory compliance remains a challenging task due to the complexity and variability of legal texts. Models trained on one regulation often fail to generalise to others. This limitation underscores the need for principled methods to improve cross-domain transfer. We study data selection as a strategy to mitigate negative transfer in compliance detection framed as a natural language inference (NLI) task. Specifically, we evaluate four approaches for selecting augmentation data from a larger source domain: random sampling, Moore-Lewis’s cross-entropy difference, importance weighting, and embedding-based retrieval. We systematically vary the proportion of selected data to analyse its effect on cross-domain adaptation. Our findings demonstrate that targeted data selection substantially reduces negative transfer, offering a practical path toward scalable and reliable compliance automation across heterogeneous regulations. I Introduction Ensuring that software data and privacy protection comply with regulatory requirements is a critical yet resource-intensive task [ 21 , 2 , 9 ] . In the context of the General Data Protection Regulation (GDPR), organisations must validate that Data Processing Agreements (DPAs) align with legal provisions governing the collection, processing, and protection of personal data. Traditionally, this validation process requires extensive legal and technical expertise, making it costly and time-consuming without automation. To reduce this burden, researchers have explored automated approaches to compliance detection. Yet, developing models that can handle the complexity and variability of legal texts across domains remains a major challenge. Regulations differ not only in terminology but also in structure, intent, and reasoning style, making cross-domain generalisation particularly difficult. Fig. 1: Given a large source domain (e.g. GDPR) and a smaller target domain (e.g. HIPAA), we evaluate several data selection methods to select a subset of the source domain data to prevent negative transfer. In single domain compliance detection, early work has relied on interpretable rule-based graph matching [ 3 ] , which provides transparency but struggles with linguistic variability, ambiguous legal phrasing, and limited scalability to new regulatory domains. More recent studies have reframed compliance as a text classification problem, applying statistical machine learning and language models to identify relevant clauses [ 1 ] . Another study proposed verbalising requirements as a class [ 11 ] and compliance verification [ 14 ] as natural language inference (NLI) tasks, which offers a more structured formulation and some degree of data-driven explainability. Recent studies [ 15 , 10 ] have leveraged Natural Language Inference (NLI) by framing requirements as premises and contractual clauses or policy statements as hypotheses, enabling systematic reasoning over regulatory alignment. While effective in single-domain settings, these approaches face a persistent bottleneck: the scarcity and domain-specificity of annotated datasets. Resources such as the GDPR dataset provide valuable supervision, but their limited size restricts model performance and their narrow scope hampers generalisation beyond a single regulatory framework. In a cross-domain setting, J. Sun et al., [ 26 ] propose a retrieval-augmented generation framework to improve clause matching and explanation quality. Another recent study by Etezadi [ 10 ] examines classification and prompting strategies for the traceability of legal requirements. They evaluate models on multiple domains, such as the General Data Protection Regulation (GDPR) and the Health Insurance Portability and Accountability Act (HIPAA), in the health domain. While these works highlight promising directions, they primarily focus on multiple-domain evaluation rather than cross-domain transfer, where models trained in one regulatory domain are applied to another regulatory domain. A natural solution is to augment scarce datasets with additional training data, either by generating synthetic examples or transferring data from related domains. However, prior studies on transfer learning warn that not all data is equally useful [ 29 ] . Introducing poorly aligned samples can cause negative transfer, where performance degrades rather than improves when moving across domains [ 18 ] . This challenge highlights the need for principled data selection strategies that ensure augmentation enhances both predictive performance and explanation quality in compliance detection. In this work, we systematically investigate cross-domain data selection for compliance detection. Figure 1 illustrates the abstract data selection methods that were used in our study. In this work, we make the following contributions: • Systematic study of cross-domain data selection. We investigate the impact of augmenting compliance detection with source-domain data when transferring from GDPR to HIPAA. • Evaluation of four selection strategies . We compare two baseline random sampling and full augmentation with three methods: (1) Moore–Lewis cross-entropy filtering [ 19 ] , (2) importance weighting, and embedding-based retrieval (DSIR) [ 31 ] as candidate approaches for source data selection. • Analysis of scaling effects . We examine how performance changes under different selection ratios, highlighting when and why negative transfer emerges and how targeted selection mitigates it. • Empirical insights for compliance automation . Our results show that embedding-based selection is the most reliable strategy, avoiding negative transfer and yielding consistent improvements, thereby underscoring the importance of selective augmentation for trustworthy compliance detection. We made our code implementation and preprocessed data publicly available in this repository 1 1 1 https://github.com/farizikhwantri/cross-domain-regcomp . TABLE I: Compliance Detection as NLI task where GDPR requirement is the premise and Data Processing Agreement is the hypothesis Req. Premise (Req) Hypothesis (DPA) DPA-ID Label R18 The processor shall assist the controller in consulting the supervisory authorities prior to processing … to mitigate the risk. (Art. 28(3)(f), Art. 36) At controller’s request and at the controller’s reasonable expense on a time and materials basis, … fulfilling any … Applicable Data Protection Law. Online 100 entailment II Related Work II-A Compliance detection in Requirements Adhering to legal regulations and industry standards has become essential as software systems, particularly in finance and healthcare, become increasingly integrated into everyday life. Software requirements to guarantee compliance must be validated to ensure they align with relevant laws, regulations, standards, and organisational policies, such as those related to data protection (e.g., GDPR, CCPA), cybersecurity (e.g., IEC 62443, NIST 800-53), and safety-critical standards (e.g., HIPAA). This verification process is referred to as compliance detection. Past studies have thoroughly assessed statistical machine learning and language model techniques for text classification [ 1 ] . Their findings indicate that text classification methods surpass traditional rule-based graph matching. Their method enhanced flexibility and adaptability for managing different types of data. A recent study [ 15 ] focused on explainable compliance detection by using natural language inference tasks and assurance case structure as a reasoning format. II-B Cross-Domain Data Augmentation Data augmentation is a widely used strategy for addressing data scarcity in natural language processing (NLP) tasks. The basic idea is to expand the available training set with additional data, either generated synthetically or transferred from related sources, to improve model robustness and generalisation. In the context of regulatory compliance detection, augmentation is particularly relevant because annotated datasets are both costly to create and highly domain-specific. Cross-domain data augmentation extends this idea by leveraging data from external but related domains. For example, models trained on GDPR-related texts may benefit from additional data derived from other legal frameworks such as HIPAA or CRA, provided the differences in terminology and reasoning can be managed. However, prior studies in transfer learning have shown that naively adding