Risk-Equalized Differentially Private Synthetic Data: Protecting Outliers by Controlling Record-Level Influence Amir Asiaee, Chao Yan, Zachary B. Abrams, Bradley A. Malin Abstract When synthetic data is released, some individuals are harder to protect than others. A patient with a rare disease combination or a transaction with unusual characteristics stands out from the crowd. Differential privacy provides worst-case guarantees, but empirical attacks—particularly membership inference—succeed far more often against such outliers, especially under moderate privacy budgets and with auxiliary information. This paper introduces risk-equalized DP synthesis , a framework that prioritizes protection for high-risk records by reducing their influence on the learned generator. The mechanism operates in two stages: first, a small privacy budget estimates each record’s “outlierness”; second, a DP learning procedure weights each record inversely to its risk score. Under Gaussian mechanisms, a record’s privacy loss is proportional to its influence on the output—so deliberately shrinking outliers’ contributions yields tighter per-instance privacy bounds for precisely those records that need them most. We prove end-to-end DP guarantees via composition and derive closed-form per-record bounds for the synthesis stage (the scoring stage adds a uniform per-record term). Experiments on simulated data with controlled outlier injection show that risk-weighting substantially reduces membership inference success against high-outlierness records; ablations confirm that targeting—not random downweighting—drives the improvement. On real-world benchmarks (Breast Cancer, Adult, German Credit), gains are dataset-dependent, highlighting the interplay between scorer quality and synthesis pipeline. 1 Introduction Suppose a hospital releases a synthetic version of its patient database. Most patients—those with common diagnoses, typical demographics, and standard treatment paths—blend into the crowd. But consider a patient with a rare genetic condition who also happens to be unusually young and from a small geographic region. Even in synthetic data, this combination may appear only once. An adversary with auxiliary knowledge about such a patient can search the synthetic dataset, find a unique or near-unique match, and infer sensitive attributes that were never meant to be disclosed. This scenario reflects real patterns in privacy research. Empirical studies show that privacy attacks against machine learning models and synthetic data succeed far more often against unusual records ( 18 ; 14 ) . For synthetic data specifically, outliers face substantially higher re-identification risk through linkage attacks ( 20 ) , and membership inference attacks achieve higher accuracy against rare individuals even when differential privacy is applied ( 21 ; 10 ) —particularly under moderate privacy budgets. Differential privacy offers a formal guarantee: changing any single record changes the output distribution by at most a bounded amount. But this is a worst-case bound. The parameter \varepsilon describes the maximum privacy loss any record could suffer—it says nothing about how that loss is distributed. In practice, typical records may experience privacy loss far below the nominal \varepsilon , while outliers approach or reach the worst case ( 22 ; 19 ) . Standard DP mechanisms treat all records symmetrically, yet their empirical vulnerabilities differ. The core idea. If outliers face higher empirical risk, a principled mechanism should compensate by giving them stronger protection. The question is how. Excluding outliers entirely would degrade utility for minority subgroups—often the populations most important to represent. Adding more noise globally would harm everyone. Our solution is to control each record’s influence on the learned generator. Under Gaussian mechanisms, privacy loss is proportional to how much a record affects the output. By deliberately reducing the contribution of high-risk records—through careful weighting rather than exclusion—we can tighten their per-instance privacy bounds while still including their information. The result is a form of privacy equalization: records that are harder to protect receive less influence and hence lower privacy loss, while typical records contribute normally. Approach. The mechanism operates in two stages. First, using a small privacy budget, we estimate each record’s outlierness—how rare or atypical it is—via a differentially private scoring procedure (e.g., histogram frequencies or density estimates). Second, we train a DP synthesizer where each record’s contribution is scaled inversely to its risk score. High-risk outliers contribute less to the learned model, which directly reduces their per-instance privacy loss. The two stages compose via standard DP accounting. Contributions. 1. A problem formulation that explicitly targets outlier protection: minimize utility loss subject to global DP and an upper bound on per-instance privacy loss for high-risk records. 2. REPS (Risk-Equalized Private Synthesis), a modular mechanism combining DP outlier scoring with risk-weighted DP learning, instantiated for Gaussian sufficient-statistics release. 3. Per-instance privacy theory: closed-form bounds showing how a record’s privacy loss depends on its weight, plus a constructive schedule for choosing weights to cap per-record \varepsilon_{i} for designated high-risk records. 4. Experiments on simulated data (with controlled outlier injection) and real-world tabular benchmarks (Breast Cancer Wisconsin, Adult, German Credit), evaluating both utility and privacy with explicit focus on membership inference stratified by outlierness. Scope. The goal is not to improve aggregate fidelity metrics—existing DP synthesizers already perform well on averages. Rather, we target the distribution of privacy protection, ensuring that formal guarantees are realized more uniformly across the population. This matters especially in healthcare and social domains where outliers often represent vulnerable individuals who most need protection. 2 Related Work This section situates our contribution relative to four research threads: empirical privacy vulnerability, per-instance and heterogeneous DP, DP synthetic data generation, and targeted high-risk approaches. 2.1 Empirical privacy vulnerability Privacy attacks do not affect all individuals equally. Membership inference attacks ( 18 ) reveal training set membership, but success rates vary dramatically across records. 14 provide theoretical and empirical evidence of disparate vulnerability : outliers and minorities face systematically higher attack success. 11 caution that naive evaluations can mislead, but the core finding persists. For synthetic data specifically, 9 develop Anonymeter, measuring singling-out, linkability, and inference risks. 20 demonstrate that rare records are substantially easier to re-identify via linkage. Two recent attacks sharpen the threat model. DOMIAS ( 21 ) targets local overfitting : by comparing a target’s density under the synthetic distribution versus an auxiliary reference, it achieves high membership inference accuracy—especially against uncommon samples. MAMA-MIA ( 10 ) exploits the structure of marginal-based generators (PrivBayes, MST, Private-GSD): knowing which algorithm was used allows substantially more efficient inference than prior attacks. These results motivate our experimental protocol: we evaluate membership inference stratified by outlierness and include attacks tailored to the generator class. 16 show that high-risk records can be identified efficiently from training artifacts (loss trajectories, gradient norms), suggesting practical outlier scoring within the DP pipeline. 2.2 Per-instance and heterogeneous differential privacy Standard DP provides a worst-case guarantee: the same \varepsilon applies to all records. Per-instance DP (pDP) ( 22 ) refines this by deriving record-specific bounds \varepsilon_{i}(D) that can be much tighter for typical records. 19 analyze DP-SGD’s per-instance behavior, showing that records with similar neighbors enjoy tighter bounds than isolated outliers. These works are analytic —they quantify heterogeneity post hoc rather than designing mechanisms to address it. A separate line studies personalized or individualized privacy ( 13 ; 1 ) , where users specify their desired protection level. Recent work on per-record DP ( 17 ; 8 ) allows the privacy parameter to vary across records based on record characteristics (e.g., magnitude of contributions in skewed data). The key difference from our work: these frameworks let privacy vary to improve utility on typical records while maintaining a budget; we use risk-based weighting to tighten protection for outliers who face higher empirical attack success. The mechanisms are complementary: per-record DP provides the accounting framework, while our risk-adaptive weighting provides the policy for assigning tighter bounds to vulnerable records. 2.3 DP synthetic data generation DP synthetic data methods fall into two families. Marginal-based approaches like PrivBayes ( 24 ) and PrivSyn ( 25 ) measure noisy marginals and fit a distribution. Deep generative approaches like PATE-GAN ( 12 ) and DP-CTGAN ( 6 ) train neural generators with DP-SGD. Both families treat all records symmetrically: gradients are clipped uniformly, contributions are weighted equally, and the resulting privacy guarantee is worst-case. Smooth sensitivity ( 15 ) calibrates noise to data-dependent rather than worst-case sensitivity, reducing noise when the data permits. Our approach is philosophically similar but inverted: rather than reducing noise globally, we increase protection locally for high-risk records by shrinking their influence. 2.4 Targeted high-risk approaches The closest prior work is \varepsilon -PrivateSMOTE ( 3 ) , which addresses high-risk records by replacing them with synthetic interpolations (SMOTE-style) under DP noise. This achieves strong linkability protection for targeted records with low computational cost. Our approach differs in three ways: (1) we reduce influence rather than replace—outliers still contribute to the learned model, preserving their distributional signal; (2) we provide formal per-instance privacy bounds, not just empirical risk reduction; (3) our framework applies to general DP learning (sufficient statistics, DP-SGD), not only interpolation-based synthesis. Summary. Prior work documents outlier vulnerability empirically ( 20 ; 21 ) or analyzes per-instance privacy theoretically ( 22 ; 19 ) , but does not design mechanisms that explicitly control record-level influence based on risk. \varepsilon -PrivateSMOTE ( 3 ) targets high-risk cases but replaces rather than weights them, and does not provide per-instance DP bounds. Our contribution is a DP synthesis mechanism with formal per-instance bounds and a constructive schedule for risk-based protection, bridging the empirical vulnerability literature with mechanism design. 3 Preliminaries This section establishes notation and recalls the definitions we build on: differential privacy, per-instance privacy, and DP synthetic data generation. 3.1 Data model and notation Let D=(z_{1},\dots,z_{n})\in\mathcal{Z}^{n} denote a dataset of n records; we assume n is public. For tabular predictive modeling, each record is z=(x,y) with features x\in\mathcal{X} and label y\in\mathcal{Y} . To avoid ambiguity about normalization by n under remove-one comparisons, we use the standard padding convention: let \bot denote a fixed “null” record that contributes zero to all released statistics, and define D^{(-i)}:=(z_{1},\dots,z_{i-1},\bot,z_{i+1},\dots,z_{n}) . We treat D and D^{(-i)} as neighbors (equivalently, add/remove adjacency on variable-size datasets with a known size bound n ( 5 ) ). A randomized mechanism \mathcal{M} maps datasets to outputs in some measurable space. 3.2 Differential privacy Definition 1 (Differential Privacy ( 4 ) ) . A mechanism \mathcal{M} satisfies (\varepsilon,\delta) -DP if for all neighboring D\sim D^{\prime} and all measurable S , \mathbb{P}[\mathcal{M}(D)\in S]\leq e^{\varepsilon}\mathbb{P}[\mathcal{M}(D^{\prime})\in S]+\delta. 3.3 Per-instance privacy Standard DP is a worst-case guarantee: the same \varepsilon bounds every record’s privacy loss. Per-instance DP refines this by providing record-specific bounds. Definition 2 (Per-instance DP ( 22 ) ) . Fix dataset D and index i\in[n] . Let D^{(-i)} denote D with record z_{i} replaced by the null record \bot . The mechanism \mathcal{M} satisfies (\varepsilon_{i}(D),\delta) -pDP for record i on D if for all events S , \mathbb{P}[\mathcal{M}(D)\in S]\leq e^{\varepsilon_{i}(D)}\mathbb{P}[\mathcal{M}(D^{(-i)})\in S]+\delta. If \mathcal{M} is (\varepsilon,\delta) -DP, then \varepsilon_{i}(D)\leq\varepsilon for all D,i . The per-instance bound can be much tighter for typical records and approach \varepsilon only for outliers—this heterogeneity is what we exploit. 3.4 DP synthetic data generation The standard paradigm learns generator parameters \theta from D using a DP algorithm \mathcal{A} , then samples synthetic data: \theta\leftarrow\mathcal{A}(D),\tilde{D}\sim p_{\theta}^{\otimes m}. Since any function of a DP output is DP (post-processing), releasing \tilde{D} inherits the privacy guarantee of \theta . 4 Problem Formulation This section formalizes what “risk-equalized” means. The primary goal is to cap per-instance privacy loss for high-risk records : outliers should not approach the worst-case \varepsilon just because they are rare. A secondary goal is to reduce inequality in per-instance bounds across all records. 4.1 Outlier scores We abstract “which records are high-risk” via an outlierness functional. Definition 3 (Outlier score) . An outlier score is a mapping \mathsf{Out}:\mathcal{Z}^{n}\times\mathcal{Z}\to\mathbb{R}_{\geq 0} assigning each record z_{i} a score s_{i}:=\mathsf{Out}(D,z_{i}) . Larger s_{i} indicates higher re-identification or linkage risk. Concrete examples: negative log-density under a data model, k -nearest-neighbor distance, leverage scores, or small-cluster membership. In private settings, s_{i} must be computed under DP or from public auxiliary data. 4.2 Design objective Let \mathcal{M} denote a DP mechanism producing synthetic data \tilde{D} . We measure utility via downstream performance or fidelity metrics, and privacy via per-instance loss \varepsilon_{i}(D) . Primary constraint: outlier protection. Let \mathcal{H}_{\tau}:=\{i:s_{i}\geq\tau\} be the high-risk set. The key constraint is: \max_{i\in\mathcal{H}_{\tau}}\varepsilon_{i}(D)\;\leq\;\varepsilon_{\mathrm{out}}, where \varepsilon_{\mathrm{out}}<\varepsilon is a tighter cap for outliers. This ensures that records most vulnerable to attack receive stronger formal protection. Secondary constraint: inequality reduction. We may also bound the spread of per-instance losses: \mathsf{Ineq}(\varepsilon_{1:n}(D))\leq B, where \mathsf{Ineq} could be the max-to-median ratio, Gini coefficient, or a quantile gap. Optimization view. Combining these: \displaystyle\min_{\mathcal{M}} \displaystyle\mathbb{E}[\mathsf{Util}(\mathcal{M}(D))] (1) \displaystyle\text{s.t.} \displaystyle\mathcal{M}\text{ is }(\varepsilon,\delta)\text{-DP}, \displaystyle\max_{i\in\mathcal{H}_{\tau}}\varepsilon_{i}(D)\leq\varepsilon_{\mathrm{out}}. Standard DP synthesis solves only the global constraint; our goal is to explicitly control the distribution of \varepsilon_{i}(D) across records via mechanism design. 5 Method: Risk-Equalized DP Synthesis This section describes REPS (Algorithm 1 ), a modular mechanism achieving the objective in ( 1 ). The mechanism has two stages: (1) estimate each record’s outlierness using a small privacy budget, then (2) train a DP generator where each record’s contribution is weighted inversely to its risk. The stages compose additively. Algorithm 1 REPS 0: Dataset D , budgets (\varepsilon_{s},\delta_{s}) and (\varepsilon_{t},\delta_{t}) , weight map g , clip C . 0: Synthetic dataset \tilde{D} . 1: \widehat{s}_{1:n}\leftarrow\mathcal{W}(D) // DP risk scoring, budget (\varepsilon_{s},\delta_{s}) 2: w_{i}\leftarrow g(\widehat{s}_{i}) for each i // map scores to weights 3: \theta\leftarrow\mathcal{A}(D;w_{1:n}) // weighted DP learning, budget (\varepsilon_{t},\delta_{t}) 4: \tilde{D}\sim p_{\theta}^{\otimes m} 5: return \tilde{D} 5.1 Stage 1: DP outlier scoring Any DP mechanism that produces per-record risk scores suffices. We describe one concrete instantiation suitable for mixed tabular data: DP histogram frequencies. Discretize continuous features into bins. For each column j\in[d] , release noisy bin counts: \tilde{c}_{j,b}=c_{j,b}(D)+\eta_{j,b},\eta_{j,b}\sim\mathcal{N}(0,\sigma_{s}^{2}). Form estimated marginal probabilities \tilde{p}_{j,b}=\max(\tilde{c}_{j,b},0)/\sum_{b^{\prime}}\max(\tilde{c}_{j,b^{\prime}},0) and define a rarity score: \widehat{s}_{i}=-\sum_{j=1}^{d}\log\big(\max(\tilde{p}_{j,\mathrm{bin}(x_{ij})},p_{\min})\big). Records with low marginal probabilities receive higher scores. This is not a full density model but is stable, fast, and can be strengthened via pairwise marginals at additional privacy cost. Alternative scorers (DP clustering, DP k NN distances) are possible; our theory treats \mathcal{W} abstractly. Sensitivity and accounting. Each record contributes to exactly one bin per feature, so the histogram vector for column j has \ell_{2} sensitivity 1 (add/remove changes one count by 1). For d features released independently, we allocate \varepsilon_{s}/d per feature under basic composition, or use tighter Rényi composition. In our experiments, we release all d histogram vectors jointly as a single \sum_{j}B_{j} -dimensional vector (where B_{j} is the number of bins for feature j ); since each record affects exactly d coordinates (one per feature), the \ell_{2} sensitivity is \sqrt{d} , and we calibrate \sigma_{s}=\sqrt{d}\cdot\sqrt{2\log(1.25/\delta_{s})}/\varepsilon_{s} . 5.2 Stage 1.5: Mapping scores to weights Given scores \widehat{s}_{i} , define weights w_{i}\in(0,1] that decrease with risk. Two useful families: \displaystyle\textbf{(cap)}\quad w_{i} \displaystyle=\min\!\left(1,\frac{\tau}{\widehat{s}_{i}+\tau}\right), \displaystyle\textbf{(hinge-exp)}\quad w_{i} \displaystyle=\exp\big(-\gamma(\widehat{s}_{i}-t)_{+}\big). The cap mapping yields gradual protection; hinge-exp yields sharper protection for extreme outliers. For equalization, set w_{i} so that w_{i}\cdot\alpha_{i}\leq\tau_{\mathrm{inf}} for all i , where \alpha_{i} is record i ’s influence proxy (e.g., clipped contribution norm). This directly caps per-instance privacy loss (Theorem 2 ). 5.3 Stage 2: Risk-weighted DP learning We instantiate two variants: one-shot Gaussian release (for marginal-based synthesis) and iterative DP-SGD (for deep generators). Both rely on clipping —bounding each record’s contribution to norm at most C —which is standard in DP learning to control sensitivity. Instantiation A: weighted clipped statistics. Let \phi:\mathcal{Z}\to\mathbb{R}^{k} encode per-record sufficient statistics (e.g., feature values, squared values for variances, one-hot category indicators). Define the weighted clipped aggregate: \displaystyle f_{w}(D) \displaystyle:=\frac{1}{n}\sum_{i=1}^{n}w_{i}\cdot\mathrm{clip}(\phi(z_{i}),C), (2) \displaystyle\mathrm{clip}(u,C) \displaystyle:=u\cdot\min\{1,C/\left\lVert u\right\rVert_{2}\}. Release \tilde{f}=f_{w}(D)+\mathcal{N}(0,\sigma^{2}I_{k}) , fit a graphical model or exponential family to \tilde{f} , and sample synthetic data. Instantiation B: risk-weighted DP-SGD. For a generator loss \ell(\theta;z) , standard DP-SGD clips per-example gradients and adds noise. We modify it to incorporate risk weights: \displaystyle\bar{g}(\theta) \displaystyle=\frac{1}{|B|}\sum_{i\in B}w_{i}\cdot\mathrm{clip}(\nabla_{\theta}\ell(\theta;z_{i}),C), \displaystyle\tilde{g}(\theta) \displaystyle=\bar{g}(\theta)+\mathcal{N}(0,\sigma^{2}C^{2}I). Update \theta\leftarrow\theta-\eta\tilde{g}(\theta) . This reduces outliers’ influence on the learned generator while still including their signal. 6 Theory This section provides the formal underpinnings for REPS. The results fall into two categories: (1) standard DP machinery—composition and Gaussian mechanism bounds—applied to our setting, and (2) new contributions—the constructive protection schedule (Proposition 1 ) and the interpretation of weighting as a per-instance privacy lever. Our per-instance bounds are tightest for Instantiation A (one-shot Gaussian release); for DP-SGD we provide intuition and validate empirically. All proofs are deferred to Appendix A . 6.1 End-to-end DP via composition Theorem 1 (Composition) . If Stage 1 scorer \mathcal{W} is (\varepsilon_{s},\delta_{s}) -DP and Stage 2 learner \mathcal{A}(\cdot;w) is (\varepsilon_{t},\delta_{t}) -DP for any fixed w , then Algorithm 1 is (\varepsilon_{s}+\varepsilon_{t},\delta_{s}+\delta_{t}) -DP. Corollary 1 (End-to-end per-instance bound) . Under Theorem 1 , Algorithm 1 satisfies (\varepsilon_{i,\mathrm{tot}}(D),\delta_{s}+\delta_{t}) -pDP for each record i , with \varepsilon_{i,\mathrm{tot}}(D)\leq\varepsilon_{s}+\varepsilon_{i,t}(D), where \varepsilon_{i,t}(D) is any valid per-instance bound for the Stage 2 release (e.g., Corollary 2 with \delta_{t} ). 6.2 Influence and per-instance privacy: general framework The key insight is that under Gaussian mechanisms, a record’s privacy loss is controlled by its influence —how much removing it changes the output. This is a direct application of standard Gaussian mechanism analysis ( 5 ) to the per-instance setting. Definition 4 (Record-level influence) . For a function f:\mathcal{Z}^{n}\to\mathbb{R}^{k} and dataset D , define record i ’s influence as \alpha_{i}(f,D):=\left\lVert f(D)-f(D^{(-i)})\right\rVert_{2}, where D^{(-i)} replaces z_{i} with \bot . Theorem 2 (Influence-to-privacy bound) . Let \mathcal{M}(D)=f(D)+\mathcal{N}(0,\sigma^{2}I_{k}) . For any \delta\in(0,1) , record i on dataset D satisfies (\varepsilon_{i}(D),\delta) -pDP with \varepsilon_{i}(D)\;\leq\;\frac{\alpha_{i}(f,D)}{\sigma}\sqrt{2\log(1.25/\delta)}. Remark 1 (What is new) . The bound itself is standard. Our contribution is the design interpretation : by constructing mechanisms where \alpha_{i} is small for high-risk records, we obtain tighter per-instance bounds for precisely those records. This motivates the risk-weighted aggregates below. 6.3 Weighted aggregates: instantiation For the weighted clipped aggregate f_{w}(D)=\frac{1}{n}\sum_{i=1}^{n}w_{i}\cdot\mathrm{clip}(\phi(z_{i}),C) , we take D^{(-i)} to replace z_{i} with the null record \bot and assume \phi(\bot)=0 , so \mathrm{clip}(\phi(\bot),C)=0 . This yields a clean influence bound under the same normalization by n . Lemma 1 (Influence under weighting) . \alpha_{i}(f_{w},D)=\left\lVert f_{w}(D)-f_{w}(D^{(-i)})\right\rVert_{2}\leq\frac{w_{i}C}{n}. Combining with Theorem 2 : Corollary 2 (Per-instance bound for weighted release) . For \mathcal{M}(D)=f_{w}(D)+\mathcal{N}(0,\sigma^{2}I_{k}) and any \delta_{t}\in(0,1) , record i satisfies (\varepsilon_{i}(D),\delta_{t}) -pDP with \varepsilon_{i}(D)\leq\frac{w_{i}C}{n\sigma}\sqrt{2\log(1.25/\delta_{t})}. Reducing w_{i} directly reduces record i ’s per-instance privacy bound. 6.4 Outlier protection schedule The following result shows how to protect a designated high-risk set while maintaining global DP calibration. Proposition 1 (Targeted protection) . Let \mathcal{H}\subset[n] be the high-risk set. Suppose we set w_{i}=\begin{cases}\tau_{\mathrm{out}}/C&i\in\mathcal{H}\\ 1&i\notin\mathcal{H}\end{cases} for some \tau_{\mathrm{out}}\leq C . Then: 1. Records in \mathcal{H} satisfy \varepsilon_{i}(D)\leq\varepsilon_{\mathrm{out}}:=\frac{\tau_{\mathrm{out}}}{n\sigma}\sqrt{2\log(1.25/\delta_{t})} . 2. The global sensitivity is \Delta_{\max}=C/n (unchanged from uniform weighting). 3. The mechanism remains (\varepsilon,\delta_{t}) -DP with \varepsilon=\frac{C}{n\sigma}\sqrt{2\log(1.25/\delta_{t})} . The proposition shows that protecting outliers does not require increasing global noise—it only requires identifying them and reducing their weights. The trade-off is in utility: outliers contribute less to the learned model. Remark 2 (Comparison to naive equalization) . A naive approach would cap all weights at \tau_{\mathrm{out}}/C , yielding \varepsilon_{i}\leq\varepsilon_{\mathrm{out}} for all i . But this reduces sensitivity globally and either (a) allows less noise for the same global \varepsilon , or (b) requires the same noise for a tighter global \varepsilon . Proposition 1 achieves outlier protection without this trade-off by targeting only high-risk records. 6.5 Utility: bias–variance trade-off Risk-weighting introduces bias from downweighting. Let \bar{\phi}(D)=\frac{1}{n}\sum_{i}\phi(z_{i}) be the unweighted mean. Proposition 2 (Bias bound) . \displaystyle\displaystyle\left\lVert f_{w}(D)-\bar{\phi}(D)\right\rVert_{2} \displaystyle\leq \displaystyle\frac{1}{n}\sum_{i=1}^{n}(1-w_{i})\left\lVert\mathrm{clip}(\phi(z_{i}),C)\right\rVert_{2}+ \displaystyle\frac{1}{n}\sum_{i=1}^{n}\left\lVert\phi(z_{i})-\mathrm{clip}(\phi(z_{i}),C)\right\rVert_{2}. The first term is the cost of downweighting; the second is the cost of clipping. When only a small fraction of records (outliers) have w_{i}<1 , the bias is small. The variance is k\sigma^{2} , determined by global DP calibration. 6.6 Extension to DP-SGD (informal) For DP-SGD, the influence \alpha_{i} depends on gradient similarity across iterations ( 19 ) . Risk-weighting shrinks the clipped gradient contribution of high-risk records at each step, directly reducing their cumulative influence. A full per-instance accounting extends 7 ; we leave formal statements to future work and validate empirically via attack success stratified by outlierness. 7 Experiments We evaluate REPS along four axes: (Q1) whether, under a fixed global DP budget (\varepsilon,\delta) , it reduces outlier-targeted membership inference compared to standard DP synthesis; (Q2) whether it reduces risk inequality while preserving utility; (Q3) how the utility–privacy frontier varies with risk-weight aggressiveness \gamma and budget allocation; and (Q4) whether gains are specific to targeting outliers (vs. random downweighting). 7.1 Threat Model We consider an adversary who observes the released synthetic dataset \tilde{D} and aims to infer information about individuals in the original training set D . Adversary knowledge. The adversary has access to: (i) the full synthetic dataset \tilde{D} ; (ii) knowledge of the synthesis algorithm class (but not random seeds or noise realizations); and (iii) auxiliary information about some target individuals, such as partial quasi-identifiers or known membership in the training population. Adversary goals. We focus on membership inference (MIA), aligned with inference risks in the Anonymeter framework ( 9 ) . MIA asks whether a target record z^{*} is in D ; we measure success via AUC and advantage =2\cdot\text{AUC}-1 ( 23 ) . Throughout, we stratify results by outlier decile (defined by k NN distance in feature space) to quantify disproportionate risk for high-decile records. Attack implementations. We implement two MIA variants: (1) a simple distance-based baseline where records closer to synthetic data are predicted as members, and (2) a DOMIAS-style attack ( 21 ) that computes the ratio of distances to synthetic data vs. a reference set of non-members. Success metrics. We report: (i) overall MIA advantage (absolute value); (ii) top-decile MIA advantage (attack success on the 10% most outlying records); and (iii) risk inequality ratio = top-decile / median-decile advantage. 7.2 Datasets We evaluate on four datasets spanning different scales and outlier characteristics: Simulated dataset (controlled outliers). We construct a synthetic tabular dataset ( n=6{,}000 ) with explicit outlier injection to enable ground-truth evaluation. The dataset contains 6 continuous features drawn from a 2-component Gaussian mixture (inliers) and 3 categorical features. We inject 2% outliers ( n_{\text{out}}=120 ) with: (i) rare categorical values (“Z”, “Q”, “R”) that appear only in outliers; and (ii) shifted continuous features ( \mu=2.4 vs. \mu\in\{-0.8,0.8\} for inliers). A binary label is generated via logistic model with signal from both continuous and categorical features. Breast Cancer Wisconsin. UCI Breast Cancer dataset ( n=569 ) with 30 continuous features from digitized cell nucleus images. We bin 3 randomly selected features into 5 quantile-based categories to create a mixed-type dataset. Natural outliers arise from rare tumor characteristics. Adult (Census Income). UCI Adult dataset ( n=45{,}222 ) with 6 continuous and 8 categorical features predicting income > $50K. This large-scale dataset tests scalability and contains natural demographic outliers (rare occupation/education combinations). German Credit. UCI German Credit dataset ( n=1{,}000 ) with 7 continuous and 13 categorical features predicting creditworthiness. The high categorical dimensionality creates many rare feature combinations that serve as natural outliers. Data splits and evaluation. Each dataset is split 56%/14%/30% into train/validation/test sets. The validation set is used for hyperparameter selection ( \gamma ) to avoid test leakage. Outlier scores are computed via k NN distance ( k=10 ) in standardized feature space; records are assigned to deciles with decile 10 containing the 10% most outlying. All experiments use 5 random seeds; we report mean results. 7.3 Methods and Baselines We compare REPS against baselines and ablations: Non-private baseline. We run the same Naive Bayes synthesis without any noise to establish utility upper bounds. This baseline also reveals the privacy leakage when no DP protection is applied. DP uniform (no scoring). All records receive weight w_{i}=1 and we spend the full budget (\varepsilon,\delta) on the synthesis stage. This is the standard DP baseline under the same total privacy budget. DP uniform (matched split). To isolate the effect of risk-weighting under matched noise, we also report a split-budget uniform baseline that uses only (\varepsilon_{t},\delta_{t})=(0.9\varepsilon,\delta/2) for synthesis. The remaining (\varepsilon_{s},\delta_{s})=(0.1\varepsilon,\delta/2) budget is unused. REPS (ours). Two-stage mechanism as described in Algorithm 1 : Stage 1 computes DP histogram-based scores (16 bins for continuous features; exact categories for categorical features) using (\varepsilon_{s},\delta_{s})=(0.1\varepsilon,\delta/2) ; Stage 1.5 maps scores to weights via w_{i}=\exp(-\gamma(s_{i}-t)_{+}) with threshold t at the 90th percentile; Stage 2 releases risk-weighted clipped statistics (Eq. 2 ) using (\varepsilon_{t},\delta_{t})=(0.9\varepsilon,\delta/2) . We select \gamma\in\{0.5,1.0,2.0,4.0\} using a held-out validation set: choose the largest \gamma whose validation TSTR AUROC is within 0.02 of the DP uniform (no scoring) baseline. This tuning step is not included in the DP accounting; in a deployed mechanism, \gamma must be fixed a priori or selected using a DP-safe procedure. Ablation: random downweighting. Apply the same weight distribution as REPS but shuffle weights randomly across records. This tests whether the benefit comes from reducing total contribution variance or specifically from targeting outliers. Ablation: hard removal. Remove all records with DP scores above the 90th percentile threshold, then run standard DP synthesis on remaining records. This compares soft downweighting against hard exclusion. Additional baselines. Our goal is to isolate the effect of risk-weighting in a controlled sufficient-statistics pipeline. We therefore emphasize comparisons against the two uniform DP baselines above and targeted ablations. Extending REPS weighting to canonical DP synthesizers (e.g., PGM/MST or DP-SGD-based generators) is an important direction for future work. 7.4 Privacy Budget and Accounting We evaluate across privacy budgets \varepsilon\in\{0.5,1.0,2.0,4.0\} with \delta=1/n^{2} (standard choice for n -record datasets). For REPS (and the matched-split baseline), we split privacy as \varepsilon=\varepsilon_{s}+\varepsilon_{t} with \varepsilon_{s}=0.1\varepsilon , \varepsilon_{t}=0.9\varepsilon , and \delta_{s}=\delta_{t}=\delta/2 . The DP uniform (no scoring) baseline uses the full (\varepsilon,\delta) for synthesis. End-to-end DP follows from Theorem 1 . For a Gaussian mechanism with \ell_{2} sensitivity \Delta_{2} , we use noise \sigma=\Delta_{2}\cdot\sqrt{2\log(1.25/\delta)}/\varepsilon ( 5 ) . 7.5 Utility Evaluation We measure utility via train-on-synthetic, test-on-real (TSTR): we generate \tilde{D} with |\tilde{D}|=|D_{\text{train}}| , train logistic regression on \tilde{D} , and report AUROC on the held-out real test set. Full details are in Appendix B . 7.6 Results: Membership Inference by Outlier Decile Full numerical results across all datasets and baselines are provided in Appendix B . We report two uniform DP baselines: DP uniform (no scoring), which spends the full (\varepsilon,\delta) on synthesis, and DP uniform (matched split), which matches REPS’s synthesis-stage budget. Q1: Does REPS reduce outlier-targeted privacy risk? On the simulated dataset with ground-truth injected outliers, REPS reduces top-decile MIA advantage across all tested \varepsilon values (Figure 2 ). For example, at \varepsilon=4.0 the top-decile advantage drops from 0.760 (DP uniform, no scoring) to 0.728 (REPS). On the real-world benchmarks, results are mixed: Breast Cancer shows modest improvements at higher \varepsilon , while Adult and Credit do not show consistent top-decile improvements under the same total budget (Appendix B ; per-decile curves in Figure 3 ). This underscores that risk-weighting is not a universal “free win” against membership inference in all tabular settings. Q2: Does it reduce risk inequality while preserving utility? Figure 1 shows the utility–privacy trade-off on the simulated dataset. Risk-weighting can reduce top-decile vulnerability with modest utility loss, and can modestly reduce the top/median inequality ratio in settings where outliers are well captured by the scorer. However, on datasets where the vulnerability is driven by higher-order feature interactions, we observe limited or negative changes in the inequality ratio (Appendix B ). Figure 1: Utility (TSTR AUROC) versus privacy budget on the simulated dataset. REPS shows slightly lower utility—the expected cost of downweighting outliers to protect their privacy. Figure 2: Top-10% MIA advantage versus privacy budget on the simulated dataset. Lower is better: REPS reduces attacker success against the most vulnerable records. Q3: Privacy-utility frontier. As \varepsilon increases, all methods improve in utility (Figure 1 ). At low \varepsilon , utility constraints limit aggressive downweighting; at higher \varepsilon , more aggressive weighting is feasible. Q4: Ablation—is targeting essential? Shuffling weights randomly across records (same distribution, random assignment) is less effective than targeted weighting on the simulated dataset, confirming that identifying high-risk records matters. Results on real-world benchmarks are mixed (Appendix B ). 8 Discussion Outliers vs. minorities. Outliers may represent marginalized populations whose accurate representation matters for fairness. Downweighting improves their privacy but may degrade fidelity for these groups. We recommend treating \gamma as a policy knob balancing privacy equity against representation. Scorer quality. Scorer quality (Figures 4 – 5 ) improves with \varepsilon on simulated and Breast Cancer data. On Adult, scorer quality is high even at \varepsilon=0.5 , yet MIA improvements are limited—suggesting effectiveness depends on whether the attack exploits the same statistics we control (e.g., higher-order interactions on Credit). Scope and attack model. We focus on sufficient-statistics synthesis for clean per-instance analysis; DP-SGD bounds require integrating data-dependent analyses ( 19 ; 7 ) . Our distance-based MIA may underestimate sophisticated attackers ( 2 ) ; MAMA-MIA ( 10 ) suggests sufficient-statistics methods may be more vulnerable, which REPS mitigates by reducing outlier influence. Broader applicability. The principle extends to DP-SGD, federated learning with outlier clients, and query answering—anywhere per-instance loss scales with influence. 9 Conclusion We introduced risk-equalized DP synthetic data generation, a framework that protects high-risk outliers by reducing their influence on the learned synthesizer. Our two-stage mechanism—DP outlier scoring followed by risk-weighted DP learning—achieves formal (\varepsilon,\delta) -DP with improved per-instance privacy bounds for vulnerable records. Experiments across four datasets with five random seeds show clear reductions in top-decile MIA advantage on the controlled outlier-injection benchmark, and smaller but sometimes positive gains on Breast Cancer at higher \varepsilon . On Adult and Credit, we observe mixed results under a fixed total budget, highlighting that influence control in a sufficient-statistics pipeline does not automatically translate to uniform empirical robustness against membership inference across all tabular domains. Ablations suggest that, when improvements occur, they come from correctly targeting high-risk records rather than random downweighting. This work bridges the empirical observation that outliers face disproportionate privacy risk in synthetic data ( 20 ; 14 ) with mechanism design tools from per-instance differential privacy ( 22 ) . The main practical takeaway is that influence-weighting provides a simple lever to shape per-instance guarantees; empirical outlier-robustness gains depend on scorer quality and on the synthesis/attack setting. Broader Impact This paper advances differentially private synthetic data generation with the explicit goal of reducing disproportionate privacy risk for high-outlierness individuals. A primary positive impact is enabling safer data sharing in domains such as healthcare and finance where rare records are both valuable and vulnerable; risk-equalized mechanisms can help organizations deploy DP synthesis while providing more uniform protection across the population. Potential negative impacts stem from the same mechanism: downweighting outliers may reduce fidelity for minority subpopulations and affect downstream fairness, particularly if synthetic data is used for policy or clinical decisions. We recommend treating the risk-weight aggressiveness as a policy knob and reporting subgroup utility alongside privacy metrics, and we caution against using synthetic data as the sole basis for high-stakes decisions without domain-specific auditing. Appendix A Proofs Proof of Theorem 1 . Stage 1 releases \widehat{s}_{1:n}\leftarrow\mathcal{W}(D) and is (\varepsilon_{s},\delta_{s}) -DP by assumption. The weights w_{1:n}=g(\widehat{s}_{1:n}) are deterministic post-processing of the Stage 1 output. Stage 2 takes w_{1:n} as auxiliary input and releases \theta\leftarrow\mathcal{A}(D;w_{1:n}) ; since \mathcal{A}(\cdot;w) is (\varepsilon_{t},\delta_{t}) -DP for any fixed w , adaptive composition [ 5 ] yields that (\widehat{s}_{1:n},\theta) is (\varepsilon_{s}+\varepsilon_{t},\delta_{s}+\delta_{t}) -DP. Sampling \tilde{D}\sim p_{\theta}^{\otimes m} is further post-processing. ∎ Proof of Corollary 1 . Stage 1 is (\varepsilon_{s},\delta_{s}) -DP, hence also (\varepsilon_{s},\delta_{s}) -pDP for every record. Conditional on any fixed weights w , Stage 2 admits a per-instance bound (\varepsilon_{i,t}(D),\delta_{t}) -pDP by assumption (e.g., Corollary 2 for a Gaussian release). Applying adaptive composition to the two-stage release yields (\varepsilon_{s}+\varepsilon_{i,t}(D),\delta_{s}+\delta_{t}) -pDP for record i . ∎ Proof of Theorem 2 . Fix record i and let D^{\prime}=D^{(-i)} . The function f has \ell_{2} sensitivity \Delta_{2}=\left\lVert f(D)-f(D^{\prime})\right\rVert_{2}=\alpha_{i}(f,D) for this particular neighboring pair. The Gaussian mechanism with noise \mathcal{N}(0,\sigma^{2}I_{k}) therefore satisfies (\varepsilon_{i}(D),\delta) -DP for this pair with \varepsilon_{i}(D)\leq\Delta_{2}\sqrt{2\log(1.25/\delta)}/\sigma [ 5 ] . ∎ Proof of Lemma 1 . By definition, D^{(-i)} replaces z_{i} with \bot and we take \mathrm{clip}(\phi(\bot),C)=0 , so f_{w}(D)-f_{w}(D^{(-i)})=\frac{1}{n}w_{i}\cdot\mathrm{clip}(\phi(z_{i}),C). Since \left\lVert\mathrm{clip}(\phi(z_{i}),C)\right\rVert_{2}\leq C by definition of clipping, we have \alpha_{i}(f_{w},D)\leq w_{i}C/n . ∎ Proof of Corollary 2 . Apply Theorem 2 to f=f_{w} and use Lemma 1 to bound \alpha_{i}(f_{w},D)\leq w_{i}C/n . ∎ Proof of Proposition 1 . For i\in\mathcal{H} , Corollary 2 gives \varepsilon_{i}(D)\leq\frac{w_{i}C}{n\sigma}\sqrt{2\log(1.25/\delta_{t})}=\varepsilon_{\mathrm{out}} . For global sensitivity, the worst-case influence bound is \max_{i}w_{i}C/n=C/n since w_{i}=1 for i\notin\mathcal{H} . The Gaussian mechanism calibrated to sensitivity C/n is therefore (\varepsilon,\delta_{t}) -DP with \varepsilon=\frac{C}{n\sigma}\sqrt{2\log(1.25/\delta_{t})} . ∎ Proof of Proposition 2 . Write \bar{\phi}(D)=\frac{1}{n}\sum_{i=1}^{n}\phi(z_{i}) and expand: \displaystyle f_{w}(D)-\bar{\phi}(D) \displaystyle=\frac{1}{n}\sum_{i=1}^{n}\big(w_{i}\mathrm{clip}(\phi(z_{i}),C)-\phi(z_{i})\big) \displaystyle=\frac{1}{n}\sum_{i=1}^{n}(w_{i}-1)\mathrm{clip}(\phi(z_{i}),C) \displaystyle+\frac{1}{n}\sum_{i=1}^{n}\big(\mathrm{clip}(\phi(z_{i}),C)-\phi(z_{i})\big). Taking norms and applying the triangle inequality, and using w_{i}\in(0,1] so \left\lVert(w_{i}-1)u\right\rVert_{2}=(1-w_{i})\left\lVert u\right\rVert_{2} , yields the stated bound. ∎ Appendix B Extended Experimental Details This appendix provides reproducibility details (pipeline, DP accounting, attacks) and full numerical results (mean over 5 seeds). B.1 Implementation and preprocessing Feature processing. Continuous features are standardized using the training split (zero mean, unit variance) and clipped to [-3,3] before computing DP sufficient statistics. Categorical features are treated as strings and one-hot encoded only for evaluation models/attacks. Train/validation/test splits. We split each dataset into 56%/14%/30% train/validation/test with stratification on the label. The validation split is used only for selecting \gamma for REPS, and we report mean metrics over 5 random seeds. B.2 DP accounting and hyperparameters Budgets. We use \delta=1/n^{2} where n is the training-set size. For REPS we split (\varepsilon,\delta) across stages as (\varepsilon_{s},\delta_{s})=(0.1\varepsilon,\delta/2) for scoring and (\varepsilon_{t},\delta_{t})=(0.9\varepsilon,\delta/2) for synthesis. The DP uniform (no scoring) baseline uses the full (\varepsilon,\delta) for synthesis. Scoring. Stage 1 computes DP histogram rarity scores using 16 bins for continuous features (uniform bin edges over [-3,3] ) and exact categories for categorical features, releasing all histograms jointly with Gaussian noise and \ell_{2} sensitivity \sqrt{d} for d features. We report scorer quality by (i) Spearman correlation between DP scores and non-private k NN outlier scores, and (ii) Recall@Top-10% (fraction of k NN top-decile records that are also in the DP-score top decile). Weights and tuning. We map scores to weights via w_{i}=\exp(-\gamma(s_{i}-t)_{+}) with threshold t at the 90th percentile. We select \gamma\in\{0.5,1.0,2.0,4.0\} by choosing the largest value whose validation TSTR AUROC is within 0.02 of the DP uniform (no scoring) baseline. This selection is not included in the DP accounting; in a deployed mechanism, \gamma must be fixed a priori or chosen using a DP selection procedure. B.3 Synthesis model (Instantiation A) Conditional Gaussian Naive Bayes. Our synthesizer releases a set of DP sufficient statistics and samples from a class-conditional model: it releases weighted label frequencies, categorical frequencies conditioned on the label, and (for continuous features) label-conditional first and second moments. Each per-record contribution is \ell_{2} clipped, and Gaussian noise is added to each query block; the overall release is DP by composition. B.4 Attacks and metrics MIA and DOMIAS-style attack. We report membership inference advantage 2\cdot\mathrm{AUC}-1 (absolute value). In addition to a distance-to-synthetic baseline, we implement a DOMIAS-style attack using a held-out reference set: for a query record, compute the ratio of average k NN distances to synthetic data versus to the reference set (we use k=5 ). We use the test split as the reference set of non-members. B.5 Per-decile risk curves and scorer diagnostics Figure 3: MIA advantage by outlier decile (DOMIAS-style), for Adult and Breast Cancer at \varepsilon\in\{1.0,4.0\} . Lower curves indicate better privacy; the gap between decile 10 and decile 1 reflects privacy inequity. Figure 4: Scorer quality versus \varepsilon : Spearman correlation between DP histogram scores and non-private k NN outlier scores. Higher correlation indicates the DP scorer successfully identifies true outliers. Figure 5: Scorer quality versus \varepsilon : Recall@Top-10% between the DP-score top decile and the k NN top decile. Higher recall means the DP scorer correctly flags the same high-risk records as the oracle. Figure 6: Risk inequality ratio (top-decile MIA advantage divided by median-decile advantage) versus \varepsilon . Values closer to 1 indicate more equalized privacy protection across the population. Table 1: Results on sim dataset (mean over 5 seeds). Bold indicates best DP method per \varepsilon . \varepsilon Method \gamma TSTR \uparrow MIA Adv \downarrow Top-10% Adv \downarrow Top/Med \downarrow 0.5 Non-private – 0.772 0.015 0.841 1.167 DP Uniform (no scoring) 0.0 0.604 0.006 0.667 1.025 DP Uniform (split) 0.0 0.589 0.007 0.666 1.015 REPS (ours) 0.5 0.569 0.008 0.659 1.009 Random Downwt. 0.5 0.581 0.005 0.663 1.005 Hard Removal 0.5 0.627 0.005 0.667 0.999 1.0 Non-private – 0.772 0.015 0.841 1.167 DP Uniform (no scoring) 0.0 0.664 0.016 0.708 1.097 DP Uniform (split) 0.0 0.656 0.015 0.703 1.084 REPS (ours) 4.0 0.647 0.008 0.690 1.050 Random Downwt. 4.0 0.653 0.012 0.705 1.090 Hard Removal 4.0 0.627 0.013 0.695 1.024 2.0 Non-private – 0.772 0.015 0.841 1.167 DP Uniform (no scoring) 0.0 0.704 0.008 0.731 1.088 DP Uniform (split) 0.0 0.697 0.006 0.737 1.091 REPS (ours) 4.0 0.689 0.005 0.708 1.086 Random Downwt. 4.0 0.691 0.010 0.718 1.090 Hard Removal 4.0 0.660 0.015 0.702 1.064 4.0 Non-private – 0.772 0.015 0.841 1.167 DP Uniform (no scoring) 0.0 0.734 0.010 0.760 1.108 DP Uniform (split) 0.0 0.729 0.015 0.758 1.109 REPS (ours) 4.0 0.720 0.014 0.728 1.097 Random Downwt. 4.0 0.724 0.012 0.752 1.128 Hard Removal 4.0 0.690 0.013 0.720 1.089 Table 2: Results on breast_cancer dataset (mean over 5 seeds). Bold indicates best DP method per \varepsilon . \varepsilon Method \gamma TSTR \uparrow MIA Adv \downarrow Top-10% Adv \downarrow Top/Med \downarrow 0.5 Non-private – 0.989 0.038 0.904 1.016 DP Uniform (no scoring) 0.0 0.751 0.032 0.572 0.657 DP Uniform (split) 0.0 0.721 0.046 0.548 0.624 REPS (ours) 0.5 0.705 0.063 0.550 0.629 Random Downwt. 0.5 0.708 0.055 0.546 0.630 Hard Removal 0.5 0.707 0.054 0.550 0.628 1.0 Non-private – 0.989 0.038 0.904 1.016 DP Uniform (no scoring) 0.0 0.914 0.049 0.568 0.653 DP Uniform (split) 0.0 0.910 0.047 0.558 0.640 REPS (ours) 4.0 0.821 0.040 0.559 0.641 Random Downwt. 4.0 0.817 0.047 0.564 0.652 Hard Removal 4.0 0.781 0.022 0.554 0.647 2.0 Non-private – 0.989 0.038 0.904 1.016 DP Uniform (no scoring) 0.0 0.959 0.042 0.585 0.661 DP Uniform (split) 0.0 0.958 0.027 0.573 0.643 REPS (ours) 4.0 0.946 0.034 0.568 0.649 Random Downwt. 4.0 0.954 0.034 0.562 0.643 Hard Removal 4.0 0.946 0.026 0.574 0.655 4.0 Non-private – 0.989 0.038 0.904 1.016 DP Uniform (no scoring) 0.0 0.966 0.023 0.574 0.644 DP Uniform (split) 0.0 0.965 0.037 0.585 0.677 REPS (ours) 4.0 0.963 0.034 0.558 0.639 Random Downwt. 4.0 0.961 0.035 0.565 0.645 Hard Removal 4.0 0.965 0.045 0.565 0.645 Table 3: Results on adult dataset (mean over 5 seeds). Bold indicates best DP method per \varepsilon . \varepsilon Method \gamma TSTR \uparrow MIA Adv \downarrow Top-10% Adv \downarrow Top/Med \downarrow 0.5 Non-private – 0.890 0.008 0.650 1.107 DP Uniform (no scoring) 0.0 0.853 0.007 0.683 1.246 DP Uniform (split) 0.0 0.851 0.007 0.689 1.266 REPS (ours) 4.0 0.845 0.008 0.695 1.294 Random Downwt. 4.0 0.850 0.007 0.695 1.285 Hard Removal 4.0 0.855 0.007 0.722 1.351 1.0 Non-private – 0.890 0.008 0.650 1.107 DP Uniform (no scoring) 0.0 0.863 0.007 0.650 1.151 DP Uniform (split) 0.0 0.860 0.008 0.656 1.166 REPS (ours) 4.0 0.854 0.008 0.664 1.196 Random Downwt. 4.0 0.859 0.007 0.662 1.180 Hard Removal 4.0 0.864 0.009 0.687 1.245 2.0 Non-private – 0.890 0.008 0.650 1.107 DP Uniform (no scoring) 0.0 0.878 0.005 0.627 1.087 DP Uniform (split) 0.0 0.876 0.006 0.632 1.098 REPS (ours) 4.0 0.870 0.008 0.635 1.124 Random Downwt. 4.0 0.874 0.006 0.636 1.110 Hard Removal 4.0 0.870 0.008 0.669 1.171 4.0 Non-private – 0.890 0.008 0.650 1.107 DP Uniform (no scoring) 0.0 0.889 0.006 0.618 1.064 DP Uniform (split) 0.0 0.887 0.007 0.613 1.060 REPS (ours) 4.0 0.882 0.007 0.614 1.079 Random Downwt. 4.0 0.884 0.007 0.615 1.062 Hard Removal 4.0 0.880 0.008 0.632 1.110 Table 4: Results on credit dataset (mean over 5 seeds). Bold indicates best DP method per \varepsilon . \varepsilon Method \gamma TSTR \uparrow MIA Adv \downarrow Top-10% Adv \downarrow Top/Med \downarrow 0.5 Non-private – 0.781 0.058 0.965 0.982 DP Uniform (no scoring) 0.0 0.544 0.051 0.924 0.968 DP Uniform (split) 0.0 0.541 0.054 0.927 0.970 REPS (ours) 4.0 0.537 0.054 0.927 0.969 Random Downwt. 4.0 0.539 0.041 0.925 0.966 Hard Removal 4.0 0.535 0.053 0.925 0.963 1.0 Non-private – 0.781 0.058 0.965 0.982 DP Uniform (no scoring) 0.0 0.570 0.036 0.937 0.963 DP Uniform (split) 0.0 0.574 0.036 0.930 0.964 REPS (ours) 4.0 0.573 0.058 0.934 0.975 Random Downwt. 4.0 0.571 0.049 0.928 0.967 Hard Removal 4.0 0.570 0.039 0.925 0.957 2.0 Non-private – 0.781 0.058 0.965 0.982 DP Uniform (no scoring) 0.0 0.643 0.042 0.950 0.974 DP Uniform (split) 0.0 0.636 0.042 0.948 0.970 REPS (ours) 0.5 0.641 0.033 0.949 0.975 Random Downwt. 0.5 0.629 0.024 0.946 0.977 Hard Removal 0.5 0.648 0.028 0.944 0.974 4.0 Non-private – 0.781 0.058 0.965 0.982 DP Uniform (no scoring) 0.0 0.689 0.056 0.965 0.989 DP Uniform (split) 0.0 0.682 0.040 0.962 0.986 REPS (ours) 4.0 0.682 0.040 0.961 0.984 Random Downwt. 4.0 0.677 0.041 0.960 0.983 Hard Removal 4.0 0.682 0.044 0.961 0.986