Smoothing the Black-Box: Signed-Distance Supervision for Black-Box Model Copying

Rubén Jiménez, Oriol Pujol · 2026

Read Smoothing the Black-Box: Signed-Distance Supervision for Black-Box Model Copying by Rubén Jiménez, Oriol Pujol (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20773.txt.

Introduction

Rubén Jiménez and Oriol Pujol copy deployed AI models using nothing but questions and answers. Their 2026 paper studies black-box model copying with signed-distance supervision. Deployed systems must evolve as data, architectures, and regulations change. Often the original training data and model internals are gone. Black-box copying offers a practical refactoring path. A replica is learned from input-output queries alone. The legacy model is upgraded without ever being opened.

The authors smooth that copying with signed-distance supervision. A signed distance says how far an input sits from a decision boundary, and on which side. That richer signal guides the replica beyond bare labels. Better copies preserve behavior where it matters most. The method serves teams stuck with models they cannot retrain. It turns a black box into a maintainable asset.

Catalog record

CREATORRubén Jiménez, Oriol Pujol
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE91 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20773

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Smoothing the Black-Box: Signed-Distance Supervision for Black-Box Model Copying Rubén Jiménez, Oriol Pujol Abstract Deployed machine learning systems must continuously evolve as data, architectures, and regulations change, often without access to original training data or model internals. In such settings, black-box copying provides a practical refactoring mechanism, i.e. upgrading legacy models by learning replicas from input-output queries alone. When restricted to hard-label outputs, copying turns into a discontinuous surface reconstruction problem from pointwise queries, severely limiting the ability to recover boundary geometry efficiently. We propose a distance-based copying (distillation) framework that replaces hard-label supervision with signed distances to the teacher’s decision boundary, converting copying into a smooth regression problem that exploits local geometry. We develop an α \alpha -governed smoothing and regularization scheme with Hölder/Lipschitz control over the induced target surface, and introduce two model-agnostic algorithms to estimate signed distances under label-only access. Experiments on synthetic problems and UCI benchmarks show consistent improvements in fidelity and generalization accuracy over hard-label baselines, while enabling distance outputs as uncertainty-related signals for black-box replicas. Keywords— Model Copies, Black-box Distillation, Regularization, Distance-based Supervision 1 Introduction Deployed machine learning systems must evolve as data, architectures, and regulations change. Practitioners and companies are confronted with the problem of updating legacy models, migrating them to new architectures, or adapting them to satisfy transparency, privacy, or explainability requirements ( 13 ; 34 ; 12 ; 20 ; 18 ; 16 ; 5 ; 32 ) . This creates a growing need for systematic approaches to model maintenance and continuous evolution. These challenges can be viewed as problems of environmental adaptation ( 30 ) , where a deployed model must be modified in response to shifts in data, features, computational budgets, institutional conditions, or regulation. Within this setting, differential replication denotes generating a new model that preserves salient properties of an existing one (e.g., decision boundary, predictive behaviour, performance) while satisfying updated constraints. Depending on access to data and internals, replication spans from straightforward retraining, through dataset editing or enrichment, to white-box transfer and distillation-based teacher-student strategies. In the most restrictive regime, when neither data nor internals are available, replication collapses to black-box copying, i.e. training a replica solely from input-output queries to approximate the original decision boundary ( 26 ) . This data- and model-agnostic regime is the focus of this work. Black-box copying has been used to address feature unavailability, architectural migration, interpretability needs, and regulatory compliance ( 33 ; 27 ; 28 ; 6 ) . In practice, however, practitioners care not only about fidelity to the source model, but also about task accuracy and additional properties such as fairness, privacy, robustness, or computational efficiency. An important limitation in many realistic scenarios is that the oracle exposes only hard labels, providing a discontinuous supervisory signal that is especially problematic for non-smooth boundaries and high-dimensional inputs ( 1 ) . Most existing methods respond by designing better query datasets ( 29 ; 8 ) , but the structure of the hard-label signal itself has received comparatively little attention. In this work, we study black-box copying in a non-adversarial, fully data-free setting where query access to deployed models is legitimate and inexpensive, and we frame copying and distillation as tools for model maintenance and responsible evolution, analogous to refactoring in software engineering. Departing from prior work focused on compression or adversarial extraction, we introduce a distance-based distillation framework that replaces hard-label supervision with signed distances to the teacher’s decision boundary, transforming copying from learning a discontinuous surface into regressing a smooth target that exploits local geometry. Building on this formulation, we propose a novel \alpha -parametrized, target-centric regularization mechanism that explicitly controls the regularity of the supervisory signal, with regimes that interpolate between replication and distance copying and provide provable Hölder/Lipschitz guarantees. This data-free regularization improves sample efficiency in low-data regimes and enables controlled post-hoc refinement of deployed models, while the distance outputs naturally endow replicas with uncertainty estimates useful for downstream decision-making. Section 2 reviews related work. Section 3 introduces our framework and the proposed target-centric regularization scheme, as well as two model-agnostic algorithms for estimating signed distances from hard labels. Sections 4 and 5 present the experimental setup and results on synthetic datasets and UCI benchmarks, respectively. We conclude by summarizing the main findings, discussing key limitations, and outlining directions for future research. The appendices provide pseudocode, the proof of Theorem 3.1 , and supplementary tables and figures supporting the reported results. 2 Related Work: Distillation and Copying with Hard-Label Binary Teachers Knowledge distillation traditionally transfers knowledge from high-capacity teachers to compact students by matching soft class probabilities ( 9 ) , typically requiring access to model internals ( 10 ; 7 ) . In contrast, hard-label black-box copying trains replicas solely from input–output queries ( 26 ; 24 ; 25 ) , addressing data-free model maintenance when neither training data nor internals are available. Hard labels create discontinuous supervision that hinders decision boundary recovery ( 1 ) . Prior work mitigates this via boundary proxies. Wang et al. ( 31 ) estimate per-class boundary distances to construct soft labels; adversarial methods like boundary attacks ( 3 ) probe geometry via walks; and recent extensions pursue logit reconstruction ( 35 ) , generative boundary sampling ( 22 ) , or active probing ( 17 ) . Unlike these, we regress signed distances directly with \alpha -controlled Hölder/Lipschitz regularity (Thm. 3.1 ), providing a single-parameter family interpolating replication ( \alpha=0 ) and distance copying ( \alpha=1 ) while guaranteeing target smoothness without complex soft-label engineering. 2.1 Differential replication through copying Knowledge distillation typically assumes fixed datasets and soft targets (logits), even in data-free settings where synthetic samples query the teacher ( 9 ) . Black-box copying differs fundamentally ( 26 ) considering unknown training distributions and hard-label oracles. As a result, it becomes a dual optimization over both synthetic queries S and replica parameters \theta . For expressive student spaces \mathcal{H}_{t} , hard-label supervision is separable, so unconstrained fidelity minimization ( \theta^{\dagger} ) achieves perfect empirical fit. Copying thus reduces to constrained capacity ( \Omega(\theta) ) minimization: \displaystyle\underset{\theta,S}{\text{minimize}} \displaystyle\quad\Omega(\theta) (1) subject to \displaystyle\quad\left\|R^{\mathcal{F}}_{emp}(f_{\mathcal{C}}(\theta),f_{\mathcal{O}})-R^{\mathcal{F}}_{emp}(f_{\mathcal{C}}(\theta^{\dagger}),f_{\mathcal{O}})\right\|<\varepsilon for a tolerance \varepsilon , where \theta^{\dagger} is the solution of the unconstrained fidelity minimization problem 1 1 1 Single-pass unconstrained problem: \theta^{\dagger}=\underset{\theta,S}{\text{argmin}}\quad R^{\mathcal{F}}_{emp}(f_{\mathcal{C}}(\theta),f_{\mathcal{O}}). , R^{\mathcal{F}}_{emp} is the empirical fidelity risk, and f_{\mathcal{C}} and f_{\mathcal{O}} correspond to the copying and original models, respectively. A simplified version of the former problem samples S\sim P_{\mathcal{Z}} and then minimizes R^{\mathcal{F}}_{\text{emp}} . Although in practice this single-pass approach is the standard setup, achieving good fidelities require of large synthetic sets. Other approaches, such as alternating optimization jointly refines queries and parameters for memory-efficient approximations of ( 1 ) ( 24 ) . Our signed-distance supervision can be layered on top of existing copying pipelines, providing a controllable smoothness–robustness regularizer. 3 Target-centric Regularized Distance-based Copying Unlike prior decision-based distillation methods that reconstruct multi-class soft targets and optimize divergence-based objectives, we cast hard-label copying as a regression problem by learning to approximate the full signed-distance surface induced by the teacher’s decision boundary. Moreover, we propose a novel target-centric regularization mechanism governed by a parameter \alpha that converts discontinuous label feedback into a smooth metric target with provable regularity for which

Read the complete text