Locally Adaptive Conformal Inference for Operator Models
Trevor A. Harris, Yan Liu · 2025
Read Locally Adaptive Conformal Inference for Operator Models by Trevor A. Harris, Yan Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20975.txt.
Introduction
Trevor Harris and Yan Liu build an uncertainty tool in twenty twenty-five. Operator models map functions to functions and are used to forecast change over space and time. They also serve to emulate physics. In high-stakes uses, their predictions need honest error bounds. The authors offer a method that needs no assumptions about the data's distribution.
Their frame, called LSCI, makes prediction sets that adapt to local conditions. They prove it stays valid on finite samples. They also bound how far its coverage can drift when data are locally exchangeable. Tests covered synthetic tasks plus air quality, energy demand, and weather. The method gave tighter sets than standard conformal baselines and held up under biased predictions.
Catalog record
| CREATOR | Trevor A. Harris, Yan Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-20975
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Locally Adaptive Conformal Inference for Operator Models Trevor A. Harris, Yan Liu Abstract Operator models are regression algorithms for functional data and have become a key tool for emulating large-scale dynamical systems. Recent advances in deep neural operators have dramatically improved the accuracy and scalability of operator modeling, but lack an inherent notion of predictive uncertainty. We introduce Local Spectral Conformal Inference (LSCI), a new framework for locally adaptive, distribution-free uncertainty quantification for neural operator models. LSCI uses projection-based depth scoring and localized conformal inference to generate function-valued prediction sets with statistical guarantees. We prove approximate finite-sample marginal coverage under local exchangeability, and demonstrate significant gains in adaptivity and coverage across synthetic and real-world operator learning tasks. 1 Introduction An operator is a map \Gamma:\mathcal{F}\mapsto\mathcal{G} between two function spaces \mathcal{F} and \mathcal{G} . Given a function f as input, an operator \Gamma returns another function g=\Gamma(f) . An operator model, then, is a parameterized operator \Gamma_{\theta}:\mathcal{F}\mapsto\mathcal{G} that is trained to predict functions g\in\mathcal{G} given functions f\in\mathcal{F} . As in ordinary regression, we learn an operator model’s parameters \theta\in\Theta by minimizing a function valued loss \mathcal{L}:\Theta\times(\mathcal{F},\mathcal{G})\mapsto\mathbb{R} . Many scientific and engineering problems can be cast as operator learning problems. Recent works include partial differential equation (PDE) approximation li2020fourier and closure modeling sanderse2024scientific , weather forecasting pathak2022fourcastnet and climate downscaling jiang2023efficient , medical imaging ( maier2022known ) , and image super-resolution wei2023super . Early approaches to operator modeling used linear operator models to infer statistical relationships between functional covariates and functional response variables ( ramsay1991some ; besse1996approximation ; yao2005functional ; wu2011response ; ivanescu2015penalized ) . Linear models typically take one of two forms ( wang2016functional ) \Gamma_{\theta}(f)(t)=\beta_{0}(t)+\beta_{1}(t)f(t)\quad\text{or}\quad\Gamma_{\theta}(f)(t)=\alpha_{0}(t)+\int_{D}\beta_{1}(t,s)f(s)ds (1) where \beta_{1} and \alpha_{1} act as weight functions, \beta_{0} and \alpha_{0} as bias functions. The response g\in\mathcal{G} is modeled pointwise as g(t)=\Gamma_{\theta}(f)(t)+\epsilon(t) , where \epsilon(t) is an assumed error process, such as a Gaussian process. Non-linear extensions using higher-order polynomial terms include ( yao2010functional ; giraldo2010continuous ; ferraty2011recent ; mclean2014functional ; scheipl2015functional ) . A recent innovation in non-linear operator modeling are the Neural Operator (NOs) models, which mimic the structure of deep neural networks ( chen1995universal ; lu2021learning ; bhattacharya2021model ; nelsen2021random ) . Neural operators sequentially build up the operator \Gamma_{\theta} through a sequence of non-linear kernel integrations. An L -layer neural operator is defined as \Gamma_{\theta}=Q\circ K_{L}\circ...\circ K_{1}\circ R , where R and Q are linear projection operators and each K_{l} is a kernel integration kovachki2021universal ; kovachki2024operator . Each non-linear kernel integrations is defined as K_{l}(v)(t)=\sigma\left(W_{l}v(t)+b_{l}(t)+\int_{D}k^{l}(t,s)v(s)ds\right), (2) where v is the output of K_{l-1} , \sigma is a point-wise activation function, W_{l} and b_{l} are weight and bias matrices, and k^{l} is a neural network ( li2020fourier ) . Neural operators have been shown to approximate the solutions of non-linear PDEs, such as Navier-Stokes and Darcy’s equations, at a fraction of the cost of numerical methods ( li2020fourier ; bonev2023spherical ; tripura2023wavelet ; lanthaler2023nonlocal ; benitez2024out ; kovachki2024operator ) . Other applications include large-scale weather forecasting ( pathak2022fourcastnet ) , climate model downscaling ( jiang2023efficient ) , 3D automative aerodynamic simulation li2023geometry , and carbon capture storage reservoir pressure buildup wen2023real . Figure 1: Example prediction sets using three baseline methods (Section 3.5 ) and the proposed method (LSCI) on Energy Demand data (Section 4.2 ). Three examples of prediction sets for different levels of residual variability. In many domains where NOs are currently being applied, such as in weather and climate modeling, precise uncertainty quantification (UQ) is critical. However, unlike statistical operator models, NOs do not contain an inherent notion of uncertainty because they lack an explicit probabilistic model. This severely limits their utility and trustworthiness for high stakes applications and rigorous scientific discovery. Therefore, we propose a new statistically rigorous uncertainty quantification technique for NO models, based on locally adaptive conformal inference ( shafer2008tutorial ; lei2018distribution ) , called Local Spectral Conformal Inference (LSCI). Building on recent works for conformal inference for functional data lei2015conformal ; diquigiovanni2022conformal ; ma2024calibrated ; mollaali2024conformalized ; moya2025conformalized and local conformal inference ( hore2023conformal ; guan2023localized ) , we introduce a new functional conformity measure called local \Phi -scores that allows us to construct locally adaptive, and statistically valid, prediction sets for operator models. We show that conformalization with local \Phi -scores results in statistically exact prediction sets that are highly adaptive to local variations (Figure 1 ). To make LSCI prediction sets practical, we further introduce a simple sampling procedure to generate prediction ensembles and prediction bands. 2 Background Conformal Inference Conformal inference is a general family of procedures for imbuing arbitrary prediction algorithms with exact, finite-sample, uncertainty quantification ( shafer2008tutorial ; lei2018distribution ) . Given a prediction algorithm \Gamma_{\theta}:\mathcal{F}\mapsto\mathcal{G} , we first train the model on the training dataset \mathcal{D}_{tr}=\{(f_{s},g_{s})\}_{s=1}^{m} where f_{s}\in\mathcal{F} and g_{s}\in\mathcal{G} . Then, given separate calibration data \mathcal{D}_{cal}=\{(f_{t},g_{t})\}_{t=1}^{n} , and a test point f_{n+1} , a conformal procedure generates a prediction set C_{\alpha}(f_{n+1})\subset\mathcal{G} such that P(g_{n+1}\in C_{\alpha}(f_{n+1}))\geq 1-\alpha (3) under the key assumption that (f_{t},g_{t}) for t\in 1,...,n+1 form an exchangeable sequence. The prediction set C_{\alpha}(f_{n+1})) depends on the model \Gamma_{\theta} , although we omit explicit conditioning for notational convenience. In the standard split, or inductive , conformal procedure we define C_{\alpha}(f_{n+1})=\Gamma_{\hat{\theta}}(f_{n+1})\pm k_{n} , where k_{n} is the \lceil(1-\alpha)(n+1)\rceil/n quantile of the calibration residual scores S(f_{t},g_{t})=||g_{t}-\Gamma_{\hat{\theta}}(f_{t})||_{2} . Adaptive Conformal Inference The fixed form of the prediction sets, \pm k_{n} , prevents C_{\alpha} from adapting to heterogeneity in the data (Figure 1 ), a feature present in many real-world datasets but dis-allowed under pure exchangeability. Adaptive conformal inference methods attempt to circumvent this issue by either introducing adaptive scoring rules, localization procedures, or through quantile regression based estimators (Section 3.5 ). Our proposal is based on localization, which has been shown to strongly improve over adaptive scoring rules and quantile regression in univariate tasks ( guan2023localized ; hore2023conformal ; barber2023conformal ) . 3 Local Spectral Conformal Inference for Operators Let \Gamma_{\theta}:\mathcal{F}\mapsto\mathcal{G} denote an operator model from \mathcal{F} to \mathcal{G} . We assume that \mathcal{F},\mathcal{G}\subset\mathcal{L}^{2}(\Omega) , the space of square integrable functions, i.e., \int_{\Omega}f(x)^{2}dx<\infty , on the compact domain \Omega\subset\mathbb{R}^{p} , p\geq 1 . Let \mathcal{D}_{tr}=\{(f_{s},g_{s})\}_{s=1}^{m} denote a sequence of m training regression pairs, and let \mathcal{D}_{cal}=\{(f_{t},g_{t})\}_{t=1}^{n} denote n calibration pairs. We use different indexing notations, s and t , to emphasize that \mathcal{D}_{tr} and \mathcal{D}_{cal} are disjoint sets. Finally, let \alpha\in(0,1) denote a confidence level, let f_{n+1} denote the new test function, and let g_{n+1} denote the unobserved target function. Our goal is to construct a prediction set C_{\alpha}(f_{n+1}) such that P(g_{n+1}\in C_{\alpha}(f_{n+1}))\geq 1-\alpha and such that C_{\alpha}(f_{n+1}) is locally adaptive to changes in the conditional distribution of g_{n+1}\mid f_{n+1} , such as shape or variance changes. We formalize this processing by assuming that g_{t}\mid f_{t} can be additively decomposed as g_{t}\mid f_{t}=\Gamma(f_{t})+r_{t}, (4) where \Gamma:\mathcal{F}\mapsto\mathcal{G} is an unknown operator and r_{t}\in(r_{t})_{t\in\mathcal{T}} is locally exchangeable error process ( campbell2019local ) . Local exchangeability relaxes exchangeability to allow the distribution of r_{t} to evolve smoothly over the indices t\in\mathcal{T} (Section A.1 ). We denote the distribution of each r_{t} as P_{t}\in\mathcal{P}(\mathcal{G}) and the marginal distribution of (r_{t})_{t\in\mathcal{T}} as P\in\mathcal{P}(\mathcal{G}) . In addition to relaxing full exchangeability, assuming local exchangeability allows us to consistently estimate projections of P_{t} and provide an