Parameter-Free and Group Conditional Online Conformal Prediction

Beepul Bharti [email protected], Ambar Pal [email protected], Jacopo Teneggi [email protected], Jeremias Sulam [email protected] · 2026

Read Parameter-Free and Group Conditional Online Conformal Prediction by Beepul Bharti [email protected], Ambar Pal [email protected], Jacopo Teneggi [email protected], Jeremias Sulam [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00419.txt.

Introduction

Bharti and co-authors build a tune-free tool for live range calls that hold fair across groups. Range calls must stay sound when data shift with time. Group-wise sound calls guard fair play for each set of points. Past live tools gave up group guards or needed a set learn rate.

Their tool holds group guards with no dial to set at all. Proof gives it the best group-wise marks in its class. Tests span fake and real data runs. It beats past tune-free tools on how sound its calls stay. Its range widths tie well-tuned group tools in size. The work lays a base for fair, firm range calls in shift-prone fields.

Catalog record

CREATORBeepul Bharti [email protected], Ambar Pal [email protected], Jacopo Teneggi [email protected], Jeremias Sulam [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00419

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Parameter-Free and Group Conditional Online Conformal Prediction Beepul Bharti [email protected], Ambar Pal [email protected], Jacopo Teneggi [email protected], Jeremias Sulam [email protected] Abstract Uncertainty quantification (UQ) is critical for the deployment of machine learning predictors in real-world scenarios where the data distribution may shift over time (i.e., data may not be exchangeable). Online conformal prediction (OCP) methods address this issue at the expense of either (i) group-wise error control or (ii) learning-rate independent implementation. Group-conditional coverage is essential for fairness across different collections of data points and for providing finer UQ guarantees. Parameter-free optimization is crucial for robustness to adversarial and unknown data shifts. We propose a parameter-free algorithm for group-conditional OCP and demonstrate that it achieves the best group-conditional coverage guarantees. We evaluate our algorithm on synthetic and real-world data, demonstrating that our method not only improves the reliability of existing parameter-free OCP methods but also provides prediction intervals that are comparable in size to well-tuned group-conditional approaches. By unifying group-conditional coverage with parameter-free online algorithms, our work lays a foundation for fair and robust uncertainty quantification in shifting environments. 1 Introduction Machine learning (ML) models are increasingly deployed in high-stakes domains, such as supporting patient assessment in hospitals [ 23 , 15 ] , informing loan decisions in banking [ 9 ] , and enabling real-time perception and control in autonomous vehicles [ 21 ] . These models affect consequential decision-making, and it is critical that we can rigorously quantify the uncertainty in their predictions. Conformal prediction (CP) is a versatile methodology for constructing prediction sets that contain the unknown label of a test point with finite-sample, distribution-free guarantees [ 44 , 51 , 39 , 50 , 45 , 32 , 12 , 3 ] . More precisely, given a fixed predictor and a user-specified miscoverage level \alpha\in(0,1) , CP produces prediction sets that contain the true label with probability 1-\alpha . This guarantee, however, only holds when the data is exchangeable, an assumption rarely satisfied in practice. In medical triage, for example, patient populations are affected by a number of factors that impact the incoming streams of patients, including seasonal events such as the flu [ 1 ] and large transportation accidents that can cause surges in patient admission [ 43 ] . Online conformal prediction (OCP) methods [ 17 , 54 , 7 , 2 , 18 , 8 , 40 , 6 , 33 ] address this limitation by generating a sequence of prediction sets ({\mathcal{I}}_{t})_{t\geq 1} that provide coverage for the labels of a potentially adversarial stream of data ((X_{t},Y_{t}))_{t\geq 1}=(X_{1},Y_{1}),(X_{2},Y_{2}),\dots . Most OCP methods target a marginal coverage guarantee: as the time horizon T grows, the sets achieve a coverage rate close to 1-\alpha , i.e. \frac{1}{T}\sum^{T}_{t=1}{\bf 1}\left\{Y_{t}\in{\mathcal{I}}_{t}\right\}\approx 1-\alpha . However, this guarantee does not capture the heterogeneity of subpopulations in the data. Going back to the triage example, if the prevalence of a minority group is approximately \alpha , an OCP method could systematically fail to cover the minority group while satisfying the marginal guarantee. This lack of group-conditional coverage can lead to harmful decisions. Accordingly, previous works have proposed OCP algorithms with group guarantees [ 7 , 41 ] . However, they are not parameter-free : their performance depends on the choice of a learning rate—which can be problematic in online adversarial settings, where little to no assumptions are made about the data stream. Since the data may be adversarial, one cannot rely on a validation set to tune the learning rate [ 33 ] . Moreover, even if one commits to a “good” learning rate, the data could be modified arbitrarily at any point to render such choice inappropriate [ 36 ] . While there has been a growing call for parameter-free OCP methods, existing methods only achieve marginal coverage [ 55 , 40 , 33 ] . Thus, it remains unclear how to design parameter-free OCP methods that provide both marginal and group-conditional coverage guarantees. Contributions. To address this gap, we develop a parameter-free algorithm for group-conditional OCP. Formally, consider grouping functions c_{j}(X)\in[0,1] that tell us whether (and to what degree) a sample X_{t} belongs to group j . Following prior works [ 41 ] , we consider k potentially intersecting groups, c_{1},\dots,c_{k}\in[0,1] , and provide an algorithm that constructs a sequence of prediction sets ({\mathcal{I}}_{t})_{t\geq 1} which provides online coverage conditionally on every group, namely \displaystyle\lim_{T\rightarrow\infty}\left|\frac{1}{T_{j}}\sum^{T}_{t=1}{\bf 1}\left\{Y_{t}\in{\mathcal{I}}_{t}\right\}c_{j}(X_{t})-(1-\alpha)\right|=0 \displaystyle\quad\text{for all $j=1,2,\dots,k$}, (1) where T_{j} is the number of times group j appeared up to time T . Specifically, our contributions are: 1. We introduce the first parameter-free algorithm for group-conditional online conformal prediction, that we dub P ortfolios for O nline G roup C o nformal (POGO). 2. We establish rigorous coverage guarantees for POGO, which represent the best finite-time group-coverage results available. 3. Through extensive experiments on both synthetic and real-world datasets, we show POGO consistently outperforms existing approaches by providing adaptive and small prediction intervals at the prescribed coverage. 1.1 Related Work Closest to our work are two lines of research drawing on classical and parameter-free online learning: marginal OCP and group-conditional coverage in stochastic settings. We discuss each of them. Online conformal prediction. Gibbs and Candès 2021 introduced Adaptive Conformal Inference (ACI) for marginal OCP, constructing prediction sets by maintaining a single parameter governing the sets’ width and updating the parameter via Online Subgradient Descent (OSD) on the quantile loss. To address ACI’s sensitivity to its step size, Bastani et al. 2022 introduced MultiValid Predictor (MVP), which provides long-term coverage but cannot rapidly adapt to changes in the data sequence. Since these methods require manual tuning of the step size, subsequent approaches—including Aggregated ACI [ 54 ] , Strongly Adaptive OCP [ 8 ] , and Dynamically-Tuned ACI [ 17 ] —looked to to overcome this limitation by employing adaptive online learning methods to automatically adjust ACI’s updates. A few works explore related settings. For example, Angelopoulos et al. 2024 introduced an algorithm that satisfies the adversarial guarantee in OCP as well as convergence guarantees in stochastic settings, along with an analysis of OSD with arbitrary step sizes. Building on this, Areces et al. 2025 developed algorithms that guarantee coverage for a broader class of stochastic processes, including those with temporal dependence. Complementary approaches recast OCP as a feedback-control problem using ideas from control theory [ 2 , 52 ] . Despite these advances, all these methods require a choice of step sizes and sometimes other hyperparameters. To address this, Zhang et al. 2024 and Podkopaev et al. 2024 used parameter-free online learning algorithms [ 37 , 27 , 26 , 38 ] for OCP. Most recently, Liu et al. 2026 improved on Podkopaev et al. 2024 by proposing Universal Portfolio OCP (UP-OCP), a parameter-free algorithm that utilizes ideas of portfolio optimization and provides the best known finite-time marginal coverage guarantee. The concepts introduced in Liu et al. 2026 serve as the foundation for our method, and we will return this it shortly in Sec. 3 . Group-conditional coverage. The goal of providing group-conditional coverage, as opposed to just marginal, was first introduced in the traditional CP setting with stochastic, i.i.d data. Vovk et al. 2003 and Romano et al. 2020 proposed algorithms with coverage guarantees for disjoint

Read the complete text