CREDO: Epistemic-Aware Conformalized Credal Envelopes for Regression
Luben M. C. Cabezas, Sabina J. Sloman, Bruno M. Resende, Fanyi Wu, Michele Caprio, Rafael Izbicki · 2026
Read CREDO: Epistemic-Aware Conformalized Credal Envelopes for Regression by Luben M. C. Cabezas, Sabina J. Sloman, Bruno M. Resende, Fanyi Wu, Michele Caprio, Rafael Izbicki (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06826.txt.
Introduction
Cabezas and colleagues build CREDO for regression intervals that stay honest when a model strays from its training data. Conformal scores cover well on average, yet they can look too sure in new regions, since they hide epistemic doubt. Credal sets show that doubt, but they usually lack calibration promises. CREDO first forms a readable credal envelope that grows where proof is thin, then calibrates it with split conformal steps. Its width splits into noise, epistemic growth, and calibration slack.
Catalog record
| CREATOR | Luben M. C. Cabezas, Sabina J. Sloman, Bruno M. Resende, Fanyi Wu, Michele Caprio, Rafael Izbicki |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83905 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.06826
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CREDO: Epistemic-Aware Conformalized Credal Envelopes for Regression Luben M. C. Cabezas, Sabina J. Sloman, Bruno M. Resende, Fanyi Wu, Michele Caprio, Rafael Izbicki Abstract Conformal prediction delivers prediction intervals with distribution-free coverage, but its intervals can look overconfident in regions where the model is extrapolating, because standard conformal scores do not explicitly represent epistemic uncertainty. Credal methods, by contrast, make epistemic effects visible by working with sets of plausible predictive distributions, but they are typically model-based and lack calibration guarantees. We introduce CREDO , a simple “credal-then-conformalize” recipe that combines both strengths. CREDO first builds an interpretable credal envelope that widens when local evidence is weak, then applies split conformal calibration on top of this envelope to guarantee marginal coverage without further assumptions. This separation of roles yields prediction intervals that are interpretable: their width can be decomposed into aleatoric noise, epistemic inflation, and a distribution-free calibration slack. We provide a fast implementation based on trimming extreme posterior predictive endpoints, prove validity, and show on benchmark regressions that CREDO maintains target coverage while improving sparsity adaptivity at competitive efficiency. 1 Introduction Uncertainty quantification (UQ) has become a central requirement for modern machine learning systems, especially in settings where predictions inform downstream decisions. In regression, a central task is to construct prediction intervals for a future response Y_{n+1} at covariates X_{n+1}=x . Two complementary lines of work address this goal: conformal prediction (CP) provides distribution-free calibration, while imprecise-probability (credal) methods represent epistemic uncertainty via sets of plausible distributions but are typically model-based. In this paper, we combine these strengths to obtain prediction intervals that are both calibrated and epistemically interpretable. On the calibration side, CP has emerged as one of the most influential approaches to distribution-free predictive inference because it offers distribution-free marginal coverage while assuming very little about the data-generating mechanism [ 41 , 38 , 29 ] . In its split form, conformal inference is simple and scalable: one fits any predictive model on a training set, computes a nonconformity score on a calibration set, and then enlarges a model-based prediction set by a data-driven correction chosen to ensure coverage. However, standard conformal scores do not explicitly reflect epistemic uncertainty—uncertainty due to limited information—as opposed to aleatoric noise inherent in the data-generating process (see Section 1.2 for related work). As a result, split-conformal intervals can remain relatively narrow in regions of low local support where the underlying predictor extrapolates confidently; while marginal coverage is still guaranteed, the interval geometry may fail to communicate where predictions are driven by extrapolation rather than evidence. From a different direction, the literature on imprecise probabilities and credal sets provides a principled language for epistemic uncertainty by representing beliefs not by a single distribution, but by a set of plausible distributions. Imprecise Probability (IP) theory [ 43 , 3 , 39 ] studies uncertainty in how stochasticity is modeled. Credal sets, convex and (weak ⋆ -)closed sets of probabilities [ 30 ] , are among the main tools from IP theory. They are attractive precisely because they can make epistemic effects explicit: in poorly informed regions the set of plausible conditionals can widen, while additional evidence can reduce this imprecision [ 36 , 11 ] . Yet, credal prediction sets are typically model-based and thus uncalibrated : they depend on how the credal set is constructed and do not usually come with distribution-free coverage guarantees. This paper aims to combine the best of both worlds in regression. We develop a framework that (a) produces interpretable credal predictive uncertainty to represent local epistemic effects, and (b) retains the distribution-free marginal coverage guarantee of conformal calibration. Concretely, we start from a local credal set of conditional predictive distributions \mathcal{F}_{0}(x) , induce from it a credal quantile envelope [\ell(x),u(x)] that summarizes the range of plausible conditional quantiles, and then apply split conformal calibration using a distance-to-envelope score. The resulting prediction interval, CREDO (Conformalized Regression with Epistemic-aware creDal envelOpes), is easy to implement, retains distribution-free marginal coverage, and expands adaptively in regions where the credal envelope reflects limited local information. Figure 1 illustrates the motivation on a toy regression with a structural transition near x=0 and weaker covariate support toward the extremes. Both CQR [ 34 ] and CREDO are split-conformal and thus target the same marginal coverage, but their geometry differs: CREDO selectively widens where local evidence is weak (near the transition and at the edges), whereas CQR can remain comparatively uniform and appear overconfident in sparse regions. CREDO also makes this behavior diagnosable via a decomposition of interval width into aleatoric and epistemic components, with epistemic uncertainty peaking exactly where the envelope inflates. Figure 1 : Motivation and decomposition. Comparison of split-conformal prediction intervals. Top-left: CREDO yields intervals that widen adaptively in regions of high epistemic uncertainty—near the transition and toward the covariate extremes. Top-right: CQR (which does not take epistemic uncertainty into account) produces comparatively uniform intervals that can look overconfident where local support is weak (few nearby training points), despite marginal validity. Bottom-left: CREDO enables an uncertainty decomposition into aleatoric (green) and epistemic (orange) components; epistemic uncertainty peaks around x=0 and at the edges, aligning with where CREDO inflates the envelope. 1.1 Novelty Our contributions are: Credal-to-conformal regression via an explicit envelope. We propose CREDO , which starts from a covariate-dependent credal set of predictive distributions \mathcal{F}_{0}(x) and summarizes it by a (1-\alpha_{0}) credal quantile envelope [\ell(x),u(x)] . We then conformalize this envelope using a distance-to-envelope score, guaranteeing finite-sample marginal coverage under exchangeability. A lightweight credal construction from posterior endpoint trimming. We introduce an endpoint-trimmed posterior credal set that produces envelopes by trimming extreme posterior predictive endpoints. This yields a simple and scalable mechanism to encode epistemic effects without modifying the conformal machinery. Diagnostics via a width decomposition. We provide a practical diagnostic that attributes interval width to (i) an aleatoric core from the conditional model, (ii) an epistemic inflation term induced by credalization, and (iii) the conformal calibration slack. This makes it possible to localize why uncertainty is large at a given x . 1.2 Relation to Other Work Conformal Inference. Conformal prediction yields distribution-free predictive sets by calibrating a nonconformity score s(x,y) on held-out data and inverting an empirical (1-\alpha) quantile, guaranteeing finite-sample marginal coverage under exchangeability [ 41 , 38 , 32 , 29 , 2 , 7 ] . From the standpoint of epistemic uncertainty, this guarantee does not by itself ensure that sets expand in data-sparse or extrapolative regions: widely used regression scores (including residual scores and CQR-style quantile-distance scores) often track primarily aleatoric variability, so the resulting expansion can be weakly sensitive to lack of local support [ 29 , 34 , 24 , 23 , 22 , 25 ] . Motivated by this, a growing line of work augments conformal prediction with epistemic-aware scores so that the conformal expansion increases when the predictor is extrapolating. For example, 17 modifies weighted regression-split conformal prediction by redefining the scale term to represent epistemic uncertainty about Y , estimated via Monte Carlo dropout. Closest to our regression setting, 35 propose uncertainty-aware CQR variants that inflate the CQR score using ensemble-based proxies for epistemic instability in the estimated quantiles (e.g., ensemble standard deviation in UACQR-S or ensemble order statistics in UACQR-P).