Flowing with Confidence

Friso de Kruiff, Dario Coscia, Max Welling, Erik Bekkers, [0.4em] CuspAI · 2026

Read Flowing with Confidence by Friso de Kruiff, Dario Coscia, Max Welling, Erik Bekkers, [0.4em] CuspAI (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18472.txt.

Introduction

Friso de Kruiff and three co-authors give a generative model confidence reports for each sample, at no extra sampling cost. Their Flow Matching with Confidence adds input dependent multiplicative noise at picked layers, then carries its spread through the network in closed form and along the ODE path. The score lets users keep strong samples, rewind runs to where the model locked in a choice, or spend more steps where the flow is unclear. It also tracks how much the learned velocity field spreads out.

Catalog record

CREATORFriso de Kruiff, Dario Coscia, Max Welling, Erik Bekkers, [0.4em] CuspAI
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77899
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18472

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Flowing with Confidence Friso de Kruiff, Dario Coscia, Max Welling, Erik Bekkers, [0.4em] CuspAI Abstract Generative models can produce nonsensical text, unrealistic images, and unstable materials faster than simulation or human review can absorb; without per-sample confidence, trust erodes. Existing fixes run k k ensembles or stochastic trajectories at k × k\times compute, measuring variability between models, not model confidence. We propose Flow Matching with Confidence (FMwC). FMwC injects input-dependent multiplicative noise at selected layers, propagates its variance through the network in closed form, and integrates it along the ODE trajectory, yielding a per-sample confidence score at standard sampling cost. The score supports multiple uses: filtering improves image quality and thermodynamic stability of crystals; editing rewinds trajectories to the points where the model commits and redirects them; and adaptive stepping concentrates ODE compute where the flow is ambiguous. We find that the confidence score correlates with the magnitude of the divergence of the learned velocity field, which gives us a window to understand the generative process, opening up surgical forms of guidance that target the moments that matter, new sampling algorithms and interpretability of generative models. 1 Introduction Generative models have become a central pillar of modern machine learning, producing samples across language, vision, and the natural sciences. Within this class, flow matching has emerged as a leading approach, training a deterministic velocity field by simulation-free regression and integrating it at inference to produce samples ( 23 ) . Despite their broad success ( 24 ; 13 ; 30 ; 10 ) , state-of-the-art models still generate outputs that contain artefacts, and each sample arrives with no native indication of how reliable it is: a hallucinated citation, an anatomically broken figure, and a thermodynamically impossible crystal each emerge with the same implicit confidence. The cost of this missing signal compounds with deployment: in materials discovery, for instance, validating a single generated candidate can take days of compute or weeks of laboratory time, and indiscriminate generation wastes both. This motivates the central question of this work: Can flow-matching models learn to know what they don’t know? Figure 1: Flow-Matching model with Confidence. (Left) Variance is propagated alongside the sample as it is generated along the path p_{0}\!\to\!p_{1} : well-placed samples ( green ) contract into a tight \pm\sigma band, while misplaced ones ( red ) stay diffuse. (Right) Sorting by the resulting confidence score recovers quality across modalities—low-energy crystals and clean digits at high confidence, implausible structures and malformed digits at low confidence. This question echoes 26 , who showed that the log-likelihoods of deep generative models cannot reliably distinguish in- from out-of-distribution inputs. We ask an orthogonal question on the generation side: not whether the model can flag anomalous inputs from its likelihood, but whether it can produce a per-sample reliability signal for the outputs it itself generates, a signal that does not require access to a likelihood at all. Confidence estimation ( 3 ; 18 ) offers a route to such a signal, yet existing approaches force a costly trade-off between training and inference budgets. Deep ensembles ( 22 ) train k models; MC-Dropout ( 12 ) , SDE-style perturbation, and post-hoc last-layer Laplace methods ( 18 ) instead run k trajectories per output at inference. Beyond their cost, all of these report disagreement between models or between runs rather than a property of the single model that produced the output, leaving per-sample confidence either expensive, or unavailable (Table 1 ). We propose Flow Matching with Confidence (FMwC), a flow-matching model that produces a calibrated per-sample confidence score for every generated output, at the same training and inference cost as the deterministic baseline. The construction builds on variational dropout ( 20 ) with input-dependent rates ( 8 ) , and departs from prior variational-dropout work by propagating variance through the entire ODE trajectory rather than through the network at a single time step; that is what turns per-layer learned noise into a trajectory-level confidence score. The resulting score is a within-model, geometric signal that reflects how the learned velocity field responds to perturbations of its own hidden states, distinct from the between-model disagreement that ensembles and MC-Dropout measure. The main contributions of this paper are: 1. A single-pass confidence estimator for flow matching. We introduce Flow Matching with Confidence (FMwC), a flow-matching model that emits a per-sample, trajectory-level confidence score alongside every generated sample, from a single deterministic forward integration as the standard flow-matching baseline. The score is obtained by analytically propagating learned, input-dependent layer-wise noise through the ODE, yielding a closed-form trajectory variance with no Monte Carlo sampling and no auxiliary networks. 2. Confidence enables practical, training-free improvements at inference. Filtering by FMwC monotonically improves sample quality over the deterministic baseline. Second, the temporal variance peak identifies the exact moment the model commits to a sample enabling targeted, constraint-respecting edits without retraining, while confidence score adaptive integration recovers quality at low step budgets where uniform stepping degrades sharply. The same signal supports zero-shot quality selection in confidence-conditioned generation, and serves as a single-pass proxy for flow diagnostics that would otherwise require multiple integrations. 3. Confidence reflects the intrinsic geometry of the learned flow. We show that FMwC’s single-pass score tracks the local divergence of the learned velocity field. This establishes the confidence score as a within-model geometric quantity, a property of the single trained flow rather than a proxy for inter-model disagreement. 2 Related Work Table 1: Comparison of uncertainty quantification approaches for flow matching. FMwC is the only method that provides per-sample confidence at the cost of a single deterministic forward pass, matching the inference budget of standard flow matching. Method Trained models Sampled trajectories Confidence FM 1 1 ✗ MC-Dropout 1 k ✓ Ensemble k k ✓ FMwC (ours) 1 1 ✓ Flow matching has a unique target with intrinsically delicate geometry. Flow matching trains a velocity field by simulation-free regression against a conditional target ( 23 ) , and has been extended to general geometries ( 6 ) and graph-structured data ( 10 ) . Because the conditional and marginal flow-matching gradients coincide, the optimal solution is uniquely determined ( 23 ) . It is a conditional expectation: at each intermediate state, the velocity averages over the conditional velocities of all endpoints reaching that state ( 28 ) . This averaging structure renders the optimal field geometrically delicate: it undergoes spontaneous symmetry-breaking transitions at critical times, where the trajectory’s posterior over endpoints contracts onto a single mode and the susceptibility of the velocity field diverges ( 31 ; 1 ) , with the local divergence of the field further governing how information concentrates along the trajectory ( 32 ) . A finite-capacity network trained on finite data approximates such a field imperfectly, with the approximation expected to be least reliable in regions of intrinsic instability. The standard flow-matching architecture, however, produces a deterministic velocity at inference and exposes no per-sample signal of where the learned flow is trustworthy. Per-sample reliability methods at inference are expensive or measure the wrong quantity. Likelihood is not a per-sample reliability signal for deep generative models ( 26 ; 19 ) , motivating methods that produce one explicitly. Deep ensembles ( 22 ) train k independent networks; at inference, each

Read the complete text