Enforcing Constraints in Generative Sampling via Adaptive Correction Scheduling
Noah Trupin, Yexiang Xue · 2026
Read Enforcing Constraints in Generative Sampling via Adaptive Correction Scheduling by Noah Trupin, Yexiang Xue (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11214.txt.
Introduction
Noah Trupin and Yexiang Xue frame constraint enforcement in generative sampling as a correction scheduling problem. Hard constraints are usually imposed by projection, once at the end or after every update. But this changes the distribution of states that future updates depend on. So delayed projection can yield samples that are feasible yet inconsistent with planned sampling dynamics.
Taking one-step constraint defect as a local sign of geometric mismatch, the team offers adaptive scheduling. This state-based policy gives budget to steps that most strongly perturb the trajectory. End and stepwise forms arise as limiting cases. Across rollouts on set manifolds and a learned projected diffusion sampler, the adaptive route wins back seventy-one point two percent of full stepwise benefit with 75 percent fewer fixes. Model builders get constraint timing as a first-class design variable.
Catalog record
| CREATOR | Noah Trupin, Yexiang Xue |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52842 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11214
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enforcing Constraints in Generative Sampling via Adaptive Correction Scheduling Noah Trupin, Yexiang Xue Abstract Hard constraints in generative sampling are typically enforced by projection, applied either once at the end of sampling or after every update. This binary framing overlooks a fundamental issue: projection changes the distribution of states which future updates depend on. As a result, delayed projection can produce samples that are feasible but inconsistent with the intended sampling dynamics, even after final projection. We formalize constraint enforcement as a correction scheduling problem over the generative rollout. Using one-step constraint defect as a local signal of geometric mismatch, we introduce adaptive correction scheduling , a state-dependent policy that allocates projection budget to the steps that most strongly perturb the trajectory. Terminal and stepwise projection arise as limiting cases of this family. Across controlled manifold rollouts and a learned projected diffusion sampler, adaptive scheduling improves the cost–accuracy frontier at matched projection budgets, recovering 71.2 % 71.2\% of full stepwise benefit with 75 % 75\% fewer corrections. These results show that constraint timing is a first-class design variable in generative sampling, and that enforcing feasibility alone is insufficient to preserve the intended constrained sampling dynamics. Figure 1: Adaptive correction preserves rollouts at a fraction of the cost. Terminal correction projects only after the trajectory has already drifted from the ridged terrain, producing a feasible but dynamically inconsistent path. Stepwise correction prevents drift by projecting after every update, but pays the full projection cost. Our adaptive scheduler uses the same projection operator but spends only 25\% of the projection calls, concentrating them where defect is largest to closely track the stepwise rollout. 1 Introduction Generative models are increasingly deployed in settings where outputs must satisfy hard constraints, including trajectory synthesis, robot planning, and structured generation ( 10 ; 11 ; 23 ; 5 ; 2 ; 16 ) . In these domains, samples are required to lie on manifolds defined by geometric, physical, or task-specific structures. A common strategy is to run the generative process in the ambient space and enforce feasibility through projection. This raises the question: when should projection be applied? In practice, two strategies dominate: terminal correction projects only at the end of sampling, while stepwise correction projects after every update. Both are widely used, and both can produce feasible outputs. However, they treat correction timing as a fixed design choice rather than part of the algorithm. This framing ignores that generative updates are state-dependent, as each step is computed from the current iterate. Once a rollout leaves the constraint set, subsequent updates are evaluated at states that a constrained trajectory would never visit. A later projection can restore feasibility, but it cannot in general undo the distributional shift induced by these off-manifold states. As a result, terminally corrected samples are often feasible but wrong. They lie on the constraint set, but correspond to a trajectory that deviated from the constrained dynamics during rollout. Constraint enforcement is therefore not only about satisfying feasibility at the endpoint, but about preserving the trajectory distribution that produces that endpoint. This makes correction timing a resource allocation problem. In typical rollouts, most updates remain close to the constraint set, while a smaller subset produces large excursions that drive downstream error. Terminal correction under-allocates effort to these critical steps, while stepwise correction over-allocates effort everywhere. The central challenge is thus how to allocate a limited number of corrections across the rollout. We address this by reframing constraint enforcement as a correction scheduling problem. We use one-step constraint defect, the distance of a proposed update from the feasible set, as a local signal of geometric mismatch. Small defect indicates that the rollout remains close to the constrained trajectory, while large defect identifies steps whose effects are unlikely to be corrected later. This leads to an online budgeted policy: spend corrections on high-defect steps, where projection is expected to most reduce downstream trajectory error. This yields a family of online budgeted schedules that interpolate between terminal and stepwise correction while adapting to the realized defect profile of each rollout. Fundamentally, this policy is not a heuristic layered onto existing methods, but a direct consequence of viewing constraint enforcement through the lens of trajectory consistency. It is model-agnostic, requires no gradients through projection, and introduces negligible overhead beyond defect evaluation. Our contribution is a scheduling view of constrained generative sampling: 1. Timing changes the rollout. We show that delayed correction alters the distribution of future updates, producing endpoint deviations that cannot be resolved by terminal projection alone. 2. Constraint enforcement is a budget allocation problem. We formalize correction as allocating a limited number of projections across rollout, making terminal, periodic, and adaptive strategies directly comparable. 3. Defect provides an effective value proxy. An online budgeted scheduler uses defect to spend corrections on the steps that most strongly perturb the trajectory. 4. Adaptive scheduling improves the cost–accuracy frontier. At matched correction cost, adaptive policies recover near-stepwise fidelity while using substantially fewer projections. Across controlled manifold rollouts and learned diffusion settings, we observe that constraint violations are highly heterogeneous across time, and that selectively correcting high-defect steps consistently outperforms uniform strategies. These results demonstrate that constraint timing is a fundamental degree of freedom in generative sampling, and that enforcing feasibility alone is insufficient to preserve the intended constrained distribution. 2 Related Work Prior work enforces hard constraints in generative modeling by incorporating projection or optimization into the sampling loop ( 5 ; 16 ; 18 ; 23 ; 7 ) . In diffusion and flow-based models, projected sampling methods often apply projection after each step to maintain feasibility throughout generation ( 4 ; 10 ; 19 ; 8 ; 11 ; 20 ; 16 ; 18 ; 14 ) . Variants introduce projected gradients, differentiable optimization layers, or discrete constraint operators ( 1 ; 2 ; 3 ; 7 ) . These approaches address how to enforce constraints, but largely treat correction timing as fixed. Stepwise projection is typically adopted as a default, while terminal projection is used as a cheaper alternative. Our work instead focuses on when correction should be applied, holding the underlying generative process fixed. This question is closely related to geometric integration, where the interaction between an update rule and a projection or retraction determines long-horizon behavior ( 6 ; 17 ; 5 ; 13 ; 12 ) . Classical results show that projection and dynamics do not generally commute, leading to trajectory drift even when endpoints are feasible. Our setting differs in two key ways: the dynamics are learned and stochastic, and the objective is efficient allocation of correction compute alongside accuracy. A separate line of work studies adaptive schedules in diffusion, selecting timesteps or noise levels to trade off speed and sample quality. Methods such as AdaDiff, TDPM, stepsize distillation, and active noise estimation allocate denoising compute across time ( 22 ; 21 ; 15 ; 9 ) . These approaches operate along an orthogonal axis: they control the generative dynamics themselves. In contrast, we allocate constraint enforcement, treating projection as a limited resource applied to preserve trajectory consistency. Closest are methods that interleave optimization with sampling, but these apply correction uniformly or through fixed heuristics. We instead treat correction as a