Latency and Ordering Effects in Online Decisions
Duo Yi · 2025
Read Latency and Ordering Effects in Online Decisions by Duo Yi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-13060.txt.
Introduction
Duo Yi prices two frictions that online decision systems usually ignore: delay and order. In live systems, feedback arrives late, and the sequence of actions changes which observations even appear, so decisions do not commute. Yi takes a Bregman divergence as the loss benchmark and proves a structured lower bound on the excess loss: the ideal loss. Plus a calibrated penalty for latency, plus one for order-sensitivity, plus a term for their interaction, minus a nonconvexity penalty that vanishes under convexity assumptions. The bound extends to prox-regular and weakly convex settings.
Theory is paired with a monitoring recipe: estimate the terms with simple two-by-two randomized experiments and streaming diagnostics such as effective sample size, clipping rate, and interaction heatmaps. The framework folds messy real-world effects into one statement a team can measure.
Catalog record
| CREATOR | Duo Yi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-13060
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Latency and Ordering Effects in Online Decisions Duo Yi Abstract Online decision systems routinely operate under delayed feedback and order-sensitive (noncommutative) dynamics: actions affect which observations arrive, and in what sequence. Taking a Bregman divergence D Φ D_{\Phi} as the loss benchmark, we prove that the excess benchmark loss admits a structured lower bound L ≥ L ideal + g 1 ( λ ) + g 2 ( ε ⋆ ) + g 12 ( λ , ε ⋆ ) − Δ ncx , L\;\geq\;L_{\mathrm{ideal}}+g_{1}(\lambda)+g_{2}(\varepsilon_{\star})+g_{12}(\lambda,\varepsilon_{\star})-\Delta_{\mathrm{ncx}}, where g 1 g_{1} and g 2 g_{2} are calibrated penalties for latency and order-sensitivity, g 12 g_{12} captures their geometric interaction, and Δ ncx ≥ 0 \Delta_{\mathrm{ncx}}\geq 0 is a nonconvexity/approximation penalty that vanishes under convex Legendre assumptions. We extend this inequality to prox-regular and weakly convex settings, obtaining robust guarantees beyond the convex case. We also give an operational recipe for estimating and monitoring the four terms via simple 2 × 2 2\times 2 randomized experiments and streaming diagnostics (effective sample size, clipping rate, interaction heatmaps). The framework packages heterogeneous latency, noncommutativity, and implementation-gap effects into a single interpretable lower-bound statement that can be stress-tested and tuned in real-world systems. Feasible intersection (Assumption I). We assume \mathcal{C}_{\varepsilon}\cap\mathcal{C}_{\lambda}\neq\emptyset ; otherwise g_{12} is undefined and the bound degenerates (use convexification or redesign). 1 Introduction Motivation. Modern forecasting and decision systems rarely operate in an unconstrained, static environment. Labels and outcomes may arrive with substantial delay, actions must be chosen within narrow decision windows, and operator order can feed back into the system state. Time and order constraints introduce systematic performance losses, yet in practice their contributions are often entangled: adding a cache, changing an update schedule, or reordering a pipeline can help or hurt in ways that are hard to attribute. Practitioners therefore lack a simple calculus for answering questions such as “how much loss is due to latency alone?” or “is the main bottleneck geometric (mismatch) or interactive (ordering/feedback)?” This paper develops a structural decomposition of the excess loss of a constrained system into interpretable terms associated with delay, geometric mismatch, and their interaction, all measured in the native units of the target loss. Scope. We deliberately work under closed convex feasibility sets and a Legendre potential \Phi , which already covers many forecasting and decision systems. Real deployments may deviate from these assumptions. Extending the framework beyond our convex scope introduces additional slack terms and technical machinery. To keep the core ideas transparent, we first present the clean convex case here. Sections 8.2 and Appendix A then develop a systematic treatment of these departures via a unified nonconvexity penalty \Delta_{\mathrm{ncx}} . Goal. We formalize these constraints and prove an inevitable additive lower bound on the realized loss relative to an ideal benchmark in latency- and order-constrained systems. Our proof employs proper scoring rules, Bregman divergences, and two-stage convex projections, yielding a precise and portable calculus for such systems. Contributions. • A unified loss decomposition under time and order constraints. • A constructive proof via Bregman geometry (two projections + Pythagorean inequality). • Monotonicity and orthogonality theorems; when and why interaction vanishes. • Practical diagnostics for estimating g_{1},g_{2},g_{12} with uncertainty. 2 Setup: Signals, Loss, and Ideals We work on a closed convex domain with a Legendre potential \Phi and its Bregman divergence D_{\Phi}(\cdot\|\cdot) . Two convex feasibility sets encode the operational constraints: \mathcal{C}_{\lambda} for finite-time latency and \mathcal{C}_{\varepsilon} for ordering (noncommutativity) . Assumption 1 (Feasible intersection) . The intersection \mathcal{C}_{\varepsilon}\cap\mathcal{C}_{\lambda} is nonempty. Selection convention. For any set-valued argmin we fix measurable selections when needed. All statements about the total bound are invariant to the particular selections; individual components may depend on the choice, as discussed in the selection remark below. Definition 1 (Interaction term) . Let p^{\star} denote the ideal predictive element corresponding to P^{\star} (the Bayes-optimal conditional law). Let a\in\arg\min_{r\in\mathcal{C}_{\varepsilon}}D_{\Phi}(p^{\star}\|r) and b\in\arg\min_{r\in\mathcal{C}_{\lambda}}D_{\Phi}(a\|r) be any measurable selections. Define g_{12}(\lambda,\varepsilon)\ :=\ \inf_{q\in\mathcal{C}_{\varepsilon}\cap\mathcal{C}_{\lambda}}\ D_{\Phi}(b\|q). Basic properties. By Assumption 1 the intersection \mathcal{C}_{\varepsilon}\cap\mathcal{C}_{\lambda} is nonempty, so g_{12}(\lambda,\varepsilon) is well-defined as the infimum of D_{\Phi}(b\|q) over a nonempty feasible set. Since D_{\Phi}(\cdot\|\cdot)\geq 0 for all arguments, we obtain g_{12}(\lambda,\varepsilon)=\inf_{q\in\mathcal{C}_{\varepsilon}\cap\mathcal{C}_{\lambda}}D_{\Phi}(b\|q)\ \geq\ 0. Thus g_{12} is always a nonnegative contribution in the convex, Legendre setting analyzed here. Importantly, this definition compares the sequential projection b only to feasible points q\in\mathcal{C}_{\varepsilon}\cap\mathcal{C}_{\lambda} ; it does not require D_{\Phi}(p^{\star}\|b) to dominate the distance from p^{\star} to the joint projection, which need not hold in general Bregman geometries. When the constraint-induced projections commute and the joint projection coincides with the sequential one, the interaction vanishes exactly, g_{12}(\lambda,\varepsilon_{\star})=0 (Lemma 1 ). Lemma 1 (When the interaction vanishes) . If the constraint-induced projections onto \mathcal{C}_{\varepsilon} and \mathcal{C}_{\lambda} commute under D_{\Phi} , then g_{12}(\lambda,\varepsilon_{\star})=0 . Let (\Omega,\mathcal{F},\mathbb{P}) be a probability space. At decision epoch t_{0} the agent chooses an action/policy based on information \mathcal{I}_{t_{0}} and a predictive object Q (e.g., distribution, score, or control). Outcomes Y are realized later; verification arrives after a lag \tau\geq 0 . The action window has length \Delta>0 . Definition 2 (Ideal benchmark) . Let L(p) denote the expected loss of a predictive object p under the data-generating process and the scoring rule. We define the evaluation benchmark as L_{\mathrm{ideal}}\;:=\;\inf_{p}L(p). This quantity is the Bayes risk: the minimal achievable expected loss under the true conditional law. It is determined entirely by the data-generating process and the loss function, and is independent of any particular deployment configuration, latency pattern, or operator ordering. In strongly reflexive systems there may be no unique physically realizable “zero-latency, fully commuting” world. Our analysis does not rely on the existence of such a world. Instead, L_{\mathrm{ideal}} serves purely as a mathematical reference point for quantifying structural penalties. For estimation, we never attempt to compute L_{\mathrm{ideal}} numerically. All of our empirical procedures work with differences of expected loss between feasible regimes (for example, via the 2\times 2 design in Section 8.4 ). Consequently, L_{\mathrm{ideal}} cancels algebraically from the estimators \widehat{g}_{1} , \widehat{g}_{2} , and \widehat{g}_{12} and does not need to be estimated; see Remark 1 for details. Loss as regret. We assume a strictly proper scoring rule (or a convex surrogate) induced by the Bregman divergence D_{\Phi} . Let P^{\star} denote the Bayes-optimal predictive object (the true conditional law or Bayes-optimal score) under the data-generating process, and let Q denote the predictive object implemented by a particular deployed system. If L(Q) is the expected loss of Q and L_{\mathrm{ideal}}=L(P^{\star}) is the Bayes risk from Definition 2 , then the excess loss (regret) of Q relative to the ideal benchmark satisfies L(Q)-L_{\mathrm{ideal}}\;=\;\mathbb{E}\big[D_{\Phi}(P^{\star}\|Q)\big]. In particular, writing L for the expected loss of the deployed system under its actual latency and ordering constraints, we have L-L_{\mathrm{ideal}}\;=\;\mathbb{E}\big[D_{\Phi}(P^{\star}\|Q)\big]. Remark 1 (On the interpretation of L_{\mathrm{ideal}} ) . By Definition 2 , L_{\mathrm{ideal}} is the Bayes risk induced by the data-generating process and the scoring rule. It depends on the underlying distribution and loss, not on any particular deployed system or a chosen configuration of latency and ordering constraints. In practice, L_{\mathrm{ideal}} is typically not directly observable. However, our structural terms g_{1} , g_{2} , and g_{12} are identified from differences between losses of feasible configurations (for example, via the 2\times 2 design in Section 8.4 ), so L_{\mathrm{ideal}} cancels algebraically and