Hierarchical Forecast Reconciliation on Networks: A Network Flow Optimization Formulation

Charupriya Sharma, Iñaki Estella Aguerri, Daniel Guimarans · 2025

Read Hierarchical Forecast Reconciliation on Networks: A Network Flow Optimization Formulation by Charupriya Sharma, Iñaki Estella Aguerri, Daniel Guimarans (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03955.txt.

Introduction

Charupriya Sharma and co-authors recast forecast reconciliation as water flowing through pipes. Businesses forecast at many levels — district sales must sum to state sales — and raw forecasts rarely respect those sums. Standard reconciliation fixes them, but only on tree hierarchies, and at heavy computational cost. Their 2025 paper introduces FlowRec, which treats coherence as a network flow problem.

The reformulation handles general network structures, not just trees. The team proves the problem stays solvable in polynomial time for a broad family of loss functions, while one hard variant remains intractable. On sparse networks the algorithm also runs markedly faster than the standard MinT method. Forecasters for supply chains and grids get coherence on the messy graphs they actually have.

Catalog record

CREATORCharupriya Sharma, Iñaki Estella Aguerri, Daniel Guimarans
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-03955

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hierarchical Forecast Reconciliation on Networks: A Network Flow Optimization Formulation Charupriya Sharma, Iñaki Estella Aguerri, Daniel Guimarans Abstract The problem of hierarchical forecasting with reconciliation requires that we forecast values that are part of a hierarchy (e.g. customer demand on a state, district or city level), and there is a relation between different forecast values (e.g. all district forecasts should add up to the state forecast). State of the art forecasting provides no guarantee for these desired structural relationships. Reconciliation addresses this problem, which is crucial for organizations requiring coherent predictions across multiple aggregation levels. Current methods like minimum trace (MinT) are mostly limited to tree structures and are computationally expensive for large-scale problems. We introduce FlowRec , which reformulates hierarchical forecast reconciliation as a network flow optimization problem, enabling forecasting on generalized network structures and relationships beyond trees. We present a rigorous complexity analysis of hierarchical forecast reconciliation under different loss functions. While reconciliation under the ℓ 0 \ell_{0} norm is NP-hard, we prove polynomial-time solvability for all ℓ p > 0 \ell_{p>0} norms and, more generally, for any strictly convex and continuously differentiable loss function. For sparse networks, FlowRec achieves O ⁡ ( n 2 ​ log ⁡ n ) O(n^{2}\log n) complexity, significantly improving upon MinT’s O ⁡ ( n 3 ) O(n^{3}) . Furthermore, we prove that FlowRec extends MinT beyond tree structures to handle general networks, replacing MinT’s error-covariance estimation step with direct network structural information, theoretically justifying its superior computational efficiency. A key novelty of our approach is its handling of dynamic scenarios: while traditional methods require recomputing both base forecasts and their reconciliation, FlowRec provides efficient localised updates with optimality guarantees. A monotonicity property ensures that when forecasts improve incrementally, the initial reconciliation remains optimal. We also establish efficient, error-bounded approximate reconciliation, enabling fast updates in time-critical applications. Experiments on both simulated and real benchmarks demonstrate that FlowRec improves runtime by 3-40x, reduces memory usage by 5-7x and improves accuracy over state of the art. These results establish FlowRec as a powerful tool for large-scale hierarchical forecasting applications. 1 Introduction Hierarchical forecasting addresses settings where predictions are needed at multiple aggregation levels and must remain coherent - that is, the individual forecasts must sum to match their aggregates, and has the goal of forecasting the future values of the underlying variable relationships. For example, demand fulfillment for an entire district must equal the aggregated demand across all stores in that district. The exponential growth of digital infrastructure and global retail operations has created unprecedented challenges in such forecasting. For instance, retail operations managing thousands of stores face complex inventory decisions where store-level forecasts must align with district totals, regional projections, and national planning. The financial implications are substantial - forecast inconsistencies between these levels lead to significant inventory costs [ 102 , 99 ] and resource misallocation. Forecasting on hierarchical data is a challenge in practise due to inconsistencies in data availability at all levels as well as mathematical challenges in recovering multivariate dependencies. Although a few end-to-end methods [ 98 , 65 , 92 ] exist, they have no guarantees on accuracy and coherence for complex networks. Thus, hierarchical forecasting typically involves two steps: generating base forecasts at each level independently, then reconciling these forecasts to satisfy aggregation constraints. These structures appear naturally in many network-based systems: traffic flows must sum across routes to match road capacity, water networks must balance supply and demand, and cloud services must allocate computing resources across data centers. For example, in the logistics network shown in Figure 1 , base forecasts for stores, warehouses, and regions must be reconciled to ensure physical consistency - the sum of flows into each location must equal the sum of flows out. These flows can represent demand, purchased goods, or the number of trucks needed to move the goods. Tree Reconciliation (Incorrect) Network Flow (Correct) T:1000 RA:600 RB:450 W1:300 D1:280 D2:250 W2:200 S1:150 (280) S2:280 (400) S3:170 (250) T:1000 RA:580 RB:420 W1:300 D1:280 D2:180 W2:170 S1: 280 S2: 400 S3: 250 150 150 130 150 100 80 170 Node Types: S: Store D: Distribution Center W : Warehouse RA,RB : Region A,B T : Totals Flow Types: Hierarchical Relationship Warehouse Flow Distribution Flow Region Flow Applications: Forecasts: Demand Product Movement Uses: truck Reservation Route Planning Inventory Control Figure 1 : Comparison of Tree and Network Reconciliation. Base forecasts deviate from true values. Tree structure cannot recover true values due to single-parent constraint. Network structure allows multiple paths, enabling recovery of true values through flow conservation. While the state-of-the-art minimum trace (MinT) [ 106 ] method combines forecasts in tree structures by minimizing the trace of the forecast error covariance matrix, it cannot handle the complex network relationships, where flows often follow multiple paths between nodes. Consider Figure 1 . MinT’s covariance estimation assumes each node has exactly one parent. The resulting tree network (left), imposes an incorrect structure (tree summing matrix) on the base forecast, failing to recover the true values (right) due to the stores receiving flow from multiple warehouse and distribution centers, which the general network structure (center) can correctly model (network flow matrix). We present FlowRec , a novel approach that reformulates hierarchical forecast reconciliation as a network flow problem. Our key insight, as in Figure 1 , is that many forecasting constraints naturally map to flow conservation in networks. FlowRec generalizes hierarchical relationships beyond trees to arbitrary network structures and provides several fundamental advantages: 1. We provide a rigorous study of the complexity of loss functions for forecast reconciliation and prove that while reconciliation under the \ell_{0} norm is NP-hard, FlowRec enables polynomial-time forecast reconciliation for all \ell_{p>0} and strictly convex and continuously differentiable losses in general. 2. We show FlowRec is a generalization of MinT from trees to networks, where the weight matrix is determined by network structure. For sparse networks, FlowRec achieves optimal runtime of O(n^{2}\log n) against O(n^{3}) for MinT. 3. FlowRec supports efficient localised dynamic updates for network and data updates, and allows an \varepsilon -relaxation of structural constraints with provable error bounds, enabling fast reconciliation for online settings. 4. We prove a monotonicity property ensuring optimality preservation under improving forecasts, particularly valuable for online settings where data quality improves over time. 5. Empirically, we demonstrate significant speedups with reduced memory usage and improved accuracy across both simulated networks and standard forecasting benchmarks, including 3-40x performance improvements over existing methods like MinT. FlowRec generalizes traditional hierarchical structures like trees to networks while improving computational efficiency, as any tree is a specific type of graph. In the comparison table of Figure 1 , FlowRec can recover true values that tree-based methods cannot represent. Complex real-world constraints that were previously difficult or impossible to incorporate are natural components of FlowRec . The remainder of this paper is organized as follows. Section 2 provides background on hierarchical forecasting and network flows. Section 3 introduces our FlowRec framework. Section 4 presents our main theoretical results on computational complexity, accuracy and establishes FlowRec ’s relationship to MinT. Section 5 provides results on dynamic updates and approximations. Section 6 presents experimental results on both simulated and real-world data. Future work and conclusions are detailed in Section 7 and

Read the complete text