Optimizing Task Completion Time Updates Using POMDPs

Duncan Eddy, Esen Yel, Emma Passmore, Niles Egan, Grayson Armour, Dylan M. Asmar, Mykel J. Kochenderfer · 2026

Read Optimizing Task Completion Time Updates Using POMDPs by Duncan Eddy, Esen Yel, Emma Passmore, Niles Egan, Grayson Armour, Dylan M. Asmar, Mykel J. Kochenderfer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12340.txt.

Introduction

Eddy and co-authors frame task completion time updates as a POMDP control problem. Project teams must choose when to revise announced finish times for clients. Static forecasts and ad-hoc rules ignore the sequential nature of that choice. Their reward weighs announcement errors against update frequency, since churn erodes trust and forces replanning. A mixed observability frame keeps policy optimization efficient with off-the-shelf solvers. Simulations show large cuts in needless updates while prediction accuracy holds or improves.

Catalog record

CREATORDuncan Eddy, Esen Yel, Emma Passmore, Niles Egan, Grayson Armour, Dylan M. Asmar, Mykel J. Kochenderfer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30099
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.12340

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimizing Task Completion Time Updates Using POMDPs Duncan Eddy, Esen Yel, Emma Passmore, Niles Egan, Grayson Armour, Dylan M. Asmar, Mykel J. Kochenderfer Abstract Managing announced task completion times is a fundamental control problem in project management. While extensive research exists on estimating task durations and task scheduling, the problem of when and how to update completion times communicated to stakeholders remains understudied. Organizations must balance announcement accuracy against the costs of frequent timeline updates, which can erode stakeholder trust and trigger costly replanning. Despite the prevalence of this problem, current approaches rely on static predictions or ad-hoc policies that fail to account for the sequential nature of announcement management. In this paper, we formulate the task announcement problem as a Partially Observable Markov Decision Process (POMDP) where the control policy must decide when to update announced completion times based on noisy observations of true task completion. Since most state variables (current time and previous announcements) are fully observable, we leverage the Mixed Observability MDP (MOMDP) framework to enable more efficient policy optimization. Our reward structure captures the dual costs of announcement errors and update frequency, enabling synthesis of optimal announcement control policies. Using off-the-shelf solvers, we generate policies that act as feedback controllers, adaptively managing announcements based on belief state evolution. Simulation results demonstrate significant improvements in both accuracy and announcement stability compared to baseline strategies, achieving up to 75% reduction in unnecessary updates while maintaining or improving prediction accuracy. I Introduction Managing stakeholder announcements of task completion times represents a critical control challenge distinct from the well-studied problem of predicting task durations and task scheduling. Accurate management of task completion announcements is critical for many organizations across various industries, including software engineering [ 9 ] , construction [ 27 ] , manufacturing [ 7 ] , and aviation [ 22 ] . While organizations have access to increasingly sophisticated prediction models, they still face the understudied decision problem of when and how to update communicated timelines as new information becomes available. This announcement control problem requires balancing the competing objectives of maintaining accuracy while minimizing the costs associated with frequent updates. The distinction between prediction and announcement control is crucial. Even with perfect predictions, organizations must decide whether updating stakeholders is worth the associated costs—customer disappointment, resource reallocation, and erosion of trust. Premature updates based on uncertain early observations may prove unnecessary, while delayed updates can magnify negative impacts. This creates a sequential decision-making problem where the controller must optimally manage the announced completion time based on evolving belief states. Consider the James Webb Space Telescope. It was initially announced to launch in 2007 at total cost of $1 billion, but it ultimately launched in 2021 at over $10 billion [ 21 , 28 ] . An independent review found that incremental announcement changes created cascading effects on stakeholder planning and resource allocation, contributing to the cost and schedule creep [ 2 ] . This example illustrates how poor announcement control policies, not just prediction errors, can amplify project costs. The announcement control problem exhibits several characteristics that make it amenable to control-theoretic approaches [ 22 ] . First, the true completion time is partially observable, with observation quality improving over time. Second, each announcement update incurs immediate costs in terms of replanning efforts and reallocation of resources. Third, the cost structure is inherently asymmetric, with different penalties for premature versus delayed updates. Traditional project management approaches fail to address these dynamics, typically employing static policies (target announced date at all costs) or reactive policies (announce the latest estimate) without considering that delays incurred by replanning make project management a sequential decision problem [ 26 ] . Single-shot estimates neglect the real costs of timeline volatility on stakeholder trust and operational planning. To address this gap, we formulate the announcement control problem as a Partially Observable Markov Decision Process (POMDP) [ 11 ] . Since most state components (current time and previous announcements) are fully observable, we leverage the Mixed Observability MDP (MOMDP) framework [ 19 , 20 ] to enable efficient policy synthesis. This formulation captures the inherent uncertainty in task completion while explicitly modeling announcement decisions as control actions with associated costs. We validate our approach using the QMDP [ 17 ] and SARSOP [ 15 ] belief-state planning algorithms and compare against heuristic baseline policies. Our framework provides actionable control policies for organizations seeking to optimize stakeholder communication strategies in various industries such as transportation, construction, and software development. II Related Work There is clear recognition of the value of accurate task estimation and scheduling from operations research, particularly for resource and cost management. This recognition has led to the compilation of project data across a range of domains, including construction and software engineering, in order to develop models that can improve estimation of total task completion time [ 3 , 24 , 8 , 4 ] . There is a large body of work on estimation of task completion that includes classical methods, such as Critical Path Analysis [ 18 ] and Earned Value Management [ 25 ] , to more recent machine learning models and algorithms, such as recurrent neural networks (RNNs) [ 29 ] , artificial neural networks (ANNs) [ 16 ] , long short-term memory (LSTM) [ 7 ] , and hierarchical deep neural networks [ 1 ] . All of these approaches rely on historical training data to predict task completion time, which limits their applicability to novel projects that lack historical completion data for training. It is also worth noting that these methods focus solely on estimating the completion time once at project outset and do not model the effect of updating the announced completion time can have on overall project duration. In this paper, we focus on cases where the task completion time announcements are made in a sequential manner, instead of a single a one-shot estimate. Recently [ 12 ] studied the problem of optimizing the frequency of wait time updates for customers in an unobservable queue [ 12 ] . They approach the problem as an analytic optimization of an economic utility function to compute the optimal frequency of updates but it does not account for noise in the wait-time estimates. The sequential, partially-observable nature of the problem, as well as the evidence for the usability of POMDPs in time-based predictions [ 13 , 5 ] , makes POMDPs a natural candidate for this problem. We use both POMDPs and MOMDPs to frame our problem and use existing solvers to generate project planning policies. All software used to to pose the problem, run experiments, and generate the results in this paper can be found at https://github.com/sisl/POMDP_Plan . III Background III-A Partially Observable Markov Decision Processes In a partially observable Markov decision process [ 11 , 14 ] , an agent makes observations o of the true state s and takes control action a at each time step. A POMDP is defined by tuple \langle\mathcal{S},\mathcal{A},\mathcal{O},T,Z,R,\gamma\rangle . Here, \mathcal{S},\mathcal{A},\mathcal{O} denote the sets of states, control actions, and observations, respectively. The transition function T(s^{\prime}\mid s,a) models state evolution under control, while the observation function Z(o\mid s^{\prime},a) captures measurement uncertainty. The reward function R(s,a) encodes control objectives, and \gamma\in[0,1) is

Read the complete text