CLOUDADV: Decision-Aligned Instance Sizing with Zero-Shot Foundation Models under Drift
1 st Jack Bell, 2 nd Giacomo Carfi, 3 rd Gerlando Gramaglia, 4 th Andrea Simioni, 5 th Daniele Fontani, 6 th Vincenzo Lomonaco · 2026
Read CLOUDADV: Decision-Aligned Instance Sizing with Zero-Shot Foundation Models under Drift by 1 st Jack Bell, 2 nd Giacomo Carfi, 3 rd Gerlando Gramaglia, 4 th Andrea Simioni, 5 th Daniele Fontani, 6 th Vincenzo Lomonaco (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31470.txt.
Introduction
Bell and five colleagues present CLOUDADV, an advisory system that sizes cloud virtual machines by the decisions its advice drives. Cloud machines are often overprovisioned, wasting money month after month. Workloads drift, so a size that fit last quarter may waste money now or risk overload later.
For each query CLOUDADV builds a decision context from past utilization, zero-shot time-series forecasts, machine metadata, candidate sizes, prices, and sizing heuristics. A large model writes reference recommendations offline, and a smaller production model is scored on matching them under latency and cost limits. In a study of seven production machines, reference advice cut simulated monthly cost by about half, to near 708 dollars, with the worst downgrade case exceeding capacity only rarely.
Catalog record
| CREATOR | 1 st Jack Bell, 2 nd Giacomo Carfi, 3 rd Gerlando Gramaglia, 4 th Andrea Simioni, 5 th Daniele Fontani, 6 th Vincenzo Lomonaco |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.31470
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CLOUDADV: Decision-Aligned Instance Sizing with Zero-Shot Foundation Models under Drift 1 st Jack Bell, 2 nd Giacomo Carfi, 3 rd Gerlando Gramaglia, 4 th Andrea Simioni, 5 th Daniele Fontani, 6 th Vincenzo Lomonaco Abstract Cloud virtual machines are often overprovisioned, creating avoidable cost and operational inefficiency. We present CLOUDADV, an interactive engineer-facing advisory system for cloud instance sizing under workload drift. The system combines zero-shot time-series forecasting with bounded recommendation generation across day-, week-, and month-scale planning horizons. For each query, CLOUDADV constructs a structured decision context from historical utilization, forecast summaries, current VM metadata, candidate instance options, pricing, and explicit sizing heuristics. A higher-capacity LLM is used offline to generate reference recommendations, while a smaller production model is evaluated on the same prompts to assess deployment-time alignment under latency and cost constraints. Evaluation prioritizes downstream recommendation quality using simulated Azure cost savings and ex-post exceedance, with rolling-origin forecast accuracy reported as a secondary diagnostic against classical and supervised baselines. In a case study of seven production VMs, the reference recommendations reduce simulated monthly cost from about $1,503 to $708, yielding $795/month in savings (52.9%) under conservative heuristic constraints, while the highest observed exceedance rate among downgraded cases is 1.5%. Although Chronos-2 does not minimize every forecasting metric, it often induces recommendation patterns similar to those of a supervised per-VM baseline. These results suggest that zero-shot foundation models can support decision-aligned provisioning in non-stationary cloud environments while reducing the operational burden of repeated per-tenant retraining, revalidation, and redeployment. I Introduction Cloud computing enables elastic, on-demand infrastructure, yet VM provisioning in practice is still often conservative and static: resources are sized for anticipated peak demand and then left unchanged for long periods [ 18 ] . This leads to persistent over-provisioning, with cost and sustainability consequences. Large-scale data-centre studies have long shown that servers operate far below peak utilisation for much of their lifetime, while still drawing substantial power when idle or lightly loaded [ 4 ] . The problem is becoming more significant as data-centre electricity demand rises, reaching an estimated 415 TWh in 2024 and projected to grow further with increasing AI workloads [ 10 ] . VM right-sizing is therefore not only a cost-optimisation problem, but also a resource-efficiency problem. Fig. 1: CLOUDADV workflow. A planner routes user requests to forecasting, metrics, and optimisation services. Their outputs are assembled into a bounded decision context for recommendation generation and verification before an engineer-facing response is returned. Verification failures trigger a retry through the tool layer. Addressing this requires an engineer-facing advisory system that supports capacity planning across flexible horizons, with recommendations interpretable enough to assess, validate, and override when necessary [ 12 ] and without the overhead of maintaining a separate forecasting pipeline per horizon [ 19 ] . In the application-server setting studied here, utilisation over time is the primary operational signal for sizing, since direct user-facing latency signals are not available for control. Recent time-series foundation models offer a promising alternative. Models such as TimesFM [ 8 ] and Chronos [ 3 ] produce zero-shot forecasts at arbitrary horizons from a single pre-trained model, reducing the need for per-horizon or per-tenant training. This is attractive not only for modelling flexibility, but also for continual adaptation under workload drift: because zero-shot models carry no fitted per-VM state, they require no retraining trigger, revalidation pipeline, or redeployment cycle when behaviour shifts. In supervised forecasting systems, changing VM behaviour makes fitted models stale, requiring retraining, revalidation, and redeployment to remain reliable [ 14 , 23 ] . However, forecasting quality for VM right-sizing cannot be judged only by raw error alone. A forecast may be numerically imperfect yet still preserve the correct provisioning action, while a low-error forecast can still be operationally harmful if it crosses a decision boundary and triggers the wrong scaling recommendation. The relevant criterion is therefore decision alignment : whether the forecast is sufficient to preserve the downstream sizing decision [ 9 ] . Whether zero-shot time-series foundation models satisfy this requirement in cloud capacity optimisation remains underexplored. To study this question, we present CLOUDADV, an interactive engineer-facing advisory system that combines zero-shot forecasting, structured evidence retrieval, and policy-constrained LLM recommendation generation behind a natural-language interface. We further distinguish between offline reference recommendation generation and deployable online recommendation serving: a higher-capacity model is used to produce structured reference recommendations, while a smaller production model is evaluated on the same bounded prompts to test whether stronger-model recommendation behaviour can be preserved at lower serving cost. Our contributions are fourfold. First, we formulate cloud instance sizing as a decision-aligned forecasting problem under workload drift. Second, we design CLOUDADV, combining zero-shot forecasting, bounded recommendation generation, and engineer-facing interaction for multi-horizon VM sizing. Third, we introduce a deployment-aware reference–production recommendation pipeline for assessing alignment between a stronger offline model and a smaller deployable model. Fourth, we evaluate the system using simulated savings, ex-post exceedance, and forecast accuracy across multiple horizons and model classes. II Related Work II-A VM Right-Sizing and Cloud Cost Optimization The overprovisioning problem. VM right-sizing refers to matching a virtual machine’s allocated resources to its actual workload demand, and is widely recognised as a primary lever for reducing cloud waste. Industry surveys consistently find that over-provisioning affects the majority of deployments [ 7 ] , with idle resources generating avoidable expenditure that compounds at fleet scale. Prior work on prediction-informed provisioning. Cortez et al. [ 7 ] demonstrated in Resource Central that VM workload behaviours are consistent enough across lifetimes for machine learning to support prediction-informed scheduling on Azure. Nawrocki and Sus [ 16 ] further showed that anomaly detection is a necessary pre-processing step for long-term capacity planning, since contaminated usage histories lead to poor provisioning decisions even when the forecasting model is otherwise sound. Limitations of existing tools. Commercial tools such as Azure Advisor [ 15 ] and AWS Compute Optimizer [ 2 ] rely on percentile-based heuristics over fixed lookback windows, providing point-in-time recommendations rather than forward-looking forecasts and no mechanism for engineer feedback. Reactive autoscaling [ 13 ] is likewise insufficient, as VM size cannot be changed without explicit reprovisioning. CLOUDADV addresses these gaps through probabilistic long-horizon forecasts and an engineer-in-the-loop validation workflow. II-B Forecasting Infrastructure Metrics Classical and statistical approaches. Time series forecasting for infrastructure metrics traditionally relies on statistical models such as ARIMA , exponential smoothing, and Prophet [ 5 , 20 ] . These methods are computationally efficient and perform well on stationary series with regular seasonality. However, cloud resource metrics often exhibit regime shifts, bursts, and workload-driven non-stationarity that degrade performance at longer horizons [ 16 ] . Deep learning models. More recent work applies deep sequence models such as LSTMs and temporal convolutional networks, which improve short-horizon forecasting over statistical baselines [ 17 ] . TSMixer [ 6 ] , a lightweight MLP-mixer architecture, offers competitive accuracy with lower inference cost and serves as one of our supervised baselines. Challenges at long horizons. Forecasting accuracy degrades with horizon length, and the practical costs of this degradation differ across applications. For VM right-sizing, the relevant question is not whether the forecast is accurate in an absolute sense, but whether it is accurate enough to preserve the direction of