PILOT: Policy-Informed Learned Optimization for Adaptive Deep Network Training
Sattam Altuuaim, Lama Ayash, Muhammad Mubashar, Naeemullah Khan, King Abdullah University of Science, Technology (KAUST), Thuwal, Saudi Arabia · 2026
Read PILOT: Policy-Informed Learned Optimization for Adaptive Deep Network Training by Sattam Altuuaim, Lama Ayash, Muhammad Mubashar, Naeemullah Khan, King Abdullah University of Science, Technology (KAUST), Thuwal, Saudi Arabia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24570.txt.
Introduction
Sattam Altuuaim and three colleagues present PILOT, a 2026 online optimizer that adapts its update rule during training instead of fixing its form in advance. Rather than holding momentum, normalization, and sign-based updates in a fixed balance, it judges local stability from how well gradient directions agree. When gradients turn stable, noisy, or inconsistent, the update shifts accordingly. On FashionMNIST and CIFAR-10, PILOT topped the compared optimizers. It reached 94.13 percent and 81.94 percent on a convolutional network and 95.71 percent and 93.42 percent on ResNet-18.
Catalog record
| CREATOR | Sattam Altuuaim, Lama Ayash, Muhammad Mubashar, Naeemullah Khan, King Abdullah University of Science, Technology (KAUST), Thuwal, Saudi Arabia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43141 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24570
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PILOT: Policy-Informed Learned Optimization for Adaptive Deep Network Training Sattam Altuuaim, Lama Ayash, Muhammad Mubashar, Naeemullah Khan, King Abdullah University of Science, Technology (KAUST), Thuwal, Saudi Arabia Abstract Despite the central role of optimization in deep learning, most optimizers rely on update structures whose functional form is fixed before training begins. This static design can limit their ability to respond to changing gradient behavior across the loss landscape, where training may shift between stable, noisy, and inconsistent regimes. This study proposes PILOT (Policy-Informed Learned OpTimizer), an online optimizer that adapts its update behavior during training. Rather than using a fixed balance between momentum, normalization, and sign-based updates, PILOT uses gradient-direction agreement as a signal of local training stability. Conditioning the update rule on this agreement signal allows the optimizer to adjust its behavior when gradients become stable, noisy, or inconsistent. Experiments on FashionMNIST and CIFAR-10 show that PILOT consistently achieves the highest accuracy among the evaluated optimizers across convolutional settings. On the CNN architecture, PILOT reaches 94.13% on FashionMNIST and 81.94% on CIFAR-10. On ResNet-18, it further improves performance, reaching 95.71% on FashionMNIST and 93.42% on CIFAR-10. These results suggest that learning how to adapt the update structure during training can improve performance across both compact and deeper convolutional models while preserving a simple first-order optimization framework. The implementation of PILOT is publicly available at https://github.com/SattamAltwaim/PILOT.git . 1 Introduction Figure 1: Optimizer trajectories on the loss landscape for CIFAR-10 / SmallCNN. PILOT follows a distinct path through the surface and converges to a lower-loss region compared to the baselines. Optimization is a central component of deep neural network training because it determines how model parameters are updated from stochastic gradient information 3 . The choice of optimizer directly affects convergence speed, numerical stability, generalization behavior, and computational cost, particularly as models and datasets increase in scale 1 . Modern deep learning optimization has evolved from classical stochastic gradient descent and momentum-based methods toward adaptive, sign-based, curvature-aware, and learned update mechanisms 11 . Recent surveys emphasize that optimizer design remains an active research area because deep learning objectives are highly non-convex, noisy, architecture-dependent, and sensitive to interactions among gradients, learning rates, curvature, and regularization 11 . Widely used adaptive methods such as Adam 8 and AdamW 12 improve robustness through moment estimation and variance normalization, while newer optimizers such as Lion 6 and Sophia 10 explore sign-based and curvature-informed update rules. Despite this progress, a major limitation remains: most optimizers use a fixed update structure throughout training. Adam and AdamW impose a predefined balance between momentum and second-moment normalization through fixed moment-update equations and adaptive scaling rules 8 ; 12 . Lion relies on sign-based updates, improving memory efficiency but discarding explicit gradient magnitude information in the parameter update 6 . Sophia introduces curvature-aware scaling through Hessian-based estimation, but its update mechanism is still specified in advance and introduces additional estimation overhead 10 . Learned optimizers and optimizer-discovery methods expand the design space, but they often require expensive offline search, meta-training, or task-specific optimizer generation 2 ; 4 . This gap motivates an online adaptive mechanism that adjusts the optimizer’s update behavior during ordinary training, without requiring offline optimizer search, expensive meta-training, or task-specific optimizer generation. The motivation behind PILOT is that the local optimization regime changes over training. Consecutive gradients may become strongly aligned in smooth regions, weakly aligned in noisy regions, or negatively aligned near unstable curvature or rapidly changing loss surfaces. Such directional agreement provides a compact signal about the current training dynamics. PILOT uses this signal to adapt the optimizer online by learning a small policy that controls three core update primitives: momentum reliance, variance-normalization strength, and sign-based behavior. Instead of selecting one fixed optimizer behavior before training, PILOT continuously interpolates between Adam-like, raw-gradient, and sign-based update regimes according to the observed gradient-agreement signal. The main contributions are summarized as follows: • An online adaptive optimizer, PILOT, is introduced to dynamically modulate momentum interpolation, variance normalization, and sign-based behavior during training. • A gradient-direction agreement signal is used as a landscape-aware indicator of local optimization stability, enabling the update rule to respond to changing training dynamics. • A compact polynomial policy with only 3(d+1) learnable coefficients is proposed, allowing adaptive optimizer behavior without offline search or explicit second-order estimation. • Existing update behaviors, including Adam-like adaptive updates and sign-based updates, are represented as fixed configurations within the same general formulation. • Empirical evaluation on FashionMNIST and CIFAR-10 using CNN and ResNet-18 architectures shows that PILOT is competitive with strong optimizer baselines and can improve accuracy and stability in selected convolutional settings. Overall, PILOT aims to bridge the gap between rigid hand-designed optimizers and computationally expensive learned optimizers. By learning a small online policy conditioned on gradient-direction agreement, the proposed method provides a practical mechanism for adaptive optimizer behavior while retaining a first-order optimization structure. This makes PILOT a promising direction for optimizer design in settings where the training landscape varies over time and a single fixed update rule may be insufficient. The qualitative loss-landscape visualization in Fig. 1 further illustrates this behavior, showing that PILOT follows a distinct optimization trajectory and reaches a lower-loss region compared with the baseline optimizers. 2 Related Work 2.1 Adaptive first-order methods Adaptive gradient-based optimizers constitute the dominant paradigm for training deep neural networks. The Adam optimizer 8 combines first-order momentum with element-wise second-moment normalization, yielding scale-invariant updates that improve convergence stability. AdamW 12 further improves generalization by decoupling weight decay from the adaptive update, addressing implicit regularization issues in Adam. Subsequent work has refined the estimation of second-order statistics; for example, AdaBelief 15 replaces the variance of gradients with the variance of prediction error, adjusting step sizes based on the reliability of gradient estimates. While these methods achieve strong empirical performance, they share a common structural limitation: the update rule remains fixed throughout training, enforcing a static trade-off between momentum and normalization that does not adapt to changing optimization dynamics. 2.2 Sign-based and magnitude-invariant updates An alternative line of work explores sign-based optimization, where update magnitudes are decoupled from gradient scale. Lion 6 eliminates second-moment estimation and performs updates using the sign of a momentum term, resulting in improved memory efficiency and competitive performance in large-scale settings. Earlier approaches such as signSGD 5 similarly demonstrate robustness under noisy gradients. However, by discarding magnitude information, these methods impose a rigid inductive bias that may be suboptimal in regimes where gradient scale encodes curvature or noise characteristics. Consequently, their ability to adapt across heterogeneous optimization regimes remains limited. 2.3 Curvature-aware and second-order methods To improve convergence efficiency, several approaches incorporate curvature information into the update rule. Methods such as AdaHessian 14 approximate second-order structure through stochastic Hessian estimation, while Sophia 10 employs a diagonal Hessian approximation with clipping to stabilize updates in large-scale language model training. These methods provide more informed scaling of parameter updates and can significantly reduce training time. However, they introduce additional computational overhead and rely on predefined mechanisms for incorporating curvature, resulting in update rules that remain structurally fixed rather than dynamically adapting to the optimization trajectory. 2.4 Learned optimizers and automated update design Optimizer design has also been approached as a learning problem. Early work formulates optimizer discovery