Data-Driven Distributed Optimization via Aggregative Tracking and Deep-Learning

Riccardo Brumali, Guido Carnevale, Giuseppe Notarstefano · 2025

Read Data-Driven Distributed Optimization via Aggregative Tracking and Deep-Learning by Riccardo Brumali, Guido Carnevale, Giuseppe Notarstefano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04668.txt.

Introduction

Riccardo Brumali, Guido Carnevale, and Giuseppe Notarstefano set out a shared tuning scheme where a set of agents learn their own costs from data as they go. Their paper is from two thousand twenty-five.

In the frame they use, each agent's cost rests on its own choice and on a sum of all choices. No agent knows its cost's form. Each can probe it at one point per step, from a sensor or user. The scheme has three parts. A net learns which way the local cost falls. A tune step moves the choice that way. A track step rebuilds the shared sums from local facts. The team proves, for strong cases, that the group nears the best joint choice.

Catalog record

CREATORRiccardo Brumali, Guido Carnevale, Giuseppe Notarstefano
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04668

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data-Driven Distributed Optimization via Aggregative Tracking and Deep-Learning Riccardo Brumali, Guido Carnevale, Giuseppe Notarstefano Abstract In this paper, we propose a novel distributed data-driven optimization scheme. In particular, we focus on the so-called aggregative framework, namely, the scenario in which a set of agents aim to cooperatively minimize the sum of local costs, each depending on both local decision variables and an aggregation of all of them. We consider a data-driven setup in which each objective function is unknown and can be only sampled at a single point per iteration (thanks to, e.g., feedback from human users or physical sensors). We address this scenario through a distributed algorithm that combines three key components: (i) a learning part that leverages neural networks to learn the local cost functions descent direction, (ii) an optimization routine that steers the estimates according to the learned direction to minimize the global cost, and (iii) a tracking mechanism that locally reconstructs the unavailable global quantities. By using tools from system theory, i.e., timescale separation and averaging theory, we formally prove that, in strongly convex setups, the overall distributed strategy linearly converges in a neighborhood of the optimal solution whose radius depends on the given accuracy capabilities of the neural networks. Finally, we corroborate the theoretical results with numerical simulations. I Introduction Distributed optimization has recently gained significant attention across various domains. The comprehensive overview provided in the surveys [ 1 , 2 , 3 ] discusses the most popular setups and the algorithms used to address these challenges. The mentioned surveys do not include the so-called aggregative optimization framework which is particularly suited to model tasks arising in cooperative robotics, see the recent tutorial [ 4 ] . This novel distributed optimization scenario has been introduced by the pioneering work [ 5 ] and deals with networks of agents aiming at cooperatively minimizing the sum of local functions each depending on both microscopic variables (e.g., the position of a single robot) and macroscopic ones (e.g., the spatial distribution of the entire team). Online and constrained versions of the aggregative problem are considered in [ 6 ] . Other works on distributed aggregative optimization include [ 7 ] in which a distributed method based on the Frank-Wolfe update is proposed, and [ 8 , 9 ] in which momentum-based algorithms are proposed. Authors in [ 10 ] propose a continuous time algorithm with non-uniform gradient gains which only requires the sign of relative state information between agents’ neighbors. While in [ 11 ] a compressed communication scheme is interlaced with the solution proposed in [ 5 ] . Aggregative optimization scenarios with uncertain environments have been explored in [ 12 ] where the distributed scheme proposed in [ 5 ] is enhanced with a Recursive Least Square (RLS) method estimating the unknown cost via feedback from the users. A similar framework is addressed in [ 13 ] where instead the learning part relies on a neural network. Unknown environments as those mentioned above are particularly interesting in the context of the so-called personalized optimization frameworks. In this field, the goal is to minimize cost functions given by the sum of a known part, named engineering function and related to measurable quantities (e.g., time or energy), and an unknown part representing the user’s (dis)satisfaction with the current solution. Since synthetic models based on human preferences often perform well only on average, failing to address the unique preferences of individual users, personalized optimization emphasizes data-driven strategies. These approaches leverage feedback from specific users about the current solution to adapt and better meet their individual needs. With growing human–robot collaboration, personalized optimization techniques can greatly enhance the control of cooperative robotic networks. In centralized optimization, an initial step toward incorporating user feedback to define human discomfort was undertaken by [ 14 ] , where a trajectory design problem was addressed using a cost function influenced by human complaints. In [ 15 ] , personalized optimization is explored by integrating a learning mechanism based on Gaussian Processes (GP) with an optimization approach. Similarly, [ 16 ] applies a personalized framework within the context of game theory. As for personalized distributed frameworks, the articles [ 17 ] and [ 18 ] respectively use GP combined with a primal-dual method and RLS merged with the gradient tracking algorithm. Zeroth-order optimization methods are a popular solution to address problems with unknown cost functions, see [ 19 ] for an overview on this topic. Within this class, the so-called 1 -point optimization methods are particularly appealing since they only require a single function evaluation per iteration and, thus, are particularly suited in scenarios where cost functions evaluations are expensive or multi-point evaluations are not possible, such as when the environment is non-stationary (see [ 20 ] ). Examples arise in online optimization, control, reinforcement learning settings (e.g. [ 21 ] ). These methods have been widely explored in the centralized literature (see the early references [ 22 , 23 ] or the most recent ones [ 24 , 20 , 25 , 26 ] ), while a recent extension to the distributed setting is proposed in [ 27 ] . Despite their efficiency, 1 -point methods typically underperform compared to multi-evaluation zeroth-order methods. As we will better detail later, we overcome this issue by embedding the use of neural networks in our 1 -point architecture. The use of neural networks in optimization and control is a recent interesting research trend. For example, in [ 28 , 29 ] , they are integrated into feedback controllers to estimate the system state from perceptual information. In [ 30 ] , neural networks are combined with a zeroth-order scheme, while [ 31 ] introduces a general framework for the verification of neural network controllers. Authors in [ 32 ] employ neural networks to learn stabilizing policies for nonlinear systems. The work [ 33 ] proposes a framework to learn from data algorithms for optimizing nonconvex functions. Further neural networks have been widely adopted in model predictive control algorithms, where they act as approximators for control policies. In this context, [ 34 ] proposes a method to certify the reliability of the neural network-based controller, while in [ 35 ] the problem is addressed via HardTanh deep neural networks. Finally, in [ 36 ] a set point tracking scenario for a robot manipulator is considered. In this paper, we introduce DEep-Learning aggregative TrAcking (DELTA), a novel distributed data-driven optimization scheme for aggregative problems. The peculiarity of DELTA is to tackle the typical convergence issues of standard 1 -point methods based on static gradient approximations by integrating a dynamic learning strategy based on neural networks that does not increase the number of cost evaluations per iteration. More in detail, DELTA operates on a single timescale and integrates three core components: (i) a learning-oriented module, (ii) an optimization-oriented routine, and (iii) a tracking-oriented mechanism. The learning-oriented component uses local neural networks to asymptotically estimate the correct costs (and their gradients) in a data-driven fashion. Specifically, each neural network employs only a single cost evaluation per iteration taken in the neighborhood of the current local estimates. The optimization-oriented component applies an approximated distributed gradient method to the aggregative problem. Its inexactness arises

Read the complete text