Nonlinear-Gain Distributed Zeroth-Order Optimization for Networked Black-Box Control Extended Version

Shengjun Zhang, Tingyi Liu, Heng Zhang, Dong Xie · 2026

Read Nonlinear-Gain Distributed Zeroth-Order Optimization for Networked Black-Box Control Extended Version by Shengjun Zhang, Tingyi Liu, Heng Zhang, Dong Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25306.txt.

Introduction

Shengjun Zhang and colleagues tackle optimization over a peer network where agents see only function values, never gradients. Their ZOOM-PB method samples coordinates and blends estimates with a fractional-power response, keeping a primal state. The raw estimate stays as an anchor, with mixing weight tied to the step size. That design avoids flipping network direction when noisy estimates are averaged. Under a smooth oracle and a connected graph, it reaches nonconvex rates plus a fast term after a transient. Matched-budget tests against seven baselines confirm the design.

Catalog record

CREATORShengjun Zhang, Tingyi Liu, Heng Zhang, Dong Xie
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38440
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25306

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nonlinear-Gain Distributed Zeroth-Order Optimization for Networked Black-Box Control Extended Version Shengjun Zhang, Tingyi Liu, Heng Zhang, Dong Xie Abstract This letter studies distributed stochastic optimization over a peer-to-peer network when agents can query only zeroth-order function values. We propose ZOOM-PB, a coordinate-sampling distributed zeroth-order method equipped with a fractional-power powerball map. The proposed mechanism applies a nonlinear feedback gain directly to coordinate ZO estimates: it amplifies weak signals in flat regions and attenuates large stochastic estimates while transmitting only primal variables. Under standard smoothness, oracle-variance, and network-connectivity assumptions, ZOOM-PB achieves the leading nonconvex stationarity rate 𝒪 ⁡ ( p / ( n ​ T ) ) \mathcal{O}(\sqrt{p/(nT)}) , where p p is the decision dimension, n n is the number of agents, and T T is the iteration horizon. Under the Polyak–Łojasiewicz condition, it further attains the leading objective residual rate 𝒪 ⁡ ( p / ( n ​ T ) ) \mathcal{O}(p/(nT)) . Thus the method preserves the known distributed ZO order while changing the finite-time behavior through a local nonlinear control gain. Simulations on black-box learning and sensor-driven UAV source seeking show faster empirical convergence in weak-signal regimes. I Introduction Distributed optimization is a basic tool for networked control, machine learning, robotic swarms, and sensor networks, where agents cooperatively solve \min_{x\in\mathbb{R}^{p}}f(x)\triangleq\frac{1}{n}\sum_{i=1}^{n}f_{i}(x),\qquad f_{i}(x)=\mathbb{E}_{\xi_{i}}[F_{i}(x,\xi_{i})]. (1) Many first-order distributed methods assume that each agent can compute or estimate \nabla f_{i}(x) directly. This assumption is restrictive in black-box control and simulation-based optimization, where agents may observe only noisy function values, such as concentration readings in source seeking [ 6 ] or loss values in black-box learning [ 10 , 2 , 1 , 5 ] . Zeroth-order (ZO) methods replace gradients by finite-difference estimates and have been extensively studied in centralized stochastic optimization [ 3 , 7 , 9 , 8 ] . Distributed ZO methods further couple gradient estimation with network consensus [ 14 , 15 , 12 , 4 , 13 , 18 , 11 ] . However, most existing distributed stochastic ZO algorithms follow one of two paths: they either use spherical perturbations with primal–dual or tracking variables, or they focus on asymptotic stationarity without addressing the transient slowdowns caused by small ZO signals in flat nonconvex regions. This issue arises naturally in black-box networked control, where agents may be far from an informative signal source and the finite-difference values are dominated by noise. We introduce a nonlinear powerball amplification map into distributed ZO updates. For an estimated gradient component g , the map \sigma(g,\gamma)=\operatorname{sgn}(g)|g|^{\gamma},\qquad\gamma\in[1/2,1], (2) is applied componentwise. When |g|<1 , it amplifies weak signals; when |g|>1 , it attenuates large estimates. Thus, from a control viewpoint, ZOOM-PB can be interpreted as a state-dependent nonlinear feedback gain rather than merely another finite-difference estimator. This is the main distinction from current distributed ZO methods. Powerball-type maps were originally studied for first-order descent methods [ 16 ] ; here they are applied to noisy coordinate ZO estimates inside a peer-to-peer algorithm. The threshold |g|=1 is relative to the normalization of the ZO estimate and can be absorbed into the stepsize scale. With this mechanism, the paper makes three contributions. First, we propose a fully distributed stochastic ZO algorithm that exchanges only primal variables and uses coordinate-wise function queries, so different agents can explore different coordinate subspaces in parallel. Second, we prove the leading nonconvex stationarity rate \mathcal{O}(\sqrt{p/(nT)}) and the leading Polyak–Łojasiewicz (PL) objective rate \mathcal{O}(p/(nT)) under the same primal communication primitive, with the full finite-time bounds stated in Theorems 1 – 2 . Third, we isolate the finite-time effect of the nonlinear powerball gain by comparing it with the linear endpoint \gamma=1 in both black-box learning and sensor-driven UAV source seeking. The resulting distinction is mechanism-level: ZOOM-PB changes the local input applied to the distributed ZO recursion, while the oracle schedule and transmitted state remain unchanged. The nonlinear map in ( 2 ) is not introduced as a heuristic stepsize change. For any nonzero component g , \frac{|\sigma(g,\gamma)|}{|g|}=|g|^{\gamma-1}. (3) Hence the feedback gain is larger than one in weak-signal regions 0<|g|<1 and smaller than one for large estimates |g|>1 . Existing distributed ZO schemes mainly change the estimator or add tracking variables; ZOOM-PB changes the local descent vector through this componentwise nonlinear gain while keeping the peer-to-peer communication primitive unchanged. Proposition 1 . For any \gamma\in(0,1) and any scalar g\neq 0 , the powerball map satisfies |\sigma(g,\gamma)|>|g| if |g|<1 , |\sigma(g,\gamma)|=|g| if |g|=1 , and |\sigma(g,\gamma)|<|g| if |g|>1 . Moreover, \sigma(g,\gamma) preserves the sign of g . Proof. The result follows directly from |\sigma(g,\gamma)|/|g|=|g|^{\gamma-1} and \gamma-1<0 . Sign preservation follows from the definition of \operatorname{sgn}(\cdot) . ∎ Proposition 1 gives the control interpretation of ZOOM-PB. When agents operate far from an informative region, the estimated ZO signal is often small and stochastic; the fractional power increases the actuation magnitude without changing the descent direction. Near sharp regions or under large oracle perturbations, the same map attenuates the injected vector and helps avoid aggressive jumps. This effect does not change the asymptotic big- \mathcal{O} exponent, so the convergence-order claim and the nonlinear-gain claim are stated separately. TABLE I: Positioning Against Representative Zeroth-Order Optimization Methods Method Setting Oracle/comm. Rate or limitation Centralized ZO [ 3 , 7 ] Stochastic Server-based \mathcal{O}(\sqrt{p/T}) ZO-GDA [ 12 ] Deterministic Spherical ZO, primal Deterministic convergence ZONE-M [ 4 ] Stochastic Multi-point ZO, primal/dual \mathcal{O}(p^{2}n/T) with large sampling Primal-dual accelerated ZO [ 13 , 18 , 17 ] Stochastic ZO, primal/dual Linear-speedup rates; acceleration uses auxiliary states ZOOM-PB Stochastic Coordinate ZO, primal only \mathcal{O}(\sqrt{p/(nT)}) ; PL: \mathcal{O}(p/(nT)) I-A Relation to Existing Distributed ZO Methods The proposed method should be distinguished from three nearby lines of work. The first line is centralized stochastic ZO optimization, where all function evaluations are collected by one processor or server. Such methods provide the baseline dimension dependence \mathcal{O}(\sqrt{p/T}) in nonconvex stochastic settings, but they do not exploit network parallelism and do not address peer-to-peer agreement. The rate in Theorem 1 replaces this term by \mathcal{O}(\sqrt{p/(nT)}) up to the consensus transient, which reflects the fact that n agents generate independent local ZO information. The second line is deterministic distributed ZO optimization. These algorithms are valuable when each local cost can be queried exactly, but they do not model streaming stochastic function values. In networked sensing and black-box control, the local oracle often includes sampling noise, environmental disturbances, or minibatch randomness. The oracle model in Assumption 3 keeps this stochastic component explicit, and the Lyapunov recursion separates it from the topology-induced error. The third and closest line is stochastic distributed ZO with primal–dual, tracking, or feedback-optimization mechanisms. ZOD-PDA and ZODIAC achieve linear speedup rates under stochastic nonconvex objectives, and the accelerated distributed ZO method in [ 17 ] also uses a powerball-type nonlinear gain within a primal–dual architecture. Multi-agent ZO feedback optimization studies gradient-free control loops with cooperative agents [ 11 ] . In contrast, ZOOM-PB keeps the communication state primal-only: agents send only their current decisions, local directions need not be coordinated across the network, and the nonlinear gain is applied locally to the coordinate-ZO estimate. The analysis separates rate preservation from gain shaping. ZOOM-PB is not a claim of a new minimax exponent; it shows that a fractional-power ZO feedback gain can

Read the complete text