Momentum-based Distributed Resource Scheduling Optimization Subject to Sector-Bound Nonlinearity and Latency Mohammadreza Doostmohammadian, Zulfiya R. Gabidullina, Hamid R. Rabiee Abstract This paper proposes an accelerated consensus-based distributed iterative algorithm for resource allocation and scheduling. The proposed gradient-tracking algorithm introduces an auxiliary variable to add momentum towards the optimal state. We prove that this solution is all-time feasible, implying that the coupling constraint always holds along the algorithm iterative procedure; therefore, the algorithm can be terminated at any time. This is in contrast to the ADMM-based solutions that meet constraint feasibility asymptotically. Further, we show that the proposed algorithm can handle possible link nonlinearity due to logarithmically-quantized data transmission (or any sign-preserving odd sector-bound nonlinear mapping). We prove convergence over uniformly-connected dynamic networks (i.e., a hybrid setup) that may occur in mobile and time-varying multi-agent networks. Further, the latency issue over the network is addressed by proposing delay-tolerant solutions. To our best knowledge, accelerated momentum-based convergence, nonlinear linking, all-time feasibility, uniform network connectivity, and handling (possible) time delays are not altogether addressed in the literature. These contributions make our solution practical in many real-world applications. Journal: Systems and Control Letters † † graphicalabstract: † † highlights: Introduction of a novel accelerated momentum-based distributed iterative algorithm specifically designed for optimal resource allocation and scheduling tasks. Demonstration that the proposed algorithm maintains all-time feasibility, ensuring that the coupling constraint is satisfied at every iteration, allowing for termination at any point without violating the constraints. Capability to manage link nonlinearity arising from logarithmically-quantized data transmission or other sign-preserving odd sector-bound nonlinear mappings. Proof of convergence over uniformly-connected dynamic networks, accommodating the complexities of mobile and time-varying multi-agent systems. Addressing latency issues in network communication by proposing solutions that are tolerant to delays, enhancing practical applicability. 1 Introduction Decentralized multi-agent optimization and learning has been significantly advanced due to recent developments in cloud computing, parallel processing, Internet-of-Things (IoT) and applications in machine learning, artificial intelligence, and distributed data processing [ 1 , 2 ] . This motivates decentralized setups toward optimizing the resource scheduling on large-scale, where the process of learning is distributed over a network of computing nodes/agents [ 3 ] (see Fig. 1 ). The challenges posed by the dynamic workloads, data-transmission latencies, volatile networking conditions, and nonlinearities (such as quantization and clipping) within the system ask for innovative solutions that can rapidly adapt to the intricacies of modern computing problems. This motivates to bridge the gap and devise a solution that can operate effectively and rapidly in the face of different local and coupling constraints and ensure the reliability of distributed applications over networked setups. In response to the mentioned challenges, this study introduces a momentum-based algorithm that not only addresses the intricacies of existing constraints but also provides a dynamic localized framework for resource allocation and scheduling. The motivation is to offer a distributed strategy that collaboratively optimizes resource utilization in the presence of latency, and effectively goes through the nonlinearities inherent in real-world computing setups while addressing fast convergence. Figure 1: A distributed networked multi-agent optimization/learning setup motivated by cloud-based decentralized computing and parallel processing. Some relevant literature is discussed here. The optimal resource-constrained problem in centralized setups using transfer learning is considered in [ 4 ] . The preliminary works on distributed linear resource scheduling algorithms are discussed in [ 5 , 6 ] . Distributed optimization application by combining finite-time observers and homogeneous system theory with control design application is considered in [ 7 ] . Distributed nonlinear dynamics for optimization using single-bit consensus protocols (to reduce communication load on agents) is proposed in [ 8 ] . Optimal energy scheduling for plug-in electric vehicle (PEV) charging is discussed in [ 9 , 10 ] . Energy resource allocation over the power grid (referred to as the economic dispatch problem) is considered using different consensus-based [ 11 , 12 , 13 ] , event-driven [ 14 ] , and adaptive dynamic programming methods [ 15 ] . Distributed multi-robot task assignment (and allocation) is considered in [ 16 , 17 , 18 ] . Momentum-based solution for unconstrained optimization with machine learning applications is studied in [ 19 , 20 , 21 , 22 ] . Distributed consensus coordination and optimization under time-delay is studied in [ 23 , 24 , 25 ] . However, these works mostly require all-time network connectivity (i.e., cannot handle temporary disconnectivity), and further cannot address all-time resource-demand feasibility while unable to handle nonlinear data-transmission (e.g., due to log-quantization). Quantized communication over all-time connected networks (with no all-time constraint feasibility) is studied in [ 26 ] . All-time feasible methods are proposed in [ 27 , 12 ] without consideration of communication delays and nonlinearity. Alternating-direction-method-of-multipliers (ADMM) resource allocation solutions [ 20 , 28 , 29 , 30 , 31 ] are based on primal-dual optimization. These works are known to reach constraint-feasibility asymptotically over time and therefore are not all-time feasible. Further, they only converge on all-time connected networks and are mostly vulnerable to time-delays. Another interesting line of research is additive- increase-multiplicative-decrease (AIMD) strategies used in various networking and resource management scenarios, particularly for controlling congestion in data networks [ 32 ] ; the literature includes average-based AIMD admission control policy with minimal communication between individual nodes and the aggregator [ 33 ] and its application in charging electric and plug-in hybrid vehicles [ 34 ] and optimal scheduling of the charging process of electric bus fleets [ 35 ] . Finally, this paper improves the previous work of the authors [ 36 ] by adding a momentum term to reach faster convergence. This paper introduces a novel momentum-based algorithm designed to tackle the mentioned challenges associated with distributed resource allocation and scheduling, offering an adaptive solution to the dynamic nature of the existing applications. The main contributions are summarized as follows: (i) Our proposed algorithm operates over uniformly-connected networks, where the agents may lose connectivity temporarily because of mobility or packet drops. This exhibits a remarkable ability to converge under time-varying and relaxed network-connectivity conditions. This advances the existing ADMM-based [ 20 , 28 , 29 , 30 , 31 ] and delay-tolerant solutions [ 25 , 24 ] . (ii) The algorithm holds exact convergence (with no optimality gap) in the face of possible nonlinearities commonly encountered in practical distributed systems, such as logarithmic quantization and saturation/clipping. In general, the proposed solution is robust subject to general sign-preserving sector-bound nonlinear mapping on the data-transmission channels. This adaptability enhances its applicability, from traditional computing clusters to emerging edge and fog computing paradigms. This contribution is not addressed in most existing literature. (iii) The proposed solution is all-time constraint feasible, implying that at any termination time of the algorithm, the resource-demand balance holds. This contributes to its ability to handle dynamic setups and avoid service disruption. This particularly is in contrast to the dual-based ADMM [ 20 , 28 , 29 , 30 , 31 ] and other existing delay-tolerant solutions [ 25 , 24 ] . (iv) By leveraging momentum-based techniques, our approach enables rapid convergence to optimal resource distribution. This makes it particularly well-suited for real-time scenarios, ensuring that system resources are optimally allocated sufficiently fast. This along with the all-time feasibility, enhances the algorithm’s adaptability towards scenarios characterized by evolving workloads. (v) Another key strength of our proposed algorithm lies in its capability to handle latency and time-delay prevalent in data-transmission networks. This is mainly due to limited bandwidth and synchronization issues in the data-sharing network of processing nodes. Our approach ensures optimality even in situations characterized by variable heterogeneous time-delays over undirected symmetric networks. This feature is particularly crucial in real-world applications where instantaneous decision-making is imperative. This notion of network latency is rarely addressed in distributed scheduling literature. Few existing works [ 25 , 24 ] are not all-time feasible and cannot handle nonlinearity. To our best knowledge, no existing work in the literature addresses the contributions (i)-(v) altogether. Some works address one or two contributions (as discussed in the literature review), but not all the mentioned contributions entirely together. Paper Organization: Section 2 presents some preliminaries and formulated the problem. Section 3 presents our main algorithm for iterative resource scheduling. Section 4 discusses the constraint feasibility and optimal convergence. Section 5 provides some simulations and Section 6 concludes the paper. General Notations: \mathbf{1}_{n} and I_{n} respectively denote the vector of all ones and identity matrix of size n . The operator “ ; ” implies column concatenation. \partial_{x} is simplified form of \frac{d}{dx} , i.e., the derivative with respect to x . \nabla_{x}F is the gradient of F(\cdot) with respect to x . 2 Preliminaries and Problem Formulation 2.1 Problem Setup The resource scheduling and allocation problem is formulated as equality-constraint optimization in its primal form. It aims to minimize a globally convex objective function subject to the resource-demand constraint. This balancing constraint guarantees that the weighted sum of resources meets the sum of demands, and is referred to as the feasibility constraint . Violating this constraint may cause service disruption in practical applications. The mathematical form of the problem is \min_{\mathbf{z}}~~\widetilde{F}(\mathbf{z}):=\sum_{i=1}^{n}\widetilde{f}_{i}(z_{i}),~~\text{s.t.}~\mathbf{a}^{\top}\mathbf{z}-b=0, (1) with the column state vector \mathbf{z}=[z_{1};\dots;z_{n}]\in\mathbb{R}^{n} representing the resources ( z_{i}\in\mathbb{R} is the resource at node/agent i ), and positive weighting factor \mathbf{a}=[{a}_{1};\dots;{a}_{n}]\in\mathbb{R}^{n}_{+} and the demand vector b\in\mathbb{R} . The function f_{i}:\mathbb{R}\mapsto\mathbb{R} denotes the local objective/cost at node i . Assumption 1 . The global cost function \widetilde{F}(\cdot) is strictly convex and smooth. By simple change of variables x_{i}:=z_{i}a_{i} , the problem takes the standard mathematical form as, \displaystyle\displaystyle\min_{\mathbf{x}} \displaystyle F(\mathbf{x})=\sum_{i=1}^{n}f_{i}(x_{i}) (2) \displaystyle\text{s.t.} \displaystyle\sum_{i=1}^{n}(x_{i}-b_{i})=0 with \mathbf{x}=[x_{1};\dots;x_{n}]\in\mathbb{R}^{n} as the new state variable and the predefined parameter b_{i}\in\mathbb{R} as the preset local demand at node i (note that \sum_{i=1}^{n}b_{i}=b ). For example, in power allocation and economic dispatch, the parameter b_{i} represents the nominal power rating of the power generators and is a predefined value. The above equality constraint represents the balance between the scheduled resources and the demand, which needs to be always satisfied in all-time feasible solutions. In the case that the resource states are further locally constrained by m_{i}\leq x_{i}\leq M_{i} and m_{i}\leq b_{i}\leq M_{i} , the local objective f_{i}(\cdot) is added with a penalizing additive term to address these box constraints [ 37 , 27 ] . One example of penalty function is \sigma[{x}_{i}-M_{i}]^{+}+\sigma[m_{i}-{x}_{i}]^{+} with [u]^{+}=\max\{u,0\}^{c} , c\in\mathbb{Z}^{+} . Another smooth example is, \displaystyle\frac{\sigma}{\alpha}\log(1+e^{\alpha({x}_{i}-M_{i})})+\frac{\sigma}{\alpha}\log(1+e^{\alpha(m_{i}-{x}_{i})}), (3) with \sigma,\alpha\in\mathbb{R}^{+} . Remark 1 . In the problem statement ( 2 ) the state variables are considered scalar as in many applications mentioned in Section 2.2 , including the energy resource management (generator coordination) and CPU scheduling, where the optimization state variable is scalar, for example, the allocated power in generator coordination and CPU workload in CPU scheduling over data centres. This scalar case is also considered in many works in the literature, for example, see references [ 5 , 6 , 11 , 12 , 36 , 38 , 39 , 40 ] . However, the results can be easily extended to the case where x_{i}\in\mathbb{R}^{p} and b_{i}\in\mathbb{R}^{p} with p>1 . 2.2 Applications The applications of the optimization problem ( 2 ) range from the control systems to computer networks. In these applications a group of agents collaboratively learn how to locally optimize the resource scheduling costs, as discussed in the following: • An example is the problem of distributed CPU scheduling over networked data centres considered in [ 38 , 41 , 39 ] . In this problem, the idea is to optimally allocate tasks to a group of networked servers while optimizing the computational cost functions. The equality constraint balances the assigned CPU resources and the computational tasks. • Distributed energy resource management and generator coordination is another application considered in [ 11 , 12 , 15 , 40 ] to distribute the electricity dispatch and power demand to a group of networked power generators. The resource-demand feasibility implies the balance between the assigned power resources to the load demand. • Battery scheduling for distributed PEV charging is studied in [ 9 , 42 , 10 ] to assign a fleet of PEVs to charging stations to optimize the electricity cost. The decision-making is distributed and localized to address large-scale frameworks. • The problem of rate-distributed linearly constrained minimum variance (LCMV) beamforming in wireless acoustic sensor networks is another example in [ 43 , 44 ] . The goal is to optimize the energy usage within the network and the transmission cost while addressing the constraint on noise reduction performance. • Another application is in coverage control, facility location optimization, and distributed task allocation over mobile robotic networks [ 18 , 45 , 46 , 47 ] . The idea is to optimally assign a group of agents to maximize the mission area coverage while balancing duty-to-capability ratios. 2.3 Graph Theoretic Notions The multi-agent network is modelled by a graph topology \mathcal{G}=\{\mathcal{V},\mathcal{E}\} with adjacency (weight) matrix W . Its associated Laplacian matrix is defined as L=D-W with D=\mbox{diag}[\sum_{j=1}^{n}W_{ij}] (the diagonal degree matrix). Assuming the network to be undirected and W to be symmetric, its L is positive semi-definite (PSD) [ 48 ] . This is the case when the agents have similar communication range and broadcasting power. The graph is said to be weight-balanced (WB) if \sum_{i=1}^{n}W_{ij}=\sum_{j=1}^{n}W_{ij} . For WB networks, the matrix L_{s}:=\frac{L+L^{\top}}{2} is PSD. It is possible that the agents temporarily lose connectivity due to mobility or packet drops. In this case, the switching network \mathcal{G}(t) is said to be uniformly connected over time-window B>0 (or B -connected), if there is B>0 such that \mathcal{G}_{B}(t) with edge union \bigcup_{t}^{t+B}\mathcal{E}(t) is connected. In this case, the Laplacian L_{B} associated with \mathcal{G}_{B} only has one isolated zero eigenvalue [ 49 ] . Note that this is the most relaxed network connectivity condition and contradicting this condition implies that, for example, there are two separate subgraphs (islands) in the network with no path between them, and therefore no collaborative agreement can be reached over a non-uniformly-connected network. This union connectivity is particularly vital for link-failure scenarios. In case there are packet drops or link failures with probability p_{l} , one can define a bond-percolation probability p_{c} over which the network loses its connectivity. In other words, p_{c} serves as a critical threshold that separates the two network connectivity and disconnectivity phases. For example, for Erdos-Renyi (ER) random graphs with linking density p and link failure rate p_{l} , for p_{l}0 is the step-rate, k is the time step, \mathcal{N}_{i} denotes the set of neighbours of agent i , W_{ij} is the consensus weighting factor on the shared information over link (j,i) , 0\leq\mu<1 is the momentum-rate, and variable y_{i}(k) denotes the momentum term of node i at time k . The momentum term y_{i} is added to improve the convergence rate and accelerate the solution. For initialization, the agents set their initial state values as x_{i}(0)=b_{i} and y_{i}(0)=0 . 3.2 Solution Subject to Sector-Bound Nonlinearity The data transmission channels (or the communication links) between agents might be subject to nonlinear constraints. This implies that the sent data \partial_{x_{j}}f_{j}(k) over a link (j,i) is delivered to agent i as g_{l}(\partial_{x_{j}}f_{j}(k)) , where g_{l}:\mathbb{R}\mapsto\mathbb{R} denotes the nonlinear mapping. Then, the decentralized solution is updated as, \displaystyle x_{i}(k+1)= \displaystyle x_{i}(k)+\mu y_{i}(k) \displaystyle+\eta\sum_{j\in\mathcal{N}_{i}}W_{ij}(g_{l}(\partial_{x_{j}}f_{j}(k))-g_{l}(\partial_{x_{i}}f_{i}(k))), (12) \displaystyle y_{i}(k+1)= \displaystyle x_{i}(k+1)-x_{i}(k), (13) where the weight matrix W is only weight-balanced and not necessarily stochastic. Assumption 3 . The nonlinear function g_{l}(\cdot) is assumed to be odd, strongly sign-preserving, and sector-bound. One example of such link nonlinearity is saturation or clipping. Another example is log-scale quantization [ 55 , 56 ] illustrated in Fig. 2 with its formula as follows: \displaystyle g_{l}(u) \displaystyle:=\mbox{sgn}(u)\exp(g_{u}(\log(|u|))), (14) with g_{u}(u):=\rho\left[\frac{u}{\rho}\right] (the operator \left[\cdot\right] as rounding to the nearest integer) and \rho>0 as the quantization level. Figure 2: The log-scale or logarithmic quantizer (with the quantization level \rho ) is shown in this figure as a strongly sign-preserving sector-bound nonlinearity. The sector-bounds of this nonlinear function are 1\pm\delta as shown in the figure. 3.3 Delay-Tolerant Solution Latency in a network refers to the delay between the transmission of data from a source agent to its destined agent; in other words, the exchanged data packets over the communication network are typically subject to time-delays. This might be due to limited bandwidth which leads to increased latency and drops, especially under high load. Further, mismanaged traffic and congestion, synchronization issues, and physical obstructions and interference from other devices can contribute to latency over the network. This may lead to instability in the multi-agent network and, in distributed optimization setup, is described by the number of time steps it takes to transfer data over a link/channel. Let \overline{\tau} denote the maximum possible steps of time-delay over the network and \tau_{ij}(k)\leq\overline{\tau} denote the delay over the link (j,i) at time k . We assume the most general case for the delays as arbitrary, random, (possibly) time-varying, and heterogeneous at different links. Then, the delay-tolerant solution is updated as \displaystyle x_{i}(k+1)= \displaystyle x_{i}(k)+\eta_{\tau}\sum_{j\in\mathcal{N}_{i}}\sum_{r=0}^{\overline{\tau}}W_{ij}\Big(g_{l}(\partial_{x_{j}}f_{j}(k-r)) \displaystyle-g_{l}(\partial_{x_{i}}f_{i}(k-r))\Big)\mathcal{I}_{k-r,ij}(r)+\mu y_{i}(k), (15) \displaystyle y_{i}(k+1)= \displaystyle x_{i}(k+1)-x_{i}(k), (16) with \eta_{\tau} as the step-rate, \overline{\tau}\in\mathbb{Z}^{+} as the maximum possible time-delay (upper bound) and the indicator function \mathcal{I} defined as, \displaystyle\mathcal{I}_{k,ij}(r)=\left\{\begin{array}[]{ll}1,&\text{if}~\tau_{ij}(k)=r,\\ 0,&\text{otherwise}.\end{array}\right. It should be noted that in Eq. ( 15 ), although the local information is immediately available, the delayed information g_{l}(\partial_{x_{j}}f_{j}(k-r))-g_{l}(\partial_{x_{i}}f_{i}(k-r)) is used instead of g_{l}(\partial_{x_{j}}f_{j}(k-r))-g_{l}(\partial_{x_{i}}f_{i}(k)) . In other words, agents use their past state information g_{l}(\partial_{x_{i}}f_{i}(k-r)) based on the time-delay 0\leq r\leq\overline{\tau} to ensure that the sum of states remains constant. This guarantees all time resource-demand feasibility as proved later in Lemma 4 , which ensures that at any termination time of the algorithm the balance between assigned resources \sum_{i=1}^{n}x_{i}(k) and the demand \sum_{i=1}^{n}b_{i} holds irrespective of the time-delays. For example, for application in distributed energy resource management and generator coordination, this implies that the allocated power states to the generators are always equal to the power demand and there would be no service disruption due to delays. The most general form of the proposed iterative solution is summarized in Algorithm 1 . Note that in Eq. ( 15 ) the amount of time-delay of a received message is known to the destined agent. This is done by time-stamping the data shared over the network. Algorithm 1 Distributed Multi-Agent Resource Scheduling 1 Input: \mathcal{N}_{i} , W , \mathcal{G} , \eta_{\tau} , \mu , b_{i} , f_{i}(\cdot) , \overline{\tau} ; 2 Initialization: set k=0 , x_{i}(0)=b_{i} , y_{i}(0)=0 ; 3 while termination criteria NOT true do 4 Agent i receives (possibly delayed) information \partial_{x_{j}}f_{j} from agent j\in\mathcal{N}_{i} over the network \mathcal{G} ; 5 Agent i updates its resource state via Eq. ( 15 )-( 16 ); 6 Agent i shares information \partial_{x_{i}}f_{i} with neighbors i\in\mathcal{N}_{j} over the network \mathcal{G} ; 7 k\leftarrow k+1 ; 8 Return Assigned resource state x_{i} and optimal cost f_{i}(x_{i}) ; 4 Analysis of Convergence This section analyzes the convergence of the proposed algorithm towards optimal resource scheduling. We prove all-time constraint feasibility, stability of the optimizer \mathbf{x}^{*} (as the equilibrium of the proposed dynamics), and convergence condition towards this optimal point. Lemma 4 (Constraint Feasibility) . Given a uniformly connected undirected network of agents, the solution under Algorithm 1 preserves its all-time constraint feasibility. Proof. We need to show that \sum_{i=1}^{n}(x_{i}(k)-b_{i})=0 for all k . From the proposed dynamics ( 15 )-( 16 ) we have, \displaystyle\sum_{i=1}^{n}x_{i}(k+1)= \displaystyle\sum_{i=1}^{n}x_{i}(k)+\eta_{\tau}\sum_{i=1}^{n}\sum_{j\in\mathcal{N}_{i}}\sum_{r=0}^{\overline{\tau}}W_{ij}\Big(g_{l}(\partial_{x_{j}}f_{j}(k-r)) \displaystyle-g_{l}(\partial_{x_{i}}f_{i}(k-r))\Big)\mathcal{I}_{k-r,ij}(r)+\mu\sum_{i=1}^{n}y_{i}(k) Recall that the weight matrix is symmetric and the nonlinear mapping is odd and sign-preserving. Therefore, \displaystyle W_{ij}\Big(g_{l}(\partial_{x_{i}} \displaystyle f_{i}(k-r))-g_{l}(\partial_{x_{j}}f_{j}(k-r))\Big)= \displaystyle-W_{ji}\Big(g_{l}(\partial_{x_{j}}f_{j}(k-r)-g_{l}(\partial_{x_{i}}f_{i}(k-r)\Big). As a result, the summation on the gradient tracking is zero and \sum_{i=1}^{n}x_{i}(k+1)=\sum_{i=1}^{n}x_{i}(k)+\mu\sum_{i=1}^{n}y_{i}(k) . Initializing from x_{i}(0)=b_{i} and y_{i}(0)=0 and substituting y_{i}(k)=x_{i}(k)-x_{i}(k-1) , we have \sum_{i=1}^{n}x_{i}(k+1)=\sum_{i=1}^{n}x_{i}(k) . Further, we have \sum_{i=1}^{n}y_{i}(k)=0 . This completes the proof. ∎ Lemma 5 (Equilibrium) . Let \mathbf{x}^{*} be the optimal point of the Algorithm 1 and the equilibrium of the proposed dynamics. Then, following Lemma 1 , \nabla F(\mathbf{x}^{*})\in\mbox{span}\{\mathbf{1}_{n}\} . Proof. We prove this by reductio ad absurdum. Let \nabla F(\mathbf{x}^{*})=({\varphi}^{*}_{1};\dots;{\varphi}^{*}_{n}) where \varphi^{*}\notin\mbox{span}\{\mathbf{1}_{n}\} , i.e., \displaystyle\varphi^{*}_{i}\neq\varphi^{*}_{j}\Longleftrightarrow\partial f_{i}(x_{i}^{*})\neq\partial f_{j}(x_{j}^{*}), (19) for at least two nodes i,j . Let, \displaystyle\alpha=\argmax_{q\in\{1,\dots,n\}}{\varphi}^{*}_{q},~\beta=\argmin_{q\in\{1,\dots,n\}}{\varphi}^{*}_{q}. (20) as two nodes over the network with maximum and minimum gradients. Recall that \mathcal{G}_{B} is uniformly connected; therefore, there exists a path in \mathcal{G}_{B} from node \alpha to node \beta over time-interval B . In this path, there is at least two nodes \overline{\alpha} and \overline{\beta} with the neighbors \mathcal{N}_{\overline{\alpha}} and \mathcal{N}_{\overline{\beta}} , respectively, satisfying \varphi^{*}_{\overline{\alpha}}>\varphi^{*}_{\mathcal{N}_{\overline{\alpha}}},~\varphi^{*}_{\overline{\beta}}<\varphi^{*}_{\mathcal{N}_{\overline{\beta}}} . This implies that the gradient-tracking summation in dynamics ( 15 ) is non-zero, and {x}^{*}_{\overline{\alpha}}(k+1)\neq{x}^{*}_{\overline{\alpha}}(k) and {x}^{*}_{\overline{\beta}}(k+1)\neq{x}^{*}_{\overline{\beta}}(k) over time-window of length B . This contradicts the definition of the equilibrium and completes the proof. ∎ Theorem 1 (Convergence) . The states of the agents under Algorithm 1 collaboratively converge to the optimal solution of problem ( 2 ) for 0\leq\mu<1 and \displaystyle\eta_{\tau}<\frac{\kappa\lambda_{2}}{u\lambda_{n}^{2}\mathcal{K}^{2}(\overline{\tau}+1)} (21) Proof. We prove the theorem in three steps. Step I: we set \mu=0 and derive the convergence condition for the delay-free case ( \overline{\tau}=0 ), i.e., solution under Eqs. ( 12 )-( 13 ). Let define \overline{F}(k):=F(\mathbf{x}(k))-F(\mathbf{x}^{*}) with F(\mathbf{x}^{*}) as the optimal cost. We need to prove that this residual satisfies \overline{F}(k+1)<\overline{F}(k) for \mathbf{x}(k)\neq\mathbf{x}^{*} . Recall that {\mathbf{y}(k+1)=\mathbf{x}(k+1)-\mathbf{x}(k)} . Following Lemma 3 , we have \displaystyle\nabla_{x}F^{\top}\mathbf{y}(k+1)+u\mathbf{y}(k+1)^{\top}\mathbf{y}(k+1)\leq 0. (22) Using the graph-theoretic notions of Section 2.3 and notations from the consensus literature [ 53 ] , we rewrite Eq. ( 15 ) (with some abuse of notation) in the Laplacian-gradient form as \displaystyle\mathbf{x}(k+1)=\mathbf{x}(k)-\eta_{\tau}Lg_{l}(\nabla_{x}F) (23) with g_{l}(\nabla_{x}F) acting as an element-wise nonlinear mapping on entries of \nabla_{x}F . For notation simplicity, we drop the dependence on k . Then, from Eq. ( 22 ) and ( 23 ), we have \displaystyle-\eta_{\tau}\nabla_{x}F^{\top}Lg_{l}(\nabla_{x}F)+u\eta_{\tau}^{2}g_{l}(\nabla_{x}F)^{\top}L^{\top}Lg_{l}(\nabla_{x}F)\leq 0. (24) Recalling the equilibrium condition from Lemma 5 , define \phi(\mathbf{x}):=\nabla_{x}F-\frac{\mathbf{1}_{n}}{n}\sum_{i=1}^{n}\partial_{x_{i}}f_{i} as the dispersion (or disagreement) parameter. Using Lemma 2 , it is straightforward to show that Eq. ( 24 ) holds for \displaystyle(-\kappa\eta\lambda_{2}+u\lambda_{n}^{2}\mathcal{K}^{2}\eta^{2})\phi^{\top}\phi\leq 0, (25) Because \phi^{\top}\phi>0 for \mathbf{x}\neq\mathbf{x}^{*} , we need the following to hold \displaystyle\eta<\frac{\kappa\lambda_{2}}{u\lambda_{n}^{2}\mathcal{K}^{2}}=:\overline{\eta}. (26) This proves that for \eta<\overline{\eta} the optimal convergence holds and the summation \sum_{j\in\mathcal{N}_{i}}W_{ij}(g_{l}(\partial_{x_{j}}f_{j})-g_{l}(\partial_{x_{i}}f_{i})) goes to zero. Step II: Next, we extend the proof for convergence in the presence of time-delays ( \overline{\tau}>0 ), i.e., the solution under Eqs. ( 15 )-( 16 ). For general arbitrary delays, the information sent from any node i reaches its neighbour j\in\mathcal{N}_{i} at most in \overline{\tau}+1 steps. Then, we need to consider \mathbf{x}(k+\overline{\tau}+1)-\mathbf{x}(k) for the convergence analysis in Step I instead of \mathbf{x}(k+1)-\mathbf{x}(k) . Recall from ( 3.3 ) that 0<\sum_{r=0}^{\overline{\tau}}\mathcal{I}_{k-r,ij}(r)\leq(\overline{\tau}+1) . This implies that the Eqs. ( 22 ) and ( 24 ) need to be scaled by \overline{\tau}+1 , and therefore, the outcome of \eta_{\tau} is down-scaled by \overline{\tau}+1 , i.e., (\overline{\tau}+1)\eta_{\tau}<\overline{\eta} . Therefore, to reach the convergence, \eta_{\tau} needs to satisfy \displaystyle\eta_{\tau}<\frac{\overline{\eta}}{\overline{\tau}+1} For this range of \eta_{\tau} , we have \overline{F}(k+1)<\overline{F}(k) and the residual converges to zero in the presence of time-delays. Further, under this range of \eta_{\tau} we have the following, \displaystyle\sum_{j\in\mathcal{N}_{i}}\sum_{r=0}^{\overline{\tau}} \displaystyle W_{ij}(g_{l}(\partial_{x_{j}}f_{j}(k-r)) \displaystyle-g_{l}(\partial_{x_{i}}f_{i}(k-r)))\mathcal{I}_{k-r,ij}(r)\rightarrow 0. (27) Step III: as the final step, we consider 0<\mu<1 . Note that Eq. ( 15 ) can be written as \displaystyle y_{i}(k+1)= \displaystyle\eta_{\tau}\sum_{j\in\mathcal{N}_{i}}\sum_{r=0}^{\overline{\tau}}W_{ij}\Big(g_{l}(\partial_{x_{j}}f_{j}(k-r)) \displaystyle-g_{l}(\partial_{x_{i}}f_{i}(k-r))\Big)\mathcal{I}_{k-r,ij}(r)+\mu y_{i}(k), (28) Following Eq. ( 27 ), the above converges in limit to a geometric series in the form y_{i}(k+1)=\mu y_{i}(k) . For 0<\mu<1 this series converges to zero. Further, from the proof of Lemma 4 we have \displaystyle\eta_{\tau}\sum_{i=1}^{n}\sum_{j\in\mathcal{N}_{i}}\sum_{r=0}^{\overline{\tau}} \displaystyle W_{ij}\Big(g_{l}(\partial_{x_{j}}f_{j}(k-r)) \displaystyle-g_{l}(\partial_{x_{i}}f_{i}(k-r))\Big)\mathcal{I}_{k-r,ij}(r)=0 Recalling the initialization y_{i}(0)=0 , this further implies that \displaystyle\sum_{i=1}^{n}y_{i}(k+1)=\sum_{i=1}^{n}\mu y_{i}(k)=0 for all k . This completes the proof. ∎ 4.1 Some Discussions and Remarks It is worth mentioning that one can prove convergence and constraint-feasibility of the proposed algorithm over WB directed networks in the delay-free case (i.e., with \overline{\tau}=0 ). Recall that Lemma 2 holds for strongly-connected WB directed networks by replacing L with L_{s}:=\frac{L+L^{\top}}{2} . Similar stability results for consensus algorithms are proved in [ 48 ] . Then, following as in consensus literature [ 53 ] and substituting \lambda_{ns},\lambda_{2s} (as the largest and smallest non-zero eigenvalues of L_{s} respectively) the proof of Lemma 2 can be extended to WB networks. Consequently, the proofs in Theorem 1 similarly follow for WB directed networks for \overline{\tau}=0 . Moreover, it should be mentioned that the proposed nonlinear solution not only works for log-scale quantization and saturation but also works for any sector-bound sign-preserving nonlinearity. This implies that one can purposefully apply various proper nonlinear mappings, for example, to tune the convergence rate via sign-based functions. Further, similar to nonlinear robust consensus algorithms [ 57 , 58 ] , other types of nonlinearity might be applied to dynamics ( 12 ) to come up with robust solutions to disturbance and noise. In contrast to the primal-dual formulations (such as ADMM) which require all-time connected static networks [ 20 , 28 , 29 , 30 ] , this work allows for uniform-connectivity, i.e., changes in the network topology and temporary disconnectivity of the communication network. Further, convergence over networks subject to time-delays and nonlinear data transmissions are hard to address via primal-dual formulations. Few existing delay-tolerant papers in the literature [ 25 , 24 , 31 ] are not all-time feasible and lose resource-demand balance at some times. 5 Simulations 5.1 Academic Example: Comparison with the Literature For MATLAB simulation, we consider a random network of ER graph (with linking probability of p=25\% ) representing the multi-agent network of n=20 nodes. The agents locally optimize the following cost function: \displaystyle f_{i}(x_{i})=g_{i}x_{i}^{2}+d_{i}x_{i}+a_{i}+\sigma[{x}_{i}-M_{i}]^{+}+\sigma[m_{i}-{x}_{i}]^{+} (29) with random cost parameters g_{i}\in(0,0.3] , d_{i}\in(0,10] , a_{i}\in(0,10] , and box constraint parameters m_{i}=10 , M_{i}=110 , \sigma=1 . For the balancing constraint, we consider b_{i}=50 for all i . The step rate and momentum-rate are set as \eta=0.04 and \mu=0.9 . First, we simulate in the absence of time-delays (i.e., Eqs. ( 12 )-( 13 )) and subject to log-scale quantization with quantizer level \rho=\frac{1}{2^{10}} . Under our proposed momentum-based nonlinear solution, the residual is compared with linear [ 5 ] , accelerated linear [ 6 ] (with \beta=0.5 ), single-bit [ 8 ] , finite sign-based [ 11 ] (with \zeta=0.6 ), fixed sign-based [ 40 ] (with \zeta_{1}=0.6,\zeta_{2}=1.5 ), and saturated dynamics [ 36 ] (with \delta=0.5 ) in Fig. 3 . These works provide constraint-feasible solutions while many other existing literature, including ADMM-based formulations, are not all-time feasible. Figure 3: Comparison of the time-evolution of the cost residuals under different resource scheduling solutions in the literature. Next, we perform the simulation of the proposed nonlinear dynamics considering logarithmic quantization for different quantizer levels \rho . We set \mu=0.5 , \eta=0.04 and the rest of the simulation setup and parameters are the same as the previous ones. Fig. 4 shows the residual convergence for different values \rho . Figure 4: The time-evolution of the cost residuals under different log-scale quantization levels as sector-bound nonlinearity. Next, we simulate our proposed algorithm over a uniformly-connected ER network setup by considering random link failure rate p_{l}=80\% . For linking probability p=25\% of ER graph, the bond-percolation threshold for link failure from Eq. ( 4 ) is p_{c}=58\% . For link failure p_{l}>p_{c} the ER graph becomes disconnected, but it preserves uniform-connectivity over time-window of B steps for p_{l}^{B}