An Adaptive Proximal Inexact Gradient Framework and Its Application to Per-Antenna Constrained Joint Beamforming and Compression Design Part of this work has been presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2024 [ 1 ] . X. Fan and Y.-F. Liu are
Xilai Fan, Bo Jiang, and Ya-Feng Liu · 2025
Read An Adaptive Proximal Inexact Gradient Framework and Its Application to Per-Antenna Constrained Joint Beamforming and Compression Design Part of this work has been presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2024 [ 1 ] . X. Fan and Y.-F. Liu are by Xilai Fan, Bo Jiang, and Ya-Feng Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01721.txt.
Introduction
Xilai Fan, Bo Jiang, and Ya-Feng Liu propose an optimization framework for problems whose data are known only roughly. Their 2025 paper covers nonsmooth composite problems, where the objective mixes a smooth part with a kinked part, and where function and gradient values carry errors. Older inexact methods choose step sizes in ways that ignore part of that error.
Their adaptive method uses a new line search rule that responds to both kinds of error while keeping proof guarantees. It reaches a near stationary point at the best known rate for nonconvex problems, and a near optimal one for convex problems. The team then applies the method to a wireless design task, jointly shaping antenna beams and data compression under per antenna power limits in cooperative cellular networks.
Catalog record
| CREATOR | Xilai Fan, Bo Jiang, and Ya-Feng Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 112 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01721
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Adaptive Proximal Inexact Gradient Framework and Its Application to Per-Antenna Constrained Joint Beamforming and Compression Design Part of this work has been presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2024 [ 1 ] . X. Fan and Y.-F. Liu are with the State Key Laboratory of Scientific and Engineering Computing, Institute of Computational Mathematics and Scientific/Engineering Computing, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China (e-mail: {fanxilai, yafliu}@lsec.cc.ac.cn). B. Jiang is with Ministry of Education Key Laboratory of NSLSCS, School of Mathematical Sciences, Nanjing Normal University, Nanjing 210023, China (e-mail: [email protected]). Xilai Fan, Bo Jiang, and Ya-Feng Liu Abstract In this paper, we propose an adaptive proximal inexact gradient (APIG) framework for solving a class of nonsmooth composite optimization problems involving function and gradient errors. Unlike existing inexact proximal gradient methods, the proposed framework introduces a new line search condition that jointly adapts to function and gradient errors, enabling adaptive stepsize selection while maintaining theoretical guarantees. Specifically, we prove that the proposed framework achieves an ϵ \epsilon -stationary point within 𝒪 ( ϵ − 2 ) \mathcal{O}(\epsilon^{-2}) iterations for nonconvex objectives and an ϵ \epsilon -optimal solution within 𝒪 ( ϵ − 1 ) \mathcal{O}(\epsilon^{-1}) iterations for convex cases, matching the best-known complexity in this context. We then custom-apply the APIG framework to an important signal processing problem: the joint beamforming and compression problem (JBCP) with per-antenna power constraints (PAPCs) in cooperative cellular networks. This customized application requires careful exploitation of the problem’s special structure such as the tightness of the semidefinite relaxation (SDR) and the differentiability of the dual. Numerical experiments demonstrate the superior performance of our custom-application over state-of-the-art benchmarks for the JBCP. I Background and Introduction In this paper, we consider the composite optimization problem of the form \min_{\mathbf{x}\in\mathbb{R}^{n}}\ \left\{F(\mathbf{x}):=f(\mathbf{x})+h(\mathbf{x})\right\}, (1) where h:\mathbb{R}^{n}\to\mathbb{R}\cup\{+\infty\} is a proper closed convex function with a tractable proximal mapping, and f:\mathbb{R}^{n}\to\mathbb{R} is a continuously differentiable function that may be nonconvex. Problem ( 1 ) has numerous practical applications in signal processing and machine learning (e.g., [ 2 , 3 , 4 , 5 , 6 ] ) and includes several important classes as special cases. For instance, setting h(\cdot)=0 in ( 1 ) yields an unconstrained optimization problem, while setting h(\cdot) as the indicator function of a (closed) convex set leads to a convex constrained optimization problem. In this paper, we are interested in the case where computing the function and gradient information of f(\cdot) is costly, often requiring the solution of an associated convex subproblem. Examples of such problems can be found in [ 7 , 8 , 9 , 10 , 11 , 12 ] . The proximal gradient (PG) method is an efficient class of algorithms for solving problem ( 1 ). Given a parameter \lambda>0 , the proximal operator \operatorname{prox}_{\lambda h}:\mathbb{R}^{n}\rightarrow\operatorname{dom}(h):=\{\mathbf{x}\in\mathbb{R}^{n}\mid h(\mathbf{x})<+\infty\} is defined as \operatorname{prox}_{\lambda h}(\mathbf{x})=\argmin_{\mathbf{y}\in\mathbb{R}^{n}}\ \left\{\frac{1}{2\lambda}\|\mathbf{y}-\mathbf{x}\|^{2}+h(\mathbf{y})\right\}. (2) At the i -th iteration, the standard PG method for solving problem ( 1 ) updates the next iterate as \mathbf{x}^{i+1}=\operatorname{prox}_{\lambda_{i}h}(\mathbf{x}^{i}-\lambda_{i}\nabla f(\mathbf{x}^{i})). (3) Here, \lambda_{i}>0 is the stepsize, which typically satisfies certain line search (LS) condition. However, obtaining \mathbf{x}^{i+1} requires the exact knowledge of \nabla f(\mathbf{x}^{i}) , which may be computationally expensive or even inaccessible in our interested setting. Consequently, it becomes crucial to solve problem ( 1 ) using only inexact gradient or function information of f(\cdot) [ 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 ] . Let \mathbf{g}^{i} denote the inexact gradient at \mathbf{x}^{i} . The proximal inexact gradient (PIG) method updates the iterate as \mathbf{x}^{i+1}=\operatorname{prox}_{\lambda_{i}h}(\mathbf{x}^{i}-\lambda_{i}\mathbf{g}^{i}), (4) which replaces the exact gradient \nabla f(\mathbf{x}^{i}) in the PG method ( 3 ) with its approximation \mathbf{g}^{i} . To guarantee the convergence of the PIG method, the stepsize \lambda_{i} in ( 4 ) must satisfy a LS condition specifically tailored to the inexact function or gradient information. In the following, we review the existing results on the PIG method ( 4 ), including the selection strategies of the stepsize \lambda_{i} and the required conditions on the inexactness of the function and gradient approximations. I-A Prior Works Given \lambda>0 and \mathbf{d}\in\mathbb{R}^{n} , the gradient mapping [ 24 ] at a point \mathbf{x}\in\mathbb{R}^{n} is defined as \mathbf{G}_{\lambda}(\mathbf{x},\mathbf{d})=\lambda^{-1}(\mathbf{x}-\operatorname{prox}_{\lambda h}(\mathbf{x}-\lambda\mathbf{d})). (5) By [ 24 , Theorem 10.7] , it holds that \mathbf{G}_{\lambda}(\mathbf{x},\nabla f(\mathbf{x}))=0 if and only if \mathbf{x} is a stationary point of problem ( 1 ). Denote the gradient error by \varepsilon_{i}^{\mathbf{g}}=\mathbf{g}^{i}-\nabla f(\mathbf{x}^{i}). (6) Then various existing conditions on \varepsilon_{i}^{\mathbf{g}} can be unified in the following form: \|\varepsilon_{i}^{\mathbf{g}}\|^{2}\leq(\eta_{i}^{\mathbf{g}})^{2}+(a^{2}+b^{2}\lambda_{i}^{2})\varepsilon_{i}^{2}, (7) where \{\eta_{i}^{\mathbf{g}}\} is a predefined nonnegative sequence, a\geq 0 , b\geq 0 , and \varepsilon_{i} is either \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\nabla f(\mathbf{x}^{i}))\| or \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\| . Note that, \mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\nabla f(\mathbf{x}^{i})) and \mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i}) simplify to \nabla f(\mathbf{x}^{i}) and \mathbf{g}^{i} , respectively, when h(\cdot)=0 . When a=b=0 in ( 7 ), the corresponding condition is referred to as the absolute inexactness condition , as the sequence \{\eta_{i}^{\mathbf{g}}\} is predefined. Otherwise, when a+b>0 , it is called the relative inexactness condition , as the gradient error \varepsilon_{i}^{\mathbf{g}} is adaptively controlled based on the information from the iterates. In the special case where \eta_{i}^{\mathbf{g}}\equiv 0 , b=0 , \varepsilon_{i}=\|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\nabla f(\mathbf{x}^{i}))\| , and h(\cdot)=0 , the corresponding relative inexactness condition becomes \|\varepsilon_{i}^{\mathbf{g}}\|\leq a\|\nabla f(\mathbf{x}^{i})\|,\quad a\in(0,1), (8) which is known as the norm condition , first introduced in [ 14 ] and later employed in other works, e.g., [ 25 , 23 , 18 ] . In the following, we discuss both the absolute and relative inexactness conditions for the PIG method ( 4 ), under different stepsize strategies: constant stepsize strategies depending on the gradient Lipschitz constant and adaptive stepsize strategies based on LS conditions. TABLE I: Summary of the existing works on the PIG method. Literature Stepsize \|\varepsilon_{i}^{\mathbf{g}}\|^{2}\leq(\eta_{i}^{\mathbf{g}})^{2}+(a^{2}+b^{2}\lambda_{i}^{2})\varepsilon_{i}^{2} |\varepsilon_{i}^{f}|\leq\eta_{i}^{f}+c\lambda_{i}\|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\|^{2} Objective Iteration Complexity \eta_{i}^{\mathbf{g}} a b \varepsilon_{i} \eta_{i}^{f} c h(\cdot) f(\cdot) NC C [ 15 ] 1/L summable 0 0 \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\| 0 0 C C – \mathcal{O}(\epsilon^{-1}) [ 18 ] 1/L 0 [0,1) 0 \|\nabla f(\mathbf{x}^{i})\| 0 0 0 NC ∗ – [ 19 ] 1/(L(1+a)) 0 [0,1) 0 \|\nabla f(\mathbf{x}^{i})\| 0 0 I C \mathcal{O}(\epsilon^{-2})^{\dagger} – [ 11 ] 1/L 0 0 [0,L/2) \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\| 0 0 C NC \mathcal{O}(\epsilon^{-2}) – [ 20 ] adaptive 0 [0,1) 0 \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\| 0 0 I NC linear ‡ – [ 21 ] adaptive 0 0 [0,\infty) \|\mathbf{g}^{i}\| 0 0 0 NC/C \mathcal{O}(\epsilon^{-2}) \mathcal{O}(\epsilon^{-1}) [ 22 ] adaptive 0 0 [0,\infty) \|\mathbf{g}^{i}\| 0 \big[0,\frac{\theta\lambda_{i}}{4\lambda_{\max}}\big] 0 NC/C \mathcal{O}(\epsilon^{-2}) \mathcal{O}(\epsilon^{-1}) [ 23 ] adaptive 0 [0,1) 0 \|\nabla f(\mathbf{x}^{i})\| \mathcal{O}(\epsilon^{2}) 0 0 NC/C \mathcal{O}(\epsilon^{-2}) \mathcal{O}(\epsilon^{-1}) This work adaptive square-summable [0,1) [0,\infty) \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\| summable [0,\frac{\theta}{4}] C NC \mathcal{O}(\epsilon^{-2}) – summable 0 0 \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\| summable [0,\frac{\theta}{4}] C C – \mathcal{O}(\epsilon^{-1}) 0 [0,1) [0,\infty) \|\mathbf{G}_{\lambda_{i}}(\mathbf{x}^{i},\mathbf{g}^{i})\| 0 [0,\frac{\theta}{4}] C C – \mathcal{O}(\epsilon^{-1}) Note: In this table, I = indicator function of a convex set, NC = nonconvex, and C = convex. The iteration complexity refers to the algorithm’s complexity in returning an \epsilon -stationary point \mathbf{x} that satisfies \|\mathbf{G}_{\lambda}(\mathbf{x},\nabla f(\mathbf{x}))\|\leq\epsilon in the NC case, and an \epsilon -optimal solution \mathbf{x} that satisfies F(\mathbf{x})-F^{\star}\leq\epsilon in the C case. The symbol “–” means that no corresponding results are established for that case; “ * ” indicates