An Efficient Memory Gradient Method for Extreme M-Eigenvalues of Elastic type Tensors Thanks: This work was supported by the National Natural Science Foundation of P.R. China (Grant No.12171064). Zhuolin Du, Yisheng Song Abstract M-eigenvalues of fourth order hierarchically symmetric tensors play a significant role in nonlinear elastic material analysis and quantum entanglement problems. This paper focuses on computing extreme M-eigenvalues for such tensors. To achieve this, we first reformulate the M-eigenvalue problem as a sequence of unconstrained optimization problems by introducing a shift parameter. Subsequently, we develop a memory gradient method specifically designed to approximate these extreme M-eigenvalues. Under this framework, we establish the global convergence of the proposed method. Finally, comprehensive numerical experiments demonstrate the efficacy and stability of our approach. Keywords: Hierarchically symmetric tensors; M-eigenvalues; Memory gradient method; Global convergence AMS Subject Classification(2010): 90C23, 65H17, 15A18, 90C30. 1 Introduction Tensor eigenvalue problems play a critical role in numerical multilinear algebra [ 6 , 12 , 27 , 32 , 43 , 50 ] , with significant applications in areas such as magnetic resonance imaging (MRI) [ 5 ] , spectral hypergraph theory [ 34 ] , and automatic control [ 16 , 17 , 18 ] . In particular, M-eigenvalue problems for fourth order hierarchically symmetric tensors have attracted considerable attention in recent years due to their wide range of applications, including nonlinear elastic material analysis [ 12 , 19 , 20 , 29 , 27 , 40 , 42 , 49 ] and quantum entanglement problems in physics [ 10 , 8 , 14 , 45 ] . To further investigate properties related to the M-eigenvalues of fourth order hierarchically symmetric tensors, Han-Dai-Qi [ 20 ] and Qi-Dai-Han [ 42 ] introduced the definitions of M-eigenvalues and M-eigenvectors for this class of tensors. Definition 1.1 Let \mathcal{A}=(a_{ijkl})\in\mathbb{R}^{m\times n\times m\times n} or \mathcal{A}=(a_{ikjl})\in\mathbb{R}^{m\times m\times n\times n} . If for all i,k\in[m],~j,l\in[n] , a_{ijkl}=a_{kjil}=a_{ilkj}=a_{klij}, where [n]=\{1,2,\ldots,n\} , then \mathcal{A} is called a fourth order hierarchically symmetric tensor (Helbig [ 15 , 26 ] ). Such a tensor is called elastic type tensor also (Backus [ 4 ] ). If for all i,k\in[m],~j,l\in[n] , a_{ijkl}=a_{kjil}=a_{ilkj}, then \mathcal{A} is called a fourth order partially symmetric tensors (Qi-Dai-Han [ 42 ] ). Obviously, a fourth order hierarchically symmetric tensor is symmetric whenever a_{ijkl}=a_{ikjl}, and a fourth order n -dimensional ( m=n ) hierarchically symmetric tensor has \dfrac{n(n+1)(n^{2}+n+2)}{8} independent components (Backus [ 4 ] ). When m=n=3 , a fourth order hierarchically symmetric tensor has 21 independent components, and a fourth order partially symmetric tensor has 36 independent components. For the sake of simplicity, we denote \mathbb{H}^{m\times n\times m\times n} the set of all fourth order hierarchically symmetric tensors. Definition 1.2 ( [ 20 , 42 ] ) Let \mathcal{A}=(a_{ijkl})\in\mathbb{H}^{m\times n\times m\times n} . If (\lambda,{\bf x},{\bf y})\in\mathbb{R}\times\mathbb{R}^{m}\backslash\{{\bf 0}\}\times\mathbb{R}^{n}\backslash\{{\bf 0}\} satisfies the following system \mathcal{A}\cdot{\bf y}{\bf x}{\bf y}=\lambda{\bf x},~~\mathcal{A}{\bf x}{\bf y}{\bf x}\cdot=\lambda{\bf y},~~{\bf x}^{\top}{\bf x}=1,~~{\bf y}^{\top}{\bf y}=1, (1.1) where (\mathcal{A}\cdot{\bf y}{\bf x}{\bf y})_{i}=\sum_{\begin{subarray}{c}k\in[m];~j,l\in[n]\end{subarray}}a_{ijkl}y_{j}x_{k}y_{l}\quad\mbox{and}\quad(\mathcal{A}{\bf x}{\bf y}{\bf x}\cdot)_{l}=\sum_{\begin{subarray}{c}i,k\in[m];~j\in[n]\end{subarray}}a_{ijkl}x_{i}y_{j}x_{k}, then \lambda is called an M-eigenvalue of \mathcal{A} with the left M-eigenvector {\bf x} and the right M-eigenvector {\bf y} . The exploration of M-eigenvalues for fourth order hierarchically symmetric tensors has become an active research area over the past decade [ 7 , 9 , 35 , 24 , 25 , 48 , 47 ] . Significant progress has been made through interval inclusion methods and spectral approximation techniques [ 11 , 30 ] . However, substantial computational challenges remain in accurately characterizing these M-eigenvalues. To address this, Wang et al. [ 47 ] developed a computational approach that reformulates the largest M-eigenvalue problem as a biquadratic homogeneous polynomial optimization over unit spheres; this method also enables verification of strong ellipticity. Building on this foundation, Li et al. [ 35 ] derived two specialized M-eigenvalue inclusion intervals for fourth order hierarchically symmetric tensors. Subsequently, Che et al. [ 7 ] estimated M-eigenvalues by analyzing distinct M-eigenvector components and established upper bounds for the M-spectral radius of nonnegative hierarchically symmetric tensors. Notably, these bounds were incorporated as parameters in the WQZ algorithm [ 47 ] , demonstrating their utility in iterative methods. A key application of M-eigenvalue sets is verifying positive definiteness [ 31 , 32 , 33 ] . A significant limitation of existing inclusion sets [ 7 , 35 ] , however, is their confinement to regions near the coordinate axes, rendering them ineffective for determining M-positive definiteness. Addressing this gap, recent work [ 24 ] introduced novel S-type M-eigenvalue inclusion theorems. Complementing these theoretical advances, an alternating shifted power method was developed for computing extremal M-eigenvalues of fourth order hierarchically symmetric tensors [ 46 ] . Beyond iterative methods like the alternating shifted power method, several specialized optimization strategies have recently emerged for tensor eigenvalue problems [ 21 , 28 , 22 , 23 , 38 ] . Han [ 21 ] introduced an unconstrained optimization model for computing generalized eigenpairs of symmetric tensors; applying the BFGS method to this model yields superlinearly convergent sequences, providing a robust solution framework. In practical applications such as MRI [ 44 ] , the focus often shifts toward computing extremal eigenvalues or local maxima rather than determining the entire spectral set, highlighting the need for efficient, targeted algorithms. However, as tensor order or dimension increases, these optimization problems become large-scale or even very large-scale, posing significant computational challenges. To address this, Li et al. [ 34 ] proposed a linearly convergent adaptive gradient method. This raises a natural question: Can adaptive gradient methods be extended to fourth order hierarchically symmetric tensors? We note that the steepest descent method [ 13 ] relies solely on current gradient information to determine the next iterate, potentially underutilizing historical data. In contrast, Narushima et al. [ 37 ] developed a memory gradient method that incorporates past information to enhance classical gradient descent while circumventing Hessian computations. Motivated by these insights, particularly the untapped potential of historical gradient data for structured tensor problems, we propose a Memory Gradient Method (MGM) for computing the largest M-eigenvalue of fourth order hierarchically symmetric tensors. We establish the global convergence of MGM and present comprehensive numerical results demonstrating its computational efficiency. The remainder of this paper is organized as follows. Section 2 introduces a transformation that reformulates the M-eigenvalue problem into an unconstrained optimization framework. Building on this foundation, Section 3 develops the Memory Gradient Method (MGM) for computing extremal M-eigenvalues and establishes its global convergence. Section 4 presents comprehensive numerical experiments demonstrating the computational efficiency and performance advantages of MGM compared to existing methods. Finally, Section 5 provides concluding remarks. 2 Unconstrained framework for M-eigenvalues of elastic type tensors Let \mathbb{R}^{n} be the n dimensional real Euclidean space. Generally, scalars are denoted by lowercase letters such as a,b and vectors are denoted by bold lowercase letters such as {\bf x},{\bf y} . Furthermore, matrices are denoted by capital letters such as {\bf A} , {\bf B} and tensors are denoted by calligraphic capital letters such as \mathcal{A},\mathcal{B} . The superscript ⊤ stands for the transpose of vectors and matrices. Let \mathbb{H}^{m\times n\times m\times n} denote the set of all four order hierarchically symmetric tensors. For any \mathcal{A}=(a_{ijkl})\in\mathbb{H}^{m\times n\times m\times n} , the corresponding gradient is as follows: \nabla_{\bf x}(\mathcal{A}{\bf x}{\bf y}{\bf x}{\bf y})=2\mathcal{A}\cdot{\bf y}{\bf x}{\bf y},~~~~\nabla_{\bf y}(\mathcal{A}{\bf x}{\bf y}{\bf x}{\bf y})=2\mathcal{A}{\bf x}{\bf y}{\bf x}\cdot. For the sake of simple, \mathcal{A}\cdot{\bf y}{\bf x}{\bf y} and \mathcal{A}{\bf x}{\bf y}{\bf x}\cdot are also denoted by \mathcal{A}{\bf y}{\bf x}{\bf y} and \mathcal{A}{\bf x}{\bf y}{\bf x} respectively. Motivated by the work of Auchmuty [ 1 ] , we consider the following unconstrained optimization problem, which has close relationship with the M-eigenvalue problem (see Theorem 2.1 ): \min\limits_{\begin{subarray}{c}{\bf x}\in\mathbb{R}^{m}\\ {\bf y}\in\mathbb{R}^{n}\end{subarray}}f({\bf x},{\bf y})=\frac{1}{4}({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y})^{2}-\frac{1}{2}\mathcal{A}{\bf x}{\bf y}{\bf x}{\bf y}. (2.1) Then, the gradient of f({\bf x},{\bf y}) with respect to {\bf x} and {\bf y} are given by g_{1}({\bf x},{\bf y})=\nabla_{\bf x}f({\bf x},{\bf y})=({\bf x}^{\top}{\bf x}){\bf x}({\bf y}^{\top}{\bf y})^{2}-\mathcal{A}{\bf y}{\bf x}{\bf y}, (2.2) g_{2}({\bf x},{\bf y})=\nabla_{\bf y}f({\bf x},{\bf y})=({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y}){\bf y}-\mathcal{A}{\bf x}{\bf y}{\bf x}. (2.3) Moreover, we have the following results. Theorem 2.1 Let \mathcal{A}\in\mathbb{H}^{m\times n\times m\times n} be a nonzero tensor. Assume that \lambda^{\ast} is the largest M-eigenvalue of \mathcal{A} . Then we have the following results (1) The problem ( 2.1 ) has a global minimum. (2) Let {\bf x}\in\mathbb{R}^{m}\setminus\{\bf 0\} and {\bf y}\in\mathbb{R}^{n}\setminus\{\bf 0\} be critical points of ( 2.1 ). Then \lambda=({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y}) is a positive M-eigenvalue of {\cal A} , with the associated M-eigenvectors {\bf u}={\bf x}/\|{\bf x}\| and {\bf v}={\bf y}/\|{\bf y}\| . (3) If \lambda^{*}>0 , then f({\bf x},{\bf y}) attains its global minimum f_{\min}=-\frac{1}{4}(\lambda^{\ast})^{2} at nonzero critical points ({\bf x},{\bf y}) . Proof. (1) Since the unit sphere is compact and the function ({\bf u},{\bf v})\mapsto\left|\mathcal{A}{\bf u}{\bf v}{\bf u}{\bf v}\right| is continuous, denote C=\max_{\|{\bf u}\|=1,\|{\bf v}\|=1}\left|\mathcal{A}{\bf u}{\bf v}{\bf u}{\bf v}\right| , and the optimal value C is attainable, i.e., there exist unit vectors {\bf u}_{0},{\bf v}_{0} such that C=\left|\mathcal{A}{\bf u}_{0}{\bf v}_{0}{\bf u}_{0}{\bf v}_{0}\right| . Since \mathcal{A} is a nonzero tensor, we have C>0 . Now, we consider two cases based on the sign of \mathcal{A}{\bf u}{\bf v}{\bf u}{\bf v} . Let t=\|{\bf x}\|^{2}\|{\bf y}\|^{2} , if t=0 , then f({\bf x},{\bf y})=0 . Otherwise, we obtain that f({\bf x},{\bf y})=\frac{1}{4}({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y})^{2}-\frac{1}{2}\mathcal{A}{\bf x}{\bf y}{\bf x}{\bf y}\geq\frac{1}{4}\|{\bf x}\|^{4}\|{\bf y}\|^{4}-\frac{C}{2}\|{\bf x}\|^{2}\|{\bf y}\|^{2}=\frac{1}{4}t^{2}-\frac{C}{2}t. By direct computation, we know that f({\bf x},{\bf y})\geq-\frac{1}{4}C^{2} , and the equality holds when t=C . (2) By ( 2.2 )-( 2.3 ), the critical points of f({\bf x},{\bf y}) satisfy \mathcal{A}{\bf y}{\bf x}{\bf y}=({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})^{2}{\bf x}~\mbox{and}~\mathcal{A}{\bf x}{\bf y}{\bf x}=({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y}){\bf y}. (2.4) Denote {\bf u}={\bf x}/\|{\bf x}\|,{\bf v}={\bf y}/\|{\bf y}\| . Then, combining this with ( 2.4 ), it holds that \mathcal{A}{\bf v}{\bf u}{\bf v}=({\bf x}^{\top}{\bf x})\frac{({\bf y}^{\top}{\bf y})^{2}}{\|{\bf y}\|^{2}}{\bf u}~\mbox{and}~\mathcal{A}{\bf u}{\bf v}{\bf u}=\frac{({\bf x}^{\top}{\bf x})^{2}}{\|{\bf x}\|^{2}}({\bf y}^{\top}{\bf y}){\bf v}. By Definition 1.2 , we have that \lambda=({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})>0 satisfies \mathcal{A}{\bf v}{\bf u}{\bf v}=\lambda{\bf u} , \mathcal{A}{\bf u}{\bf v}{\bf u}=\lambda{\bf v} . Thus, {\bf u}\in\mathbb{R}^{m}\setminus\{\bf 0\} and {\bf v}\in\mathbb{R}^{n}\setminus\{\bf 0\} are M-eigenvectors corresponding to the positive M-eigenvalue \lambda . (3) Let \lambda be an arbitrary positive M-eigenvalue of \mathcal{A} . By Definition 1.2 , there exist unit vectors {\bf u},{\bf v} such that \mathcal{A}{\bf v}{\bf u}{\bf v}=\lambda{\bf u}~\mbox{and}~\mathcal{A}{\bf u}{\bf v}{\bf u}=\lambda{\bf v} . Denote {\bf x}=p{\bf u} and {\bf y}=q{\bf v} for some scalars p,q\in\mathbb{R}\setminus\{0\} . The gradients of f({\bf x},{\bf y}) are derived as follows \displaystyle\nabla_{{\bf x}}f({\bf x},{\bf y}) \displaystyle=({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})^{2}{\bf x}-\mathcal{A}{\bf y}{\bf x}{\bf y} \displaystyle=p^{2}q^{4}p{\bf u}-\mathcal{A}(q{\bf v})(p{\bf u})(q{\bf v}) \displaystyle=p^{3}q^{4}{\bf u}-pq^{2}\mathcal{A}{\bf v}{\bf u}{\bf v}=p^{3}q^{4}{\bf u}-pq^{2}\lambda{\bf u} \displaystyle=pq^{2}(p^{2}q^{2}-\lambda){\bf u} \displaystyle\nabla_{{\bf y}}f({\bf x},{\bf y}) \displaystyle=({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y}){\bf y}-\mathcal{A}{\bf x}{\bf y}{\bf x} \displaystyle=p^{4}q^{2}q{\bf v}-\mathcal{A}(p{\bf u})(q{\bf v})(p{\bf u}) \displaystyle=p^{4}q^{3}{\bf v}-p^{2}q\mathcal{A}{\bf u}{\bf v}{\bf u}=p^{4}q^{3}{\bf v}-p^{2}q\lambda{\bf v} \displaystyle=p^{2}q(p^{2}q^{2}-\lambda){\bf v}. Note that {\bf x}^{\top}{\bf x}=(p{\bf u})^{\top}(p{\bf u})=p^{2} , and {\bf y}^{\top}{\bf y}=(q{\bf v})^{\top}(q{\bf v})=q^{2} . Choosing p,q such that p^{2}q^{2}=\lambda , we have \nabla_{{\bf x}}f({\bf x},{\bf y})=0 and \nabla_{{\bf y}}f({\bf x},{\bf y})=0 . Consequently, ({\bf x},{\bf y}) is a nonzero critical point of f({\bf x},{\bf y}) , and satisfying ({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})=p^{2}q^{2}=\lambda . At this critical point, we also have \mathcal{A}{\bf x}{\bf y}{\bf x}{\bf y}=({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y})^{2}=\lambda^{2} . Therefore, f({\bf x},{\bf y})=-\frac{1}{4}({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y})^{2}=-\frac{1}{4}\lambda^{2}\geq-\frac{1}{4}(\lambda^{\ast})^{2}. This implies that the global minimum is f_{\min}=-\frac{1}{4}(\lambda^{\ast})^{2}, attained at a critical point corresponding to \lambda^{\ast}=({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y}) . \Box Remark 2.1 If all M-eigenvalues of \mathcal{A} are non-positive, then f({\bf x},{\bf y}) has no nonzero critical points. Indeed, the existence of a nonzero critical point ({\bf x},{\bf y}) would imply that \lambda=({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})>0 is an M-eigenvalue. Thus, in this case, the set of critical points is restricted to trivial solutions of the form (\mathbf{0},{\bf y}) or ({\bf x},\mathbf{0}) , which do not correspond to any M-eigenvalue. To address the case where \mathcal{A} has only non-positive M-eigenvalues, we introduce the following shifted problem with a parameter t>0 as follows \mathop{\min}\limits_{\begin{subarray}{c}{\bf x}\in\mathbb{R}^{m}\\ {\bf y}\in\mathbb{R}^{n}\end{subarray}}f_{t}({\bf x},{\bf y})=\frac{1}{4}({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y})^{2}-\frac{1}{2}\mathcal{A}{\bf x}{\bf y}{\bf x}{\bf y}-\frac{t}{2}({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y}). (2.5) For a sufficiently large t , it holds that f_{t}({\bf x},{\bf y})<0 for any nonzero vectors ({\bf x},{\bf y}) . On the other hand, f_{t}({\bf 0},{\bf y})=0 and f_{t}({\bf x},{\bf 0})=0 for all {\bf x}\in\mathbb{R}^{m} and {\bf y}\in\mathbb{R}^{n} . Therefore, points of the form (\bf 0,{\bf y}) or ({\bf x},\bf 0) are maximizers of f_{t}({\bf x},{\bf y}) , while the global minimum is strictly negative and attained at a nonzero point. The gradients of f_{t}({\bf x},{\bf y}) are given by g_{t_{1}}({\bf x},{\bf y})=\nabla_{\bf x}f_{t}({\bf x},{\bf y})=({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})^{2}{\bf x}-\mathcal{A}{\bf y}{\bf x}{\bf y}-t({\bf y}^{\top}{\bf y}){\bf x}, (2.6) g_{t_{2}}({\bf x},{\bf y})=\nabla_{\bf y}f_{t}({\bf x},{\bf y})=({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y}){\bf y}-\mathcal{A}{\bf x}{\bf y}{\bf x}-t({\bf x}^{\top}{\bf x}){\bf y}. (2.7) It is clear that for all {\bf x}\in\mathbb{R}^{m} and {\bf y}\in\mathbb{R}^{n} , the points (\bf 0,{\bf y}) and ({\bf x},\bf 0) are critical points of f_{t}({\bf x},{\bf y}) . More importantly, any nonzero critical point ({\bf x},{\bf y}) of ( 2.5 ) corresponds to an M-eigenvalue \lambda=({{\bf x}}^{\top}{\bf x})({{\bf y}}^{\top}{\bf y})-t . Since f_{t}(\mathbf{x},\mathbf{y}) attains negative values for nonzero (\mathbf{x},\mathbf{y}) , a suitable descent algorithm for ( 2.5 ) is expected to converge to a nonzero critical point. Therefore, by solving either the original problem ( 2.1 ) or the shifted problem ( 2.5 ), the M-eigenvalues and their associated M-eigenvectors can be effectively computed. The following algorithm outlines this adaptive procedure. Algorithm 1 Step 0. Input \mathcal{A}\in\mathbb{P}^{m\times n\times m\times n},~t\geq 1,~\rho>1 and 0<\epsilon\ll 1 , k=0 . Step 1. Solving problem ( 2.1 ) to obtain ({\bf x}_{k},{\bf y}_{k}) . Compute \lambda_{k}=({{\bf x}_{k}}^{\top}{\bf x}_{k})({{\bf y}_{k}}^{\top}{\bf y}_{k}) . Step 2. If \min\{\|{\bf x}_{k}\|,\|{\bf y}_{k}\|\}>\epsilon , output ({\bf x}_{k},{\bf y}_{k}) and \lambda_{k} , Stop. Otherwise go to Step 3. Step 3. Solve problem ( 2.5 ) to obtain ({\bf x}_{k},{\bf y}_{k}) . Compute \lambda_{k}=({{\bf x}_{k}}^{\top}{\bf x}_{k})({{\bf y}_{k}}^{\top}{\bf y}_{k})-t . Step 4. If \min\{||\mathbf{x}_{k}||,||\mathbf{y}_{k}||\}>\epsilon , output (\mathbf{x}_{k},\mathbf{y}_{k}) and \lambda_{k} , Stop. Otherwise, update t=\rho t , and repeat Step 3. Remark 2.2 The iterative process between Step 2 and Step 3 constitutes an inner loop. Since any suitable descent algorithm applied to ( 2.5 ) is guaranteed to converge to a nonzero critical point provided that t is sufficiently large, this inner loop ensures finite termination. Consequently, Algorithm 1 is well-defined. Remark 2.3 In practice, the same unconstrained optimization method should be applied to solve both the original problem ( 2.1 ) and the shifted problem ( 2.5 ). In the subsequent section, we introduce a specialized memory gradient method tailored for this class of problems. 3 A memory gradient method and its convergence In this section, we present the MGM designed to solve the unconstrained optimization problems formulated in Section 2. Specifically, MGM is employed as the primary solver in Steps 1 and 3 within the adaptive framework of Algorithm 1. For simplicity, let \mathbf{z}=(\mathbf{x}^{\top},\mathbf{y}^{\top})^{\top}\in\mathbb{R}^{m+n} and \Phi(\mathbf{z}):\mathbb{R}^{m+n}\to\mathbb{R} denote the objective function (representing either f(\mathbf{x},\mathbf{y}) or f_{t}(\mathbf{x},\mathbf{y}) ). Correspondingly, let g(\mathbf{z})=\nabla\Phi(\mathbf{z}) denote the gradient. The iterative update scheme of the proposed method is given by {\bf z}_{k+1}={\bf z}_{k}+\alpha_{k}{\bf d}_{k}, where \alpha_{k}>0 is a step size determined by a line search procedure. The search direction {\bf d}_{k} is computed as follows for k\geq 1 {\bf d}_{k}=-\gamma_{k}g({\bf z}_{k})+\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}{\bf d}_{k-i}, (3.1) where \beta_{k_{i}}\in\mathbb{R} for i=1,\ldots,N and \gamma_{k}>0 . For the case k0 , specifically, {\bf d}_{0}=-\gamma_{0}g({\bf z}_{0}) . Note that the parameters are different from those proposed by Miele et al. [ 36 ] . To ensure the search direction satisfies descent property, we define the parameters as follows \beta_{k_{i}}=\|g({\bf z}_{k})\|^{2}\varphi_{k_{i}}^{\dagger},\quad\text{where }a^{\dagger}=\begin{cases}0&\text{if }a=0,\\ \dfrac{1}{a}&\text{otherwise}.\end{cases} (3.2) Here, the scalars \varphi_{k_{i}} are chosen to satisfy \begin{cases}\varphi_{k_{1}}>\max\left\{\dfrac{{g({\bf z}_{k})}^{\top}{\bf d}_{k-1}}{\gamma_{k}},\ 0\right\},&i=1,\\ \varphi_{k_{i}}\geq\max\left\{\dfrac{{g({\bf z}_{k})}^{\top}{\bf d}_{k-i}}{\gamma_{k}},\ 0\right\},&i=2,\ldots,N.\end{cases} (3.3) It is important to note that a^{\dagger}a\leq 1 , and from ( 3.2 ) and ( 3.3 ), it follows that \beta_{k_{1}}>0 and \beta_{k_{i}}\geq 0 for i=2,\ldots,N . Building on these properties, the following theorem establishes the descent property of the proposed search direction. Theorem 3.1 Let the search direction {\bf d}_{k} be defined by ( 3.1 ). Suppose that the parameters \beta_{k_{i}} and \varphi_{k_{i}} are chosen to satisfy conditions ( 3.2 ) and ( 3.3 ) for all k . Then, the descent condition holds for all k , i.e., g(\mathbf{z}_{k})^{\top}\mathbf{d}_{k}<0 . Proof. For k=0 , we have g({\bf z}_{0})^{\top}{\bf d}_{0}=-\gamma_{0}\|g({\bf z}_{0})\|^{2}<0 , which establishes the descent property at the initial step. For k\geq 1 , we consider the expression -\gamma_{k}\|g({\bf z}_{k})\|^{2}+\beta_{k_{i}}g({\bf z}_{k})^{\top}{\bf d}_{k-i},~i=1,\ldots,N. Case 1: i=1 . From ( 3.1 ) and ( 3.2 ), and considering that \beta_{k_{1}},\gamma_{k}>0 , it holds that \displaystyle-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\beta_{k_{1}}g({\bf z}_{k})^{\top}{\bf d}_{k-1} \displaystyle\leq-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\beta_{k_{1}}\max\left\{g({\bf z}_{k})^{\top}{\bf d}_{k-1},0\right\} \displaystyle=-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\|g({\bf z}_{k})\|^{2}\varphi_{k_{1}}^{\dagger}\max\left\{g({\bf z}_{k})^{\top}{\bf d}_{k-1},0\right\} \displaystyle<-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\gamma_{k}\|g({\bf z}_{k})\|^{2}\varphi_{k_{1}}^{\dagger}\varphi_{k_{1}} \displaystyle\leq 0. The strict inequality follows from the condition in ( 3.3 ) for i=1 , and the last inequality uses the property a^{\dagger}a\leq 1 . Case 2: i=2,\ldots,N . Similarly, \displaystyle-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\beta_{k_{i}}g({\bf z}_{k})^{\top}{\bf d}_{k-i} \displaystyle\leq-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\beta_{k_{i}}\max\left\{g({\bf z}_{k})^{\top}{\bf d}_{k-i},0\right\} \displaystyle=-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\|g({\bf z}_{k})\|^{2}\varphi_{k_{i}}^{\dagger}\max\left\{g({\bf z}_{k})^{\top}{\bf d}_{k-i},0\right\} \displaystyle\leq-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\gamma_{k}\|g({\bf z}_{k})\|^{2}\varphi_{k_{i}}^{\dagger}\varphi_{k_{i}} \displaystyle\leq 0. Combining this with ( 3.1 ), it follows that \displaystyle g({\bf z}_{k})^{\top}{\bf d}_{k} \displaystyle=-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}g({\bf z}_{k})^{\top}{\bf d}_{k-i} (3.4) \displaystyle=\frac{1}{N}\sum_{i=1}^{N}\left(-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\beta_{k_{i}}g({\bf z}_{k})^{\top}{\bf d}_{k-i}\right)<0. Therefore, the descent condition is satisfied and the desired results hold. \Box It is worth noting that the index satisfying the strict inequality ( 3.3 ) is not necessarily restricted to i=1 . Specifically, the conclusion of the theorem remains valid provided that there exists at least one index i such that \varphi_{k_{i}}>\max\left\{\frac{g({\bf z}_{k}){\bf d}_{k-i}}{\gamma_{k}},\,0\right\}. However, utilizing the most recent iterative information is a natural choice. Next, we focus on establishing the sufficient descent condition, i.e., g({\bf z}_{k})^{\top}{\bf d}_{k}\leq-c\|g({\bf z}_{k})\|^{2},\quad\forall~k\geq 1 (3.5) for some positive constant c . The following theorem shows that condition ( 3.5 ) is satisfied by the proposed method under stronger assumptions on \gamma_{k},\varphi_{k_{i}} for i=1,\ldots,N . Theorem 3.2 Let the search direction {\bf d}_{k} be defined by ( 3.1 ). Suppose there exists a constant \bar{\gamma}>0 such that \gamma_{k}\geq\bar{\gamma} for all k , and \varphi_{k_{i}} ( i=1,\ldots,N ) are chosen to satisfy \begin{cases}g({\bf z}_{k})^{\top}{\bf d}_{k-1}+\|g({\bf z}_{k})\|\|{\bf d}_{k-1}\|<\gamma_{k}\varphi_{k_{1}},&(i=1),\\[6.0pt] g({\bf z}_{k})^{\top}{\bf d}_{k-i}+\|g({\bf z}_{k})\|\|{\bf d}_{k-i}\|\leq\gamma_{k}\varphi_{k_{i}},&(i=2,\ldots,N).\end{cases} (3.6) Then, the proposed method satisfies the sufficient descent condition ( 3.5 ). Proof. Define the index set \mathcal{I}=\{i\in\{1,\dots,N\}\mid g(\mathbf{z}_{k})^{\top}\mathbf{d}_{k-i}>0\} . Let t=|\mathcal{I}| . It is clear that 0\leq t\leq N . Note that for i\notin\mathcal{I} , we have g({\bf z}_{k})^{\top}{\bf d}_{k}\leq 0 . By ( 3.1 ),( 3.2 ), and ( 3.6 ), it holds that \displaystyle g({\bf z}_{k})^{\top}{\bf d}_{k} \displaystyle=-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\frac{1}{N}\sum_{i=1}^{N}g({\bf z}_{k})^{\top}{\bf d}_{k-i}\varphi_{k_{i}}^{\dagger}\|g({\bf z}_{k})\|^{2} \displaystyle\leq-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\frac{1}{N}\sum_{i\in\mathcal{I}}\frac{g({\bf z}_{k})^{\top}{\bf d}_{k-i}}{\varphi_{k_{i}}}\|g({\bf z}_{k})\|^{2} \displaystyle\leq-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\frac{1}{N}\sum_{i\in\mathcal{I}}\frac{\gamma_{k}g({\bf z}_{k})^{\top}{\bf d}_{k-i}}{g({\bf z}_{k})^{\top}{\bf d}_{k-i}+\|g({\bf z}_{k})\|\|{\bf d}_{k-i}\|}\|g({\bf z}_{k})\|^{2} \displaystyle\leq-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\frac{1}{N}\sum_{i\in\mathcal{I}}\frac{\gamma_{k}g({\bf z}_{k})^{\top}{\bf d}_{k-i}}{2g({\bf z}_{k})^{\top}{\bf d}_{k-i}}\|g({\bf z}_{k})\|^{2} \displaystyle=-\gamma_{k}\|g({\bf z}_{k})\|^{2}+\frac{1}{N}\sum_{i\in\mathcal{I}}\frac{\gamma_{k}}{2}\|g({\bf z}_{k})\|^{2} \displaystyle=-\gamma_{k}\|g({\bf z}_{k})\|^{2}\left(1-\frac{t}{2N}\right). Since 0\leq t\leq N , we have 1-\frac{t}{2N}\geq\frac{1}{2} . Combining this with \gamma_{k}\geq\bar{\gamma} , it follows that g(\mathbf{z}_{k})^{\top}\mathbf{d}_{k}\leq-\frac{\gamma_{k}}{2}\|g(\mathbf{z}_{k})\|^{2}\leq-\frac{\bar{\gamma}}{2}\|g(\mathbf{z}_{k})\|^{2}, which implies that the sufficient descent condition ( 3.5 ) holds with c=\frac{\bar{\gamma}}{2} . \Box Note that condition ( 3.5 ) is stronger than ( 3.4 ). Now, we present the MGM, in which the step size \alpha_{k}>0 is determined by the Wolfe line search conditions \Phi({\bf z}_{k}+\alpha_{k}{\bf d}_{k})-\Phi({\bf z}_{k})\leq\rho\alpha_{k}g({\bf z}_{k})^{\top}{\bf d}_{k}, (3.7) g({\bf z}_{k}+\alpha_{k}{\bf d}_{k})^{\top}{\bf d}_{k}\geq\sigma g({\bf z}_{k})^{\top}{\bf d}_{k}, (3.8) where 0<\rho<\sigma<1. Algorithm 2. MGM Input: Function \Phi(\mathbf{z}) (problem (2.1) or (2.5)), shift parameter t\geq 0 (set t=0 for problem (2.1)), 0<\epsilon\ll 1 , \gamma_{0}>0 , N>0 , 0<\rho<\sigma<1 . Step 0. Choose a random initial point {\bf z}_{0}=({\bf x}_{0}^{\top},{\bf y}_{0}^{\top})^{\top}\in\mathbb{R}^{m+n} . Compute g(\mathbf{z}_{0}) . If \|g({\bf z}_{0})\|\leq\epsilon , stop; otherwise, set {\bf d}_{0}=-\gamma_{0}g({\bf z}_{0}) and k=0 . Step 1. Determine the step size \alpha_{k}>0 satisfying ( 3.7 ) and ( 3.8 ). Step 2. Update {\bf z}_{k+1}={\bf z}_{k}+\alpha_{k}{\bf d}_{k} . If \|g({\bf z}_{k+1})\|\leq\epsilon , set {\bf z}_{k}={\bf z}_{k+1} , stop. Otherwise, calculate \xi_{k}=\sqrt{\|\mathbf{y}_{k+1}\|/\|\mathbf{x}_{k+1}\|} . Update \mathbf{x}_{k+1}\leftarrow\xi_{k}\mathbf{x}_{k+1} and \mathbf{y}_{k+1}\leftarrow(1/\xi_{k})\mathbf{y}_{k+1} . Go to Step 3. Step 3. Compute \gamma_{k+1} and \varphi_{(k+1)_{i}} satisfying ( 3.3 ), then compute \beta_{(k+1)_{i}} by ( 3.2 ). Step 4. Compute {\bf d}_{k+1} by ( 3.1 ). Set k\leftarrow k+1 and return to Step 1. Output: {\bf z}_{k}=\left({{\bf x}_{k}}^{\top},{{\bf y}_{k}}^{\top}\right)^{\top} . M-eigenvalue \lambda=({{\bf x}_{k}}^{\top}{\bf x}_{k})({{\bf y}_{K}}^{\top}{\bf y}_{k})-t ; associated left and right eigenvectors {\bf x}_{k}/\|{\bf x}_{k}\| and {\bf y}_{k}/\|{\bf y}_{k}\| . Remark 3.1 It is crucial to observe that the objective function \Phi(\mathbf{z}) is invariant under the transformation \mathbf{x}\to\xi\mathbf{x} and \mathbf{y}\to\xi^{-1}\mathbf{y} for any \xi\neq 0 . Consequently, the generated sequence \{\mathbf{z}_{k}\} could theoretically be unbounded where \|\mathbf{x}\|\to\infty and \|\mathbf{y}\|\to 0 . In Algorithm 2, the rescaling step restricts the iterates to satisfy \|\mathbf{x}\|=\|\mathbf{y}\| . This operation guarantees the compactness required for the convergence analysis (see Lemma 3.1 ) without altering the objective function value or the directions of the M-eigenvectors. To prove the global convergence of the proposed method, we first establish several key lemmas. Lemma 3.1 Let \{\mathbf{z}_{k}\} be the sequence generated by MGM. Then, the sequence \{\mathbf{z}_{k}\} is bounded. Specifically, there exist constants \eta_{1},\eta_{2}>0 such that \|\mathbf{x}_{k}\|\leq\eta_{1} and \|\mathbf{y}_{k}\|\leq\eta_{2} for all k\geq 0 . Proof. Since \{\mathbf{z}_{k}\} is generated by Algorithm 2, the descent property ensures \Phi(\mathbf{z}_{k})\leq\Phi(\mathbf{z}_{0}) for all k . Moreover, the algorithm enforces \|\mathbf{x}_{k}\|=\|\mathbf{y}_{k}\| . Let s_{k}=\|\mathbf{x}_{k}\|\|\mathbf{y}_{k}\| . It follows that \|\mathbf{x}_{k}\|^{2}=\|\mathbf{y}_{k}\|^{2}=s_{k} , and consequently \|\mathbf{z}_{k}\|^{2}=2s_{k} . Recall the objective function \Phi(\mathbf{z}) defined in ( 2.5 ) (which covers the original problem when t=0 ). \Phi(\mathbf{z}_{k})=\frac{1}{4}\|\mathbf{x}_{k}\|^{4}\|\mathbf{y}_{k}\|^{4}-\frac{1}{2}\mathcal{A}\mathbf{y}_{k}\mathbf{x}_{k}\mathbf{y}_{k}-\frac{t}{2}\|\mathbf{x}_{k}\|^{2}\|\mathbf{y}_{k}\|^{2}. By Theorem 2.1(1), |\mathcal{A}\mathbf{x}_{k}\mathbf{y}_{k}\mathbf{x}_{k}\mathbf{y}_{k}|\leq C\|\mathbf{x}_{k}\|^{2}\|\mathbf{y}_{k}\|^{2}=Cs_{k}^{2} for some constant C>0 . Consequently, \Phi(\mathbf{z}_{k})\geq\frac{1}{4}s_{k}^{4}-\frac{C}{2}s_{k}^{2}-\frac{t}{2}s_{k}^{2}=\frac{1}{4}s_{k}^{4}-\frac{C+t}{2}s_{k}^{2}. Suppose for contradiction that the sequence \{\mathbf{z}_{k}\} is unbounded. Then there exists a subsequence \{\mathbf{z}_{k_{j}}\} such that \|\mathbf{z}_{k_{j}}\|\to\infty as j\to\infty , which is equivalent to s_{k_{j}}\to\infty . Thus, we have \lim_{j\to\infty}\Phi(\mathbf{z}_{k_{j}})\geq\lim_{s_{k_{j}}\to\infty}\left(\frac{1}{4}s_{k_{j}}^{4}-\frac{C+t}{2}s_{k_{j}}^{2}\right)=+\infty. This implies that for sufficiently large j , \Phi(\mathbf{z}_{k_{j}})>\Phi(\mathbf{z}_{0}) , which leads to a contradiction. Therefore, the sequence \{\mathbf{z}_{k}\} is bounded. Consequently, there exist constants \eta_{1},\eta_{2}>0 such that \|\mathbf{x}_{k}\|\leq\eta_{1} and \|\mathbf{y}_{k}\|\leq\eta_{2} for all k\geq 0 . \Box For the subsequent convergence analysis, define \mathcal{D}=\left\{\mathbf{z}=(\mathbf{x}^{\top},\mathbf{y}^{\top})^{\top}\in\mathbb{R}^{m+n}\mid\|\mathbf{x}\|\leq\eta_{1},\|\mathbf{y}\|\leq\eta_{2}\right\}, (3.9) where \eta_{1} and \eta_{2} are constants from Lemma 3.1 . Lemma 3.2 If \mathcal{A}\in\mathbb{H}^{m\times n\times m\times n} , then \mathcal{A}\mathbf{y}\mathbf{x}\mathbf{y} and \mathcal{A}\mathbf{x}\mathbf{y}\mathbf{x} are Lipschitz continuous on \mathcal{D} . Proof. Let M=\max_{i,j,k,l}|a_{ijkl}| . First, we establish the Lipschitz continuity of \mathcal{A}{\bf y}{\bf x}{\bf y} . For any ({\bf x},{\bf y}),({\bf x}^{\prime},{\bf y})\in\mathcal{D} , we have \displaystyle\|\mathcal{A}\mathbf{y}\mathbf{x}\mathbf{y}-\mathcal{A}\mathbf{y}\mathbf{x}^{\prime}\mathbf{y}\| \displaystyle=\left\|\left(\sum_{k=1}^{m}\sum_{j,l=1}^{n}a_{ijkl}\,y_{j}\,(x_{k}-x_{k}^{\prime})\,y_{l}\right)_{i=1}^{m}\right\| (3.10) \displaystyle\leq\sqrt{m}M\sum_{j=1}^{n}|y_{j}|\sum_{l=1}^{n}|y_{l}|\sum_{k=1}^{m}|x_{k}-x_{k}^{\prime}| \displaystyle\leq\sqrt{m}M\left(\sqrt{n}\|\mathbf{y}\|\right)\left(\sqrt{n}\|\mathbf{y}\|\right)(\sqrt{m}\|\mathbf{x}-\mathbf{x}^{\prime}\|) \displaystyle\leq mnM\eta_{2}^{2}\|\mathbf{x}-\mathbf{x}^{\prime}\|=P_{1}\|\mathbf{x}-\mathbf{x}^{\prime}\|, where P_{1}=mnM\eta_{2}^{2} is a positive constant. Next, for (\mathbf{x}^{\prime},\mathbf{y}),(\mathbf{x}^{\prime},\mathbf{y}^{\prime})\in\mathcal{D} , utilizing the inequality |ab-a^{\prime}b^{\prime}|\leq|a||b-b^{\prime}|+|b^{\prime}||a-a^{\prime}| , we obtain \displaystyle\|\mathcal{A}\mathbf{y}\mathbf{x}^{\prime}\mathbf{y}-\mathcal{A}\mathbf{y}^{\prime}\mathbf{x}^{\prime}\mathbf{y}^{\prime}\| \displaystyle=\left\|\left(\sum_{k=1}^{m}\sum_{j,l=1}^{n}a_{ijkl}\,x^{\prime}_{k}\,(y_{j}y_{l}-y^{\prime}_{j}y^{\prime}_{l})\,\right)_{i=1}^{m}\right\| (3.11) \displaystyle\leq\sqrt{m}M\sum_{k=1}^{m}|x_{k}^{\prime}|\sum_{j,l=1}^{n}\left(|y_{j}||y_{l}-y_{l}^{\prime}|+|y_{l}^{\prime}||y_{j}-y_{j}^{\prime}|\right) \displaystyle\leq\sqrt{m}M\left(\sqrt{m}\eta_{1}\right)\left(2\sqrt{n}\eta_{2}\sqrt{n}\|\mathbf{y}-\mathbf{y}^{\prime}\|\right) \displaystyle=2mnM\eta_{1}\eta_{2}\|\mathbf{y}-\mathbf{y}^{\prime}\|=P_{2}\|\mathbf{y}-\mathbf{y}^{\prime}\|, where P_{2}=2mnM\eta_{1}\eta_{2} is a positive constant. Thus, \mathcal{A}{\bf y}{\bf x}{\bf y} is Lipschitz continuous with respect to both \mathbf{x} and \mathbf{y} . Similarly, we analyze \mathcal{A}\mathbf{x}\mathbf{y}\mathbf{x} . For (\mathbf{x},\mathbf{y}),(\mathbf{x}^{\prime},\mathbf{y})\in\mathcal{D} , it follows that \displaystyle\|\mathcal{A}{\bf x}{\bf y}{\bf x}-\mathcal{A}{\bf x}^{\prime}{\bf y}{\bf x}^{\prime}\| \displaystyle=\left\|\left(\sum_{i,k=1}^{m}\sum_{j=1}^{n}a_{ijkl}\,y_{j}\,(x_{i}x_{k}-x^{\prime}_{i}x_{k}^{\prime})\right)_{l=1}^{n}\right\| (3.12) \displaystyle\leq\sqrt{n}M\sum_{j=1}^{n}|y_{j}|\sum_{i,k=1}^{m}\left(|x_{k}||x_{i}-x_{i}^{\prime}|+|x_{i}^{\prime}||x_{k}-x_{k}^{\prime}|\right) \displaystyle\leq\sqrt{n}M\left(\sqrt{n}\eta_{2}\right)\left(2\sqrt{m}\eta_{1}\sqrt{m}\|\mathbf{x}-\mathbf{x}^{\prime}\|\right) \displaystyle=P_{2}\|\mathbf{x}-\mathbf{x}^{\prime}\|. For ({\bf x}^{\prime},{\bf y}),({\bf x}^{\prime},{\bf y}^{\prime})\in\mathcal{D} , it holds that \displaystyle\|\mathcal{A}{\bf x}^{\prime}{\bf y}{\bf x}^{\prime}-\mathcal{A}{\bf x}^{\prime}{\bf y}^{\prime}{\bf x}^{\prime}\| \displaystyle=\left\|\left(\sum_{i,k=1}^{m}\sum_{j=1}^{n}a_{ijkl}\,x^{\prime}_{i}\,(y_{j}-y_{j}^{\prime})x^{\prime}_{k}\right)_{l=1}^{n}\right\| (3.13) \displaystyle\leq\sqrt{n}M\sum_{i,k=1}^{m}|x_{i}^{\prime}x_{k}^{\prime}|\sum_{j=1}^{n}|y_{j}-y_{j}^{\prime}| \displaystyle\leq\sqrt{n}M\left(m\eta_{1}^{2}\right)\left(\sqrt{n}\|\mathbf{y}-\mathbf{y}^{\prime}\|\right) \displaystyle=mnM\eta_{1}^{2}\|\mathbf{y}-\mathbf{y}^{\prime}\|=P_{3}\|\mathbf{y}-\mathbf{y}^{\prime}\|, where P_{3}=mnM\eta_{1}^{2} is a positive constant. By ( 3.10 )-( 3.13 ), we conclude that both \mathcal{A}{\bf y}{\bf x}{\bf y} and \mathcal{A}{\bf x}{\bf y}{\bf x} are Lipschitz continuous on \mathcal{D} . \Box Lemma 3.3 Let \mathcal{A}\in\mathbb{H}^{m\times n\times m\times n} . Then, the gradient g_{t}(\mathbf{z}) of the shifted problem (2.5) is Lipschitz continuous on \mathcal{D} . Specifically, there exists a positive constant L_{t} such that for all \mathbf{z},\mathbf{z}^{\prime}\in\mathcal{D} , the following inequality holds \|g_{t}(\mathbf{z})-g_{t}(\mathbf{z}^{\prime})\|\leq L_{t}\|\mathbf{z}-\mathbf{z}^{\prime}\|. (3.14) In particular, when t=0 , the same conclusion holds for ( 2.1 ). Proof. First, we estimate the Lipschitz constant for g_{t_{1}}({\bf x},{\bf y}) , it follows from ( 2.6 ) and Lemma 3.1 that for all ({\bf x},{\bf y}) , ({\bf x}^{\prime},{\bf y}^{\prime})\in\Omega , we have \displaystyle\|g_{t_{1}}({\bf x},{\bf y})-g_{t_{1}}({\bf x}^{\prime},{\bf y})\| \displaystyle= \displaystyle\|({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})^{2}{\bf x}-\mathcal{A}{\bf y}{\bf x}{\bf y}-t({\bf y}^{\top}{\bf y}){\bf x}-({\bf x}^{\prime\top}{\bf x}^{\prime})({\bf y}^{\top}{\bf y})^{2}{\bf x}^{\prime}+\mathcal{A}{\bf y}{\bf x}^{\prime}{\bf y}+t({\bf y}^{\top}{\bf y}){\bf x}^{\prime}\| \displaystyle\leq \displaystyle\|\mathcal{A}{\bf y}{\bf x}{\bf y}-\mathcal{A}{\bf y}{\bf x}^{\prime}{\bf y}\|+\|({\bf x}^{\top}{\bf x})({\bf y}^{\top}{\bf y})^{2}{\bf x}-({\bf x}^{\prime\top}{\bf x}^{\prime})({\bf y}^{\top}{\bf y})^{2}{\bf x}^{\prime}\|+\|t({\bf y}^{\top}{\bf y}){\bf x}^{\prime}-t({\bf y}^{\top}{\bf y}){\bf x}^{\prime}\| \displaystyle\leq \displaystyle P_{1}\|{\bf x}-{\bf x}^{\prime}\|+\|{\bf y}\|^{4}\|({\bf x}^{\top}{\bf x}){\bf x}-({\bf x}^{\top}{\bf x}){\bf x}^{\prime}+({\bf x}^{\top}{\bf x}){\bf x}^{\prime}-({\bf x}^{\prime\top}{\bf x}^{\prime}){\bf x}^{\prime}\|+|t|\|{\bf y}\|^{2}\|{\bf x}-{\bf x}^{\prime}\| \displaystyle\leq \displaystyle P_{1}\|{\bf x}-{\bf x}^{\prime}\|+\|{\bf y}\|^{4}\left(\|{\bf x}\|^{2}\|{\bf x}-{\bf x}^{\prime}\|+(\|{\bf x}\|+\|{\bf x}^{\prime}\|)\|{\bf x}^{\prime}\|(\|{\bf x}\|-\|{\bf x}^{\prime}\|)\right)+|t|\|{\bf y}\|^{2}\|{\bf x}-{\bf x}^{\prime}\| \displaystyle\leq \displaystyle\left(P_{1}+\eta_{2}^{4}(\eta_{1}^{2}+\eta_{1}(\eta_{1}+\eta_{1}))+t\eta_{2}^{2}\right)\|\mathbf{x}-\mathbf{x}^{\prime}\| \displaystyle= \displaystyle L_{11}\|{\bf x}-{\bf x}^{\prime}\| where L_{11}=P_{1}+3\eta_{1}^{2}\eta_{2}^{4}+t\eta_{2}^{2} is a positive constant. \displaystyle\|g_{t_{1}}({\bf x}^{\prime},{\bf y})-g_{t_{1}}({\bf x}^{\prime},{\bf y}^{\prime})\| \displaystyle= \displaystyle\|({\bf x}^{\prime\top}{\bf x}^{\prime})({\bf y}^{\top}{\bf y})^{2}{\bf x}^{\prime}-\mathcal{A}{\bf y}{\bf x}^{\prime}{\bf y}-t({\bf y}^{\top}{\bf y}){\bf x}^{\prime}-({\bf x}^{\prime\top}{\bf x}^{\prime})({\bf y}^{\prime\top}{\bf y}^{\prime})^{2}{\bf x}^{\prime}+\mathcal{A}{\bf y}^{\prime}{\bf x}^{\prime}{\bf y}^{\prime}+t({\bf y}^{\prime\top}{\bf y}^{\prime}){\bf x}^{\prime}\| \displaystyle\leq \displaystyle\|\mathcal{A}{\bf y}{\bf x}^{\prime}{\bf y}-\mathcal{A}{\bf y}^{\prime}{\bf x}^{\prime}{\bf y}^{\prime}\|+\|({\bf x}^{\prime\top}{\bf x}^{\prime})({\bf y}^{\top}{\bf y})^{2}{\bf x}^{\prime}-({\bf x}^{\prime\top}{\bf x}^{\prime})({\bf y}^{\prime\top}{\bf y}^{\prime})^{2}{\bf x}^{\prime}\|+\|t({\bf y}^{\top}{\bf y}){\bf x}^{\prime}-t({\bf y}^{\prime\top}{\bf y}^{\prime}){\bf x}^{\prime}\| \displaystyle\leq \displaystyle P_{2}\|{\bf y}-{\bf y}^{\prime}\|+\|{\bf x}^{\prime}\|^{3}\|({\bf y}^{\top}{\bf y})^{2}-({\bf y}^{\prime\top}{\bf y}^{\prime})^{2}\|+\|t{\bf x}^{\prime}\|\|{\bf y}^{\top}{\bf y}-{\bf y}^{\prime\top}{\bf y}^{\prime}\| \displaystyle\leq \displaystyle P_{2}\|{\bf y}-{\bf y}^{\prime}\|+\|{\bf x}^{\prime}\|^{3}(\|{\bf y}\|^{2}+\|{\bf y}^{\prime}\|^{2})(\|{\bf y}\|+\|{\bf y}^{\prime}\|)\|{\bf y}-{\bf y}^{\prime}\|+t\|{\bf x}^{\prime}\|\|{\bf y}+{\bf y}^{\prime}\|\|{\bf y}-{\bf y}^{\prime}\| \displaystyle\leq \displaystyle\left(P_{2}+4\eta_{1}^{3}\eta_{2}^{3}+2t\eta_{1}\eta_{2}\right)\|\mathbf{y}-\mathbf{y}^{\prime}\|=L_{12}\|\mathbf{y}-\mathbf{y}^{\prime}\|. Therefore, it holds that \displaystyle\|g_{t_{1}}({\bf x},{\bf y})-g_{t_{1}}({\bf x}^{\prime},{\bf y}^{\prime})\| \displaystyle=\|g_{t_{1}}({\bf x},{\bf y})-g_{t_{1}}({\bf x}^{\prime},{\bf y})+g_{t_{1}}({\bf x}^{\prime},{\bf y})-g_{t_{1}}({\bf x}^{\prime},{\bf y}^{\prime})\| (3.15) \displaystyle\leq\|g_{t_{1}}({\bf x},{\bf y})-g_{t_{1}}({\bf x}^{\prime},{\bf y}^{\prime})\|+\|g_{t_{1}}({\bf x}^{\prime},{\bf y})-g_{t_{1}}({\bf x}^{\prime},{\bf y}^{\prime})\| \displaystyle\leq L_{11}\|{\bf x}-{\bf x}^{\prime}\|+L_{12}\|{\bf y}-{\bf y}^{\prime}\|. Similarly, we estimate the Lipschitz constant for g_{t_{2}}({\bf x},{\bf y}) . From ( 2.7 ) and Lemma 3.1 , we have \displaystyle\|g_{t_{2}}({\bf x},{\bf y})-g_{t_{2}}({\bf x}^{\prime},{\bf y})\| \displaystyle= \displaystyle\|({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y}){\bf y}-\mathcal{A}{\bf x}{\bf y}{\bf x}-t({\bf x}^{\top}{\bf x}){\bf y}-({\bf x}^{\prime\top}{\bf x}^{\prime})^{2}({\bf y}^{\top}{\bf y}){\bf y}+\mathcal{A}{\bf x}^{\prime}{\bf y}{\bf x}^{\prime}+t({\bf x}^{\prime\top}{\bf x}^{\prime}){\bf y}\| \displaystyle\leq \displaystyle\|\mathcal{A}{\bf x}{\bf y}{\bf x}-\mathcal{A}{\bf x}^{\prime}{\bf y}{\bf x}^{\prime}\|+\|({\bf x}^{\top}{\bf x})^{2}({\bf y}^{\top}{\bf y}){\bf y}-({\bf x}^{\prime\top}{\bf x}^{\prime})^{2}({\bf y}^{\top}{\bf y}){\bf y}\|+\|t({\bf x}^{\top}{\bf x}){\bf y}-t({\bf x}^{\prime\top}{\bf x}^{\prime}){\bf y}\| \displaystyle\leq \displaystyle P_{2}\|{\bf x}-{\bf x}^{\prime}\|+\|{\bf y}\|^{3}\left(\|{\bf x}\|^{2}+\|{\bf x}^{\prime}\|^{2}\right)(\|{\bf x}\|+\|{\bf x}^{\prime}\|)\|{\bf x}-{\bf x}^{\prime}\|+t\|{\bf y}\|(\|{\bf x}\|+\|{\bf x}^{\prime}\|)\|{\bf x}-{\bf x}^{\prime}\| \displaystyle= \displaystyle L_{21}\|{\bf x}-{\bf x}^{\prime}\|, where L_{21}=P_{2}+4\sqrt{n}\eta_{1}^{3}\eta_{2}^{3}+2t\eta_{1}\eta_{2} is a positive constant. \displaystyle\|g_{t_{2}}({\bf x}^{\prime},{\bf y})-g_{t_{2}}({\bf x}^{\prime},{\bf y}^{\prime})\| \displaystyle= \displaystyle\|({\bf x}^{\prime\top}{\bf x}^{\prime})^{2}({\bf y}^{\top}{\bf y}){\bf y}-\mathcal{A}{\bf x}^{\prime}{\bf y}{\bf x}^{\prime}-t({\bf x}^{\prime\top}{\bf x}^{\prime}){\bf y}-({\bf x}^{\prime\top}{\bf x}^{\prime})^{2}({\bf y}^{\prime\top}{\bf y}^{\prime}){\bf y}^{\prime}+\mathcal{A}{\bf x}^{\prime}{\bf y}^{\prime}{\bf x}^{\prime}+t({\bf x}^{\prime\top}{\bf x}^{\prime}){\bf y}^{\prime}\| \displaystyle\leq \displaystyle\|\mathcal{A}{\bf x}^{\prime}{\bf y}{\bf x}^{\prime}-\mathcal{A}{\bf x}^{\prime}{\bf y}^{\prime}{\bf x}^{\prime}\|+\|({\bf x}^{\prime\top}{\bf x}^{\prime})^{2}({\bf y}^{\top}{\bf y}){\bf y}-({\bf x}^{\prime\top}{\bf x}^{\prime})^{2}({\bf y}^{\prime\top}{\bf y}^{\prime}){\bf y}^{\prime}\|+\|t({\bf x}^{\prime\top}{\bf x}^{\prime}){\bf y}-t({\bf x}^{\prime\top}{\bf x}^{\prime}){\bf y}^{\prime}\| \displaystyle\leq \displaystyle P_{3}\|{\bf y}-{\bf y}^{\prime}\|+\|{\bf x}^{\prime}\|^{4}\left(\|{\bf y}\|^{2}\|{\bf y}-{\bf y}^{\prime}\|+(\|{\bf y}\|+\|{\bf y}^{\prime}\|)\|{\bf y}^{\prime}\|(\|{\bf y}-{\bf y}^{\prime}\|)\right)+t\|{\bf x}^{\prime}\|^{2}\|{\bf y}-{\bf y}^{\prime}\| \displaystyle= \displaystyle L_{22}\|{\bf y}-{\bf y}^{\prime}\|, where L_{22}=P_{3}+3\eta_{1}^{4}\eta_{2}^{2}+t\eta_{1}^{2} is a positive constant. Therefore, it holds that \displaystyle\|g_{t_{2}}({\bf x},{\bf y})-g_{t_{2}}({\bf x}^{\prime},{\bf y}^{\prime})\| \displaystyle=\|g_{t_{2}}({\bf x},{\bf y})-g_{t_{2}}({\bf x}^{\prime},{\bf y})+g_{t_{2}}({\bf x}^{\prime},{\bf y})-g_{t_{2}}({\bf x}^{\prime},{\bf y}^{\prime})\| (3.16) \displaystyle\leq\|g_{t_{2}}({\bf x},{\bf y})-g_{t_{2}}({\bf x}^{\prime},{\bf y}^{\prime})\|+\|g_{t_{2}}({\bf x}^{\prime},{\bf y})-g_{t_{2}}({\bf x}^{\prime},{\bf y}^{\prime})\| \displaystyle\leq L_{21}\|{\bf x}-{\bf x}^{\prime}\|+L_{22}\|{\bf y}-{\bf y}^{\prime}\|. Combining the above, let M_{1}=\sqrt{2L_{11}^{2}+2L_{21}^{2}} and M_{2}=\sqrt{2L_{12}^{2}+2L_{22}^{2}} . Using the inequality (a+b)^{2}\leq 2(a^{2}+b^{2}) , we have \displaystyle\|g_{t}(\mathbf{z})-g_{t}(\mathbf{z}^{\prime})\|^{2} \displaystyle=\|g_{t_{1}}(\mathbf{z})-g_{t_{1}}(\mathbf{z}^{\prime})\|^{2}+\|g_{t_{2}}(\mathbf{z})-g_{t_{2}}(\mathbf{z}^{\prime})\|^{2} \displaystyle\leq 2\left(L_{11}^{2}+L_{21}^{2}\right)\|\mathbf{x}-\mathbf{x}^{\prime}\|^{2}+2\left(L_{12}^{2}+L_{22}^{2}\right)\|\mathbf{y}-\mathbf{y}^{\prime}\|^{2} \displaystyle\leq\max\left(M_{1}^{2},M_{2}^{2}\right)\left(\|\mathbf{x}-\mathbf{x}^{\prime}\|^{2}+\|\mathbf{y}-\mathbf{y}^{\prime}\|^{2}\right) \displaystyle=L_{t}^{2}\|\mathbf{z}-\mathbf{z}^{\prime}\|^{2}. Taking the square root completes the proof with L_{t}=\max\left(M_{1},M_{2}\right) . \Box Based on the lemmas established above, we now state the following well-known lemma which was proved by Zoutendijk [ 53 ] , which applies to general iterative methods. Lemma 3.4 Let the sequences \{{\bf z}_{k}\} and \{{\bf d}_{k}\} be generated by MGM. Then, \sum_{k=0}^{\infty}\frac{\left(g({\bf z}_{k})^{\top}{\bf d}_{k}\right)^{2}}{\|{\bf d}_{k}\|^{2}}<\infty. Proof. From the Wolfe line search condition ( 3.8 ) and Lemma 3.3 , it follows that (\sigma-1)g({\bf z}_{k})^{\top}{\bf d}_{k}\leq\left(g({\bf z}_{k+1})-g({\bf z}_{k})\right)^{\top}{\bf d}_{k}\leq L_{t}\alpha_{k}\|{\bf d}_{k}\|^{2}, which implies that \alpha_{k}\geq\frac{(\sigma-1)g({\bf z}_{k})^{\top}{\bf d}_{k}}{L\|{\bf d}_{k}\|^{2}}. Given that g({\bf z}_{k})^{\top}{\bf d}_{k}<0 , it follows from ( 3.7 ) that \Phi(\mathbf{z}_{k+1})-\Phi(\mathbf{z}_{k})\leq\rho\alpha_{k}g(\mathbf{z}_{k})^{\top}\mathbf{d}_{k}\leq\frac{\rho(\sigma-1)}{L_{t}}\frac{\left(g(\mathbf{z}_{k})^{\top}\mathbf{d}_{k}\right)^{2}}{\|\mathbf{d}_{k}\|^{2}}. (3.17) It follows from ( 3.17 ) that the sequence \{\Phi({\bf z}_{k})\} is non-increasing. Moreover, by Theorem 2.1 , \Phi({\bf z}_{k}) is bounded below. Thus, \{\Phi({\bf z}_{k})\} converges. By taking a series for both sides of ( 3.17 ), it holds that \sum_{k=0}^{\infty}\frac{\left(g({\bf z}_{k})^{\top}{\bf d}_{k}\right)^{2}}{\|{\bf d}_{k}\|^{2}}<\infty. \Box By Lemma 3.4 , we establish the following theorem. Theorem 3.3 Let the sequence \{{\bf z}_{k}\} be generated by MGM. Then, the method either terminates at a stationary point or converges in the sense that \liminf\limits_{k\to\infty}\|g({\bf z}_{k})\|=0 (3.18) Proof. From ( 3.3 ), it follows that \displaystyle\sum_{i=1}^{N}\left(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i}\right)\beta_{k_{i}} \displaystyle>(\gamma_{k}\varphi_{k_{1}}-\gamma_{k}\varphi_{k_{1}})\beta_{k_{1}}+\sum_{i=2}^{N}\left(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i}\right)\beta_{k_{i}} \displaystyle\geq\sum_{i=2}^{N}(\gamma_{k}\varphi_{k_{i}}-\gamma_{k}\varphi_{k_{i}})\beta_{k_{i}}=0. Since all the assumptions of Theorem 3.1 are satisfied, search directions are descent, which implies that g({\bf z}_{k})^{\top}{\bf d}_{k}<0\quad\text{for all }k. Therefore, it follows from ( 3.1 ) and ( 3.2 ) that \displaystyle\left|g({\bf z}_{k})^{\top}{\bf d}_{k}\right| \displaystyle=-g({\bf z}_{k})^{\top}{\bf d}_{k} (3.19) \displaystyle=\gamma_{k}\|g({\bf z}_{k})\|^{2}-\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}g({\bf z}_{k})^{\top}{\bf d}_{k-i} \displaystyle=\frac{1}{N}\sum_{i=1}^{N}\left(\gamma_{k}\|g({\bf z}_{k})\|^{2}-\beta_{k_{i}}g({\bf z}_{k})^{\top}{\bf d}_{k-i}\right) \displaystyle=\frac{1}{N}\sum_{i=1}^{N}\left(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i}\right)\beta_{k_{i}}>0. Rewrite ( 3.2 ) as {\bf d}_{k}+\gamma_{k}g({\bf z}_{k})=\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}{\bf d}_{k-i}. Squaring both sides and simplifying \|{\bf d}_{k}\|^{2}=\left\|\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}{\bf d}_{k-i}\right\|^{2}-2\gamma_{k}g({\bf z}_{k})^{\top}{\bf d}_{k}-\gamma_{k}^{2}\|g({\bf z}_{k})\|^{2}. Dividing both sides by \left(g({\bf z}_{k})^{\top}{\bf d}_{k}\right)^{2} and applying ( 3.19 ), it holds that \displaystyle\frac{\|{\bf d}_{k}\|^{2}}{\left(g({\bf z}_{k})^{\top}{\bf d}_{k}\right)^{2}} \displaystyle=\frac{\left\|\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}{\bf d}_{k-i}\right\|^{2}}{\left(g({\bf z}_{k})^{\top}{\bf d}_{k}\right)^{2}}-2\gamma_{k}\frac{g({\bf z}_{k})^{\top}{\bf d}_{k}}{\left(g({\bf z}_{k})^{\top}{\bf d}_{k}\right)^{2}}-\gamma_{k}^{2}\frac{\|g({\bf z}_{k})\|^{2}}{(g({\bf z}_{k})^{\top}{\bf d}_{k})^{2}} (3.20) \displaystyle=\frac{\left\|\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}{\bf d}_{k-i}\right\|^{2}}{(g({\bf z}_{k})^{\top}{\bf d}_{k})^{2}}-\frac{2\gamma_{k}}{g({\bf z}_{k})^{\top}{\bf d}_{k}}-\gamma_{k}^{2}\frac{\|g({\bf z}_{k})\|^{2}}{(g({\bf z}_{k})^{\top}{\bf d}_{k})^{2}} \displaystyle=\frac{\left\|\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}{\bf d}_{k-i}\right\|^{2}}{(g({\bf z}_{k})^{\top}{\bf d}_{k})^{2}}-\left(\frac{1}{\|g({\bf z}_{k})\|}+\gamma_{k}\frac{\|g({\bf z}_{k})\|}{g({\bf z}_{k})^{\top}{\bf d}_{k}}\right)^{2}+\frac{1}{\|g({\bf z}_{k})\|^{2}} \displaystyle\leq\frac{\left\|\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}{\bf d}_{k-i}\right\|^{2}}{(g({\bf z}_{k})^{\top}{\bf d}_{k})^{2}}+\frac{1}{\|g({\bf z}_{k})\|^{2}} \displaystyle=\left(\frac{\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}\|{\bf d}_{k-i}\|}{\frac{1}{N}\sum_{i=1}^{N}\beta_{k_{i}}(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i})}\right)^{2}+\frac{1}{\|g({\bf z}_{k})\|^{2}}. Noting that \gamma_{k}\varphi_{k_{i}}\geq g({\bf z}_{k})^{\top}{\bf d}_{k-i}+\|g({\bf z}_{k})\|\|{\bf d}_{k-i}\| and multiplying this by \beta_{k_{i}}\geq 0 , we have \beta_{k_{i}}\left(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i}\right)\geq\beta_{k_{i}}\|g({\bf z}_{k})\|\|{\bf d}_{k-i}\|. Summing the above inequality over i , we obtain \sum_{i=1}^{N}\beta_{k_{i}}\left(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i}\right)\geq\|g({\bf z}_{k})\|\sum_{i=1}^{N}\beta_{k_{i}}\|{\bf d}_{k-i}\|. It follows from ( 3.19 ) that \sum_{i=1}^{N}\beta_{k_{i}}(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i})>0 , and we obtain \frac{\sum_{i=1}^{N}\beta_{k_{i}}\|{\bf d}_{k-i}\|}{\sum_{i=1}^{N}\beta_{k_{i}}(\gamma_{k}\varphi_{k_{i}}-g({\bf z}_{k})^{\top}{\bf d}_{k-i})}\leq\frac{1}{\|g({\bf z}_{k})\|}. (3.21) By ( 3.20 ) and ( 3.21 ), we have \frac{\|{\bf d}_{k}\|^{2}}{\left(g_{1}({\bf x}_{k},{\bf y}_{k})^{\top}{\bf d}_{k}\right)^{2}}\leq\frac{1}{\|g({\bf z}_{k})\|^{2}}+\frac{1}{\|g({\bf z}_{k})\|^{2}}=\frac{2}{\|g({\bf z}_{k})\|^{2}}\quad\text{for all }k. (3.22) If ( 3.18 ) is not true, there exists a constant c_{1}>0 such that \|g({\bf z}_{k})\|\geq c_{1}\quad\text{for all }k. (3.23) Therefore, it follows from ( 3.22 ) and ( 3.23 ) that \frac{(g({\bf z}_{k})^{\top}{\bf d}_{k})^{2}}{\|{\bf d}_{k}\|^{2}}\geq\frac{c_{1}^{2}}{2}. Thus, we obtain \sum_{k=0}^{\infty}\frac{\left(g({\bf z}_{k})^{\top}{\bf d}_{k}\right)^{2}}{\|{\bf d}_{k}\|^{2}}=\infty. This contradicts Lemma 3.4 , confirming that ( 3.18 ) holds. \Box This theorem implies that for any choices of \gamma_{k},\varphi_{k_{i}} ( i=1,\ldots,N ) satisfy condition ( 3.6 ), global convergence of our method is achieved. 4 Numerical results In this section, we conduct some computational experiments to evaluate the efficacy and stability of the proposed method for solving problem ( 2.1 ) or ( 2.5 ). We compare the MGM method with the SS-HOPM in [ 47 ] and the SIPM in [ 46 ] , which have been reported to be efficient for unconstrained optimization. All numerical experiments were implemented in MATLAB 9.0 on a personal computer with AMD Ryzen 7 4800H CPU 2.90GHz and 16 GB random-access memory (RAM). As established in Theorem 3.2 , the global convergence of the method is guaranteed for any parameters \gamma_{k},\varphi_{k_{i}} satisfying conditions ( 3.6 ). In our experiments, we first selected \gamma_{k} , and then determined corresponding values of \varphi_{k_{i}} for i=1,\ldots,N such that ( 3.6 ) holds. For all methods, we set \bar{\gamma}=10^{-15} . In particular, we adopted the following two choices for \gamma_{k} . (i) \gamma_{k}=1 for all k ; (ii) \gamma_{0}=1 , and for k\geq 1 \displaystyle\gamma_{k} \displaystyle=\begin{cases}1,&\text{if }~\dfrac{{\bf w}_{k-1}^{\top}{\bf s}_{k-1}}{{\bf w}_{k-1}^{\top}{\bf w}_{k-1}}<\bar{\gamma},\\ \dfrac{{\bf w}_{k-1}^{\top}{\bf s}_{k-1}}{{\bf w}_{k-1}^{\top}{\bf w}_{k-1}},&\text{otherwise}.\end{cases} To clarify the adaptive rules, we define {\bf s}_{k-1}={\bf z}_{k}-{\bf z}_{k-1},{\bf t}_{k-1}=g({\bf z}_{k})-g({\bf z}_{k-1}). The modified vectors are defined as {\bf w}_{k-1}={\bf t}_{k-1}+\frac{\theta_{k-1}}{{\bf s}_{k-1}^{\top}\boldsymbol{\xi}_{k-1}}, where \boldsymbol{\xi}_{k-1} is any vectors satisfying {\bf s}_{k-1}^{\top}\boldsymbol{\xi}_{k-1}\neq 0 , ensuring that the division is well-defined. The history-dependent correction coefficient is given by \theta_{k-1}=6(f({\bf z}_{k})-f({\bf z}_{k-1}))+3(g({\bf z}_{k})-g({\bf z}_{k-1}))^{\top}{\bf s}_{k-1}. The choice of \gamma_{k} in (ii) is motivated by the sizing technique of the modified secant condition introduced by Zhang et al. [ 51 , 52 ] . For a given \gamma_{k} , we define \varphi_{k_{i}} for i=1,\ldots,N as follows \varphi_{k_{i}}=\dfrac{\|g({\bf z}_{k})\|\|{\bf d}_{k-i}\|+g({\bf z}_{k})^{\top}{\bf d}_{k-i}+m+n}{\gamma_{k}}. This choice of \varphi_{k_{i}} satisfies condition ( 3.6 ). We denote the MGM method with \gamma_{k} from (i) and (ii) as MGM-1 and MGM-2, respectively. In the implementation of the MGM algorithm, we set parameters \epsilon=10^{-6},\rho=0.1,\sigma=0.5 . The maximum number of allowed outer iterations was set to 2000. 4.1 Analysis of \gamma_{k} and N To evaluate the impact of \gamma_{k} on algorithmic performance, we consider the number of iterations and CPU time as key metrics. We employ the performance profile introduced by [ 13 ] by Dolan and Mor \acute{e} to analyze the performance of the MGM. Let Y and W be the sets of methods and test problems, n_{y},n_{w} be the number of methods and test problems, respectively. The performance profile \phi:\mathbb{R}\to[0,1] is defined for each y\in Y and w\in W such that b_{w,y}>0 represents the number of iterations (or CPU time) required to solve problem w by method y . Furthermore, the performance profile is given by \phi_{y}(\tau)=\frac{1}{n_{w}}size\left\{w\in W:r_{w,y}\leq\tau\right\}, where \tau>0 , \text{size}\{\cdot\} denotes the number of elements in a set, and r_{w,y} is the performance ratio defined as: r_{w,y}=\frac{b_{w,y}}{\min\left\{b_{w,y}:y\in Y\right\}}. Therefore, the performance profile is visualized by plotting the cumulative distribution function \phi_{y} . Notably, \phi_{y}(1) indicates the probability that the solver outperforms all other solvers. The right side of the image for \phi_{y} shows the robustness associated with a solver. To discuss the impact of the choice of \gamma_{k} on algorithm performance, we compare MGM-1 and MGM-2 based on the number of iterations and CPU time for the same value of N . We test them with values N=1,3,5,7,9 . (a) Iterations (b) CPU time Figure 1 : Performance profiles for MGM-1 and MGM-2 under the same N value. Figure 1 presents the performance profiles based on the number of iterations and CPU time. The results indicate that the performance of our methods is influenced by the parameters \gamma_{k} for the same value of N . To study how a selection of N value in MGM-1 and MGM-2 affect numerical performance, we conducted tests with N=1,3,5,7,9 . (a) Iterations (b) CPU time Figure 2 : Performance profiles for MGM-1 with different N values. (c) Iterations (d) CPU time Figure 3 : Performance profiles for MGM-2 with different N values. Figures 2 and 3 illustrate the performance profiles of MGM-1 and MGM-2 in terms of the number of iterations and CPU time, respectively. The results indicate that both MGM-1 and MGM-2 exhibit varying performance across different ranges depending on the chosen N values. Therefore, the performance of MGM-1 and MGM-2 relies on the selection of parameter N . While it is challenging to determine the optimal choice theoretically, our experiments suggest that N=3 for MGM-1 and N=1 for MGM-2 provide relatively robust performance. 4.2 Analysis of all compared algorithms In this subsection, we present the results for SIPM, SS-HOPM, MGM-1 with N=3 and MGM-2 with N=1 to verify the performance of our method. In Table 1, “iter” denotes the number of iterations, “time” represents the average CPU time by algorithms in seconds, “ \lambda^{\ast} ”indicates the largest M-eigenvalue outputted by algorithms. Example 4.1 Let \mathcal{A}=(a_{ijkl})\in\mathbb{H}^{2\times 2\times 2\times 2} be a hierarchically symmetric tensor, whose entries are \displaystyle a_{1111} \displaystyle=2,\quad a_{1211}=3,\quad a_{2111}=6,\quad a_{1121}=6,\quad a_{1112}=3,\quad a_{1212}=2, \displaystyle a_{2212} \displaystyle=10,\quad a_{1222}=10,\quad a_{2222}=5, and other a_{ijkl}=0 . Example 4.2 Consider the hierarchically symmetric tensor \mathcal{A}=(a_{ijk\ell})\in\mathbb{H}^{3\times 3\times 3\times 3} with \displaystyle a_{2222}=a_{1111} \displaystyle=196.6,\quad a_{3311}=a_{2233}=83.2,\quad a_{2323}=a_{2322}=a_{3131}=a_{1331}=54.7, \displaystyle a_{2233}=a_{2323} \displaystyle=-a_{1213}=-a_{2131}=-31.7,\quad a_{3333}=110,\quad a_{2121}=a_{2121}=64.4, \displaystyle a_{2321}=a_{1232} \displaystyle=-a_{1331}=-a_{1331}=-25.3,\quad a_{3112}=a_{1321}=44.8, \displaystyle a_{2132}=a_{1223} \displaystyle=-35.84,\quad a_{1122}=132.2, and other a_{ijk\ell}=0 . Example 4.3 Consider the tensor whose entries are uniformly generated in (-1,1) : {\cal A}(:,:,1,1)=\begin{pmatrix}-0.9727&0.3169&-0.3437\\ -0.6332&-0.7866&0.4257\\ -0.3350&-0.9896&-0.4323\end{pmatrix}, {\cal A}(:,:,2,1)=\begin{pmatrix}-0.6332&-0.7866&0.4257\\ 0.7387&0.6873&-0.3248\\ -0.7986&-0.5988&-0.9485\end{pmatrix}, {\cal A}(:,:,3,1)=\begin{pmatrix}-0.3350&-0.9896&-0.4323\\ -0.7986&-0.5988&-0.9485\\ 0.5853&0.5921&0.6301\end{pmatrix}, {\cal A}(:,:,1,2)=\begin{pmatrix}0.3169&0.6158&-0.0184\\ -0.7866&0.0160&0.0085\\ -0.9896&-0.6663&0.2559\end{pmatrix}, {\cal A}(:,:,2,2)=\begin{pmatrix}-0.7866&0.0160&0.0085\\ 0.6873&0.5160&-0.0216\\ -0.5988&0.0411&0.9857\end{pmatrix}, {\cal A}(:,:,3,2)=\begin{pmatrix}-0.9896&-0.6663&0.2559\\ -0.5988&0.0411&0.9857\\ 0.5921&-0.2907&-0.3881\end{pmatrix}, {\cal A}(:,:,1,3)=\begin{pmatrix}-0.3437&-0.0184&0.5649\\ 0.4257&0.0085&-0.1439\\ -0.4323&0.2559&0.6162\end{pmatrix}, {\cal A}(:,:,2,3)=\begin{pmatrix}0.4257&0.0085&-0.1439\\ -0.3248&-0.0216&-0.0037\\ -0.9485&0.9857&-0.7734\end{pmatrix}, {\cal A}(:,:,3,3)=\begin{pmatrix}-0.4323&0.2559&0.6162\\ -0.9485&0.9857&-0.7734\\ 0.6301&-0.3881&-0.8526\end{pmatrix}. Table 1 : The numerical results of Examples 4.1 - 4.3 . MGM-1 MGM-2 SIPM SS-HOPM Example \lambda^{\ast} iter/time iter/time iter/time iter/time 4.1 13.8616 5/0.0312 10/0.0899 11/0.0595 15/0.1286 4.2 318 11/0.0236 25/0.0521 34/0.0677 40/0.1459 4.3 2.3227 10/0.1233 29/0.2221 30/0.2767 35/0.3292 Table 1 demonstrates the superior performance of MGM-1 for computing M-eigenvalues for Examples 4.1 - 4.3 . MGM-1 demonstrates significantly faster convergence compared to other methods, achieving fewer iterations and lower computational costs. Example 4.4 Suppose that \mathcal{A}\in\mathbb{R}^{n\times n\times n\times n} is a hierarchically symmetric tensor with entries uniformly generated in (0,1), i.e., \mathcal{A}\sim U(0,1) . Since the elements are generated in a random way, we investigate the averaged performance of the four methods by generating 10 groups of data for each case. Specifically, we investigate six cases on the problems’ dimension, i.e., n=\{5,10,15,20,25,30\} . All methods start with the same random vectors, which are drawn from a standard normal distribution. (a) M-eigenvalues (b) CPU time Figure 4 : Full performance of both MGM-1, MGM-2, SIPM and SS-HOPM in terms of the averaged values and standard derivation of 10 random tests. Figure 4 shows the averaged M-eigenvalues and the CPU time, represented by solid lines. The shaded regions, colored accordingly, represent the distribution of values over 10 random experiments, with the width of the shaded regions indicating the standard deviation. A wider shaded region suggests a more unstable performance of the method. The two plots in Figure 4 sufficiently support that the MGM-1 performs quite stable. Example 4.5 Let \mathcal{A}\in\mathbb{R}^{m\times n\times m\times n} be a hierarchically symmetric tensor generated randomly with elements in (-5,5). In this experiment, we set N=3 for MGM-1 and N=1 for MGM-2. The results are presented in Table 2 , which show that MGM-1 outperforms its competitors in terms of efficiency and computational cost across all test cases. Table 2 : The numerical results of Example 4.5 MGM-1 MGM-2 SIPM SS-HOPM (m,n) \lambda^{\ast} iter/time iter/time iter/time iter/time (12,18) 14.9986 13/0.2352 15/0.3576 21/0.5373 42/0.8522 (30,18) 18.9550 24/1.5623 33/1.2134 53/1.9543 84/2.3742 (30,30) 23.2705 43/1.7412 40/1.5431 72/2.5241 93/3.6652 (50,60) 30.0465 51/3.2582 58/3.4671 68/4.2521 153/6.3823 5 Conclusions In this paper, we focused on computing extremal M-eigenvalue of fourth order hierarchically symmetric tensors by transforming the M-eigenvalue problem into an unconstrained optimization framework. Based on a new reformulaton, we proposed a memory gradient method to find an approximate solution of the problem. Furthermore, global convergence of the proposed method is established and several numerical examples verify the performance of the algorithm.