A novel adaptive quasi-Newton-type update and its global convergence without Lipschitz condition for constrained system of nonlinear monotone equations Kabiru Ahmed, Hatem E Semary, Asmaa S Al-Moisheer, Sulaiman M Ibrahim, Abubakar Sani Halilu, Muhammed Yusuf Waziri, Mohamad Afendee Mohamed, Salisu Murtala ABSTRACT This paper presents a new iterative method with a restart feature for solving constrained system of nonlinear monotone equations. The scheme, which is a double-parameter method, was initiated by considering a positive-definite adaptation of the quasi-Newton update proposed by Andrei (J. Comput. Appl. Math. 332, 26–44 (2018)) for unconstrained optimization. The two scaling parameters of the method are obtained by employing the measure function by Byrd and Nocedal (SIAM J. Numer. Anal. 26, 727–739 (1989)), which ensures that the condition number of the update is minimized. Another important attribute of the method is that its global convergence analysis is conducted without the Lipschitz assumption, which is a strong condition. Furthermore, the two parameters embedded in the scheme help in maintaining a balance in the distribution of the eigenvalues of its update matrix. The method converges globally regardless of the line search procedure employed. Numerical experiments with some methods in the literature show that the scheme is effective. 1 Introduction The interest in this paper is solution of the constrained system of nonlinear equations F ( x ¯ ) = 0 , x ¯ ∈ ℬ ⊆ ℝ n , (1) where ℬ is a nonempty closed convex set and F is a continuous vector-valued mapping, which is also monotone, namely, it satisfies ( F ( x ) − F ( y ) ) T ( x − y ) ≥ 0 , ∀ x , y ∈ ℝ n . (2) Real life applications of (1) can be found in studies such as general equilibrium problems in [ 1 , 2 ], the control systems analyzed in [ 3 ], networking and communications [ 4 ], modelling and data estimation [ 5 ], and in compressed sensing problems [ 6 – 14 ]. Some of the methods employed in solving (1) include adaptive versions of Newton’s method and its enhanced version, the quasi-Newton (QN) schemes [ 15 – 18 ], the derivative-free methods [ 19 – 24 ], Levenberg-Marquardt method [ 25 ], trust-region method [ 26 ] as well as spectral projection methods [ 27 , 28 ]. Despite their fast convergence properties, adaptations of Newton and QN methods have not been widely studied and few of the schemes for solving (1) have been developed. A viable reason for this is the huge memory required at each iteration to store matrices generated by the methods. The classical Newton and QN methods were developed to solve the optimization problem min x ∈ ℝ n f ( x ) , (3) with f being a smooth real-valued nonlinear function, with gradient g ( x ) = ∇ f ( x ) . The sequence of iterates generated by these methods are obtained via the formula x k + 1 = x k + α k d k , k = 0 , 1 , 2 … , where α k represents a step-size that is usually calculated using a line search procedure, and d k ∈ R n is search direction that is computed via G k d k = − ∇ f ( x k ) , in Newton’s method, or B k d k = − ∇ f ( x k ) , (4) in QN method, where G k ∈ R n × n = ∇ 2 f ( x k ) is a matrix known as the true Hessian or its approximation B k in the QN method. The first QN update was developed by Davidon [ 29 ] with subsequent analysis by Fletcher and Powell [ 30 ], hence the name DFP after the three authors. The update is defined by H k + 1 = H k − H k y k y k T H k y k T H k y k + s k s k T y k T s k , (5) in which y k = g k + 1 − g k , s k = x k + 1 − x k . By setting H k to be the identity matrix, the memoryless version of (6) is obtained, namely H k + 1 = I k − y k y k T y k T y k + s k s k T y k T s k . A DFP scheme with the update (6) exhibit some nice properties, which includes quadratic termination, hereditary property, and generating conjugate directions for a quadratic objective function and an exact line search procedure. It retains positive-definiteness for general nonlinear functions, when the curvature condition s k T y k > 0 is satisfied. Iterations of the scheme require 3 n 2 + 𝒪 ( n ) and it has super-linear rate of convergence. Also, for strictly convex functions under the exact line search rule, the DFP scheme converges globally [ 31 ]. Notwithstanding these attributes, numerical studies and computations conducted have shown that the DFP update is usually unstable. This is due to the loss of positive-definiteness along some iterative points as well as the distribution of its eigenvalues. The Broyden [ 32 ], Fletcher [ 33 ], Goldfarb [ 34 ], and Shanno [ 35 ] (BFGS) update is the most prominent QN scheme available. Being a member of the Broyden family, the BFGS update is given by B k + 1 = B k − B k s k s k T B k s k T B k s k + y k y k T y k T s k , k = 0 , 1 , 2 … , (6) where s k and y k remain as defined in (6). For the purpose of practical computations, search directions of the QN methods (5) are usually expressed in closed form as d k + 1 = − H k + 1 g k + 1 , (7) where H k + 1 = B k + 1 − 1 denotes the inverse approximation to the Hessian of the BFGS method. By applying the popular Woodbury formula [ 36 ] twice on (8), the inverse is obtained as H k + 1 = H k − s k y k T H k + H k y k s k T s k T y k + ( 1 + y k T H k y k s k T y k ) s k s k T s k T y k . (8) In order to avoid computing the matrix H k , which involves huge storage at each iteration, it is replaced with the identity matrix I and the so called memoryless update is obtained, i.e., H k + 1 = I − s k y k T + y k s k T s k T y k + ( 1 + ‖ y k ‖ 2 s k T y k ) s k s k T s k T y k . (9) Further analysis of (8) by Andrei [ 37 ] shows that efficiency of the BFGS method depends so much on structure of its eigenvalues. It was also shown by Powell [ 38 ] and Byrd et al. [ 39 ] that the BFGS method suffers more from large eigenvalues of (8) than small ones. By conducting some numerical experiments on the BFGS method, Gill and Leonard [ 40 ] discovered that large number of iterations or functions and gradient evaluations may be required on some problems for the scheme to converge. These shortcomings of the scheme were shown in [ 40 ] to mostly emanate from poor initial Hessian approximations or ill-conditioning along the iterations. To address these problems, some scaling procedures were applied on the update in (8). By scaling the third term in (8) with a positive parameter γ k , Biggs [ 41 ] gave the modification B k + 1 = B k − B k s k s k T B k s k T B k s k + γ k y k y k T y k T s k . Oren and Luenberger [ 42 ] scaled the first two terms of the update in (8) to obtain B k + 1 = δ k [ B k − B k s k s k T B k s k T B k s k ] + y k y k T y k T s k , where δ k is a positive parameter. By adopting the technique of changing structure of eigenvalues Andrei [ 43 ] presented a two-parameter BFGS method, with B k +1 given as B k + 1 = δ k [ B k − B k s k s k T B k s k T B k s k ] + γ k y k y k T y k T s k , with δ k and γ k being positive parameters. Here, δ k is computed to ensure that eigenvalues of B k +1 are clustered, while γ k is obtained so that large eigenvalues of B k +1 are reduced, i.e., the eigenvalues are shifted to the left. This strategy brings about a better distribution of the eigenvalues. A modification of (11) was proposed in [ 44 ], namely H k + 1 = 1 δ k [ H k − H k y k s k T + s k y k T H k s k T y k + ( δ k γ k + y k T H k y k s k T y k ) s k s k T s k T y k ] , (10) where δ k and γ k are parameters that are determined by employing Byrd and Nocedal’s measure function in [ 45 ]. The method proves to be computationally cheap and also has superlinear rate of convergence on practical problems. In order to address some of the shortfalls of the DFP (6) and BFGS (8) updates and address some of their shortfalls, some variants for solving problem (3) have been proposed in the literature. Based on the ℓ ∞ matrix norm and an upper bound for condition number of the scaled version of (11), Babaie-Kafaki [ 46 ] proposed a BFGS-type method for the unconstrained optimization problem (3). The author proved that the method satisfy the descent condition and conducted numerical experiments to show its effectiveness. Also, Babaie-Kafaki and Aminifard [ 47 ] proposed two parameter scaled memoryless BFGS update in (10) for the problem (3) with a monotone choice for the initial step length. The authors proved the sufficient descent condition of the scheme for uniformly convex functions. Aminifard and Babaie-Kafaki [ 48 ] developed a DFP-type method for solving (3) by analyzing eigenvalues of a scaled memoryless variant of the DFP update (6), where the scaled parameter is obtained by skipping the direction of maximum magnification. By exploiting a spectral secant condition for the classical DFP update (6), Dargahi et al. [ 49 ] proposed a DFP-type method for (3), where the updating matrix is obtained such that its condition number is minimized. Bakhshinejad and Babaie-Kafaki [ 50 ] also proposed a DFP-type algorithm as an extension of the search direction obtained by applying the DFP update (6). The method was shown to satisfy the much required sufficient descent condition. In order to exploit some of the advantages of the DFP and BFGS updates and address their shortcomings, some adaptive versions for solving (1) and its unconstrained form have been proposed in recent years. In line with this, Mamat et al. [ 51 ] proposed a DFP-type algorithm for solving the symmetric form of problem (1) by employing a scaled memoryless version of the DFP update (6). The authors proved global convergence of the scheme by employing some basic assumptions. As an enhancement of the classical DFP update (6), Dauda [ 52 ] proposed a three-term DFP-type method for solving the symmetric form of (1). The authors proved its global convergence using some mild conditions. Based on a scaled memoryless version of the DFP update (6), Awwal et al. [ 53 ] proposed a derivative-free method for solving (1). The authors proved global convergence of the method and compared its performance with some methods for solving (1). Inspired by a scaled version of the memoryless DFP update (6), another derivative-free method was proposed by Rao and Huang [ 54 ] for the unconstrained form of (1). Global convergence of the method was shown by employing some mild conditions. By applying a scaling technique and the measure function of Byrd and Nocedal [ 45 ] on a scaled memoryless DFP update (6), Ullah et al. [ 55 ] proposed a derivative-free DFP-type method for the constrained problem (1). Both global convergence and numerical efficiency were shown by the authors. In a recent development, Rehman et al. [ 56 ] proposed another version of a derivative-free DFP method for solving (1). The method converges globally and its effectiveness was illustrated by comparison with some recent methods in the literature. Recently, by computing an optimal value for the scaled memoryless BFGS update (11), Shah et al. [ 57 ] proposed a scaled derivative-free BFGS method for solving (1). The authors proved global convergence of the scheme and demonstrated its application to motion control. For more recent methods for solving (1), the reader can refer to works in [ 58 – 65 ]. The objectives of this paper are as follows: To develop a QN-type algorithm close to the BFGS method, for solving problem (1), which avoids the explicit computation of any matrix in the algorithm. To develop a scheme that exhibits some nice attributes of the classical BFGS update, addresses some of its shortcomings, and which possess the vital property for analyzing the convergence for problem (1). To develop a globally convergent algorithm without the Lipschitz condition and to analyze its numerical performance in solving problem (1). The paper is structured as follows: Motivation and details of the method are given in the following section. Analysis of its global convergence is given in Section 3 . Results of some numerical experiments of the scheme and some recent methods in the literature are presented in Section 4 . Conclusions are given in Section 5 . 2 An adaptive QN-type method An adaptive QN-type scheme will be derived in this section. To achieve that, the following lemma is imperative: Lemma 2.1. Cauchy Schwarz inequality Let V ― be an inner product space over the field of complex numbers ℂ with inner product ⟨ . , . ⟩ . Then, for every pair of vectors x , y ∈ V ― , the following inequality holds. | ⟨ x , y ⟩ | 2 ≤ ⟨ x , x ⟩ ⟨ y , y ⟩ . (11) As stated in the introduction section, adaptations of the iterative methods for the problem in (3) have been developed over the years. However, to the best of our knowledge few QN-type schemes exists in the literature. The ones available include the derivative-free DFP-type method proposed by Awwal et al. [ 53 ], where the authors scaled the first term of the classical DFP update (6) with a positive parameter γ k to present H k + 1 = μ k H k − H k y k y k T H k y k T H k y k + s k s k T y k T s k , k = 0 , 1 , 2 … , (12) where μ k represents a positive parameter that is computed such that the condition for analyzing global convergence holds for the scheme. Setting H k = γ k I in (14) yields H k + 1 = μ k γ k I − γ k y k y k T y k T y k + s k s k T y k T s k , k = 0 , 1 , 2 … , (13) where γ k ∈ [ γ ¯ 1 , γ ¯ 2 ] , γ ¯ 1 , γ ¯ 2 > 0 is a scaling parameter. By substituting (15) into (9), the authors obtained the search direction d k + 1 = − μ k γ k F k + 1 − s k T F k + 1 s k T y k s k + γ k y k T F k + 1 y k T y k y k , k = 0 , 1 , 2 … , with μ k ≥ α + 1 , α > 0 . The choice of μ k suggested by the authors only guarantees the condition for analyzing global convergence holds, it does not ensure stability of the proposed method. Following the work by Awwal et al. [ 53 ], Ullah et al. [ 55 ] scaled the third term of the memoryless version of the DFP update (6) with a positive parameter γ k to obtain H k + 1 = I n − y k y k T y k T y k + γ k s k s k T y k T s k , k = 0 , 1 , 2 … , (14) where γ k ,which is derived by employing the measure function of Nocedal and Byrd [ 45 ] is obtained as s k T y k ‖ s k ‖ 2 . Using this value of γ k , the authors presented search direction of the scheme as d k + 1 = − F k + 1 + F k + 1 T y k ‖ y k ‖ 2 y k − F k + 1 T s k ‖ s k ‖ 2 s k . (15) The value of the scaling parameter γ k obtained reduces the chances of the DFP updating matrix from being ill-conditioned. Still, it does not ensure that the search direction (18) satisfies the condition for analyzing global convergence. Following this, Shah et. al. [ 57 ] proposed another QN-type method for solving (1) by scaling the first and second term of the memoryless version of the Hessian approximation of the BFGS update [ 66 ], namely B k + 1 = γ k I − γ k s k s k T s k T s k + y k y k T y k T s k , k = 0 , 1 , 2 … . (16) The authors minimized the condition number of (19) to obtain the choice of γ k as ‖ y k ‖ ‖ s k ‖ resulting in the search direction d k + 1 = − ‖ s k ‖ ‖ y k ‖ F k + 1 + ( s k T F k + 1 y k + y k T F k + 1 s k y k T s k ) ‖ s k ‖ ‖ y k ‖ − ‖ y k ‖ 2 s k T F k + 1 s k ( y k T s k ) 2 ‖ s k ‖ ‖ y k ‖ − s k T F k + 1 s k y k T s k . In (19), the parameter γ k does not always ensure stability of the BFGS method as the third term on the right may grow larger producing a shift of the eigenvalues to the right. In a recent attempt to address the shortfalls of the DFP update (6), Rehman et. al. [ 56 ] scaled the first and second terms of the memoryless DFP update (6), namely H k + 1 = γ k I n − γ k y k y k T y k T y k + s k s k T y k T s k , k = 0 , 1 , 2 … , (17) with γ k being a positive parameter whose optimal value was obtained as the minimizer of the condition number of H k +1 which is given as γ k = ‖ s k ‖ ‖ y k ‖ . (18) By substituting (22) into the memoryless DFP update (21), the authors obtained H k + 1 = ‖ s k ‖ ‖ y k ‖ I n − ‖ s k ‖ ‖ y k ‖ y k y k T y k T y k + s k s k T y k T s k , k = 0 , 1 , 2 … , (19) and the search direction d k + 1 = − ‖ s k ‖ ‖ y k ‖ F k + 1 + ‖ s k ‖ ‖ y k ‖ F k + 1 T y k ‖ y k ‖ 2 y k − F k + 1 T s k s k T y k s k . Now, trace of the matrix H k +1 in (23) can be computed as tr ( H k + 1 ) = ‖ s k ‖ ‖ y k ‖ n − ‖ s k ‖ ‖ y k ‖ + ‖ s k ‖ 2 s k T y k . (20) It can be seen that the third-term on the right of (25) will shift the eigenvalues of H k +1 towards the right making the matrix to have large eigenvalues. On the other hand, the second term being negative tends to shift the eigenvalues to the left. Even though this effect is countered by the first term, which is positive, it does not ensure proper distribution of the eigenvalues of H k +1 , and by extension stability of the scheme is not guaranteed. Remark 2.2 As explained above, while the choices of the parameters μ k and γ k in (15), (17), (19), and (21) may ena ble the scheme generated with the corresponding matrix H k +1 to satisfy the vital condition for analyzing global convergence, they do not ensure its stability – a condition attributed to uneven distribution of eigenvalues of H k +1 . In addition to this, like most of the published works in the literature for the constrained problem (1), the methods in [ 53 – 56 ] depend on the Lipschitz condition for proving their global convergence. And since not all problems satisfy the Lipschitz condition, the number of problems analyzed tend to be limited. Now, by replacing s k with y ¯ k − 1 , y k with F k −1 , B k +1 with Q k in (8), and motivated by the scaling strategy in (12) and the above remark, we present the following two parameter scaled symmetric rank-two quasi-Newton type update, Q k = 1 γ k − 1 [ Q k − 1 − Q k − 1 y ¯ k − 1 y ¯ k − 1 T Q k − 1 y ¯ k − 1 T Q k − 1 y ¯ k − 1 ] + 1 δ k − 1 F k − 1 F k − 1 T F k − 1 T y ¯ k − 1 , (21) in which F k − 1 = F ( x k − 1 ) and y ¯ k − 1 = F ( ψ k − 1 ) − F ( x k − 1 ) + ν s k − 1 , ψ k − 1 = x k − 1 + α k − 1 d k − 1 , ν > 0 . (22) Setting Q k −1 as the identity matrix yields the following scaled memoryless version of (26): Q k = 1 γ k − 1 [ I − y ¯ k − 1 y ¯ k − 1 T y ¯ k − 1 T y ¯ k − 1 ] + 1 δ k − 1 F k − 1 F k − 1 T F k − 1 T y ¯ k − 1 . (23) Now, in order to define search direction of the proposed scheme, we require the inverse of the update Q k and appropriate values for the positive parameters γ k − 1 and δ k − 1 . To achieve that goal, we first show that Q k is positive-definite. Assuming that F k − 1 T y ¯ k − 1 ≥ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ > 0 , with m ∈ ( 0 , 1 ] , then we have that F k − 1 ≠ 0 and y ¯ k − 1 ≠ 0 . This further implies that a set of mutually orthonormal vectors v k − 1 1 , v k − 1 2 , . . . v k − 1 n − 2 ∈ ℝ n exists such that F k − 1 T v k − 1 i = y ¯ k − 1 T v k − 1 i = 0 , i = 1 , . . . , n − 2 , which determines that Q k v k − 1 i = Q k T v k − 1 i = 1 γ k − 1 v k − 1 i , i = 1 , . . . , n − 2 . Thus, Q k contains n − 2 eigenvalues equal to 1 γ k − 1 each. We label the two eigenvalues left as ζ k − 1 + and ζ k − 1 − . From (28), the trace of Q k is obtained as tr ( Q k ) = n γ k − 1 − 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 = 1 γ k − 1 + . . . + 1 γ k − 1 ⏟ (n-2) times + ζ k − 1 + + ζ k − 1 − , (24) which then reveals that ζ k − 1 + + ζ k − 1 − = 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 . (25) Applying the Sherman-Morrison formula [ 36 ], the inverse of Q k is computed as Q k − 1 = γ k − 1 I + ( δ k − 1 F k − 1 T y ¯ k − 1 + γ k − 1 ‖ F k − 1 ‖ 2 ) y ¯ k − 1 y ¯ k − 1 T ( F k − 1 T y ¯ k − 1 ) 2 − γ k − 1 y ¯ k − 1 F k − 1 T F k − 1 T y ¯ k − 1 − γ k − 1 F k − 1 y ¯ k − 1 T F k − 1 T y ¯ k − 1 . (26) Since Q k − 1 has n − 2 repeated eigenvalues equal to γ k − 1 each, labelling the remaining two as 1 ζ k − 1 + and 1 ζ k − 1 − , we obtain from (31) that d e t ( Q k − 1 ) = γ k − 1 ( n − 2 ) 1 ζ k − 1 + ζ k − 1 − . (27) Also, expressing Q k − 1 as the product of two matrices yields Q k − 1 = γ k − 1 I ( I + ( δ k − 1 F k − 1 T y ¯ k − 1 + γ k − 1 ‖ F k − 1 ‖ 2 ) y ¯ k − 1 y ¯ k − 1 T γ k − 1 ( F k − 1 T y ¯ k − 1 ) 2 − y ¯ k − 1 F k − 1 T F k − 1 T y ¯ k − 1 − F k − 1 y ¯ k − 1 T F k − 1 T y ¯ k − 1 ) . Let A = γ k − 1 I and B = I + ( ( δ k − 1 F k − 1 T y ¯ k − 1 + γ k − 1 ‖ F k − 1 ‖ 2 ) y ¯ k − 1 − γ k − 1 ( F k − 1 T y ¯ k − 1 ) F k − 1 ) y ¯ k − 1 γ k − 1 ( F k − 1 T y ¯ k − 1 ) 2 , then d e t ( A ) = γ k − 1 n . (28) By applying the formula for determinant of an arbitrary matrix of rank two, namely d e t ( I + a 1 a 2 T + a 3 a 4 T ) = ( 1 + a 1 T a 2 ) ( 1 + a 3 T a 4 ) − ( a 1 T a 4 ) ( a 2 T a 3 ) , and setting a 1 = − y ¯ k − 1 F k − 1 T y ¯ k − 1 , a 2 = F k − 1 , a 3 = ( δ k − 1 F k − 1 T y ¯ k − 1 + γ k − 1 ‖ F k − 1 ‖ 2 ) y ¯ k − 1 − γ k − 1 ( F k − 1 T y ¯ k − 1 ) F k − 1 γ k − 1 ( F k − 1 T y ¯ k − 1 ) 2 , and a 4 = y ¯ k − 1 , we obtain d e t ( B ) = δ k − 1 ‖ y ¯ k − 1 ‖ 2 γ k − 1 F k − 1 T y ¯ k − 1 . (29) Therefore, from (33) and (34), we obtain d e t ( Q k − 1 ) = γ k − 1 ( n − 1 ) δ k − 1 ‖ y ¯ k − 1 ‖ 2 F k − 1 T y ¯ k − 1 . (30) Now, combining (32), (35) with some simplification, we get ζ k − 1 + ζ k − 1 − = F k − 1 T y ¯ k − 1 γ k − 1 δ k − 1 ‖ y ¯ k − 1 ‖ 2 . (31) Using (30) and (36), we obtain ζ k − 1 ± = 1 2 [ 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 ± ( 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 ) 2 − 4 F k − 1 T y ¯ k − 1 γ k − 1 δ k − 1 ‖ y ¯ k − 1 ‖ 2 ] , which can also be expressed as ζ k − 1 ± = 1 2 [ 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 ± ( 1 γ k − 1 − ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 ) 2 + 4 ‖ F k − 1 ‖ 2 γ k − 1 δ k − 1 F k − 1 T y ¯ k − 1 − 4 F k − 1 T y ¯ k − 1 γ k − 1 δ k − 1 ‖ y ¯ k − 1 ‖ 2 ] . (32) Now, by applying the inequality in (13) to (37), we obtain ζ k − 1 + ≥ 1 2 [ 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 + ( 1 γ k − 1 − ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 ) 2 ] = 1 2 [ 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 + 1 γ k − 1 − ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 ] = 1 γ k − 1 . (33) Also, by employing the Cauchy Schwarz inequality in (13) and applying similar argument, we have that 0 < ζ k − 1 − ≤ 1 γ k − 1 , which applying (38) consequently yields 0 < ζ k − 1 − ≤ 1 γ k − 1 ≤ ζ k − 1 + . (34) Following (39), and since γ k − 1 is a positive parameter, we conclude that the matrix Q k is positive-definite, which implies that Q k − 1 is also positive-definite. We are now set to employ the measure function of Byrd and Nocedal [ 45 ] to compute approximations of γ k − 1 and δ k − 1 that will ensure well-conditioning of the matrix Q k as well as better distribution of its eigenvalues. The measure function is formulated as ϕ ( Q k ) = tr ( Q k ) − ln ( d e t ( Q k ) ) . (35) From (28) and applying the same approach employed to compute the determinant of Q k − 1 earlier, we obtain the determinant of Q k as d e t ( Q k ) = γ k − 1 ( 1 − n ) δ k − 1 F k − 1 T y ¯ k − 1 ‖ y ¯ k − 1 ‖ 2 . (36) Now, from (29), (40) and (41), we have ϕ ( Q k ) = n γ k − 1 − 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 − ln ( γ k − 1 ( 1 − n ) δ k − 1 F k − 1 T y ¯ k − 1 ‖ y ¯ k − 1 ‖ 2 ) = n γ k − 1 − 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 − ln ( γ k − 1 ( 1 − n ) ) + ln ( δ k − 1 ) − ln ( F k − 1 T y ¯ k − 1 ) + ln ( ‖ y ¯ k − 1 ‖ 2 ) = n γ k − 1 − 1 γ k − 1 + ‖ F k − 1 ‖ 2 δ k − 1 F k − 1 T y ¯ k − 1 − ( 1 − n ) ln ( γ k − 1 ) + ln ( δ k − 1 ) − ln ( F k − 1 T y ¯ k − 1 ) + ln ( ‖ y ¯ k − 1 ‖ 2 ) . (37) In order to obtain approximations for γ k − 1 and δ k − 1 , we have to minimize the function ϕ ( Q k ) with respect to both γ k − 1 and δ k − 1 . So, from (42), we get d ϕ ( Q k ) d γ k − 1 = 1 γ k − 1 2 − n γ k − 1 2 − ( 1 − n ) γ k − 1 . Setting this result to zero, yields 1 γ k − 1 2 − n γ k − 1 2 − ( 1 − n ) γ k − 1 = 0 , which implies that γ k − 1 ( 1 − n ) = 1 − n , or γ k − 1 = 1 . (38) Also, d ϕ ( Q k ) d δ k − 1 = 1 δ k − 1 − 1 δ k − 1 2 ‖ F k − 1 ‖ 2 F k − 1 T y ¯ k − 1 . Setting this result to zero yields 1 δ k − 1 − 1 δ k − 1 2 ‖ F k − 1 ‖ 2 F k − 1 T y ¯ k − 1 = 0 , which implies that 1 δ k − 1 2 ‖ F k − 1 ‖ 2 F k − 1 T y ¯ k − 1 = 1 δ k − 1 , or δ k − 1 = ‖ F k − 1 ‖ 2 F k − 1 T y ¯ k − 1 . (39) Following the above analysis and the fact that restarting search directions tend to improve convergence and efficiency of algorithms [ 67 ], we substitute (43) and (44) into (31), and propose the following auxiliary search direction: d k = { − F k , k = 0 , − F k + F k T F k − 1 F k − 1 T y ¯ k − 1 y ¯ k − 1 + F k T y ¯ k − 1 F k − 1 T y ¯ k − 1 F k − 1 − 2 ‖ F k − 1 ‖ 2 F k T y ¯ k − 1 ( F k − 1 T y ¯ k − 1 ) 2 y ¯ k − 1 , for k ≥ 1 and F k − 1 T y ¯ k − 1 ≥ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ , m ∈ ( 0 , 1 ] , − F k + 1 r F k T y ¯ k − 1 y ¯ k − 1 T y ¯ k − 1 y ¯ k − 1 − | F k − 1 T y ¯ k − 1 | ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ F k T F k − 1 ‖ F k − 1 ‖ 2 F k − 1 , r > 1 , otherwise . (40) Remark 2.3 It should be noted that the inequality F k − 1 T y ¯ k − 1 ≥ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ , which triggers the restart process was required for two reasons: one, it is essential for analyzing eigenvalues of the matrix Q k , and two, it helps in proving boundedness of the search direction. Lemma 2.4 The search direction d k in ( 45) sa tisfies the inequality d k T F k ≤ c ‖ F k ‖ 2 , c = min { ( 1 − 1 r ) , 1 2 } , ∀ k ≥ 1 . (41) Proof : First, from (45) for k = 0, we have d 0 T F 0 = − F 0 T ( F 0 ) = − ‖ F 0 ‖ 2 . Now, we proceed to analyze each of the two cases in (45) for k ≥ 1. 1 st Case: If F k − 1 T y ¯ k − 1 ≥ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ , we have d k T F k = − ‖ F k ‖ 2 + 2 ( F k T F k − 1 ) F k T y ¯ k − 1 F k − 1 T y ¯ k − 1 − 2 ‖ F k − 1 ‖ 2 ( F k T y ¯ k − 1 ) 2 ( F k − 1 T y ¯ k − 1 ) 2 = 2 F k T F k − 1 ( F k − 1 T y ¯ k − 1 ) F k T y ¯ k − 1 − ( F k − 1 T y ¯ k − 1 ) 2 ‖ F k ‖ 2 − 2 ‖ F k − 1 ‖ 2 ( F k T y ¯ k − 1 ) 2 ( F k − 1 T y ¯ k − 1 ) 2 ≤ ‖ F k ‖ 2 ( F k − 1 T y ¯ k − 1 ) 2 2 + 2 ‖ F k − 1 ‖ 2 ( F k T y ¯ k − 1 ) 2 − ‖ F k ‖ 2 ( F k − 1 T y ¯ k − 1 ) 2 − 2 ‖ F k − 1 ‖ 2 ( F k T y ¯ k − 1 ) 2 ( F k − 1 T y ¯ k − 1 ) 2 = − ‖ F k ‖ 2 + ‖ F k ‖ 2 2 = − ( 1 − 1 2 ) ‖ F k ‖ 2 = − 1 2 ‖ F k ‖ 2 . 2 nd Case: If F k − 1 T y ¯ k − 1 < m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ , then from (45) and Cauchy Schwarz inequality, we get d k T F k = − ‖ F k ‖ 2 + 1 r ( F k T y ¯ k − 1 ) 2 y ¯ k − 1 T y ¯ k − 1 − | F k − 1 T y ¯ k − 1 | ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ ( F k T F k − 1 ) 2 ‖ F k − 1 ‖ 2 ≤ − ‖ F k ‖ 2 + 1 r ( F k T y ¯ k − 1 ) 2 y ¯ k − 1 T y ¯ k − 1 ≤ − ‖ F k ‖ 2 + 1 r ‖ F k ‖ 2 ‖ y ¯ k − 1 ‖ 2 ‖ y ¯ k − 1 ‖ 2 = − ‖ F k ‖ 2 + 1 r ‖ F k ‖ 2 = − ( 1 − 1 r ) ‖ F k ‖ 2 . By setting c = min { ( 1 − 1 r ) , 1 2 } , we established the proof.■ For the line search strategy, we employ the adaptive procedure proposed by Yin et. al. [ 68 ], where the step-size α k is defined as α k = β ρ i k , with i k being the smallest nonnegative integer i for which − F ( ψ k ) T d k ≥ σ α k P [ λ , u ] [ ‖ F ( ψ k ) ‖ ] ‖ d k ‖ 2 , (42) for each u ∈ ℝ n , P [ λ , u ] [ . ] is the projection operator defined as P [ λ , u ] [ h ] = { u , if h ≥ u , λ , if h ≤ λ , h , otherwise , where 0 < λ ≤ u , and u > 0. Now, we described algorithm of the method as follows: Algorithm 1 (MKAS) 1 : Initialization . Select x 0 ∈ ℬ , σ > 0 , ρ ( 0 , 1 ) , m ∈ ( 0 , 1 ] , r > 1, β ∈ ( 0 , 1 ] , ϑ ∈ ( 0 , 2 ) . Set d 0 = − F 0 , k =0. 2 : For ‖ F k ‖ ≤ 10 − 10 , stop. Else, move to 3 . 3 : Compute ψ k as in (27), with α k as defined earlier such that (48) holds. 4 : If ψ k ∈ ℬ and ‖ F ( ψ k ) ‖ ≤ 10 − 10 , stop x k + 1 = ψ k . Otherwise, compute x k + 1 = P ℬ [ x k − ϑ ς k F ( ψ k ) ] , where (43) P ℬ ( . ) is the projection operator, which is defined in [ 69 ] with the property ‖ P ℬ ( x ) − y ‖ ≤ ‖ x − y ‖ , ∀ y ∈ ℬ , (44) with ς k = F ( ψ k ) T ( x k − ψ k ) ‖ F ( ψ k ) ‖ 2 . (45) 5 : Testing F k − 1 T y ¯ k − 1 , ‖ F k − 1 ‖ and ‖ y ¯ k − 1 ‖ . Compute F k − 1 T y ¯ k − 1 , ‖ F k − 1 ‖ and ‖ y ¯ k − 1 ‖ . 6 : Set d k = − F k + F k T F k − 1 F k − 1 T y ¯ k − 1 y ¯ k − 1 + F k T y ¯ k − 1 F k − 1 T y ¯ k − 1 F k − 1 − 2 ‖ F k − 1 ‖ 2 F k T y ¯ k − 1 ( F k − 1 T y ¯ k − 1 ) 2 y ¯ k − 1 if F k − 1 T y ¯ k − 1 ≥ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ , where m ∈ ( 0 , 1 ] , otherwise compute d k = − F k + F k T y ¯ k − 1 y ¯ k − 1 T y ¯ k − 1 y ¯ k − 1 − 1 r | F k − 1 T y ¯ k − 1 | ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ F k T F k − 1 ‖ F k − 1 ‖ 2 F k − 1 , where r > 1. 7 : Set k = k +1. Goto 2 . 3 Analysis of convergence We now proceed to analyze global convergence of the MKAS algorithm: First, we give the following assumptions: Assumption 3.1 The mapping F is monotone. Assumption 3.2 There exists x ¯ ∈ ℬ such that F ( x ¯ ) = 0 . Lemma 3.3 The search direction d k generated in step 6 of the MKAS algorithm satisfy the inequality min { ( 1 − 1 r ) , 1 2 } ‖ F k ‖ ≤ ‖ d k ‖ ≤ N ‖ F k ‖ , N = ( 1 + 2 m + 2 m 2 ) . (46) Proof. By applying Cauchy-Schwarz inequality and (46), the first inequality is satisfied. Now, from (45), and for k = 0, we have that d 0 = − F 0 , which shows that ‖ d 0 ‖ = ‖ F 0 ‖ . For k ≥ 1, we consider the case of F k − 1 T y ¯ k − 1 ≥ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ . From (45) and Cauchy-Schwarz inequality, we have ‖ d k ‖ = ‖ − F k + F k T F k − 1 F k − 1 T y ¯ k − 1 y ¯ k − 1 + F k T y ¯ k − 1 F k − 1 T y ¯ k − 1 F k − 1 − 2 ‖ F k − 1 ‖ 2 F k T y ¯ k − 1 ( F k − 1 T y ¯ k − 1 ) 2 y ¯ k − 1 ‖ ≤ ‖ F k ‖ + ‖ F k ‖ ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ F k − 1 T y ¯ k − 1 + ‖ F k ‖ ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ F k − 1 T y ¯ k − 1 + 2 ‖ F k − 1 ‖ 2 ‖ F k ‖ ‖ y ¯ k − 1 ‖ 2 ( F k − 1 T y ¯ k − 1 ) 2 ≤ ‖ F k ‖ + ‖ F k ‖ ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ + ‖ F k ‖ ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ + 2 ‖ F k − 1 ‖ 2 ‖ F k ‖ ‖ y ¯ k − 1 ‖ 2 ( m ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ ) 2 = ‖ F k ‖ + ‖ F k ‖ m + ‖ F k ‖ m + 2 ‖ F k ‖ m 2 = ( 1 + 2 m + 2 m 2 ) ‖ F k ‖ . Setting N 1 = ( 1 + 2 m + 2 m 2 ) , we get ‖ d k ‖ ≤ N 1 ‖ F k ‖ . For the second case, we have from (45) and Cauchy Schwarz inequality, that ‖ d k ‖ = ‖ − F k + 1 r F k T y ¯ k − 1 y ¯ k − 1 T y ¯ k − 1 y ¯ k − 1 − | F k − 1 T y ¯ k − 1 | ‖ F k − 1 ‖ ‖ y ¯ k − 1 ‖ F k T F k − 1 ‖ F k − 1 ‖ 2 F k − 1 ‖ ≤ ‖ F k ‖ + 1 r ‖ F k ‖ ‖ y ¯ k − 1 ‖ 2 ‖ y ¯ k − 1 ‖ 2 + ‖ F k − 1 ‖ 3 ‖ F k ‖ ‖ y ¯ k − 1 ‖ ‖ F k − 1 ‖ 3 ‖ y ¯ k − 1 ‖ = ( 1 + 1 r + 1 ) ‖ F k ‖ = ( 2 + 1 r ) ‖ F k ‖ . Setting N 2 = ( 2 + 1 r ) , we get ‖ d k ‖ ≤ N 2 ‖ F k ‖ . Therefore, since N 1 is the max of (1, N 1, N 2), we obtain that ‖ d k ‖ ≤ ( 1 + 2 m + 2 m 2 ) ‖ F k ‖ , (47) which proves that the second inequality of (52) holds.■ Lemma 3.4 Given that F in (1) is c ontinuous on ℝ n , then for each k ≥ 0 , there exists nonnegative integer i k such that ( 48) i s satisfied. Proof. Suppose by contradiction that k ≥ 0 exists for which (48) does not hold for any nonnegative integer i , i.e., − F ( x k 0 + β ρ i d k 0 ) T d k 0 < σ β ρ i P [ λ , u ] ‖ F ( x k 0 + β ρ i d k 0 ) ‖ ‖ d k 0 ‖ 2 ≤ σ β ρ i u ‖ d k 0 ‖ 2 . (48) The second inequality in (54) was obtained from the fact that P [ λ , u ] [ . ] ≤ u . By continuity of F , and letting i → ∞ with ρ ∈ ( 0 , 1 ) , we get F ( x k 0 ) T d k 0 ≥ 0 , which contradicts F ( x k 0 ) T d k 0 ≤ − min { ( 1 − 1 r ) , 1 2 } ‖ F k ‖ 2 < 0 . Lemma 3.5 Suppose Assumptions 3.1 − 3.2 hold and the sequences { x k } and { ψ k } are generated by Algorithm 1. Then for a solution x ¯ ∈ B , the sequence { ‖ x k − x ¯ ‖ } is convergent and { x k } and { ψ k } are bounded. Furthermore lim k → ∞ α k ‖ d k ‖ = 0 . (49) Proof : Using (48) and definition of ψ k , we have F ( ψ k ) T ( x k − ψ k ) = − α k F ( ψ k ) T d k ≥ σ α k 2 P [ λ , u ] ‖ F ( ψ k ) ‖ ‖ d k ‖ 2 ≥ σ λ α k 2 ‖ d k ‖ 2 = σ λ ‖ x k − ψ k ‖ 2 > 0 . (50) By (2) and for all x ¯ ∈ B , we have F ( ψ k ) T ( x k − x ¯ ) = F ( ψ k ) T ( x k − ψ k ) + F ( ψ k ) T ( ψ k − x ¯ ) ≥ F ( ψ k ) T ( x k − ψ k ) + F ( x ¯ ) T ( ψ k − x ¯ ) = F ( ψ k ) T ( x k − ψ k ) ≥ σ λ ‖ x k − ψ k ‖ 2 > 0 . (51) Combining the inequality (57) above, (49), (50) and (51), we obtain ‖ x k + 1 − x ¯ ‖ 2 = ‖ P ℬ [ x k − ϑ ς k F ( ψ k ) ] − x ¯ ‖ 2 ≤ ‖ x k − ϑ ς k F ( ψ k ) − x ¯ ‖ 2 = ‖ ( x k − x ¯ ) − ϑ ς k F ( ψ k ) ‖ 2 = ‖ x k − x ¯ ‖ 2 − 2 ϑ ς k F ( ψ k ) T ( x k − x ¯ ) + ϑ 2 ς k 2 ‖ F ( ψ k ) ‖ 2 ≤ ‖ x k − x ¯ ‖ 2 − 2 ϑ ς k F ( ψ k ) T ( x k − ψ k ) + ϑ 2 ς k 2 ‖ F ( ψ k ) ‖ 2 = ‖ x k − x ¯ ‖ 2 − ϑ ( 2 − ϑ ) ( F ( ψ k ) T ( x k − ψ k ) ) 2 ‖ F ( ψ k ) ‖ 2 ≤ ‖ x k − x ¯ ‖ 2 − ϑ ( 2 − ϑ ) σ 2 λ 2 ‖ x k − ψ k ‖ 4 ‖ F ( ψ k ) ‖ 2 , (52) where the last inequality indicates that 0 ≤ ‖ x k + 1 − x ¯ ‖ ≤ ‖ x k − x ¯ ‖ holds. The implication of this is that { ‖ x k − x ¯ ‖ } is a monotone decreasing sequence that is bounded below. So, { ‖ x k − x ¯ ‖ } is convergent and { x k } is bounded. Now, since { x k } is bounded and F is continuous, we see that there exists a constant ϑ ¯ > 0 such that for all k ≥ 0, ‖ x k ‖ ≤ ϑ ¯ , ‖ F ( x k ) ‖ ≤ ϑ ¯ . (53) Combining (59) with (53) shows that { d k } is bounded. Furthermore, from (2), Cauchy Schwarz inequality, and (56), we have ϑ ¯ ≥ ‖ F k ‖ ≥ F k T ( x k − ψ k ) ‖ x k − ψ k ‖ ≥ F ( ψ k ) T ( x k − ψ k ) ‖ x k − ψ k ‖ ≥ σ λ ‖ x k − ψ k ‖ ≥ σ λ ‖ ψ k ‖ − σ λ ϑ ¯ , which further yields ‖ ψ k ‖ ≤ ϑ ¯ + σ λ ϑ ¯ σ λ , which clearly shows the boundedness of { ψ k } , which by continuity of F , indicates boundedness of { F ( ψ k ) } , namely, a constant κ exists for which ‖ F ( ψ k ) ‖ ≤ κ . ∀ k ≥ 0 . Combining this result with the last inequality of (58) yields ϑ ( 2 − ϑ ) σ 2 λ 2 κ 2 ∑ k = 0 ∞ ‖ x k − ψ k ‖ 4 ≤ ∑ k = 0 ∞ ( ‖ x k − x ¯ ‖ 2 − ‖ x k + 1 − x ¯ ‖ 2 ) = ‖ x 0 − x ¯ ‖ 2 − lim k → ∞ ‖ x k + 1 − x ¯ ‖ 2 < ∞ , which further implies that 0 ≤ lim k → ∞ ‖ x k − ψ k ‖ = lim k → ∞ α k ‖ d k ‖ . Hence the proof is obtained. ■ Theorem 3.6 The sequence { x k } generated by MKAS Algorithm converges globally to a solution of (1). Proof. Two cases are analyzed for the proof 1 st case: Assuming that lim inf k → 0 ‖ F k ‖ = 0 , then the boundedness of { x k } and continuity of F implies that some cluster points x ^ exists for which F ( x ^ ) = 0 . Also, since { ‖ x k − x ^ ‖ } is convergent, it implies that { x k } converges to x ^ . 2 nd case: lim inf k → 0 ‖ F k ‖ > 0 . In this case we have that a constant c ¯ > 0 exists such that ‖ F k ‖ ≥ c ¯ , ∀ k ≥ 0 . (54) From first inequality in (52), we have ‖ d k ‖ ≥ min { ( 1 − 1 r ) , 1 2 } ‖ F k ‖ ≥ min { ( 1 − 1 r ) , 1 2 } c ¯ . Combining this result with (55) yields lim k → ∞ α k = 0 . (55) By the boundedness of the sequences { x k } and { d k } , we see that there exists subsequences { x k i } and { d k i } for which lim i → ∞ , i ∈ 𝒦 x k i = x ^ , lim i → ∞ , i ∈ 𝒦 d k i = d ^ , with 𝒦 being an infinite indexing set. From (52), we get − F ( x k i ) T d k i ≥ min { ( 1 − 1 r ) , 1 2 } ‖ F ( x k i ) ‖ 2 , ∀ i ∈ 𝒦 . (56) Letting i → ∞ in (63) with continuity of F and (61), we obtain − F ( x ^ ) T d ^ ≥ min { ( 1 − 1 r ) , 1 2 } ‖ F ( x ^ ) ‖ 2 > min { ( 1 − 1 r ) , 1 2 } c ¯ 2 > 0 . (57) On the other hand, from (48), if α k ≠ β , then α ¯ = α ρ will not satisfy (48), i.e., − F ( x k i + ρ − 1 α k i d k i ) T d k i < σ ρ − 1 α k i P [ λ , u ] [ ‖ F ( x k i + ρ − 1 α k i d k i ) ‖ ] ‖ d k i ‖ 2 ≤ σ ρ − 1 α k i u ‖ d k i ‖ 2 (58) By taking limit as i → ∞ , with i ∈ 𝒦 in (65), (62) and continuity of F , we obtain − F ( x ^ ) T d ^ ≤ 0 , which shows a contradiction with (64). Hence the proof is established. ■ 4 Numerical experiments To test the MKAS method’s effectiveness, it is compared with the QN-type methods in [ 55 ] labelled SMDFP, [ 57 ] labelled SMBFGS and [ 56 ] labelled PBDFP. To code the four algorithms, MATLAB R 2014 a was employed with a PC configured as (2.30ghz cpu, 4GB RAM). The criteria for stopping the iterations is ‖ F ( x k ) ‖ ≤ 10 − 10 or ‖ F ( ψ k ) ‖ ≤ 10 − 10 or iterations exceed 1000 without attaining a solution. Parameters values for MKAS are set as β = 1 , ρ = 0.5 , σ = 0.01 , ϑ = 1.99 , ν = 0.001 , m = 0.01, r = 1.6, λ = 0.001 and u = 0.8. Parameter values for the other algorithms are set according to how they are used in the papers. The following test examples with dimensions 1000, 5000, and 10000, where F is given as: F = ( f 1 ( x ) , f 2 ( x ) , . . . , f n ( x ) ) T . Example 1 This is the gradient of the strictly convex test example in [ 70 ] where ℬ = ℝ + n added to yield f i ( x ) = exp x i − 1 , i = 1 , 2 , … , n . Example 2 This is a modified version of the test example in [ 71 ] with ℬ = ℝ + n added to yield f 1 ( x ) = exp x 1 − 1 , f i ( x ) = exp x i + x i − 1 , i = 2 , … , n . Example 3 [ 72 ] with ℬ = ℝ + n f i ( x ) = 2 x i − sin | x i | , i = 1 , 2 , … , n . Example 4 [ 73 ]. f 1 ( x ) = x 1 − exp ( c o s ( x 1 + x 2 2 ) ) , f i ( x ) = x i − exp ( c o s ( x i − 1 + x i + x i + 1 i ) ) , i = 2 , 3 , … , n − 1 , f n ( x ) = x n − exp ( c o s ( x n − 1 + x n n ) ) , with ℬ = ℝ + n . Example 5 A modified version of the test example in [ 72 ] with ℬ = ℝ + n f i ( x ) = 3 x i − sin x i , i = 1 , 2 , … , n . Example 6 A modification of the test example 3 with ℬ = ℝ + n f i ( x ) = 3 x i + cos x i − 1 , i = 1 , 2 , … , n . Example 7 A modification of the test example 3 with ℬ = ℝ + n added to yield f 1 ( x ) = 2 x 1 + exp sin x 1 − 1 , f i ( x ) = 2 x i − 1 + exp sin x i + 2 x i − 1 , f n ( x ) = 2 x n + exp sin x n − 1 , i = 2 , … , n − 1 . Example 8 A modification of the test example 3 with ℬ = ℝ + n added to yield f 1 ( x ) = sin x 1 + exp sin x 1 − 1 , f i ( x ) = sin x i + exp sin x i + x i − 1 , i = 2 , … , n . Example 9 A modification of the test example 2 with ℬ = ℝ + n added to yield f 1 ( x ) = 3 x 1 + exp sin x 1 − 1 , f i ( x ) = 3 x i + exp sin x i − 1 , i = 2 , … , n . The following initial guesses were used: x 1 = ( 1 n , 2 n , . . . , 1 ) T , x 2 = ( 1 , 1 2 , . . . , 1 n ) T , x 3 = ( 1 2 , 3 2 , . . . , − [ ( − 1 ) n − 2 ] 2 ) T , x 4 = ( 1 , 1 , . . . , . . . , 1 ) T , x 5 = ( 3 4 , 1 4 , . . . , − [ ( − 1 ) n − 2 ] 4 ) T , x 6 = ( 2 , 2 , . . . , 2 ) T . The numerical result of the experiments for the four algorithms is displayed in three tables, and is accessible from the link https://github.com/hungugida/hungugida/blob/main/Tables1-3MKAS.pdf , where “N” and “Pdim” denotes example of the operator F and dimension, “SP” and “Nit” represents for initial guess and number of iterations. Also, “Fval,” “Ptime(s)” and “Norm” stands for function evaluations, processing time and the residual at stopping point, while “***” denotes failure to obtain a solution. In order describe the values shown in the above link, we use the evaluation too by Dolan and Moré [ 74 ]. Figs 1 – 3 were plotted for iterations, function evaluations, and CPU time performance metrics. From Fig 1 , we see that MKAS solved about 95% of the test examples with less number of iterations. This values however, include 9% solved by the algorithm together with PBDFP, SMDFP, and SMBFGS. It also showed that SMDFP solved 15% of the test examples with less iterations. Here also, this value includes 12% solved with the other algorithms. Fig 2 showed that MKAS solved 93% of the test examples with less function evaluations. It also showed that PBDFP solved 8%, which includes 2% solved with SMDFP, and SMBFGS algorithms. For least CPU time metric, Fig 3 showed that MKAS perform better than PBDFP, SMDFP, and SMBFGS because it solved 89% while the latter recorded 8%, 1% and 2%. To further validate the results of the experiments, we present the average residual obtained for each of the four algorithms as computed from tables in the above link as follows: MKAS (1.21 × 10 −11 ), PBDFP (4.41 × 10 −11 ), SMDFP (1.83 × 10 −10 ) and SMBFGS (1.75 × 10 −10 ). Hence, the above analysis indicates that MKAS method is better suited for solving (1) than the other schemes. 10.1371/journal.pone.0344697.g001 Fig 1 Performance profile of the four methods for number of iterations. 10.1371/journal.pone.0344697.g002 Fig 2 Performance profile of the four methods for function evaluations. 10.1371/journal.pone.0344697.g003 Fig 3 Performance profile of the four methods for CPU time. 5 Concluding remarks and future research We have presented a new quasi-Newton-type method for solving constrained system of monotone nonlinear equations in this article. The method is an adaptive modification of the BFGS method for unconstrained optimization. The scheme possesses the vital property for analyzing global convergence as well as the trust region property irrespective of the line search procedure; what’s more, the global convergence was proven without the Lipschitz condition, thereby broadening its applicability to a wider class of problems. Another important finding was the impact of the restart strategy in improving convergence of the scheme, as evident in the best average residual it recorded. Furthermore, numerical experiments with the method and some of the available quasi-Newton type methods for solving constrained system of monotone nonlinear equations showed that it is effective. The focus of a future research will be to develop a variant of the proposed method, where the global convergence will be analyzed without the monotonicity and Lipschitz assumptions. We also hope to include real-life applications of the method in the study.