On extending the class of convex functions
Shravan Mohan · 2025
Read On extending the class of convex functions by Shravan Mohan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01854.txt.
Introduction
Shravan Mohan wrote this 2025 mathematics note extending the family of known convex functions. Convexity is the property that makes optimization tractable, so each new certified class is a tool. The note leans on classic linear algebra, factoring the Hessian in ways matrix analysis can judge.
One result shows that a quadratic form wrapped around a logarithm stays convex when the matrix is a diagonally dominant M-matrix. Two classes of convex homogeneous polynomials follow by the same technique, one of them sum-of-squares convex as well. A third result draws a sharp border: an exponential cousin is convex only when the matrix is a plain nonnegative diagonal. Examples and remarks on usefulness accompany each claim.
Catalog record
| CREATOR | Shravan Mohan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-01854
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On extending the class of convex functions Thanks: This work is not related to the work of the author at Amazon. Shravan Mohan Abstract In this brief note, it is shown that the function p ⊤ W log ( p ) p^{\top}W\log(p) is convex in p p if W W is a diagonally dominant positive definite M-matrix. The techniques used to prove convexity are well-known in linear algebra and essentially involves factoring the Hessian in a way that is amenable to martix analysis. Using similar techniques, two classes of convex homogeneous polynomials is derived - namely, p ⊤ W p 2 p^{\top}Wp^{2} and ( p k ) ⊤ W p k (p^{k})^{\top}Wp^{k} - the latter also happen to be SOS-convex. Lastly, usign the same techniques, it is also shown that the function p ⊤ W e p p^{\top}We^{p} is convex over the positive reals only if W W is a non-negative diagonal matrix. Discussions regarding the utility of these functions and examples accompany the results presented. I Introduction Convex functions play a pivotal role in optimization theory due to their unique properties that guarantee the local minimum of a convex function is also a global minimum. This attribute simplifies optimization problems significantly, making convex functions integral in fields such as operations research, economics, and machine learning, where finding optimal solutions is crucial. Moreover, the structural characteristics of convex functions, such as their ability to approximate complex functions using convex envelopes, contribute to their widespread application in solving large-scale optimization problems efficiently [ 1 , 2 ] . The aim of this work is to enrich the set of well-known convex functions with a few more. To the best of the authors knowledge, these functions have not been shown to be convex before. The first in these relates to the entropy function. The entropy function commonly represented in the context of information theory as \displaystyle H(p)=-\sum_{x}p(x)\log p(x), (1) where p(x) denotes the probability distribution over discrete random variables, serves as a fundamental measure of uncertainty or randomness in a system. This function is notably convex, which can be demonstrated through its second derivative. The strict convexity of the entropy function plays a pivotal role in determining the characteristics of probability distributions that maximize entropy. Specifically, it ensures that there is a unique distribution that achieves this maximum — namely, the uniform distribution. This uniqueness arises because strict convexity guarantees that any local extremum of the entropy function is also the global maximum, which, in the case of entropy, corresponds to the scenario where outcomes are equiprobable, as seen in the uniform distribution. Furthermore, the convexity of the entropy function directly influences the properties of the Kullback-Leibler divergence, which is a measure of how one probability distribution diverges from another. The convexity of KL divergence with respect to its arguments ensures that the divergence is minimized precisely when the two distributions being compared are identical [ 3 ] . In the first part, the convexity of a novel entropy-like function: p^{\top}W\log(p) is established for W belonging to a specific class of matrices. This work also generalizes the standard entropy function, which emerges as a special case when W is set to the identity matrix. Although the immediate applications of these results are not yet fully clear, the establishment of such properties invites further exploration into their potential utility across various domains. The method employed to prove the convexity of the aforementioned entropy-like function involves factoring the Hessian and making it amenable to well-known techniques from linear algebra, so that sufficient conditions for its positive semi-definiteness can be obtained. The techniques used are also extendable to a range of polynomial functions (specifically, posynomials [ 4 ] ), thereby further enriching the set of known convex functions. This set of results forms the second part of this paper. Incidentally, the class of polynomials which are shown to be convex also happen to be SOS-convex, a well-known subset of all convex polynomials [ 5 ] . The last result in this paper shows that the function x^{\top}We^{x} is convex over the positive reals only if W is a positive diagonal matrix. The function xe^{x} appears in several applied areas, such as, in solutions to ODEs [ 6 ] , the Lambert W function [ 7 ] . In other words, this result negates the possibility of having mixed terms ( x_{i}e^{x_{j}},~i\neq j ) with the additional requirement of convexity. The next section presents the main results of this paper along with their detailed proofs, demonstrating the application of the aforementioned linear algebraic techniques to establish convexity. Each theorem is supplemented with a discussion for clarity. This is followed by concluding remarks that summarize the key findings and suggest directions for future research. II Preliminaries The term \mathcal{R} represents the set of real numbers and \mathcal{R}^{+} represents the set of positive reals. Matrices and vectors are denoted by uppercase and lowercase letters, respectively. The entries of a matrix A are represented as A_{i,j} , where i and j index rows and columns. Matrix operations used here include the transpose A^{\top} , inverse A^{-1} , and the Hadamard product A\circ B . The term D_{v} refers to a diagonal matrix with v as its diagonal elements. The inequality A\geq 0 implies that all elements of A are non-negative, while the inequality A\succeq 0 implies that the matrix A is positive semidefinite. Convex function [ 1 ] : A twice differentiable function f:\mathbb{R}^{n}\to\mathbb{R} is defined to be convex on a domain D\subseteq\mathbb{R}^{n} if the Hessian matrix of f , denoted as \nabla^{2}f(x) , is positive semidefinite for all x in D . M-matrix [ 8 ] : A matrix A\in\mathbb{R}^{n\times n} is called an M-matrix if it can be expressed in the form \displaystyle A=sI-B, (2) where I is the identity matrix, B is a nonnegative matrix (i.e., all entries of B are nonnegative), and s is a scalar greater than or equal to the spectral radius of B . Inverse-Positivity of M-Matrices [ 8 ] : Let A be an M-matrix. Then the inverse of A is nonnegative, i.e., \displaystyle A^{-1}\geq 0, (3) where the inequality is element-wise. Sylvester’s Law of Inertia [ 9 ] : Let A be a real symmetric matrix. Then, for any invertible matrix P , the matrix B=P^{\top}AP is congruent to A and has the same inertia. That is, the number of positive eigenvalues, the number of negative eigenvalues, and the number of zero eigenvalues of A remain invariant under such transformations. Schur’s Complement Theorem [ 9 ] : Let M be a block matrix given by \displaystyle M=\begin{bmatrix}A&B\\ C&D\end{bmatrix} (4) where A , B , C , and D are matrices of appropriate dimensions and A is invertible. The Schur complement of A in M is defined as \displaystyle M/A=D-CA^{-1}B. (5) The matrix M is positive definite if and only if both A and the Schur complement M/A are positive definite. Schur Product Theorem: Let A and B be two n\times n complex Hermitian positive semidefinite matrices. The Hadamard product (A\circ B) is also positive semidefinite. Posynomial [ 4 ] : A polynomial defined over the set of positive reals is called