Orthogonality conditions for convex regression
Sheng Dai, Timo Kuosmanen, Xun Zhou · 2025
Read Orthogonality conditions for convex regression by Sheng Dai, Timo Kuosmanen, Xun Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-21110.txt.
Introduction
Sheng Dai, Timo Kuosmanen, and Xun Zhou work out the identification conditions for convex regression, a method that fits a curved, bowl-shaped relation to data without fixing its exact form. Standard regression leans on the condition that errors are unrelated to the inputs. For convex regression, the matching condition was unknown.
Using duality theory from optimization, they derive the sample conditions for several model forms, with and without requirements that the relation rise steadily or scale evenly. They then propose a hybrid method that blends instrument variables with a control function to fight endogeneity, where inputs may be entangled with errors. Simulations and Chilean factory data support the approach.
Catalog record
| CREATOR | Sheng Dai, Timo Kuosmanen, Xun Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-21110
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Orthogonality conditions for convex regression E-mail addresses: [email protected] (S. Dai) , [email protected] (T. Kuosmanen) , [email protected] (X. Zhou) . Sheng Dai, Timo Kuosmanen, Xun Zhou Abstract Econometric identification generally relies on orthogonality conditions, which usually state that the random error term is uncorrelated with the explanatory variables. In convex regression, the orthogonality conditions for identification are unknown. Applying Lagrangian duality theory, we establish the sample orthogonality conditions for convex regression, including additive and multiplicative formulations of the regression model, with and without monotonicity and homogeneity constraints. We then propose a hybrid instrumental variable control function approach to mitigate the impact of potential endogeneity in convex regression. The superiority of the proposed approach is shown in a Monte Carlo study and examined in an empirical application to Chilean manufacturing data. Keywords : Endogeneity, convex regression, control function, instruments, consistency 1 Introduction Shape-constrained nonparametric regression avoids restrictive assumptions about the functional form of the regression function by building upon convexity ( Hildreth 1954 ) and/or monotonicity constraints ( Brunk 1955 ; Brunk 1958 ) . Convexity and monotonicity constraints are particularly relevant in the microeconomic applications where the theory implies certain monotonicity and convexity/concavity properties for many functions of interest ( Afriat 1967 ; Afriat 1972 ; Varian 1982 ; Varian 1984 , e.g.,) . For example, the cost function of a firm must be monotonic increasing and convex with respect to the input prices. The recent developments in the convex regression enable researchers to impose concavity or convexity constraints implied by the theory to estimate the functions of interest without any parametric functional form assumptions. Since the development of an explicit piecewise linear characterization by Kuosmanen 2008 , convex regression has attracted growing interest in econometrics, statistics, operations research, machine learning, and related fields ( Seijo and Sen 2011 ; Lim and Glynn 2012 ; Hannah and Dunson 2013 ; Mazumder et al. 2019 ; Yagi et al. 2020 ; Bertsimas and Mundru 2021 , e.g.,) . Extensions of the convex regression to the quantile and expectile estimation have proved useful for estimating marginal abatement costs of pollution emissions ( Kuosmanen and Zhou 2021 ; Dai et al. 2023a ; Dai et al. 2025 ) . In the linear regression, the random error term is assumed to be uncorrelated with the explanatory variables. In the generalized method of moments (GMM) interpretation of the linear regression, this property is called the population orthogonality condition. It is easy to show that the residuals of the ordinary least squares (OLS) estimator satisfy the corresponding sample orthogonality condition, that is, OLS residuals do not correlate with any of the regressors by construction. Essential statistical properties such as unbiasedness and consistency of the OLS estimator critically depend on the orthogonality condition. If the orthogonality condition does not hold, the problem is referred to as endogeneity. The standard econometric approach is then to find instrumental variables (IVs) that are highly correlated with the regressors but uncorrelated with the error term. The orthogonality conditions for convex regression remain unknown. While the statistical consistency of the convex regression has been proved assuming the standard orthogonality condition, we do not know how convex regression behaves if regressors are endogenous. Consequently, practitioners are unable to evaluate the suitability of convex regression in applications where explanatory variables may be endogenous, and they lack the means to address potential endogeneity bias. The contributions of this paper are three-fold: The first contribution of this paper is to formally analyze the sample orthogonality for convex regression. Applying Lagrange duality, we establish the sample orthogonality conditions for the most essential variants of convex regression, including additive and multiplicative formulations of the regression model, with and without monotonicity and homogeneity constraints. The results of this paper are relevant to practitioners who need to understand what kind of exogeneity assumptions are required for different variants of convex regression. The second contribution of this paper is to propose a hybrid IV control function approach integrated into convex regression. The classic two-stage least squares (2SLS) approach can be adapted to correct the endogeneity bias in convex regression, but the nonparametric IV estimation may lead to poor statistical performance due to its ill-posedness ( Chetverikov and Wilhelm 2017 ) . Moreover, it is difficult to estimate convex regression with endogeneity (a pure nonparametric regression model) because the 2SLS approach is not directly transferable to a nonlinear or nonparametric setting ( Yatchew 2003 ) . Alternatively, the control function is commonly used to address the simultaneity bias ( Olley and Pakes 1996 ; Levinsohn and Petrin 2003 ; Ackerberg et al. 2015 , see, e.g.,) or the measurement error in inputs ( Collard-Wexler and De Loecker 2016 ; Dong et al. 2021 , see, e.g.,) when estimating the production function. In the spirit of fully utilizing the IV and control function, we propose a hybrid IV control function-based convex regression to address the potential endogeneity problem. The consistency of the proposed approach is established. Our third contribution is to conduct three Monte Carlo experiments in the context of the classic Cobb–Douglas production function. The first experiment examines the finite sample performance of OLS and convex regression estimators under endogeneity. The second experiment compares the finite sample performance of convex regression and convex regression with the 2SLS and IV control function approaches, where the monotonicity is relaxed. The third experiment tests whether the performance of convex regression with monotonicity improves or deteriorates when the IV and IV control function approaches are introduced. An empirical application to the Chilean manufacturing production data illustrates whether the hybrid IV control function approach empirically makes a difference and whether monotonicity should be avoided in convex regression. We further shed new light on the question: if the sample orthogonality does not hold, then how does the performance of convex regression with IV control function? In the existing literature, there is little evidence of whether the performance should improve or deteriorate after using the IV control function or even the 2SLS approach. Our simulation findings suggest that the convex regression with monotonicity constraints (i.e., the sample orthogonality condition cannot be held) can improve its performance after using the IV control function approach in the case of endogeneity. The rest of this paper is organized as follows. Section 2 briefly introduces the additive and multiplicative convex regression. Section 3 examines the sample orthogonality conditions in the cases with and without monotonicity. The two-stage IV control function-based convex regression is developed in Section 4 . Sections 5 and 6 implement the Monte Carlo simulations and empirical application to Chilean manufacturing data. Section 7 concludes the paper with suggested future avenues. The formal proofs and additional tables and figures are attached in the Appendix. 2 Preliminaries on convex regression 2.1 Additive model Consider the following multivariate additive model y_{i}=f({\boldsymbol{x}}_{i})+\varepsilon_{i} (1) where y_{i} is the dependent variable, {\boldsymbol{x}}_{i} is a k -dimensional vector of explanatory variables, and \varepsilon_{i} is a random error term with zero mean and a constant and finite variance. f:{\mathbb{R}}_{+}^{k}\rightarrow{\mathbb{R}} is assumed to be a (homogeneous) concave/convex regression function with an unknown functional form ( Kuosmanen 2008 ; Seijo and Sen 2011 ; Kuosmanen and Kortelainen 2012 , see, e.g.,) . Building on the results by Afriat 1967 ( Afriat