Overidentification testing with weak instruments and heteroskedasticity
Stuart Lane Frank Windmeijer · 2025
Read Overidentification testing with weak instruments and heteroskedasticity by Stuart Lane Frank Windmeijer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-21096.txt.
Introduction
Econometricians test whether their instruments are valid using overidentification tests, but weak instruments and uneven error variance can distort those tests badly. Stuart Lane and Frank Windmeijer compare two such tests in a 2025 econometrics paper. One is the classic J-test; the other is the Kleibergen-Paap rank test.
The authors derive the limiting distributions of both tests under heteroskedasticity and weak instruments, as special cases of a robust score test. Simulations show the Kleibergen-Paap test usually behaves better. The J-test suffers severe size distortions, rejecting valid instruments too often. Because test size depends on parameters that weak instruments cannot pin down, they recommend a conservative approach. A classic estimation problem is revisited at the end.
Catalog record
| CREATOR | Stuart Lane Frank Windmeijer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 108 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-21096
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Overidentification testing with weak instruments and heteroskedasticity Thanks: We thank Vincent Han, Stefan Hubner, Gregory Jolivet, Pascal Lavergne, David Pacini, Pietro Spini, Senay Sokullu and participants in seminars at the University of Bristol and University College London for helpful comments and suggestions. Contact Stuart Lane via email for MATLAB replication code, and preliminary versions of Python and R functions and packages for robust overidentification testing. *This paper is based on Chapters 1 and 2 of Stuart Lane’s Ph.D. thesis (University of Bristol, 2024). Stuart Lane Frank Windmeijer Abstract Exogeneity is key for IV estimators, which can assessed via overidentification (OID) tests. We discuss the Kleibergen-Paap ( K P KP ) rank test as a heteroskedasticity-robust OID test and compare to the typical J J -test. We derive the heteroskedastic weak-instrument limiting distributions for J J and K P KP as special cases of the robust score test estimated via 2SLS and LIML respectively. Monte Carlo simulations show that K P KP usually performs better than J J , which is prone to severe size distortions. Test size depends on model parameters not consistently estimable with weak instruments, so a conservative approach is recommended. This generalises recommendations to use LIML-based OID tests under homoskedasticity. We then revisit the classic problem of estimating the elasticity of intertemporal substitution (EIS) in lifecycle consumption models. Lagged macroeconomic indicators should provide naturally valid but frequently weak instruments. The literature provides a wide range of estimates for this parameter, and J J frequently rejects the null of valid instruments. J J often rejects the null whereas K P KP does not; we suggest that J J over-rejects, sometimes severely. We argue that K P KP -test should be used over the J J -test. We also argue that instrument invalidity/misspecification is unlikely the cause of the range of EIS estimates in the literature. Keywords: Overidentification tests, weak instruments, heteroskedasticity, elasticity of intertemporal substitution 1 Introduction Exogeneity is a key identifying assumption for validity in instrumental variables (IV) regression. Overidentification tests assess this assumption with the hypothesis specification \mathbb{H}_{0}:\mathbb{E}[z_{i}u_{i}]=0 v.s. \mathbb{H}_{1}:\mathbb{E}[z_{i}u_{i}]\neq 0 , where z_{i} and u_{i} are the instrument vector and structural error for observation i , respectively. These tests can be performed whenever k_{z}>k_{x} , where k_{z} and k_{x} are the number of instruments and endogenous regressors respectively. The Sargan test ( Sargan 1958a ) is an early example of such a test, testing the orthogonality of instruments in the standard linear setting with homoskedasticity. The Hansen test ( Hansen 1982a ) , denoted by J , generalises the Sargan test to the generalised method of moments (GMM) framework, allowing for overidentification testing on a far greater range of econometric models. The properties of these test statistics are well-known under standard asymptotics (e.g. Greene 2003a ). In this paper we discuss the use of the Kleibergen-Paap ( KP hereafter) rank test ( Kleibergen & Paap 2006a ) as a heteroskedasticity-robust overidentification test and compare its suitability to the ubiquitous J -test. This is the first assessment of the test in an overidentification context, following from Windmeijer 2018a who presents a framework linking overidentification tests, underidentification tests, the score test, and rank tests. Underidentification tests assess rank hypotheses such as \mathbb{H}_{0}:\textup{rank}(\Pi)=k_{x}-1 v.s. \mathbb{H}_{1}:\textup{rank}(\Pi)=k_{x} , where \Pi is the k_{z}\times k_{x} first-stage parameter matrix (the KP -test is a standard underidentification test, commonly reported in statistical packages such as Stata). By formulating overidentification tests as rank tests on the reduced-form k_{z}\times(k_{x}+1) parameter matrix \bar{\Pi} with \mathbb{H}_{0}:\textup{rank}(\bar{\Pi})=k_{x} v.s. \mathbb{H}_{1}:\textup{rank}(\bar{\Pi})=k_{x}+1 instead of the usual \mathbb{H}_{0}:\mathbb{E}[z_{i}u_{i}]=0 , Windmeijer 2018a shows that any underidentification test can be used as an overidentification test if performed on an appropriate auxiliary regression, with an analogous result for using overidentification tests as underidentification tests. The paper further shows that the 2SLS-based and LIML-based robust score tests are equivalent to the J - and KP -tests respectively. The J - and KP -tests have the same limiting \chi^{2}(k_{z}-k_{x}) distributions under the null when instruments are strong and provide numerically similar values in finite samples. However, their behaviour in a weak instrument setting is unlikely to be similar, and the relative performance of IV methods when instruments are potentially weak is often a key motivator for choosing between them. Staiger & Stock 1997a derive the limiting distribution of the Sargan test under weak instruments with homoskedasticity, providing a general recommendation to use LIML over 2SLS for overidentification tests based on numerical evidence. We extend these results by deriving the limiting distribution of the robust score test (which nests J and KP ) under heteroskedastic weak instruments. Due to the highly non-standard nature of the limiting distributions, a direct comparison is difficult. We therefore conduct an extensive Monte Carlo study, and usually find KP preferable to J . The J -test performs extremely poorly in models with high endogeneity and/or strong heteroskedasticity and in general KP exhibits better size properties and is much less likely than J to be severely size distorted, especially when the number of overidentifying restrictions is small. Test size is dependent on model parameters that are not consistently estimable with weak instruments such as the strength of endogeneity. Consequently, it is difficult for researchers to gauge which test statistic would work better based on parameters estimated from data, and recommend a conservative approach that avoids severe size distortions where possible. We therefore find that our guidance to use the KP -test (equivalent to a LIML robust score test) under heteroskedastic weak instruments generalises the guidance from Staiger & Stock 1997a for LIML-based testing under homoskedasticity. Given these theoretical results, we revisit the classic macroeconomic problem of estimating the elasticity of intertemporal substitution (EIS), the degree to which consumers adjust their consumption path in response to changes in the expected real interest rate. Due to the importance of this parameter for both theory and policy, it is unsurprising that the EIS has been given considerable attention in the empirical literature (e.g. Hansen & Singleton 1983a and Hall 1988a ). However, there is large variation in values of the EIS that constitute credible estimates, with substantial variation depending on the country, asset of choice or how the data are aggregated. Common concerns regard the strength and validity of the instruments used in estimation, often formed from lagged macroeconomic indicators. Such instruments should be naturally exogenous, but unfortunately are often poorly correlated with endogenous variables at time t , particularly as the number of lags increases, and this can lead to substantial weak instrument problems ( Yogo 2004a ) . The model also likely suffers from heteroskedasticity, which represents precautionary saving in this model ( Yogo 2004a ; Gomes & Paz 2013a ) . Within the literature, there are a number of papers where both weak instruments and heteroskedasticity are present, and that reject the overidentifying restrictions using the J -test e.g. Epstein & Zin 1991a , Dacy & Hasanov 2011a , Gomes & Paz 2011a , and Gomes & Paz 2013a . This leads to doubt over the validity of the moment conditions and instruments that identify and estimate the model and could potentially, at least partially, explain the variation in estimates of the EIS found in the literature. However, our