Universal Inference for Incomplete Discrete Choice Models

Hiroaki Kaido, Yi Zhang · 2025

Read Universal Inference for Incomplete Discrete Choice Models by Hiroaki Kaido, Yi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17973.txt.

Introduction

Hiroaki Kaido and Yi Zhang build a confidence method for economic models that predict a set of outcomes instead of one. Many choice models are incomplete: the same conditions allow several results, so the model names a range. Standard tests then lean on tuning knobs, resampling, or heavy simulation.

Their procedure grows from universal inference, hardened for this setting. It keeps finite-sample validity, meaning the stated confidence holds even in small samples. No moment selection, bootstrap, or simulation is required. The target can be a policy counterfactual or another function of the hidden parameters. Mixed discrete and continuous inputs, plus nuisance parameters, are all allowed.

Catalog record

CREATORHiroaki Kaido, Yi Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-17973

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Universal Inference for Incomplete Discrete Choice Models Thanks: This paper builds on earlier work by the authors titled “Robust Likelihood-ratio Tests in Incomplete Economic Models”, which evolved into two papers including this paper. We thank Jean-Jacques Forneron for his comments on the earlier work and for pointing us to work on universal inference. We are grateful to Áureo de Paula, Hidehiko Ichimura, Toru Kitagawa, Seojeong Lee, Simon Lee, Kirill Ponomarev, Azeem Shaikh, and Alex Torgovitsky for their helpful comments. We thank, for their comments, the seminar, lecture, and conference participants at the following places: Chicago, CyberAgent (AI lab), KER International Conference, Kyoto Summer Workshop in Applied Economics, and EEA-ESEM. We thank Undral Byambadalai, Yan Liu, Junwen Lu, Jiahui Guo and Jie Huang for their excellent research assistance. Financial support from NSF grants SES-1824344 and SES-2018498 is gratefully acknowledged. Part of the research was conducted at Microsoft Research (New England) and the University of Tokyo while Kaido was visiting them. Financial support from the Young Scientists Fund of the National Natural Science Foundation of China (NSFC) grant No.72203077 is gratefully acknowledged. Hiroaki Kaido, Yi Zhang Abstract A growing number of empirical models exhibit set-valued predictions. This paper develops a tractable inference method with finite-sample validity for such models. The proposed procedure uses a robust version of the universal inference framework by Wasserman et al. (2020) and avoids using moment selection tuning parameters, resampling, or simulations. The method is designed for constructing confidence intervals for counterfactual objects and other functionals of the underlying parameter. It can be used in applications that involve model incompleteness, discrete and continuous covariates, and parameters containing nuisance components. Keywords: Universal inference, Incomplete models, Discrete choice, Counterfactual analysis, Incidental parameters 1 Introduction Discrete choice models are widely used to study economic agents’ decisions. Such models may make set-valued predictions when the researcher is willing to relax restrictive assumptions. A commonly used structure is that given observable and unobservable exogenous variables (X,U) , multiple values G(U|X;\theta) of an outcome variable Y are predicted. However, how Y is selected from the predicted set is unspecified. A growing number of empirical models exhibit such predictions. Examples include but are not limited to discrete games ( Bresnahan and Reiss, 1990 ; Ciliberto and Tamer, 2009 ) , dynamic panel data models ( Honoré and Tamer, 2006 ; Chesher et al., 2024 ) , discrete choice models with heterogeneous choice sets ( Barseghyan et al., 2021 ) , models with instrumental variables ( Chesher and Rosen, 2017 ; Berry and Compiani, 2022 ) , auctions ( Haile and Tamer, 2003 ) , network formation ( Miyauchi, 2016 ; Sheng, 2020 ) , product offerings ( Eizenberg, 2014 ) , exporter’s decisions ( Dickstein and Morales, 2018 ) and school choices ( Fack et al., 2019 ) . This class nests classic discrete choice models such as binary, multinomial, and ordered choice models, in which G contains a single value of Y . Despite the recent developments in the econometrics literature, the existing methods for estimating such incomplete models often face challenges in applications. In particular, the limiting distributions of the existing statistics for full-vector and sub-vector inference are often non-standard and require complex regularity conditions or tuning parameters. We propose a novel inference method for conducting hypothesis tests and constructing confidence sets (or intervals) in incomplete models. Specifically, we consider testing the composite hypotheses: \displaystyle H_{0}:\theta\in\Theta_{0}~~~\text{v.s.}~~~H_{0}:\theta\in\Theta_{1}~, (1.1) for subsets \Theta_{0} and \Theta_{1} of a parameter space \Theta . Our proposal is to compare a tailor-made likelihood-ratio statistic to a fixed critical value, which builds on the universal inference method of Wasserman et al. (2020) . We show that the test is universally valid, meaning the proposed test has a correct size in any finite sample without complex regularity conditions. Since the critical value is fixed, the proposed method remains computationally tractable in models of practical relevance. For example, we allow models to involve a number of discrete or continuous covariates and their associated parameters. The proposed test also avoids the use of moment selection or other regularization tuning parameters. Inverting the test yields confidence sets (or intervals) for the structural parameter, their subcomponents, and counterfactual objects. This paper aims to develop a versatile inference procedure that is widely applicable. We demonstrate that any incomplete discrete choice model possesses a structure that allows us to conduct the proposed test. The main idea is as follows: When trying to distinguish between the null parameter set \Theta_{0} and any (unrestricted) parameter value \theta_{1}\in\Theta , a classic idea is to use a likelihood ratio (LR) to compare the model fit at each \theta\in\Theta_{0} against \theta_{1} . While the model incompleteness makes it difficult to apply this idea to the current setting, we show that a special pair of densities called least-favorable pair exists for testing \theta\in\Theta_{0} against \theta_{1} . This insight allows us to construct a parametric model \{q_{\theta}\} indexed only by \theta , which is useful for constructing a robust test. 1 1 1 This parametric model can be derived analytically in many existing models ( Kaido and Zhang, 2019 , see) . We also provide a command to implement the procedure as part of a general Python library for incomplete discrete choice models ( https://github.com/hkaido0718/IncompleteDiscreteChoice ). Using this construction, we obtain a novel LR statistic for universal inference. Our framework allows the researcher to leave parts of individuals’ decision processes unspecified and heterogeneous. For example, Barseghyan et al. (2021) left the unknown choice-set formation process flexible. The choice of an insurance plan may involve some buyers forming their choice set using an online platform, while others may form their choice sets based on recommendations by their insurance agents. These potentially heterogeneous choice set formation processes are unobservable to the econometrician and may not be understood well enough to be modeled. 2 2 2 If the researcher understands how the process operates, they can formulate it using a probabilistic model. Some studies take this approach ( Bjorn and Vuong, 1984 ; Bajari et al., 2010 ) . In an extreme case, each decision maker may have their own choice-set formation process, rendering them incidental parameters . While some empirical studies impose regularity conditions that implicitly limit the heterogeneity of decision processes, our proposed procedure remains valid without such assumptions. 3 3 3 Existing studies often impose some assumption on the heterogeneity of outcome distributions to apply limit theorems. A leading example is to assume identically distributed outcomes, which holds under identically distributed selection mechanisms. A weaker assumption is that samples are stationary and strongly mixing ( Chernozhukov et al., 2007 ; Andrews and Soares, 2010 ) , which imposes implicit restrictions on the selection mechanisms. An exception is Epstein et al. (2016) , which allowed arbitrary heterogeneity and dependence. The proposed procedure has two novel features compared to standard treatments of LR tests. Integrating them into the standard inference toolkit is straightforward. First, it utilizes a tailor-made likelihood function that can be derived by solving a convex program. We provide an algorithm and demonstrate that leading examples have closed-form likelihoods. Second, the test employs cross-fitting. Specifically, we obtain a parameter estimate from one subsample, use the other subsample to evaluate the likelihood ratio, and aggregate the

Read the complete text