Is External Information Useful for Data Fusion? An Evaluation before Acquisition
Guorong Dai, Lingxuan Shao, Jinbo Chen · 2025
Read Is External Information Useful for Data Fusion? An Evaluation before Acquisition by Guorong Dai, Lingxuan Shao, Jinbo Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22351.txt.
Introduction
Guorong Dai, Lingxuan Shao, and Jinbo Chen wrote a 2025 paper on a choice that comes up in data work. A team has its own data set and may pay for outside data to sharpen its estimates. The team would like to know, before paying, whether the outside data is worth the cost.
The authors build a score for that worth, based on how much sharper the estimate could get at best. The score does not depend on which method the team later uses. They also show how to gauge the score from the team's own data alone. Worked cases show how the gauge behaves in real settings.
Catalog record
| CREATOR | Guorong Dai, Lingxuan Shao, Jinbo Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-22351
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Is External Information Useful for Data Fusion? An Evaluation before Acquisition Guorong Dai, Lingxuan Shao, Jinbo Chen Abstract We consider a general statistical estimation problem involving a finite-dimensional target parameter vector. Beyond an internal data set drawn from the population distribution, external information, such as additional individual data or summary statistics, can potentially improve the estimation when incorporated via appropriate data fusion techniques. However, since acquiring external information often incurs costs, it is desirable to assess its utility beforehand using only the internal data. To address this need, we introduce a utility measure based on estimation efficiency, defined as the ratio of semiparametric efficiency bounds for estimating the target parameters with versus without incorporating the external information. It quantifies the maximum potential efficiency improvement offered by the external information, independent of specific estimation methods. To enable inference on this measure before acquiring the external information, we propose a general approach for constructing its estimators using only the internal data, adopting the efficient influence function methodology. Several concrete examples, where the target parameters and external information take various forms, are explored, demonstrating the versatility of our general framework. For each example, we construct point and interval estimators for the proposed measure and establish their asymptotic properties. Simulation studies confirm the finite-sample performance of our approach, while a real data application highlights its practical value. In scientific research and business applications, our framework significantly empowers cost-effective decision making regarding acquisition of external information. K eywords Cost-benefit analysis \cdot Data fusion \cdot Efficiency bound \cdot Influence function 1 Introduction Consider a general statistical estimation problem, where the target is a finite-dimensional parameter vector \mu_{0}\equiv\mu(F_{Z})\in\mathbb{R}^{d} , which is a functional of the distribution function F_{Z} of a random vector Z . Suppose an internal data set \mathcal{D}_{\hbox{\rm{IN}}}:=\{Z_{i}:i=1,\ldots,n\} is available, providing n independent copies of Z , allowing valid estimation of \mu_{0} under suitable conditions. Additionally, external information concerning F_{Z} , independent of \mathcal{D}_{\hbox{\rm{IN}}} , may also be obtainable. Examples include additional individual observations or summary statistics for components of Z . This external information, denoted by \mathcal{D}_{\hbox{EX}} , has potential to enhance the estimation of \mu_{0} beyond what can be achieved with \mathcal{D}_{\hbox{\rm{IN}}} alone, as demonstrated in Chakrabortty et al. 2022 , Hu et al. 2022 , Zhang and Bradic 2022 and other data fusion literature. However, acquiring external information often incurs costs in practice. This situation raises an important question: are the potential benefits of incorporating external information worth the cost? Before making a payment decision, it is preferable to evaluate its utility for estimation using the currently available data \mathcal{D}_{\hbox{\rm{IN}}} . This problem is common in scientific research and business applications. To illustrate this, consider the following example, which will be explored in detail in Section 4 : Example 1 Suppose Z\equiv(Y,X)\in\mathbb{R}\times\mathbb{R}^{p} consists of a response variable and a set of covariates. The goal is to estimate the mean response \mu_{0}\equiv\mathbb{E}(Y) . Below are three cases involving different types of external information that may be available in addition to the internal data \mathcal{D}_{\hbox{\rm{IN}}}\equiv\{(Y_{i},X_{i}):i=1,\dots,100\} : (i) An online database offers massive covariate data, almost fully capturing the true distribution F_{X} of X , at a certain price. (ii) Under a fixed budget, it is possible to collect either 20 additional observations of Y or 100 additional observations of X . This situation, where response data are more expensive than covariate data, aligns with the “semi-supervised” setting discussed in recent literature ( Chakrabortty et al. 2022 ; Zhang and Bradic 2022 ) . (iii) Again under budget constraints, one may choose between 100 additional individual observations for X or the average of 500 additional observations for X . Such scenarios are common in practice, as summary statistics are often easier to obtain than individual-level data ( Hu et al. 2022 ) . In Example 1 and similar scenarios where \mu_{0} represents other functionals of F_{Z} , it is critical to assess and compare the utility of various types of external information for estimating \mu_{0} . Motivated by this great practical importance, we aim to quantify external information utility and perform valid statistical inference on it using the internal data \mathcal{D}_{\hbox{\rm{IN}}} . 1.1 Basic idea Using the internal data \mathcal{D}_{\hbox{\rm{IN}}} , we can typically construct consistent and asymptotically normal estimators for common parameters, ensuring valid inference. The primary advantage of incorporating the external information \mathcal{D}_{\hbox{EX}} is its potential to enhance inference efficiency. Once \mathcal{D}_{\hbox{EX}} is obtained, it can be integrated with \mathcal{D}_{\hbox{\rm{IN}}} to estimate \mu_{0} through a variety of data fusion methods, given the rapid advancements in this field. However, it is impractical to evaluate each method and compare them to estimators relying solely on internal data. This challenge motives us to characterize the utility of \mathcal{D}_{\hbox{EX}} as its intrinsic property—independent of any specific data fusion methodology. Specifically, within a broad class of reasonable and commonly used estimators for \mu_{0} , we compare the optimal efficiency attainable in two scenarios: with and without the incorporation of \mathcal{D}_{\hbox{EX}} . Such a comparison quantifies the maximum potential utility of \mathcal{D}_{\hbox{EX}} for estimating \mu_{0} , agnostic to specific algorithms employed for estimation. This conceptual framework will be formalized in Section 2 . 1.2 Existing relevant works and our contributions As one of the most compelling research areas in statistics, data fusion has garnered significant attention in the past few decades. Comprehensive reviews of this field can be found in Hu et al. 2022 and Yu and Zhang 2024 . Most existing studies on data fusion assume both the internal data \mathcal{D}_{\hbox{\rm{IN}}} and the external information \mathcal{D}_{\hbox{EX}} are already available, concentrating on how to utilize them effectively in estimation problems. This essentially differs from our objective, which is to evaluate the intrinsic, algorithm-agnostic utility of \mathcal{D}_{\hbox{EX}} before its acquisition. To our knowledge, this has not been studied in the literature. Specifically, in the context of estimating a generic functional \mu_{0}\equiv\mu(F_{Z}) of the population distribution F_{Z} , we introduce in Section 2.2 a general algorithm-agnostic utility measure, denoted by \theta_{0}\in(0,1\,] , for various types of external information. Following the approach outlined in Section 1.1 , this measure is defined as the ratio of the semiparametric efficiency bounds ( Tsiatis 2007 ) associated with estimation based solely on internal data versus estimation incorporating both internal data and external information. The complement (1-\theta_{0}) quantifies the maximum potential efficiency improvement achievable by incorporating the external information \mathcal{D}_{\hbox{EX}} into the estimation. Next, we consider statistical inference for \theta_{0} using only the internal data \mathcal{D}_{\hbox{\rm{IN}}}\equiv\{Z_{i}:i=1,\ldots,n\} , which can be performed prior to acquiring \mathcal{D}_{\hbox{EX}} . To avoid model misspecification and ensure broad applicability, we develop in Section 3 a fully nonparametric approach for estimating \theta_{0} . The efficient influence function method ( Hines et al. 2022 ) is adopted to address challenges posed by potentially complex nuisance functions, ensuring tractable asymptotic properties of our estimators. As illustrations of our general framework, we thoroughly analyze Example 1 (Section 4 ), as well as two more complex cases where the target \mu_{0} is a nonlinear or vector-valued functional of F_{Z} (Appendices A – B ). In these examples with various types of external information, we specify point and interval estimators for the utility measure \theta_{0} , deriving their asymptotic properties including convergence rates and coverage guarantees. All