Methods to address measurement error in both Outcome and Covariates
Pamela A. Shaw, Bryan E. Shepherd · 2026
Read Methods to address measurement error in both Outcome and Covariates by Pamela A. Shaw, Bryan E. Shepherd (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28810.txt.
Introduction
Shaw and Shepherd offer a tutorial on a common headache in health research: mistakes in both the outcome a study measures and the factors it compares. Large cohort studies and electronic health records are cheap and rich, but their variables were not collected for research and are often built by algorithms. Audits in cohorts of people living with HIV, they note, have found error rates as high as 56 percent for key variables.
Errors in one variable can trigger linked errors in others, for example when a wrong diagnosis date shifts every later timing. Most past work treated error in either exposures or outcomes, not both together. The tutorial lays out the data structure, builds a synthetic example dataset that readers can reuse, and walks through available correction methods. It compares results across methods and stresses that most approaches need validation or repeat data revealing how the errors behave.
Catalog record
| CREATOR | Pamela A. Shaw, Bryan E. Shepherd |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28810
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Methods to address measurement error in both Outcome and Covariates Pamela A. Shaw, Bryan E. Shepherd Abstract 1 Introduction Measurement error is a problem that arises in many settings in biostatistical applications, where exposures and outcomes can be complex and difficult to measure accurately. Data from large observational cohort studies can be particularly error-prone due to the impracticality of precise measurement on a large number of individuals. Increasingly, many clinical studies are leveraging data from large administrative databases, such as Medicare, or electronic health records (EHR) data as a cost-effective way of collecting a rich set of health-related outcomes and exposures. In study variables derived from administrative or EHR data, errors arise from two fundamental limitations: 1) the data were not collected to support research and 2) study variables are typically derived from automated computer algorithms that may miss or falsely interpret the EHR data. For example, audits of routinely collected data from cohorts of individuals living with HIV have discovered error rates as high as 56% for key variables ( 12 ; 25 ) . In this and other settings reliant on EHR data, errors can arise in both outcomes and exposures. In particular, error in one variable can set off a cascade of correlated errors. For example, if there was an error in the date of diagnosis, baseline covariates meant to represent the patient’s health at time of diagnoses would then be from the wrong time and time from diagnosis to event outcomes would also be incorrect. It has been well established that errors in exposures can bias regression coefficients in association analyses ( 6 ; 53 ; 21 ; 42 ) . Research has also shown errors in outcomes, in both linear and non-linear models, can bias analyses – particularly when errors are known to be covariate-dependent ( 21 ; 42 ) . Most of the measurement error literature to date, however, has focused on errors in either the exposure or the outcome, but not both. Even in cases where analytical approaches have been well-established ( 6 ) , such as in the simpler case of errors only in covariates, researchers often ignore the errors in their analyses or make incorrect claims about the impact of the measurement error on their study results ( 4 ; 41 ) . In this tutorial, we will discuss methods of analysis for settings where there are errors potentially in both outcomes and exposures and illustrate their use in practical examples. In these examples, we will compare results across the methods and discuss the relative advantages of the different approaches for various settings. Importantly methods to address measurement error generally need validation or replication data that provide information on the structure of the measurement error. We will consider methods of analysis that can be applied to understand the potential impact of measurement error in this setting. In section 2, we describe the data structure for the setting of interest and introduce notation. In section 3, we present a motivating example, and we describe a synthetic dataset we generate from this example which we will use to illustrate the methods; the synthetic dataset is available to readers so that they can reproduce the results in this paper. We then describe several methods available to address the measurement error in both outcomes and covariates and illustrate their application in Section 4. In section 5, we discuss methods that can be applied when there are no available data to inform the measurement error structure. Finally, we conclude with a discussion of some general observations and guidance in Section 6. 2 Data structure and notation Generally to assess, and therefore account for, the measurement error, additional data that are informative of the measurement error structure are needed. In a two-phase design, data available for the entire cohort are collected at phase 1, and additional data are obtained on a subset at phase 2 . For example, error-prone data can often be extracted relatively inexpensively from an EHR database using computer algorithms in phase 1, and in phase 2, higher quality data are obtained by a labor intensive chart review on a subset. When the data collected in phase 2 are considered error-free, or the gold standard, this subset is often referred to as the validation subset . In many settings, the data collected at phase 2 may still be error-prone, but of higher quality and potentially useful for learning about the measurement error. For example, in nutritional epidemiology setting, self-report is an inexpensive way to collect dietary exposures that can be subject to both systematic and random (unbiased) error; whereas, for some nutrients there are biomarkers that measure intake with only random error. Settings where the data at phase 2 have unbiased (classical) measurement error are typically referred to as a calibration subset, a name that refers to a common method to address measurement error, namely regression calibration. We denote error-prone versions of variables with a star. Thus, X^{*} and Y^{*} denote the error prone covariate vector and outcome of interest, respectively, and X and Y denote the error-free versions of these variables. In time-to-event settings, Y may be the pair of variables (T,\Delta) , where T is the censored event time and \Delta is the observed event indicator. These variables may also be in error, denoted as (T^{*},\Delta^{*}) . In some settings there may also be a vector Z of precisely obtained variables at phase 1. In the examples that follow, it will also be useful to define the phase 2 indicator R and distinguish between exposures in the outcome model X and auxiliary variables A , which may be useful for estimation, but do not appear in the outcome model. Let N and n be the size of the phase 1 and phase 2 samples, respectively. While we do not formally address regularity conditions necessary for the discussed methods to have desirable properties, an assumption that is generally sufficient regarding the size of the validation subset is that n/N converges to a constant \rho>0 . 3 Motivating data example 3.1 Maternal Weight Gain (MWG) Study As a running example, we consider a study looking at maternal weight gain, childhood obesity, and childhood asthma. 45 obtained EHR data for 10,335 mother-child dyads receiving care at Vanderbilt University Medical Center, where all mothers were distinct. Data for mothers were collected up to one year prior to conception to the date of delivery, and data for newborn children were collected from birth until age six years. Maternal weight gain during pregnancy and maternal body mass index (BMI) at conception were estimated using functional principal components analyses. Other variables collected for mothers included age at delivery, race, ethnicity, diabetes status, depression, insurance status, smoking history, and asthma diagnosis. Variables collected for children included weight, sex, asthma status, and an indicator that they were delivered using a Cesarean section. Because of concerns regarding the quality of EHR data, and a few key variables only being available from chart review (e.g., estimated conception date), a research nurse performed extensive chart reviews of the data for 996 mother-child dyads. These dyads were chosen using stratified random sampling that occurred over multiple sampling waves where information used from the prior waves