Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change.

de Vet HC, Terwee CB, Ostelo RW, Beckerman H, Knol DL, Bouter LM. · 2006

Read Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change. by de Vet HC, Terwee CB, Ostelo RW, Beckerman H, Knol DL, Bouter LM. (2006) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc1560110.txt.

Introduction

A small score change on a health survey can mean two unlike things. de Vet and co-authors untangled them in 2006. One is the smallest change a tool can reliably detect, beyond noise. The other is the smallest change patients count as important.

Methods that use score spread alone tend to find the detectable change. Methods anchored to patient judgment find the important change. de Vet argues the two should not be merged into one number. Knowing both tells clinics whether a tool is sharp enough to catch changes that matter. Anchor-based methods, they say, deserve preference for importance.

Catalog record

CREATORde Vet HC, Terwee CB, Ostelo RW, Beckerman H, Knol DL, Bouter LM.
YEAR2006
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC1560110

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Minimal changes in health status questionnaires: distinction between minimally detectable change and minimally important change By Henrica C de Vet, Caroline B Terwee, Raymond W Ostelo, Heleen Beckerman, Dirk L Knol, Lex M Bouter Published in: Health and Quality of Life Outcomes DOI: 10.1186/1477-7525-4-54 ABSTRACT Abstract Changes in scores on health status questionnaires are difficult to interpret. Several methods to determine minimally important changes (MICs) have been proposed which can broadly be divided in distribution-based and anchor-based methods. Comparisons of these methods have led to insight into essential differences between these approaches. Some authors have tried to come to a uniform measure for the MIC, such as 0.5 standard deviation and the value of one standard error of measurement (SEM). Others have emphasized the diversity of MIC values, depending on the type of anchor, the definition of minimal importance on the anchor, and characteristics of the disease under study. A closer look makes clear that some distribution-based methods have been merely focused on minimally detectable changes. For assessing minimally important changes, anchor-based methods are preferred, as they include a definition of what is minimally important. Acknowledging the distinction between minimally detectable and minimally important changes is useful, not only to avoid confusion among MIC methods, but also to gain information on two important benchmarks on the scale of a health status measurement instrument. Appreciating the distinction, it becomes possible to judge whether the minimally detectable change of a measurement instrument is sufficiently small to detect minimally important changes. INTRODUCTION Health status questionnaires are increasingly used in medical research and clinical practice. They are attractive because they provide a self-report of patients' perceived health status. However, the meaning of the (changes in) scores on these questionnaires is not intuitively apparent. The interpretation of (change)scores has been a topic of research for almost two decades [1,2]. It is recognized that the statistical significance of a treatment effect, because of its partial dependency on sample size, does not always correspond to the clinical relevance of the effect. Statistically significant effects are those that occur beyond some level of chance. In contrast, clinical relevance refers to the benefits derived from that treatment, its impact upon the patient, and its implications for clinical management of the patient [2,3]. As a yardstick for clinical relevance one is interested in the minimally important change (MIC) of health status questionnaires. Changes in scores exceeding the MIC are clinically relevant by definition. Different methods to determine the MIC on the scale of a measurement instrument have been proposed. These methods have been summarized by Lydick and Epstein [4], and recently more extensively by Crosby et al. [5]. Both overviews distinguish distribution-based and anchor-based methods [4,5]. Distribution-based approaches are based on statistical characteristics of the sample at issue. Most distribution-based methods express the observed change in a standardized metric. Examples are the effect size (ES) and the standardized response mean (SRM), where the numerators of both parameters represent the mean change and the denominators are the standard deviation at baseline and the standard deviation of change for the sample at issue, respectively. Another distribution-based measure is the standard error of measurement (SEM), which links the reliability of the measurement instrument to the standard deviation of the population [5]. ES and SRM are relative representations of change (without units), whereas the SEM provides a number in the same units as the original measurement. The major disadvantage of all distribution-based methods is that they do not, in themselves, provide a good indication of the importance of the observed change. Anchor-based methods assess which changes on the measurement instrument correspond with a minimal important change defined on the anchor [4], i.e. an external criterion is used to operationalize a relevant or an important change. The advantage is that the concept of 'minimal importance' is explicitly defined and incorporated in these methods. A limitation of anchor-based approaches is that they do not, in themselves, take measurement precision into account [4,5]. Thus, there is no information on whether an important change according to an anchor-based method, lies within the measurement error of the health status measurement. An often used anchor-based method is the one proposed by Jaeschke et al. [2], which defined MIC as the mean change in scores of patients categorized by the anchor as having experienced minimally important improvement or minimally important deterioration. Another anchor-based method, proposed by Deyo and Centor [6], is based on diagnostic test methodology. In this method, the change score on the measurement instrument is considered the diagnostic test and the anchor, dividing the population in persons who are minimally importantly changed and those who are not, is considered the gold standard. At different cut-off values of change scores the sensitivity and specificity are calculated and the MIC value is set at the change value on the measurement, where the sum of the percentages of false positives and false negatives is minimal. A number of studies have compared anchor-based and distribution-based approaches. Comparisons of these approaches sometimes led to surprisingly similar results. However, in other situations different results were found. The focus of this paper is on explanation of the differences between distribution-based and anchor-based approaches. We will provide arguments for the distinction between minimally detectable change and minimally important change. Appreciating and acknowledging this distinction enhances the interpretation of change scores of a measurement instrument. Comparison of SEM with anchor-based approaches A number of studies have compared the value of the SEM with the MIC value derived by an anchor-based approach. A SEM value is easy to calculate, based on the standard deviation (SD) of the sample and the reliability of the measurement instrument: in formula: SEM = SD √(1-R). As reliability parameter, test-retest reliability or Cronbach's α can be used. In the latter case, SEM can be calculated based on one measurement and it purely represents the variability of the instrument [7]. Test-retest reliability requires two measurements in a stable population. It represents the temporal stability and is therefore more appropriate than Cronbach's α to use in the context of changes in health status which are based on measurements at two different time points [8]. In classical test theory, SEM has a rather stable value in different populations [6]. Several authors showed that a MIC based on patient's global rating as anchor was close to the value of one SEM [9,11]. Cella et al. [12] also observed similar values for SEM and MIC, using clinical parameters as anchor instead of patients' global rating of change. However, Crosby et al. [13] showed that only for patients with moderate baseline values the anchor-based MIC value more or less equalled the SEM value (with adjustment for regression to the mean). With higher baseline values the MIC became considerably larger than one SEM, while with lower baseline values the MIC became much smaller than one SEM. A recent study [14] compared SEM with anchor-based estimations of minimally important change using crosssectional and longitudinal anchors. No substantial differences were found between these methods, but it should be noted that they only presented anchor-based values when effect sizes were between 0.2 and 0.5 [14]. Wyrwich [15], compared SEM to MIC values determined by an anchor-based approach in two sets of studies which differed

Read the complete text