Determining the clinical importance of treatment benefits for interventions for painful orthopedic conditions.
Katz NP, Paillard FC, Ekman E. · 2015
Read Determining the clinical importance of treatment benefits for interventions for painful orthopedic conditions. by Katz NP, Paillard FC, Ekman E. (2015) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc4327973.txt.
Introduction
Nathaniel P Katz, Florence C Paillard, and Evan Ekman explain how to judge whether a treatment for painful bone and joint conditions helps enough to matter to patients. Their paper appeared in the Journal of Orthopaedic Surgery and Research in 2015. Trials report statistical significance, but a tiny average gain can clear that bar while leaving patients no better in daily life.
The authors describe a two step yardstick: fix the smallest change on a measure that patients count as important, then apply it to each patient's results. They review how such thresholds, including the minimum clinically important difference, are derived and where they mislead. The guidance is meant for trial designers and clinicians reading orthopedic evidence.
Catalog record
| CREATOR | Katz NP, Paillard FC, Ekman E. |
|---|---|
| YEAR | 2015 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Determining the clinical importance of treatment benefits for interventions for painful orthopedic conditions By Nathaniel P Katz, Florence C Paillard, Evan Ekman Published in: Journal of Orthopaedic Surgery and Research DOI: 10.1186/s13018-014-0144-x ABSTRACT The overarching goals of treatments for orthopedic conditions are generally to improve or restore function and alleviate pain. Results of clinical trials are generally used to determine whether a treatment is efficacious; however, a statistically significant improvement may not actually be clinically important, i.e., meaningful to the patient. To determine whether an intervention has produced clinically important benefits requires a two-step process: first, determining the magnitude of change considered clinically important for a particular measure in the relevant population and, second, applying this yardstick to a patient’s data to determine whether s/he has benefited from treatment. Several metrics have been devised to quantify clinically important differences, including the minimum clinically important difference (MCID) and clinically important difference (CID). Herein, we review the methods to generate the MCID and other metrics and their use and interpretation in clinical trials and practice. We particularly highlight the many pitfalls associated with the generation and utilization of these metrics that can impair their correct use. These pitfalls include the fact that different pain measures yield different MCIDs, that efficacy in clinical trials is impacted by various factors (population characteristics, trial design), that the MCID value is impacted by the method used to calculate it (anchor, distribution), by the type of anchor chosen and by the definition (threshold) of improvement. The MCID is also dependent on the population characteristics such as disease type and severity, sex, age, etc. For appropriate use, the MCID should be applied to changes in individual subjects, not to group changes. The MCID and CID are useful tools to define general guidelines to determine whether a treatment produces clinically meaningful effects. However, the many pitfalls associated with these metrics require a detailed understanding of the methods to calculate them and their context of use. Orthopedic surgeons that will use these metrics need to carefully understand them and be aware of their pitfalls. INTRODUCTION Musculoskeletal conditions are often associated with reduced function and pain. In most common orthopedic conditions, patients and clinicians determine the success of treatment based on two main outcomes: pain reduction and functional improvement [1]. Whether a treatment is efficacious is determined by reviewing the results of randomized controlled trials (RCTs). The primary thrust of RCTs is to demonstrate a statistically significant difference in outcome between treatment groups. Statistical significance, however, does not necessarily imply clinical significance, or clinical importance, i.e., whether the observed improvement is meaningful to the patient [2-5]. Very small treatment effects, too small to be meaningful to patients, will be statistically significant if the sample sizes are large enough. Treatments that produce large and clinically important benefits may fail to achieve statistical significance if the sample size was too small. To this end, clinical researchers have introduced a series of metrics to determine whether improvements after treatment are clinically important [5]. Determining whether a treatment effect is clinically significant is paramount for a variety of stakeholders in the orthopedic community, including committees that develop treatment guidelines and formularies, make regulatory decisions, set market access and reimbursement policies, conduct systematic reviews, and practicing orthopedists who need to make informed decisions regarding patient treatments. Errors in determination of clinical significance of interventions for orthopedic conditions may have high consequences. These stakeholders bear a responsibility to understand how clinical importance is determined and ensure that decisions based on estimates of clinical importance are based on appropriate methods. Other aspects of treatment should be considered in the choice of one orthopedic intervention over another. These include impact on physical function, quality of life (both psychological and social aspects), tolerability, convenience, availability, physician’s preference and experience, cost, and alternative treatment options [6]. This review focuses on the determination of the clinical importance of changes in pain intensity (PI), usually the primary outcome measure in clinical trials of these conditions. Ultimately, this review should help those who generate the metrics of clinically important changes, and those who use these metrics to make informed decisions regarding orthopedic treatments. To this end, we will review how these metrics are generated, and how these metrics can and should be interpreted to make informed decisions, highlighting the many pitfalls of these two processes. Overview of the process Two processes In determining whether an intervention studied in an RCT has produced a clinically important benefit, two different processes are involved (Figure 1). The first is to determine what magnitude of change in PI is considered clinically important in the relevant treatment population. To accomplish this goal, one needs to collect data from clinical trial evaluating treatments for pain in the specific condition (1a) and these data need to be analyzed to determine which changes in pain are considered clinically important. For example, one can determine through this process that a decrease in pain of 20 mm on the 0–100 mm visual analog scale (VAS) in a patient with knee osteoarthritis (OA) is a clinically important change.Figure 1 Flow chart illustrating the overall process of determining CID and using it to determine treatment efficacy. (Asterisk) Other factors include: disease, impact on quality of life, tolerability, convenience, availability, cost, and alternative treatments. The second process consists of using the metrics determined in the first process as a yardstick to determine whether a treatment has produced a clinically important change in a particular patient. For instance, an OA patient who has a decrease in pain of 30 mm on VAS after treatment is considered to have a clinically important response (as determined in the first process), i.e., the patient is considered as a responder to the treatment. Whether the treatment produces a clinically meaningful impact is then determined by comparing the proportion of “responders” on active treatment compared to control. Metrics of clinically important changes The most widely used metrics of clinical important changes are described and defined in Table 1. They are typically generated by determining longitudinal improvement, i.e., comparing treatment outcome from pre- to post-treatment.Table 1 Metrics of clinically important changes Metric Definition Notes Smallest detectable difference (SDD)The amount of difference in an outcome measure for which anything smaller cannot be reliably distinguished from random error in the measurementMinimal detectable change (MDC)Minimal clinically important difference (MCID)The smallest change or difference in an outcome measure between pre- and post-treatment perceived as beneficial (or detrimental) by the patient [7-9]Can be used to measure improvement and worseningMinimal clinically important change (MCIC)Minimal clinically important improvement (MCII)Only measures improvementsClinically important difference (CID)The difference in outcome measure that is considered clinically important/meaningful How do these metrics fit together? If the MDC on a pain scale was determined to be 20 units, the minimum clinically important difference (MCID) threshold 30 units, and the clinically important difference (CID) 45 units, this means that the pain scale cannot detect changes below 20 units, the minimum change in pain score considered clinically important by patients is 30 units, and the change in pain score considered clinically important is 45 units (Figure 2).Figure 2 Metrics of clinical importance—theoretical example for a pain measure. MDC (blue dotted line), MCID (green dotted line), and CID (purple dotted