Is it possible to overcome issues of external validity in preclinical animal research? Why most animal models are bound to fail.

Pound P, Ritskes-Hoitinga M. · 2018

Read Is it possible to overcome issues of external validity in preclinical animal research? Why most animal models are bound to fail. by Pound P, Ritskes-Hoitinga M. (2018) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc6223056.txt.

Introduction

Pound and Ritskes-Hoitinga examine why animal models often fail patients. Few human diseases have approved treatments. Many drugs that work in animals fail in people. Past debate blamed poor study design and bias. The article appeared in the Journal of Translational Medicine.

The authors focus on external validity instead. That means how well findings transfer across settings and species. Animal samples often fail to represent patients. Models cannot mimic full human disease complexity. Lab settings differ greatly from clinics. Species differences add a further gap. The authors argue translation needs both kinds of validity. They suggest some fixes, but warn limits are deep. Most animal models, they argue, are bound to fail.

Catalog record

CREATORPound P, Ritskes-Hoitinga M.
YEAR2018
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC6223056

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Is it possible to overcome issues of external validity in preclinical animal research? Why most animal models are bound to fail By Pandora Pound, Merel Ritskes-Hoitinga Published in: Journal of Translational Medicine DOI: 10.1186/s12967-018-1678-1 ABSTRACT Abstract Background The pharmaceutical industry is in the midst of a productivity crisis and rates of translation from bench to bedside are dismal. Patients are being let down by the current system of drug discovery; of the several 1000 diseases that affect humans, only a minority have any approved treatments and many of these cause adverse reactions in humans. A predominant reason for the poor rate of translation from bench to bedside is generally held to be the failure of preclinical animal models to predict clinical efficacy and safety. Attempts to explain this failure have focused on problems of internal validity in preclinical animal studies (e.g. poor study design, lack of measures to control bias). However there has been less discussion of another key factor that influences translation, namely the external validity of preclinical animal models. Review of problems of external validity External validity is the extent to which research findings derived in one setting, population or species can be reliably applied to other settings, populations and species. This paper argues that the reliable translation of findings from animals to humans will only occur if preclinical animal studies are both internally and externally valid. We review several key aspects that impact external validity in preclinical animal research, including unrepresentative animal samples, the inability of animal models to mimic the complexity of human conditions, the poor applicability of animal models to clinical settings and animal–human species differences. We suggest that while some problems of external validity can be overcome by improving animal models, the problem of species differences can never be overcome and will always undermine external validity and the reliable translation of preclinical findings to humans. Conclusion We conclude that preclinical animal models can never be fully valid due to the uncertainties introduced by species differences. We suggest that even if the next several decades were spent improving the internal and external validity of animal models, the clinical relevance of those models would, in the end, only improve to some extent. This is because species differences would continue to make extrapolation from animals to humans unreliable. We suggest that to improve clinical translation and ultimately benefit patients, research should focus instead on human-relevant research methods and technologies. Keywords: External validity, Preclinical animal models, Translation, Human-relevant methods INTRODUCTION Few would dispute that the pharmaceutical industry is in the midst of a productivity crisis [1–7] or that rates of translation from bench to bedside are dismal [8–15]. Similarly, few would disagree that patients are being let down by the current system of drug discovery. Evidence suggests that current levels of investment in pharmaceutical drugs are out of proportion to their impact in terms of value for money or population health [16]. There is not a drug for every disease; several thousand diseases affect humans, of which only about 500 are estimated to have any approved treatments [17]. Many of the treatments that do exist cause dangerous and undesirable reactions in humans [18]. This failure of the drug discovery system not only lets down patients but also uses an enormous amount of resources that could likely be better spent [19]. The failure of the current drug discovery model is an issue of global importance for human health. However, the first step towards resolving this issue is to identify what is going wrong. While many factors contribute to the poor rates of translation from bench to bedside (including flawed clinical trials [20]), a predominant reason is generally held to be the failure of preclinical animal models to predict clinical efficacy [4, 6, 9, 14, 21] and safety [22, 23]. Efficacy and safety issues account for the majority of failures (52% and 24% respectively) at Phases II and III of clinical trials [24]. Attempts to explain these failures have focused on problems of internal validity in preclinical animal studies (i.e. shortcomings in study design, conduct, analysis and reporting), but there has been relatively little discussion of another key factor that influences translation, namely the external validity of preclinical animal models [25]. External validity is usually taken to mean the extent to which research findings derived in one setting, population or species can be reliably applied to other settings, populations and species [26]. It is a key criterion for assessing the credibility of scientific research. In the field of preclinical animal research, where the findings derived from animal studies are intended to have relevance in clinical settings, external validity is of the utmost importance. External validity is sometimes referred to as generalisability. Although the two terms are interchangeable, we use the term external validity here because generalisability, despite having a distinct methodological meaning, is often confused with translatability. In fact the two concepts are discrete; external validity/generalisability contributes to translatability [26] and in fact, as we shall argue, it is a prerequisite for the translation of findings from animals to humans. In this paper we argue that the translation of findings from animals to humans can only occur reliably if preclinical animal studies are both internally and externally valid. We consider the relationship between internal and external validity before going on to explore several key aspects that impact external validity in preclinical animal research. We suggest that while some problems of external validity are surmountable, the issue of human–animal species differences is not; species differences will always have an impact on external validity and the ability to translate preclinical findings to humans. We explore the implications of this conclusion. THE RELATIONSHIP BETWEEN INTERNAL AND EXTERNAL VALIDITY External validity is distinct from internal validity, which refers to the scientific robustness of a study’s design, conduct, analysis and reporting. Systematic review evidence has revealed that preclinical animal studies suffer from serious problems of internal validity, in particular a failure to take measures to prevent bias, such as random allocation to groups and blinded assessment of outcomes [27–29]. If a study does not take such measures then its internal validity is poor and its findings cannot be relied upon. Studies that lack internal validity will always lack external validity [30]. For example, in the field of stroke, animal studies that were ‘unblinded’ overestimated the effect of the intervention by 13% compared with studies that included blinding [31]. In other words, the lack of blinding led to the benefits of the animal studies being overstated. Because the benefits were not real, they could not be applied to other populations and settings. As such, lack of internal validity led to a lack of external validity. Some believe that if issues of internal validity were resolved (i.e. if researchers took measures to prevent bias and conducted studies according to agreed scientific standards) then the clinical translation of animal studies would be more successful [32]. However the available evidence does not support this view. In 1999 the Stroke Treatment Academic Industry Roundtable introduced a series of recommendations and standards intended to improve the quality of animal studies in stroke. Yet by 2012 translation rates had not improved [33] and the situation is no better today. Well over a

Read the complete text