Triangulation in aetiological epidemiology.
Lawlor DA, Tilling K, Davey Smith G. · 2016
Read Triangulation in aetiological epidemiology. by Lawlor DA, Tilling K, Davey Smith G. (2016) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc5841843.txt.
Introduction
Lawlor, Tilling, and Davey Smith set out triangulation, a way to firm up causal claims in epidemiology. Their paper appeared in the International Journal of Epidemiology. Random trials often cannot test what habits or exposures do over decades. Single observational designs carry known blind spots.
Triangulation combines several approaches on one question. Each approach must fail in a different way. When their answers still agree, confidence grows. The authors ask researchers to state each bias direction up front. Three worked examples show the method in action. Mismatches, too, teach where new studies are needed.
Catalog record
| CREATOR | Lawlor DA, Tilling K, Davey Smith G. |
|---|---|
| YEAR | 2016 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Triangulation in aetiological epidemiology By Debbie A Lawlor, Kate Tilling, George Davey Smith Published in: International Journal of Epidemiology DOI: 10.1093/ije/dyw314 ABSTRACT Abstract Triangulation is the practice of obtaining more reliable answers to research questions through integrating results from several different approaches, where each approach has different key sources of potential bias that are unrelated to each other. With respect to causal questions in aetiological epidemiology, if the results of different approaches all point to the same conclusion, this strengthens confidence in the finding. This is particularly the case when the key sources of bias of some of the approaches would predict that findings would point in opposite directions if they were due to such biases. Where there are inconsistencies, understanding the key sources of bias of each approach can help to identify what further research is required to address the causal question. The aim of this paper is to illustrate how triangulation might be used to improve causal inference in aetiological epidemiology. We propose a minimum set of criteria for use in triangulation in aetiological epidemiology, summarize the key sources of bias of several approaches and describe how these might be integrated within a triangulation framework. We emphasize the importance of being explicit about the expected direction of bias within each approach, whenever this is possible, and seeking to identify approaches that would be expected to bias the true causal effect in different directions. We also note the importance, when comparing results, of taking account of differences in the duration and timing of exposures. We provide three examples to illustrate these points. INTRODUCTION Aetiological epidemiology–understanding what causes differing levels of disease in populations–is central to the science of epidemiology. However, there is considerable debate about the circumstances under which causality can be tested or assumed.1–6 Well-conducted randomized controlled trials (RCTs) provide the best causal evidence for treatment effectiveness, but they are not always feasible or ethical. For example, the causal effects of circumstances that influence social justice,6 or behaviours such as breastfeeding, alcohol consumption and smoking, particularly when the interest is in long-term effects of these exposures,7 are difficult (or impossible) to test with RCTs. Furthermore, whether we are interested in the causal effect of an exposure that may be modified by a complex population health intervention, or one that would be the target for a drug intervention, the cost of developing and trialling those interventions highlights the importance of obtaining the best causal evidence about exposures before proceeding to intervention development and RCTs. The aim of this paper is to illustrate how triangulation–the integration of evidence from several different epidemiological approaches that have differing and unrelated key sources of bias–might be used to improve causal inference in aetiological epidemiology. The word ‘approaches’ rather than methods or study design is intentionally used because comparisons may be made between different study designs (e.g. between RCTs and cohort or cross-sectional studies), and/or between different analytical approaches within the same study design (e.g. between negative control studies, cross-context comparisons or Mendelian randomization (MR), all undertaken in cohort study designs). DEFINITION OF TRIANGULATION Triangulation has been used in quantitative surveying from at least the 1600s to describe a method that calculates a distance that is difficult (or impossible) to measure, from two or more easier-to-measure distances.8,9 The distance of interest is calculated by using the known mathematical properties of triangles. The more recent use of the term in qualitative and quantitative research–to describe obtaining more reliable or accurate answers to research questions by comparing results from two or more different study approaches–has been criticized for being unrelated to the original use of the term, and for not having clear definitions or criteria for its use.10–13 We believe that when the term ‘triangulation’ is used in research, its meaning is similar to its original use in surveying. In both there is a ‘measure’ that cannot be (easily) obtained (in aetiological epidemiology this would be an unbiased causal effect estimate), and you estimate that measure from different locations (in aetiological epidemiology, from different approaches with different sources of bias). Nonetheless, we agree that a clear definition and criteria for its use in research are important. Triangulation is used in many research fields, including sociology, education, theoretical physics and mathematics,11,13,14 and much of what we write might have relevance for other disciplines. However, our focus in this paper is on aetiological epidemiology and the integration of different epidemiological approaches in a triangulation framework. We propose the following definition of triangulation in aetiological epidemiology: The practice of strengthening causal inferences by integrating results from several different approaches, where each approach has different (and assumed to be largely unrelated) key sources of potential bias. Other commonly used methods of integrating epidemiological evidence, such as independent replication or validation, meta-analysis and systematic reviews, seek to compare (and, in some cases, quantitatively combine) results from the same study design/approach under the assumption that they are all unbiased and estimating the same underlying causal effect. Triangulation aims to integrate data from different methodological approaches with different biases and to exploit these differences to draw qualitative conclusions. The idea behind triangulation is that when we compare different approaches with assumed unrelated sources of bias, particularly if the expected direction of bias for some of the approaches is different, we would not expect to obtain the same estimates of the causal effect (unless all were unbiased).7,15 Thus, triangulation has some features in common with Austin Bradford Hill’s concept of ‘consistency’ which he defines in his considerations on causality as ‘[results that have] been repeatedly observed by different persons, in different places, circumstances and times’.16 CRITERIA FOR TRIANGULATION IN AETIOLOGICAL EPIDEMIOLOGY We propose that the following minimum set of criteria should be fulfilled for triangulation to be valid in aetiological epidemiology. Results from at least two, but ideally more, different approaches, with differing and unrelated key sources of potential biases, are compared.The different approaches address the same underlying causal question.Related to the above criterion, for each approach the duration and timing of exposure that it assesses is taken into account when comparing results.For each approach the key sources of bias are explicitly acknowledged when comparing results.For each approach the expected direction of all key sources of potential bias are made explicit where this is feasible, and ideally within the set of approaches being compared there are approaches with potential biases that are in opposite directions. In the Table 1 we summarize the key sources of bias for several ‘conventional’ and also some additional aetiological approaches that might be used in triangulation. The additional approaches are not all ‘novel’, in that several have been in use for many years, but their use is not yet widespread. These additional methods are not inherently different from the ‘conventional’ approaches and several could be applied to the same dataset. They represent refinements of conventional approaches, intended to specifically explore and assess different possible sources of bias, by varying the population(s), exposures and/or outcomes under study. For each approach we provide a brief summary of the method, assumptions and key sources of bias (Table 1) together with illustrative examples of their use to address aetiological questions (Table S1, available as Supplementary data at IJE online). Providing detailed descriptions of