Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research Authors: Carol Kilkenny, William J. Browne, Innes C. Cuthill, Michael Emerson, Douglas G. Altman Published: 2010, PLOS ONE DOI: 10.1371/journal.pbio.1000412 GOOD REPORTING IS ESSENTIAL FOR PEER REVIEW AND TO INFORM FUTURE RESEARCH Scrutiny by scientific peers has long been the mainstay of “quality control” for the publication process. The way that experiments are reported, in terms of the level of detail of methods and the presentation of key results, is crucial to the peer review process and, indeed, the subsequent utility and validity of the knowledge base that is used to inform future research. The onus is therefore on the research community to ensure that their research articles include all relevant information to allow in-depth critique, and to avoiding duplicating studies and performing redundant experiments. Ideally scientific publications should present sufficient information to allow a knowledgeable reader to understand what was done, why, and how, and to assess the biological relevance of the study and the reliability and validity of the findings. There should also be enough information to allow the experiment to be repeated [23] . The problem therefore is how to ensure that all relevant information is included in research publications. USING REPORTING GUIDELINES MEASURABLY IMPROVES THE QUALITY OF REPORTING Evidence provided by reviews of published research suggests that many researchers and peer reviewers would benefit from guidance about what information should be provided in a research article. The CONSORT Statement for randomised controlled clinical trials was one of the first guidelines developed in response to this need [24] , [25] . Since publication, an increasing number of leading journals have supported CONSORT as part of their instructions to authors [26] , [27] . As a result, convincing evidence is emerging that CONSORT improves the quality and transparency of reports of clinical trials [28] , [29] . Following CONSORT, many other guidelines have been developed—there are currently more than 90 available for reporting different types of health research, most of which have been published in the last ten years (see http://www.equator-network.org and references [30] , [31] ). Guidelines have also been developed to improve the reporting of other specific bioscience research areas including metabolomics and gene expression studies [32] – [37] . Several organisations support the case for improved reporting and recommend the use of reporting guidelines, including the International Committee of Medical Journal Editors, the Council of Science Editors, the Committee on Publication Ethics, and the Nuffield Council for Bioethics [38] – [41] . IMPROVING THE REPORTING OF ANIMAL EXPERIMENTS—THE ARRIVE GUIDELINES Most bioscience journals currently provide little or no guidance on what information to report when describing animal research [42] – [50] . Our review found that 4% of the 271 journal articles assessed did not report the number of animals used anywhere in the methods or the results sections [5] . Reporting animal numbers is essential so that the biological and statistical significance of the experimental results can be assessed or the data reanalysed, and is also necessary if the experimental methods are to be repeated. Improved reporting of these and other details will maximise the availability and utility of the information gained from every animal and every experiment, preventing unnecessary animal use in the future. To address this, we led an initiative to produce guidelines for reporting animal research. The guidelines, referred to as ARRIVE (Animals in Research: Reporting In Vivo Experiments), have been developed using the CONSORT Statement as their foundation [24] , [25] . The ARRIVE guidelines consist of a checklist of 20 items describing the minimum information that all scientific publications reporting research using animals should include, such as the number and specific characteristics of animals used (including species, strain, sex, and genetic background); details of housing and husbandry; and the experimental, statistical, and analytical methods (including details of methods used to reduce bias such as randomisation and blinding). All the items in the checklist have been included to promote high-quality, comprehensive reporting to allow an accurate critical review of what was done and what was found. Consensus and consultation are the corner-stones of the guideline development process [51] . To maximise their utility, the ARRIVE guidelines have been prepared in consultation with scientists, statisticians, journal editors, and research funders. We convened an expert working group, comprising researchers and statisticians from a range of disciplines, and journal editors from Nature Cell Biology , Science , Laboratory Animals , and the British Journal of Pharmacology (see Acknowledgments). At a one-day meeting in June 2009, the working group agreed the scope and broad content of a draft set of guidelines that were then used as the basis for a wider consultation with the scientific community, involving researchers, and grant holders and representatives of the major bioscience funding bodies including the Medical Research Council, Wellcome Trust, Biotechnology and Biological Sciences Research Council, and The Royal Society (see Table 1 ). Feedback on the content and wording of the items was incorporated into the final version of the checklist. Further feedback on the content utility of the guidelines is encouraged and sought. The ARRIVE guidelines (see Table 2 ) can be applied to any area of bioscience research using laboratory animals, and the inherent principles apply not only to reporting comparative experiments but also to other study designs. Laboratory animal refers to any species of animal undergoing an experimental procedure in a research laboratory or formal test setting. The guidelines are not intended to be mandatory or absolutely prescriptive, nor to standardise or formalise the structure of reporting. Rather they provide a checklist that can be used to guide authors preparing manuscripts for publication, and by those involved in peer review for quality assurance, to ensure completeness and transparency. Schulz, et al. (2010) [24] . TABLE: Funding bodies consulted. Name of Bioscience Research Funding Body Medical Research Council Biotechnology and Biological Sciences Research Council Wellcome Trust The Royal Society Association of Medical Research Charities British Heart Foundation Parkinson's Disease Society TABLE: Animal Research: Reporting In Vivo experiments: The ARRIVE guidelines. ITEM RECOMMENDATION TITLE 1 Provide as accurate and concise a description of the content of the article as possible. ABSTRACT 2 Provide an accurate summary of the background, research objectives (including details of the species or strain of animal used), key methods, principal findings, and conclusions of the study. INTRODUCTION Background 3 a. Include sufficient scientific background (including relevant references to previous work) to understand the motivation and context for the study, and explain the experimental approach and rationale.b. Explain how and why the animal species and model being used can address the scientific objectives and, where appropriate, the study's relevance to human biology. Objectives 4 Clearly describe the primary and any secondary objectives of the study, or specific hypotheses being tested. METHODS Ethical statement 5 Indicate the nature of the ethical review permissions, relevant licences (e.g. Animal [Scientific Procedures] Act 1986), and national or institutional guidelines for the care and use of animals, that cover the research. Study design 6 For each experiment, give brief details of the study design, including:a. The number of experimental and control groups.b. Any steps taken to minimise the effects of subjective bias when allocating animals to treatment (e.g., randomisation procedure) and when assessing results (e.g., if done, describe who was blinded and when).c. The experimental unit (e.g. a single animal, group, or cage of animals).A time-line diagram or flow chart can be useful to illustrate how complex study designs were carried out. Experimental procedures 7 For each experiment and each experimental group, including controls, provide precise details of all procedures carried out. For example:a. How (e.g., drug formulation and dose, site and route of administration, anaesthesia and analgesia used [including monitoring], surgical procedure, method of euthanasia). Provide details of any specialist equipment used, including supplier(s).b. When (e.g., time of day).c. Where (e.g., home cage, laboratory, water maze).d. Why (e.g., rationale for choice of specific anaesthetic, route of administration, drug dose used). Experimental animals 8 a. Provide details of the animals used, including species, strain, sex, developmental stage (e.g., mean or median age plus age range), and weight (e.g., mean or median weight plus weight range).b. Provide further relevant information such as the source of animals, international strain nomenclature, genetic modification status (e.g. knock-out or transgenic), genotype, health/immune status, drug- or test-naïve, previous procedures, etc. Housing and husbandry 9 Provide details of:a. Housing (e.g., type of facility, e.g., specific pathogen free (SPF); type of cage or housing; bedding material; number of cage companions; tank shape and material etc. for fish).b. Husbandry conditions (e.g., breeding programme, light/dark cycle, temperature, quality of water etc. for fish, type of food, access to food and water, environmental enrichment).c. Welfare-related assessments and interventions that were carried out before, during, or after the experiment. Sample size 10 a. Specify the total number of animals used in each experiment and the number of animals in each experimental group.b. Explain how the number of animals was decided. Provide details of any sample size calculation used.c. Indicate the number of independent replications of each experiment, if relevant. Allocating animals to experimental groups 11 a. Give full details of how animals were allocated to experimental groups, including randomisation or matching if done.b. Describe the order in which the animals in the different experimental groups were treated and assessed. Experimental outcomes 12 Clearly define the primary and secondary experimental outcomes assessed (e.g., cell death, molecular markers, behavioural changes). Statistical methods 13 a. Provide details of the statistical methods used for each analysis.b. Specify the unit of analysis for each dataset (e.g. single animal, group of animals, single neuron).c. Describe any methods used to assess whether the data met the assumptions of the statistical approach. RESULTS Baseline data 14 For each experimental group, report relevant characteristics and health status of animals (e.g., weight, microbiological status, and drug- or test-naïve) before treatment or testing (this information can often be tabulated). Numbers analysed 15 a. Report the number of animals in each group included in each analysis. Report absolute numbers (e.g. 10/20, not 50% a ).b. If any animals or data were not included in the analysis, explain why. Outcomes and estimation 16 Report the results for each analysis carried out, with a measure of precision (e.g., standard error or confidence interval). Adverse events 17 a. Give details of all important adverse events in each experimental group.b. Describe any modifications to the experimental protocols made to reduce adverse events. DISCUSSION Interpretation/scientific implications 18 a. Interpret the results, taking into account the study objectives and hypotheses, current theory, and other relevant studies in the literature.b. Comment on the study limitations including any potential sources of bias, any limitations of the animal model, and the imprecision associated with the results a .c. Describe any implications of your experimental methods or findings for the replacement, refinement, or reduction (the 3Rs) of the use of animals in research. Generalisability/translation 19 Comment on whether, and how, the findings of this study are likely to translate to other species or systems, including any relevance to human biology. Funding 20 List all funding sources (including grant number) and the role of the funder(s) in the study. IMPROVED REPORTING WILL MAXIMISE THE OUTPUT OF PUBLISHED RESEARCH These guidelines were developed to maximise the output from research using animals by optimising the information that is provided in publications on the design, conduct, and analysis of the experiments. The need for such guidelines is further illustrated by the systematic reviews of animal research that have been carried out to assess the efficacy of various drugs and interventions in animal models [8] , [9] , [13] , [52] – [55] . Well-designed and -reported animal studies are the essential building blocks from which such a systematic review is constructed. The reviews have found that, in many cases, reporting omissions, in addition to the limitations of the animal models used in the individual studies assessed in the review, are a barrier to reaching any useful conclusion about the efficacy of the drugs and interventions being compared [2] , [3] . Driving improvements in reporting research using animals will require the collective efforts of authors, journal editors, peer reviewers, and funding bodies. There is no single simple or rapid solution, but the ARRIVE guidelines provide a practical resource to aid these improvements. The guidelines will be published in several leading bioscience research journals simultaneously [56] – [60] , and publishers have already endorsed the guidelines by including them in their journal Instructions to Authors subsequent to publication. The NC3Rs will continue to work with journal editors to extend the range of journals adopting the guidelines, and with the scientific community to disseminate the guidelines as widely as possible ( http://www.nc3rs.org.uk/ARRIVE ). REFERENCES [1] Simera I Altman D. G 2009 Writing a research article that is “fit for purpose”: EQUATOR Network and reporting guidelines. Evid Based Med 14 132 134 19794009 10.1136/ebm.14.5.132 [2] van der Worp H. B Howells D. W Sena E. S Porritt M. J Rewell S 2010 Can Animal Models of Disease Reliably Inform Human Studies? PLoS Med 7 e1000245 doi: 10.1371/journal.pmed.1000245 20361020 10.1371/journal.pmed.1000245 PMC2846855 [3] Sena E. S van der Worp H. B Bath P. M. W Howells D. W Macleod M. R 2010 Publication Bias in Reports of Animal Stroke Studies Leads to Major Overstatement of Efficacy. PLoS Biol 8 e1000344 doi: 10.1371/journal.pbio.1000344 20361022 10.1371/journal.pbio.1000344 PMC2846857 [4] Sargeant J. M Thompson A Valcour J Elgie R Saint-Onge J 2010 Quality of reporting of clinical trials of dogs and cats and associations with treatment effects. J Vet Intern Med 24 44 50 19807866 10.1111/j.1939-1676.2009.0386.x [5] Kilkenny C Parsons N Kadyszewski E Festing M. F. W Cuthill I. C 2009 Survey of the Quality of Experimental Design, Statistical Analysis and Reporting of Research Using Animals. PLoS ONE 4 e7824 doi: 10.1371/journal.pone.0007824 19956596 10.1371/journal.pone.0007824 PMC2779358 [6] Sargeant J. M Elgie R Valcour J Saint-Onge J Thompson A 2009 Methodological quality and completeness of reporting in clinical trials conducted in livestock species. Prev Vet Med 91 107 115 19573943 10.1016/j.prevetmed.2009.06.002 [7] Macleod M. R Fisher M O'Collins V Sena E. S Dirnagl U 2009 Good laboratory practice. Preventing introduction of bias at the bench. Stroke 40 50 52 10.1161/STROKEAHA.108.525386 18703798 [8] Hainsworth A. H Markus H. S 2008 Do in vivo experimental models reflect human cerebral small vessel disease? A systematic review. J Cereb Blood Flow Metab 28 1877 1891 18698331 10.1038/jcbfm.2008.91 [9] Rice A. S. C Cimino-Brown D Eisenach J. C Kontinen V. K Lacroix-Fralish M. L 2008 Animal models and the prediction of efficacy in clinical trials of analgesic drugs: a critical appraisal and call for uniform reporting standards. Pain 139 243 247 18814968 10.1016/j.pain.2008.08.017 [10] Sherwin C. M 2007 Animal welfare: reporting details is good science. Nature 448 251 10.1038/448251b 17637638 [11] Jafari P Azuaje F 2006 An assessment of recently published gene expression analyses: reporting experimental design and statistics. BMC Med Inform Decis Mak 6 27 16790051 10.1186/1472-6947-6-27 PMC1523197 [12] Hackam D. G Redelmeier D. A 2006 Translation of research evidence from animals to humans. JAMA 296 1731 1732 17032985 10.1001/jama.296.14.1731 [13] Perel P Roberts I Sena E Wheble P Briscoe C 2006 Comparison of treatment effects between animal experiments and clinical trials: systematic review. BMJ 334 197 doi: 10.1136/bmj.39048.407928.BE 17175568 10.1136/bmj.39048.407928.BE PMC1781970 [14] Macleod M 2005 What can systematic review and meta-analysis tell us about the experimental data supporting stroke drug development? Int J Neuroprot Neuroregener 1 201 [15] Tooth L Ware R Bain C Purdie D. M Dobson A 2005 Quality of reporting of observational longitudinal research. Am J Epidemiol 161 280 288 15671260 10.1093/aje/kwi042 [16] Pound P Ebrahim S Sandercock P Bracken M. B Roberts I 2004 Where is the evidence that animal research benefits humans? BMJ 328 514 517 14988196 10.1136/bmj.328.7438.514 PMC351856 [17] Bennett L. T Adams M A 2004 Assessment of ecological effects due to forest harvesting: approaches and statistical issues. J Appl Ecol 41 585 598 [18] Morris C. E Bardin M Berge O Frey-Klett P Fromin N 2002 Microbial biodiversity: Approaches to experimental design and hypothesis testing in primary scientific literature from 1975 to 1999. Microbiol Mol Biol Rev 66 592 616 12456784 10.1128/MMBR.66.4.592-616.2002 PMC134657 [19] Smith J. A Birke L Sadler D 1997 Reporting animal use in scientific papers. Lab Anim 31 312 317 9350702 10.1258/002367797780596176 [20] McCance I 1995 Assessment of statistical procedures used in papers in the Australian Veterinary Journal. Aust Vet J 72 322 328 8585846 10.1111/j.1751-0813.1995.tb07534.x [21] Pocock S. J Hughes M. D Lee R. J 1987 Statistical problems in the reporting of clinical trials. A survey of three medical journals. New Engl J Med 317 426 432 3614286 10.1056/NEJM198708133170706 [22] Chalmers I Glasziou P 2009 Avoidable waste in the production and reporting of research evidence. Lancet 374 86 89 19525005 10.1016/S0140-6736(09)60329-9 [23] Festing M. F Altman D. G 2002 Guidelines for the design and statistical analysis of experiments using laboratory animals. ILAR J 43 244 258 12391400 10.1093/ilar.43.4.244 [24] Schulz K. F Altman D. G Moher D the CONSORT Group 2010 CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ 340 c332 20332509 10.1136/bmj.c332 PMC2844940 [25] Moher D Schulz K. F Altman DG for the CONSORT Group 2001 The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 357 1191 1194 11323066 [26] Altman D. G 2005 Endorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors. BMJ 330 1056 1057 15879389 10.1136/bmj.330.7499.1056 PMC557224 [27] Hopewell S Altman D. G Moher D Schulz K. F 2008 Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal ‘instructions to Authors’. Trials 9 20 18423021 10.1186/1745-6215-9-20 PMC2359733 [28] Plint A. C Moher D Morrison A Schulz K Altman D. G 2006 Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust 185 263 267 16948622 10.5694/j.1326-5377.2006.tb00557.x [29] Kane R. L Wang J Garrard J 2007 Reporting in randomized clinical trials improved after adoption of the CONSORT statement. J Clin Epidemiol 60 241 249 17292017 10.1016/j.jclinepi.2006.06.016 [30] Altman D. G Simera I Hoey J Moher D Schulz K 2008 EQUATOR: reporting guidelines for health research. Lancet 371 1149 1150 18395566 10.1016/S0140-6736(08)60505-X [31] Simera I Moher D Hoey J Schulz K Altman D. G 2010 A catalogue of reporting guidelines for health research. Eur J Clin Invest 40 35 53 20055895 10.1111/j.1365-2362.2009.02234.x [32] Wager E Field E. A Grossman L 2003 Good publication practice for pharmaceutical companies. Curr Med Res Opin 19 149 154 12814125 10.1185/030079903125001767 [33] Brazma A Hingamp P Quackenbush J Sherlock G Spellman P 2001 Minimum information about a microarray experiment (MIAME) — toward standards for microarray data. Nat Genet 29 365 371 11726920 10.1038/ng1201-365 [34] Goodacre R Broadhurst D Smilde A. K Kristal B. S Baker D. J 2007 Proposed minimum reporting standards for data analysis in metabolomics. Metabolomics 3 231 241 [35] Stone S. P Cooper B. S Kibbler C. C Cookson B. D Roberts J. A 2007 The ORION statement: guidelines for transparent reporting of outbreak reports and intervention studies of nosocomial infection. J Antimicrob Chemother 59 833 840 17387116 10.1093/jac/dkm055 [36] Peters J. L Sutton A. J Jones D. R Rushton L Abrams K. R 2006 A systematic review of systematic reviews and meta-analyses of animal experiments with guidelines for reporting. J Environ Sci Health B 41 1245 1258 16923604 10.1080/03601230600857130 [37] O'Connor A. M Sargeant J. M Gardner I. A Dickson J. S Torrence M. E 2010 The REFLECT statement: Methods and processes of creating reporting guidelines for randomised controlled trials for livestock and food safety. Prev Vet Med 93 11 18 19926151 10.1016/j.prevetmed.2009.10.008 [38] International Committee of Medical Journal Editors Uniform Requirements for Manuscripts Submitted to Biomedical Journals. Available: http://www.icmje.org/urm_full.pdf . Accessed 22 January 2010 [39] Council of Science Editors – Editorial Policy Committee 2008–2009 CSE's White Paper on promoting integrity in scientific journal publications, 2009 Update. Available: http://www.councilscienceeditors.org/editorial_policies/whitepaper/entire_whitepaper.pdf . Accessed 22 January 2010 [40] Committee on publication ethics (COPE) COPE best practice guidelines for journal editors. Available: http://publicationethics.org/files/u2/Best_Practice.pdf . Accessed 22 January 2010 [41] Nuffield Council on Bioethics: The Ethics of Research involving Animals 2005 Chapter 15: Discussion and Recommendations; pp 313, paragraph 15.58. Available: http://www.nuffieldbioethics.org/fileLibrary/pdf/RIA_Report_FINAL-opt.pdf . Accessed 26 January 2010 [42] Drummond G. B 2009 Reporting ethical matters in The Journal of Physiology: standards and advice. J Physiol 587.4 713 719 19218620 10.1113/jphysiol.2008.167387 PMC2669962 [43] Osborne N. J Payne D Newman M. L 2009 Journal editorial policies, animal welfare, and the 3Rs. Am J Bioeth 9 55 59 10.1080/15265160903318343 20013503 [44] Hooijmans C Leenars M Ritskes-Hoitinga M 2009 Improving the quality of publications on animal experiments to make systematic reviews possible. ALTEX 26 262 [45] Wurbel H 2007 Publications should include an animal welfare section. Nature 446 257 10.1038/446257a 17361159 [46] Alfaro V 2005 Specification of laboratory animal use in scientific articles: Current low detail in the journal's instructions for authors and some proposals. Methods Find Exp Clin Pharmacol 27 495 502 16258595 10.1358/mf.2005.27.7.921309 [47] Nuffield Council on Bioethics 2005 The ethics of research involving animals London Ed Nuffield Council on Bioethics Available: http://www.nuffieldbioethics.org/go/browseablepublications/ethicsofresearchanimals/report_490.html . Accessed 22 January 2010 [48] Öbrink K. J Rehbinder C 2000 Animal definition: a necessity for the validity of animal experiments? Lab Anim 34: 1 21 130 10817450 10.1258/002367700780457608 [49] Boisvert D. P. J 1997 Editorial policies and animal welfare. Zutphen L. F. M Balls M Animal Alternatives, Welfare and Ethics Elsevier 399 404 [50] Working Committee for the Biological characterisation of laboratory animals/GV-Solas 1985 Guidelines for specification of animals and husbandry methods when reporting the results of animal experiments. Lab Anim 19 106 108 3999685 10.1258/002367785780942714 [51] Moher D Schulz K Simera I Altman D. G 2010 Guidance for developers of health research reporting guidelines. PLoS Med 7 e1000217 doi: 10.1371/journal.pmed.1000217 20169112 10.1371/journal.pmed.1000217 PMC2821895 [52] Mignini L. E Khan K. S 2006 Methodological quality of systematic reviews of animal studies: a survey of reviews of basic research. Biomed Central Medical Research Methodology 6 10 16533396 10.1186/1471-2288-6-10 PMC1435907 [53] Macleod M. R Collins T Howells D. W Donnan G. A 2004 Pooling of animal experimental data reveals influence of study design and publication bias. Stroke 35 1203 1208 15060322 10.1161/01.STR.0000125719.25853.20 [54] Roberts I Kwan I Evans P Haig S 2002 Does animal experimentation inform human healthcare? Observations from a systematic review of international animal experiments on fluid resuscitation. BMJ 324 474 476 11859053 10.1136/bmj.324.7335.474 PMC1122396 [55] Horn J de Haan R. J Vermeulen M Limburg M 2001 Nimodipine in animal model experiments of focal cerebral ischemia: a systematic review. Stroke 32 2433 38 11588338 10.1161/hs1001.096009 [56] Kilkenny C Brown W. J Cuthill I. C Emerson M Altman D. G 2010 Animal Research: Reporting In Vivo Experiments: The ARRIVE guidelines. J Gene Med doi: 10.1002/jgm.1473 10.1002/jgm.1473 20607692 [57] Kilkenny C Brown W. J Cuthill I. C Emerson M Altman D. G 2010 Animal Research: Reporting In Vivo Experiments: The ARRIVE guidelines. Exp Physiol doi: 10.1113/expphysiol.2010.053793 10.1038/jcbfm.2010.220 PMC3070981 21206507 [58] Kilkenny C Brown W. J Cuthill I. C Emerson M Altman D. G 2010 Animal Research: Reporting In Vivo Experiments: The ARRIVE guidelines. J Physiol doi: 10.1113/jphysiol.2010.192278 10.1038/jcbfm.2010.220 PMC3070981 21206507 [59] Kilkenny C Brown W. J Cuthill I. C Emerson M Altman D. G 2010 Animal Research: Reporting In Vivo Experiments: The ARRIVE guidelines. Br J Pharmacol doi: 10.1111/j.1476-5381.2010.00872.x 10.1038/jcbfm.2010.220 PMC3070981 21206507 [60] Kilkenny C Brown W. J Cuthill I. C Emerson M Altman D. G 2010 Animal Research: Reporting In Vivo Experiments: The ARRIVE guidelines. Laboratory Animals doi: 10.1258/la.2010.0010021 10.1038/jcbfm.2010.220 PMC3070981 21206507