Retention strategies in longitudinal cohort studies: a systematic review and meta-analysis.
Teague S, Youssef GJ, Macdonald JA, Sciberras E, Shatte A, Fuller-Tyszkiewicz M, Greenwood C, McIntosh J, Olsson CA, Hutchinson D, SEED Lifecourse Sciences Theme. · 2018
Read Retention strategies in longitudinal cohort studies: a systematic review and meta-analysis. by Teague S, Youssef GJ, Macdonald JA, Sciberras E, Shatte A, Fuller-Tyszkiewicz M, Greenwood C, McIntosh J, Olsson CA, Hutchinson D, SEED Lifecourse Sciences Theme. (2018) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc6258319.txt.
Introduction
Teague and co-authors reviewed how long term cohort studies keep their members. Their review and analysis appeared in BMC Medical Research Methodology. Cohort studies follow the same people for years. Members who drop out can weaken the results. The team gathered 143 studies from the past decade. Sample sizes ran from thirty people to over sixty thousand.
Ninety-five distinct retention tactics were found and sorted into four groups. Some tactics cut the burden on members. Others built community, sent reminders, or traced lost members. Studies that cut burden kept about ten percent more of their sample. Reminder heavy studies did worse by a similar share. Using more tactics overall did not help. The results favour making study life easier over chasing members harder.
Catalog record
| CREATOR | Teague S, Youssef GJ, Macdonald JA, Sciberras E, Shatte A, Fuller-Tyszkiewicz M, Greenwood C, McIntosh J, Olsson CA, Hutchinson D, SEED Lifecourse Sciences Theme. |
|---|---|
| YEAR | 2018 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Retention strategies in longitudinal cohort studies: a systematic review and meta-analysis By Samantha Teague, George J Youssef, Jacqui A Macdonald, Emma Sciberras, Adrian Shatte, Matthew Fuller-Tyszkiewicz, Chris Greenwood, Jennifer McIntosh, Craig A Olsson, Delyse Hutchinson Published in: BMC Medical Research Methodology DOI: 10.1186/s12874-018-0586-7 ABSTRACT Abstract Background Participant retention strategies that minimise attrition in longitudinal cohort studies have evolved considerably in recent years. This study aimed to assess, via systematic review and meta-analysis, the effectiveness of both traditional strategies and contemporary innovations for retention adopted by longitudinal cohort studies in the past decade. Methods Health research databases were searched for retention strategies used within longitudinal cohort studies published in the 10-years prior, with 143 eligible longitudinal cohort studies identified (141 articles; sample size range: 30 to 61,895). Details on retention strategies and rates, research designs, and participant demographics were extracted. Meta-analyses of retained proportions were performed to examine the association between cohort retention rate and individual and thematically grouped retention strategies. Results Results identified 95 retention strategies, broadly classed as either: barrier-reduction, community-building, follow-up/reminder, or tracing strategies. Forty-four of these strategies had not been identified in previous reviews. Meta-regressions indicated that studies using barrier-reduction strategies retained 10% more of their sample (95%CI [0.13 to 1.08]; p = .01); however, studies using follow-up/reminder strategies lost an additional 10% of their sample (95%CI [− 1.19 to − 0.21]; p = .02). The overall number of strategies employed was not associated with retention. Conclusions Employing a larger number of retention strategies may not be associated with improved retention in longitudinal cohort studies, contrary to earlier narrative reviews. Results suggest that strategies that aim to reduce participant burden (e.g., flexibility in data collection methods) might be most effective in maximising cohort retention. Electronic supplementary material The online version of this article (10.1186/s12874-018-0586-7) contains supplementary material, which is available to authorized users. Keywords: Retention, Attrition, Cohort, Longitudinal, Engagement, Follow-up, Drop-out BACKGROUND Longitudinal cohort studies play a central role in advancing understanding of the onset and progression of physical and mental health problems. Cohort studies assess, and often compare, the incidence of a condition within a group of people who share common characteristics (e.g., being born in the same year) [1]. A key advantage of longitudinal cohort studies over other research designs is that repeated measures data temporally orders exposures and outcomes to facilitate causal inference [2]. However, significant and systematic attrition can reduce the generalisability of outcomes and the statistical power to detect effects of interest [3]. Systematic attrition in longitudinal research occurs most often in older, non-white male participants with limited education and/or multiple health problems [4]. Long duration and repeated assessments can also increase attrition due to the significant burden on participants [4]. Given the expense of longitudinal cohort studies, effective strategies that engage and retain cohort participants are critical to the integrity of research outcomes [5, 6]. In the last decade, longitudinal data collection methods and cohort retention strategies have evolved considerably. So too have participant expectations of organisations (research and otherwise) that seek information from individuals [7, 8]. Established retention strategies within longitudinal cohort studies include: cash or gift incentives, sending reminder letters to participants, re-sending surveys, and offering alternative methods of data collection (for a review, see [6]). Booker et al. [6] demonstrated that these strategies were effective in longitudinal cohort studies that used the traditional data collection methods of postal surveys, face-to-face visits (home or on-site), and telephone interviews or surveys. However, these cohort retention strategies may not be as well suited to contemporary methods of collecting longitudinal data, such as web and mobile surveys [9], wearable sensors (e.g., FitBits) [10], short message services (SMS) [11], and groupware systems (e.g., video conferencing) [12]. Novel methods of engaging participants such as web advertising [13], social media [14], and electronic reminders [15], are also now being employed in cohort studies using both traditional and modern longitudinal data collection methods. A systematic review on the effectiveness of established and emerging cohort retention strategies in longitudinal cohort studies would provide guidance to researchers and funders on maximising cohort maintenance within these high investment programs of research. Previous reviews of retention strategies in health research include [4, 6, 16, 17]; only one of these reviews focused specifically on longitudinal cohort research designs [6]. Booker et al. [6] conducted a narrative review of retention strategies in longitudinal cohort studies, including incentives, reminders, repeat visits/questionnaires, and alternative methods of data collection, finding that incentives and reminder strategies improved cohort retention. However, this review was limited by the small number of studies identified for each retention strategy, which resulted in the identification of a restricted breadth of retention strategies and the inability to synthesise findings empirically. Further, Booker et al. [6] did not include research completed after 2006 and thus were unable to investigate emerging cohort retention strategies. Brueton et al. [16] completed a more recent review of retention strategies that included both established and emerging digital data collection retention strategies. However, the authors specifically excluded longitudinal cohort studies and instead focused on participant retention in intervention trials. Differences between intervention and longitudinal cohort studies, such as research design factors (e.g., study duration) and the motivations of the participants in joining or withdrawing from studies, may impact the usefulness of retention strategies across both study designs [4, 6]. A review of retention strategies reported in modern longitudinal cohort studies is pertinent and timely, given the emergence of digital retention strategies alongside established retention methods. Maximising cohort retention in longitudinal research can reduce the administration costs of conducting research, improve the efficiency of research processes, and reduce outcome biases for studies by adopting an evidence-based cohort retention framework. In this review, we aimed to: (i) identify retention strategies used in recent longitudinal cohort studies; (ii) examine whether retention rate was moderated by different study or participant characteristics (i.e., number of waves, study duration, sample size, population type, gender, age, country); (iii) estimate the retention rate in studies that use specific retention strategies, and contrast this retention rate with studies that do not use specific retention strategies; (iv) examine whether retention rate is associated with the number of retention strategies used; (v) examine which retention strategies were the strongest independent predictors of retention rate; and (vi) contrast the retention rate based on whether studies utilised emerging or established strategies. Moreover, to ensure that recent innovations in retention strategies were identified, this review focused on literature published within the past 10 years. METHOD Search strategy A systematic review was performed as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [18]. Two search strategies were implemented. First, the electronic databases Medline, PsycINFO, Embase, CINAHL, AMED, and the Cochrane Library, were searched in July, 2016 using search terms relevant to three themes: (i) attrition, (ii) retention, and (iii) study design (Additional file 1: Table S1). The electronic search was limited to articles published from 2006 onwards in English, to avoid duplication of literature with the previous review on this topic [6]. The search was adapted to suit each database. Second, the reference lists of all articles selected for review were manually searched. Inclusion and exclusion criteria The inclusion and exclusion criteria were determined prior to implementing the search strategy.