Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study.
Cook JV, Dickinson HO, Eccles MP. · 2009
Read Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. by Cook JV, Dickinson HO, Eccles MP. (2009) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc2758861.txt.
Introduction
Cook, Dickinson, and Eccles tracked in 2009 response rates in postal surveys of healthcare professionals published between 1996 and 2005. Postal surveys are a workhorse of health services research, but low response can bias results and threaten validity. They sampled three hundred fifty studies from major databases and modeled which factors raised response.
Doctors responded at an average rate below sixty percent, significantly lower than in the prior decade. Response rose when reminders were sent, yet only half of studies used them. Smaller surveys and countries outside the United States, Canada, Australia, and New Zealand also did better. Only seventeen percent of studies checked for non-response bias at all, which leaves the size of that bias largely unknown.
Catalog record
| CREATOR | Cook JV, Dickinson HO, Eccles MP. |
|---|---|
| YEAR | 2009 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study By Julia V Cook, Heather O Dickinson, Martin P Eccles Published in: BMC Health Services Research DOI: 10.1186/1472-6963-9-160 ABSTRACT Abstract Background Postal surveys are a frequently used method of data collection in health services research. Low response rates increase the potential for bias and threaten study validity. The objectives of this study were to estimate current response rates, to assess whether response rates are falling, to explore factors that might enhance response rates and to examine the potential for non-response bias in surveys mailed to healthcare professionals. Methods A random sample of postal or electronic surveys of healthcare workers (1996-2005) was identified from Medline, Embase or Psycinfo databases or Biomed Central. Outcome measures were survey response rate and non response analysis. Multilevel, multivariable logistic regression examined the relationship between response rate and publication type, healthcare profession, country and number of survey participants, questionnaire length and use of reminders. Results The analysis included 350 studies. Average response rate in doctors was 57.5% (95%CI: 55.2% to 59.8%) and significantly lower than the estimate for the prior 10 year period. Response rates were higher when reminders were sent (adjusted OR 1.3; 95%CI 1.1-1.6) but only half the studies did this. Response rates were also higher in studies with fewer than 1000 participants and in countries other than US, Canada, Australia and New Zealand. They were not significantly affected by publication type or healthcare profession (p > 0.05). Only 17% of studies attempted assessment of possible non-response bias. Conclusion Response rates to postal surveys of healthcare professionals are low and probably declining, almost certainly leading to unknown levels of bias. To improve the informativeness of postal survey findings, researchers should routinely consider the use of reminders and assess potential for non-response bias. BACKGROUND Postal surveys are commonly used to gather information from healthcare professionals. It is important that studies using survey methodology minimise or at least recognise the influence of non-responders, as this can undermine study validity and thus generalisability to a wider population. Health professionals, in particular doctors, are considered to be a problematic population from which to collect survey data [1]. Average response rates amongst doctors were reported to be 61% in studies published during the 10 year period 1986-1995 [2] and a comparable figure of 62% was reported for mail surveys published in US medical journals in 1991 [1] although only 50% of the included surveys were amongst health professionals. The study by Cummings et al [2], considered the influence of the number of survey participants suggesting that response rates were higher in surveys with fewer than 1000 participants. Asch et al [1], considered a wider set of explanatory variables (respondent characteristics: profession, age, gender; survey characteristics: reminders, anonymity, survey length, postage and use of financial incentives) and suggested that doctors had a lower response rate compared to non-doctors, and using written or telephone reminders was associated with a higher response. However, there are concerns that response rates may have fallen recently due to increasing demands to participate in research activities [3,4]. Low response rates can result in bias, as non-responders may be systematically different from responders [5] and thus non-response analysis is important in interpreting survey results. Although it is impossible to know for sure whether non-response has introduced bias, several techniques are available for assessing the likelihood of this [6]. Whilst a response rate of 75% is considered an acceptable minimum standard [7], higher response rates are important to reduce the potential for bias due to non-response. Two large systematic reviews [8,9] of interventions to increase survey response rates (inclusive of both the general public, patients and healthcare professionals) identified factors that enhance response rates (monetary incentives, recorded delivery systems, shorter questionnaires, saliency of the survey topic, use of reminders and prenotification contact). Two smaller systematic reviews of randomised controlled trials that specifically focused on healthcare professionals [10,11] found the use of monetary incentives, reply paid envelopes, shorter questionnaires, recorded delivery and survey personalisation to increase survey response. We have therefore updated the response rate analysis of Cummings et al [2] taking into account a range of potential factors known to influence response rate. The objectives of this study were to estimate response rates to postal questionnaires targeting healthcare professionals in studies published in the 10 year period 1996-2005, to assess whether response rates among doctors had fallen since the preceding 10 year period, to explore the influence of multiple factors associated with higher response rates and to determine the frequency of assessment of potential for non-response bias. METHODS Database selection and search strategy Studies with low response rates may be less likely to be published in journals with space limitations. We therefore compared surveys published in Biomed Central, which publishes only electronically and has no restriction on article length, with surveys indexed in "standard" bibliographic databases Medline, Embase and Psycinfo. These databases were selected to give comprehensive international coverage and to include both medical and psychosocial disciplines. The search strategy is detailed below. #1 survey$ or questionnaire$.tw. #2 clinician$ or dentist$ or doctor$ or family practition$ or general practition$ or GP$ or FP$ or gyn?ecologist$ or hematologist$ or haematologist$ or internist$ or nurse$ or obstetrician$ or occupational therapist$ or OT$ or pediatrician$ or paediatrician$ or pharmacist$ or physician$ or physiotherapist$ or psychiatrist$ or psychologist$ or radiologist$ or surgeon$ or therapist$ or counse?lor$ or neurologist$ or optometrist$ or paramedic$ or social worker$ or health professional$ or primary care).tw. #3 1 and 2 Inclusion criteria are described in Table 1. Studies using a postal or electronic survey methodology (published during 1996-2005) were identified by searching the databases mentioned above. References were downloaded, duplicates were removed and Biomed references were excluded from the standard database set. [Table: Inclusion criteria and data abstraction protocol] Sampling procedure and data abstraction All references published in electronic media were screened for inclusion but references in the standard databases were sampled before screening. All screening was performed by JVC. We estimated that 272 studies were required to detect a change of 5% at significance p < 0.05, 80% power with a cluster size of 100 and an intracluster coefficient of 0.08 [12,13], assuming a baseline response rate of 61% [2]. We assumed that only 1 in 7 references would fulfil the inclusion criteria and therefore screened 2000 references, which were randomly selected using computer generated sequences of 200 random numbers per year. Data abstraction parameters are set out in Table 1. Number of survey participants, type of healthcare professional, questionnaire length, use of reminders and financial incentives were selected as predictors of response rate based on data from studies of health professionals and the general population. Publication type was chosen in order to examine the potential for publication bias. Country of study population was included as country specific factors such as healthcare system and net remuneration could moderate the effects of financial incentives. Non-response analysis was deemed present if researchers compared demographic variables between respondents and non-respondents, demonstrated sample representativeness or contacted a sample of those who did not reply. Statistical methods We examined the effects on response rate of publication type, healthcare profession, country of study population, length of questionnaire,