Assessment of “Spin” in the abstracts of systematic reviews in leading upper extremity surgery journals over the past 10 years: A cross-sectional methodological study Authors: Oluwatoba T Balogun, Varun Jain, Praveen Sritharan, Aava Param, Ajay Shah, Darius Luke Lameire, Ujash Sheth Published: 2026 ABSTRACT AbstractIntroductionPractice guidelines in upper extremity surgery are heavily influenced by systematic reviews (SRs). SRs are prone to “spin”; misleading reporting that can distort interpretation, such as omitting individual study risk of bias when formulating study conclusions. This study aimed to assess the prevalence and types of spin employed in abstracts of SRs from leading upper extremity surgical journals.MethodsA cross-sectional analysis of SRs published between 2015 and 2025 was conducted across the three highest impact factor upper extremity journals. Included study abstracts were assessed for nine types of spin using a published framework by Yavchitz et al. (2016). Descriptive statistics were used to evaluate the prevalence of spin and its associations with study bibliometric characteristics.ResultsSpin was found in 28/54 included articles (51.9%). 21/54 (38.9%) studies demonstrated more than one type of spin. The most common type of spin employed was type 9 (claims of benefit despite reporting bias) (27/54, 50.0%).ConclusionOver 50% of SRs published in leading upper extremity surgical journals demonstrated at least one form of spin in their abstracts. Claiming benefits despite a high risk of bias was most commonly employed. These findings highlight the need for robust reporting frameworks to ensure SRs are interpreted effectively.Level of evidenceIVKeywords: Spin, orthopaedic surgery, upper extremity surgery, reporting bias, abstract misrepresentation Introduction The emphasis on evidence-based medicine has placed immense importance on the utility of medical literature to guide clinical decision making. The findings and conclusions drawn from clinical research have significantly influenced the way that medicine and surgery are practiced in the real world. Systematic reviews (SRs) are an example of a study methodology which can be utilized to consolidate evidence and formulate high-level conclusions on any research question. 1 Despite their importance in the medical literature, they often rely on study authors to interpret findings of various studies (which between themselves could present with considerable heterogeneity in their respective methodologies and results) to report these high-level conclusions. Spin refers to the practice of presenting study results in a way that makes them appear more favorable or significant than they may in fact be. Often, this is done unintentionally, largely due to oversight or an overzealous interpretation of research findings. It may involve various strategies, such as emphasizing statistically significant secondary outcomes when the primary outcome is not significant, extrapolating findings to a different outcome, or omitting risk of bias when reporting results in the conclusions of a study. 2 Spin is prevalent across different types of biomedical research, including clinical trials, observational studies, and SRs, affecting the interpretation and dissemination of research findings.2,3 Yavchitz et al. (2016) 4 outlined nine types of spin that are believed to be most common in literature, providing a framework for spin analysis within abstracts (Table 1). Table 1.Nine types of spin in systematic reviews.TypeDescription1Conclusion contains recommendations for clinical practice not supported by the findings.2Title claims or suggests a beneficial effect of the experimental intervention not supported by the findings.3Selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention.4Conclusion claims safety based on non-statistically significant results with a wide confidence interval.5Conclusion claims the beneficial effect of the experimental treatment despite high risk of bias in primary studies.6Selective reporting of or overemphasis on harm outcomes or analysis favoring the safety of the experimental intervention.7Conclusion extrapolates the review's findings to a different intervention (i.e. claiming efficacy of one specific intervention although the review covers a class of several interventions).8Conclusion extrapolates the review's findings from a surrogate marker or a specific outcome to the global improvement of the disease.9Conclusion claims the beneficial effect of the experimental treatment despite reporting bias. Nine types of spin in systematic reviews. When surveying the journal reading habits of internal medicine physicians in a study conducted by Saint et al. (2000) 5 , 63% reported primarily reading a study's abstract and did not use the full text of these respective articles to make their own interpretations of the study's findings. Similarly, a randomized control trial of 300 medical oncologists conducted by Boutron et al. (2014) 6 demonstrated that the presence of spin in a sample of abstracts was associated with participants subjectively misinterpreting an intervention as beneficial over a comparator. This underscores the importance of precise abstract reporting and conclusions that are accurately divulged from the study design to maintaining a high standard of care. In the field of upper extremity surgery which is among the more research-productive orthopedic subspecialties, this becomes even more important.7,8 In orthopedic surgery, treatment decisions often rely on the findings of randomized controlled trials and the summation of evidence in SRs and meta-analyses. Spin has been shown to be highly prevalent across smaller analyses of SRs related to specific upper extremity topics—occurring in one-third of studies on rotator cuff tears, 34% of studies on proximal humeral fractures, 54% of studies on tendon transfers in massive irreparable rotator cuff tears, 93% of studies evaluating subacromial balloon spacers in the treatment of massive irreparable rotator cuff tears, and in 100% of studies on superior capsular reconstruction.9–13 This raises concerns, as surgeons may rely heavily on abstracts when making clinical decisions, and the presence of spin may inadvertently influence clinical practice. Though spin has been found to be frequently demonstrated in the abstracts of SRs across upper extremity surgery, it remains to be investigated whether this issue extends to SRs published in journals of the highest impact factor in this field based on Journal Citation Reports. With these SRs having the most outreach in the general orthopedic community, it is important to assess their standard of methodological rigor. Ultimately, the purpose of this review is to identify spin in its various forms and its prevalence in SRs abstracts from leading English-based orthopedic surgery journals that report “positive” results (statistically significant differences favoring either the intervention or comparator groups) within their samples. Secondarily, we aim to analyze studies and test for an association between the prevalence of spin and study/bibliometric factors. Methods This study employed a cross-sectional design using SR methodology to identify and evaluate the presence of spin in abstracts of SRs and meta-analyses published in high-impact journals within the field of upper extremity surgery. The review was conducted in accordance with the Cochrane Handbook for Systematic Reviews of Interventions and reported following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. 14 A protocol, created by the authors prior to data collection, was followed a priori for the literature search, screening, data extraction, and spin assessment phases. Literature search and inclusion/exclusion criteria A systematic search was performed in MEDLINE, Embase, and PubMED from 26 March 2015 to 26 March 2025. The complete search strategy is included as a supplementary document (S1). Articles were eligible for inclusion if they met the following criteria: (1) published in one of the three top impact factor upper extremity and hand journals identified by 5-year Journal Citation Reports impact factor at the time of the search (April 2025): Journal of Shoulder and Elbow Surgery, Journal of Hand Surgery (American Volume), and Journal of Hand Surgery (European Volume); (2) published in English; (3) designed as a SR or meta-analysis; (4) comparative in nature, reporting at least one clinical outcome comparing intervention and comparator groups; and (5) reporting a statistically significant difference in at least one outcome in the abstract. Articles were excluded if they met any of the following criteria: (1) not a SR or meta-analysis; (2) primary outcome was not clinical; (3) abstract did not report a statistically significant difference between groups; or (4) review focused solely on non-therapeutic or prognostic questions. The exclusion of non-therapeutic SRs was aligned with prior literature emphasizing that spin is most relevant in studies evaluating clinical outcomes of interventions. 4 Article screening Two reviewers (OB and VJ) independently screened all titles/abstracts and subsequently the full text of eligible studies in duplicate. Disagreements at the full-text stage were resolved through consensus or adjudication by a senior author (PS). Agreement between reviewers was assessed using Cohen's kappa (κ) statistic, interpreted a priori as follows: κ ≥ 0.80 (almost perfect), 0.60–0.79 (substantial), 0.40–0.59 (moderate), 0.20–0.39 (fair), and <0.20 (slight agreement). Data extraction Data were independently extracted by two reviewers (OB and VJ) with graduate-level training in health research methodology using a standardized spreadsheet (Google Sheets, Google LLC, Mountain View, CA) developed a priori. Prior to formal extraction, reviewers underwent a multi-step pilot training process to ensure inter-rater reliability including a pilot spin assessment of the first 10 abstracts to calibrate their evaluation of spin. Disagreements were resolved by a third reviewer (PS). Spin was assessed for each study based on the nine types described by Yavchitz et al. (2016), 4 applied specifically to the abstract conclusions (Table 1). Studies with statistically significant claims in the abstract had their full-text cross-referenced to confirm whether the data represented in the results section were concordant with this interpretation. Additional extracted study characteristics included: publication year, country of corresponding author, upper extremity subspecialty topic (e.g. shoulder, elbow, hand/wrist), intervention and comparator descriptions, total number of included studies or participants, whether a meta-analysis was conducted, level of evidence of included primary studies, and total and annual citation counts. Outcomes The primary outcome was the presence of spin in the abstract conclusion of each included SR or meta-analysis. Articles containing two or more distinct types of spin were categorized as exhibiting “severe spin,” a threshold defined a priori. The prevalence of spin was compared between reviews based on study characteristics such as inclusion of randomized controlled trials (level I/II evidence) versus reviews limited to observational studies (level III/IV evidence). Statistical analysis Statistical analyses were conducted using RStudio (Version 4.4.2). Descriptive statistics, including means, standard deviations, frequencies, and percentages, summarized study characteristics and spin prevalence. Associations between categorical variables were analyzed using chi-square tests (with post-hoc analysis if appropriate), while correlations between continuous and categorical variables were evaluated using Pearson's biserial correlation coefficient. Sample size calculations determined that at least 84 studies were needed to achieve 80% power to detect an effect size of 0.15 with four independent variables at α = 0.05 for multivariate analysis. If the sample size fell below this threshold, only univariate analyses were performed, consistent with the protocol. Citation analysis was limited to articles published up to 2024 to allow at least 1 year for citation accrual. Results Study characteristics The initial search identified 1390 articles with 544 articles remaining after duplicates were removed. After a thorough title/abstract and full-text screening assessment, a total of 54 SRs were included for analysis (Figure 1).15–68 κ at title/abstract stage was 0.78 [95% CI 0.70 to 0.86] and at full-text stage was 0.91 [95% CI 0.80 to 1.00], indicating substantial agreement for the title/abstract stage and almost perfect agreement for the full-text stage. At the spin analysis stage, inter-rater reliability assessed with κ was found to be 0.76 [95% CI 0.67 to 0.85], depicting substantial agreement. Of the 54 included articles, 42/54 (77.8%) were published in the Journal of Shoulder and Elbow Surgery, 9/54 (16.7%) were published in the Journal of Hand Surgery (American Volume), and 3/54 (5.6%) were published in Journal of Hand Surgery (European Volume). Shoulder arthroplasty (28.8%), shoulder instability (15.4%), and wrist fractures (7.4%) were the most represented topics within the included SRs. The mean number of citations per publication was 29.3 (SD ± 40.4). Complete study characteristic data for the 54 included articles is provided in Supplementary File S2. Preferred reporting items for systematic reviews and meta-analyses (PRISMA) flow diagram. Prevalence of spin The abstracts of included SRs ranged from depicting 04 total types of spin (Table 1), with a median of 1 type. The prevalence of spin in the included articles was 28/54 (51.9%), and the prevalence of severe spin was 21/54 (38.9%). The three most common types of spin that were found in the included SRs include: type 9 “Conclusion claims the beneficial effect of the experimental treatment despite reporting bias” (27/54, 50.0%); type 5 “Conclusion claims the beneficial effect of the experimental treatment despite high risk of bias in primary studies” (22/54, 40.7%); and type 3 “Selective reporting of or overemphasis on efficacy outcomes or analysis favoring the beneficial effect of the experimental intervention” (2/54, 3.7%). Two types of spin were not found in any of the included articles: type 6 “Selective reporting of or overemphasis on harm outcomes or analysis favoring the safety of the experimental intervention” and type 7 “Conclusion extrapolates the review's findings to a different intervention.” There was no statistically significant association between the presence of spin and number of citations per year nor total citations (χ2 = 5.323, p = 0.15). Association of spin with level of evidence Of the included articles, three (5.6%) were classified as LOE I, 14 articles (25.9%) were classified as LOE II, 18 articles (33.3%) were classified as LOE III, and 18 articles (33.3%) were classified as LOE IV. The presence of spin was highest in LOE IV studies, with a 66.7% presence of spin (12/18 articles). This is followed by LOE II (9/14, 64.3%), and LOE I and IV (1/3, 33.3% and 6/18, 33.3%, respectively) (Figure 2). There was no statistically significant association with the presence of spin and the level of evidence of the included SR, nor was there a statistically significant difference in the presence of spin found in the abstracts of articles in the RCT SR group (LOE I and II) compared to the non-randomized study SR group (LOE III and IV) (χ2 = 0.483, p = 0.49). Proportion of spin in included articles stratified by level of evidence. Discussion Our study found that spin was present in 51.9% of SRs published in the top three highest impact factor upper extremity and hand surgery journals, with 38.9% exhibiting what was defined in this study as severe spin. This demonstrates a substantial prevalence of misrepresentation of study findings in publication abstracts, even among work produced in high-impact journals. The most common types of spin identified were type 9 “asserting beneficial effects despite reporting bias” (27/54, 50.0%), type 5 “claiming benefit despite high risk of bias in primary studies” (22/54, 40.7%), and type 3 “selective overemphasis on efficacy outcomes” (2/54, 3.7%). These trends closely mirror findings in other orthopedic subspecialties. For instance, trauma literature showed a 66% prevalence of spin, commonly due to emphasis on secondary endpoints or subgroup analyses, while lower extremity arthroplasty literature exhibited a 58.7% rate of spin, similarly driven by selective reporting.69,70 Notably, the most prevalent types of spin in our review centered on bias underreporting rather than overemphasis of statistical significance alone. This suggests a particular vulnerability in SRs where bias is either not adequately assessed or omitted from abstract conclusions. These findings reinforce prior work showing that up to 59% of SRs fail to consider risk of bias in their abstract or conclusions71,72 The PRISMA guidelines themselves which have extensive reporting guidelines for manuscripts only feature one recommendation for abstracts; therefore, there is minimal guidance governing reporting accuracy in study abstracts. Including risk of bias details directly in the abstract or accurately temporizing results in studies with high risk of bias may be helpful in avoiding misleading reporting. Taken together, this finding urges authors and journal reviewers to assess for this critical criterion of spin among upper extremity literature and orthopedic research broadly. Our study found no statistically significant association between the presence of spin and journal bibliometrics, number of citations, or level of evidence. This points to a broad prevalence of spin and the inherent flaws of the publishing process across the selected journals and all types of SRs. Again, this finding supports a growing concern that spin reflects broader flaws in reporting culture and underscores the need for improved editorial standards, greater transparency in reporting, and targeted education for authors and peer reviewers. Moreover, given that clinical research—particularly in orthopedic surgery—is frequently misrepresented on news and social media outlets, it is incumbent upon the scientific community to act as a reliable and unbiased source of information.73,74 Incorporating structured assessments of risk of bias directly into abstract conclusions—especially in SRs or expanding guidelines like PRISMA for Abstracts to explicitly caution against spin may be sound strategies to decrease the prevalence of spin. This study has several limitations. First, we restricted our analysis to English-language articles published in three high-impact upper extremity journals, which may limit generalizability to lower-impact or non-English journals. Second, although we used a validated classification system by Yavchitz et al. (2016) 4 for identifying spin, the process of evaluating spin remains inherently subjective despite good inter-rater reliability. Third, we focused exclusively on reviews that reported statistically significant results, which may have introduced selection bias and potentially overestimated the prevalence of spin. Lastly, we were unable to include enough studies to conduct a multivariate analysis which could have provided more in-depth insights on the presence of spin. Future work should prioritize the development and implementation of clear guidelines and reporting frameworks to ensure that abstracts published in the scientific literature contain minimal to no spin. Additionally, since this analysis focused specifically on spin in abstracts, future research should extend this work by developing a framework specific to the assessment of spin in full-text articles and by systematically examining full texts for the presence of spin. Though the Yavchitz et al. (2016) 4 publication did recognize domains of spin that may be found in full-text articles, these did not undergo the same consensus agreement process among methodologist to determine the nine most severe forms of spin. The article explicitly stated that the framework presented was only relevant to abstracts of SRs and meta-analyses. 4 Nonetheless, a similar consensus agreement process can be undertaken to focus on full-text articles Conclusion Our findings demonstrate that approximately half (51.9%) of the SRs in the three highest impact upper extremity journals over the past 10 years demonstrate at least one form of spin in their abstracts. This was most commonly manifested by failure to incorporate risk of bias assessments in the conclusions of abstracts of SRs published in these journals. Authors must remain vigilant in their synthesis and reporting practices in their abstracts, while readers and reviewers must adopt a critical lens when appraising the literature. Promoting accuracy in the interpretation of evidence is essential to uphold the integrity of evidence-based surgical care. Supplemental Material sj-docx-1-sel-10.1177_17585732261472066 - Supplemental material for Assessment of “Spin” in the abstracts of systematic reviews in leading upper extremity surgery journals over the past 10 years: A cross-sectional methodological study Supplemental material, sj-docx-1-sel-10.1177_17585732261472066 for Assessment of “Spin” in the abstracts of systematic reviews in leading upper extremity surgery journals over the past 10 years: A cross-sectional methodological study by Oluwatoba T Balogun, Varun Jain, Praveen Sritharan, Aava Param, Ajay Shah, Darius Luke Lameire and Ujash Sheth in Shoulder & Elbow sj-xlsx-2-sel-10.1177_17585732261472066 - Supplemental material for Assessment of “Spin” in the abstracts of systematic reviews in leading upper extremity surgery journals over the past 10 years: A cross-sectional methodological study Supplemental material, sj-xlsx-2-sel-10.1177_17585732261472066 for Assessment of “Spin” in the abstracts of systematic reviews in leading upper extremity surgery journals over the past 10 years: A cross-sectional methodological study by Oluwatoba T Balogun, Varun Jain, Praveen Sritharan, Aava Param, Ajay Shah, Darius Luke Lameire and Ujash Sheth in Shoulder & Elbow sj-docx-3-sel-10.1177_17585732261472066 - Supplemental material for Assessment of “Spin” in the abstracts of systematic reviews in leading upper extremity surgery journals over the past 10 years: A cross-sectional methodological study Supplemental material, sj-docx-3-sel-10.1177_17585732261472066 for Assessment of “Spin” in the abstracts of systematic reviews in leading upper extremity surgery journals over the past 10 years: A cross-sectional methodological study by Oluwatoba T Balogun, Varun Jain, Praveen Sritharan, Aava Param, Ajay Shah, Darius Luke Lameire and Ujash Sheth in Shoulder & Elbow