Are Widely Known Findings Easier to Retract?

Shahan Ali Memon, Jevin D. West, Cailin O’Connor · 2025

Read Are Widely Known Findings Easier to Retract? by Shahan Ali Memon, Jevin D. West, Cailin O’Connor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15504.txt.

Introduction

Shahan Ali Memon, Jevin West, and Cailin O'Connor ask whether well-known findings are easier to retract than obscure ones. Retractions often fail to stop a claim from spreading. A network view suggests that when many people know a result, news of its retraction is more relevant and may spread better too.

Using citation records and attention data, the authors test that prediction. Highly cited papers showed larger drops in citations after retraction than less cited ones. Their retractions also drew more attention as they happened. The results support the idea that wide reach can help, rather than hurt, the correction of the record.

Catalog record

CREATORShahan Ali Memon, Jevin D. West, Cailin O’Connor
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15504

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Are Widely Known Findings Easier to Retract? Shahan Ali Memon, Jevin D. West, Cailin O’Connor Abstract Failures of retraction are common in science. Why do these failures occur? And, relatedly, what makes findings harder or easier to retract? We use data from Microsoft Academic Graph, Retraction Watch, and Altmetric—including retracted papers, citation records, and Altmetric scores and mentions—to test recently proposed answers to these questions. LaCroix et al. 2021 employ simple network models to argue that the social spread of scientific information helps explain failures of retraction. One prediction of their models is that widely known or well established results, surprisingly, should be easier to retract, since their retraction is more relevant to more scientists. Our results support this conclusion. We find that highly cited papers show more significant reductions in citation after retraction and garner more attention to their retractions as they occur. 1 Introduction Scientific retraction is not always effective. Across many fields retracted papers are cited approvingly after retraction, sometimes at surprisingly high rates. 1 1 1 There are now hundreds of studies yielding similar findings across diverse academic disciplines and types of results. For some examples see Bornemann-Cimenti et al. 2016 ; Neale et al. 2010 ; Pfeifer and Snodgrass 1990 ; Van Der Vet and Nijveen 2016 ; Madlock-Brown and Eichmann 2015 ; Teixeira da Silva and Dobránszki 2017 ; Szilagyi et al. 2022 ; Shuai et al. 2017 ; Kühberger et al. 2022 . This poses a problem for scientific progress. New studies draw on existing findings but cannot do so effectively if those findings are not reliable. In the wake of the metascience movement, and under the influence of the Retraction Watch blog, there is increasing attention to this issue. One relevant question is: Which findings are easier or harder to retract, and why? In previous work using models of social networks LaCroix et al. 2021 predict that finding with wide reach should be easier to retract. Humans tend to share information that is relevant. While new scientific findings are broadly relevant, information about retraction is most relevant to those already misinformed about a finding. For this reason, information about the retraction of widely known findings spreads effectively in their models. We test this modeling prediction using citation data and Altmetric data (tracking media attention). In the first case, we predict a more significant drop in citations for highly cited papers after retraction. We find clear support for this prediction. More highly cited papers see significantly greater drops in citation count upon retraction. They also see a larger relative drop in citation rate. In the second case, we predict, and find, more online attention to highly cited papers during their retractions. Our findings provide new insight into the process of retraction, and to the role of social aspects of knowledge in retraction. They also demonstrate the usefulness of combining methods of inquiry—in this case simple social models and data analysis—to the study of philosophy of science and metascience. In the next section, 2 , we describe the model from LaCroix et al. 2021 , motivating it with some relevant empirical findings. We also describe our main predictions. In section 3 we describe the two data sets we make use of, as well as our methods of analysis. In section 4 we present our main results. And section 5 provides relevant discussion. 2 Model and Predictions There are myriad candidate explanations for failures of retraction—journals do not actively communicate about retraction, some scientific search engines fail to clearly identify retracted papers, and individual scientists are often hesitant to communicate about their retractions for reputational reasons. Beyond these issues, though, features of human information sharing systems may prompt such failures as well. LaCroix et al. 2021 study the social dynamics of retraction on the empirically well-supported assumption that information spreads via social contact in human groups. They draw on SIR (susceptible, infected, recovered) models from epidemiology, which track the spread of infectious diseases, but are also used to study the spread of rumors or information in human groups ( Rogers 2012 ; Hayhoe et al. 2017 ) . Their basic model is a connected network of N agents who can be in one of three belief states. Neutral (susceptible) agents have never encountered a new, false scientific claim, false (infected) agents have encountered this claim and now hold a false belief, retracted (recovered) agents have encountered information about retraction and correctly believe the original claim to be false. In each round of simulation, an agent is randomly paired with a network neighbor, and their belief states may influence each other. Importantly information spread is asymmetric. Neutral agents may learn false beliefs, and false agents may learn about a retraction. Thus agent states only flow from neutral \rightarrow false \rightarrow retracted. A substantive assumption is that agents do not learn about retractions before learning false beliefs. As noted, the authors justify this via appeal to the role of relevance in human communication—people tend to avoid sharing irrelevant information ( Grice 1975 ; Sperber and Wilson 1986 ; Wilson and Sperber 2006 ) . Since retractions are only relevant to those who learned the original finding, information about them will not spread well absent this context. A central result is that when agents do not share new information indefinitely, false beliefs persist in these models as an accident of history. Some agents learn a false finding, and never happen to encounter its retraction. The authors explore conditions under which larger or smaller proportions of the population maintain permanent false beliefs. Most important for us is the role of delay in retraction. One might think that a retraction should be issued as soon as possible to prevent eventual false beliefs. In their models, though, delayed retractions are issued in a network where many agents have already encountered the false belief. The retraction can thus spread more readily, and is more successful. We present this effect in figure 1 which shows average final belief states in this model for different lengths of delay in retraction. 2 2 2 This figure uses original data from LaCroix et al. 2021 . Figure 1 : Delayed retractions are more effective . Results for fully connected network of size N=100 where agents share newly learned beliefs for 200 time steps of simulation. The models just described are highly simplified and do not fully track real dynamics of information sharing. 3 3 3 For example, scientists do not always accept new results, and may spread objections or counter results. Scientists also have graded levels of belief in some theories, and complex causal relations between beliefs ( O’Connor et al. 2024 ; Golub and Jackson 2010 ; Bala and Goyal 1998 ; Freeborn 2024 ) . As such, they should not be taken to directly inform real scientific communities. But we can use them to generate testable predictions about causal processes that might occur in the real world. In the models delay improves retraction because delay leads false findings to spread more widely. But in the real world the importance of the research, publication venue, status of the authors, their social sway, and chance events all determine the degree to which a finding is widely

Read the complete text