What's in a mechanism? Development of a key concept in realist evaluation.
Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. · 2015
Read What's in a mechanism? Development of a key concept in realist evaluation. by Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. (2015) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc4408605.txt.
Introduction
Sonia Dalkin, Joanne Greenhalgh, Diana Jones, Bill Cunningham, and Monique Lhussier clarified a key concept in realist evaluation, in Implementation Science in 2015. Realist evaluation judges complex social programs by asking what works, how, in which conditions, and for whom, using linked context, mechanism, and outcome patterns. Its central term, mechanism, is often confused in practice, which makes studies hard to compare and repeat. The authors set out to develop the concept further.
They argue for splitting a mechanism into two parts: the resources a program offers, and the change in participants' reasoning that those resources trigger. That split also sharpens the line between context and mechanism. Mechanisms, they stress, act on a continuum, not as an on-off switch that simply fires. The paper is a teaching piece, aimed at evaluators learning the method.
Catalog record
| CREATOR | Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. |
|---|---|
| YEAR | 2015 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
What’s in a mechanism? Development of a key concept in realist evaluation By Sonia Michelle Dalkin, Joanne Greenhalgh, Diana Jones, Bill Cunningham, Monique Lhussier Published in: Implementation Science : IS DOI: 10.1186/s13012-015-0237-x ABSTRACT Background The idea that underlying, generative mechanisms give rise to causal regularities has become a guiding principle across many social and natural science disciplines. A specific form of this enquiry, realist evaluation is gaining momentum in the evaluation of complex social interventions. It focuses on ‘what works, how, in which conditions and for whom’ using context, mechanism and outcome configurations as opposed to asking whether an intervention ‘works’. Realist evaluation can be difficult to codify and requires considerable researcher reflection and creativity. As such there is often confusion when operationalising the method in practice. This article aims to clarify and further develop the concept of mechanism in realist evaluation and in doing so aid the learning of those operationalising the methodology. Discussion Using a social science illustration, we argue that disaggregating the concept of mechanism into its constituent parts helps to understand the difference between the resources offered by the intervention and the ways in which this changes the reasoning of participants. This in turn helps to distinguish between a context and mechanism. The notion of mechanisms ‘firing’ in social science research is explored, with discussions surrounding how this may stifle researchers’ realist thinking. We underline the importance of conceptualising mechanisms as operating on a continuum, rather than as an ‘on/off’ switch. Summary The discussions in this article will hopefully progress and operationalise realist methods. This development is likely to occur due to the infancy of the methodology and its recent increased profile and use in social science research. The arguments we present have been tested and are explained throughout the article using a social science illustration, evidencing their usability and value. BACKGROUND The idea that enquiry works by uncovering the underlying, generative mechanisms that give rise to causal regularities has become a guiding principle across many social and natural science disciplines. This article aims to provide a brief description of social mechanisms, mechanisms within evaluation and then specifically mechanisms in realist evaluation. The principles of Pawson and Tilley’s [1] conceptualisation of mechanism will then be discussed and operationalised through a reconceptualisation of the Context-Mechanism-Outcome configuration (CMOc) and an understanding of mechanisms on a continuum of activation. Much ado about mechanisms Social mechanisms One of the key tenets of realism is the very basic idea that observational evidence alone cannot establish causal uniformities between variables. Rather, it is necessary to explain why the relationships come about; it is necessary to establish what goes on in the system that connects its various inputs and outputs. In this manner, physicists are able fully to understand the relationship between the properties of a gas (as measured by the variables—pressure, temperature and volume) using knowledge about the kinetic action of the constituent molecules. In pharmacology, the term ‘mechanism of action’ refers to the specific biochemical interaction through which a drug substance acts on the body to generate its curative effect. Programme evaluators do not suppose that CCTV (the intervention) causes a fall in crime rates (the outcome). It does so, when it does so, by persuading potential perpetrators of increased risks of detection (the mechanism). In all cases, science delves into the ‘black box’. In all cases, the mechanism is what generates the observed relationship. Whilst it is possible to recognise the affinities in explanatory structure across these examples, they also demonstrate that the action of the generative mechanisms is quite different, to such an extent indeed that that they defy a simple, unitary definition of their nature and content. Pawson expands on the applications of generative vs successive conceptualisations of causation elsewhere [2]. Readers of this journal will need no reminding that these paradigms have been debated for many years. Realists see physical and social reality as stratified and emergent. Things that cannot be cast as variables yet are vital to explanation (like kinetic forces, cultural norms and human interpretation or agency) are missing from correlational methods. Causal associations themselves are rarely universal; they are adaptive ‘demi-regularities’, which are always strongly influenced by setting and context. The original sources for these arguments may be found in Hesse [3], Harré [4], Pawson [2,5], Sayer [6,7], Bhaskar [8], Boudon [9] and Stinchcombe [10]. We acknowledge the further cleft between ‘critical realism’ and ‘scientific realism’. The writings of Bhaskar [8,11] and Pawson [2] serve as a reasonable proxy for these two schools. They differ on the matter of whether social science can create ‘closed system’ investigations. For Bhaskar, the closed system, experimental control available to the natural scientist is not achievable in social research because of ever-present emergence, that is to say the unique and unceasing human capacity to change the circumstances in which they live. As a ‘substitute’ for closed system empirical enquiry, he thus proposes the usage of abstract, a priori reasoning and the admission of a moral lens through which to critically evaluate human actions ([11], p. 64). Pawson, by contrast, argues much more pragmatically that neither physical science nor social science investigation depends on the achievement of closed systems ([5], p. 67). There are no crucial experiments (most especially Randomised Controlled Trials) which alone furnish us with social laws. But equally, natural science only ever makes slow and imperfect progress in gathering knowledge of the potentially infinite number of contingencies that can shape a physical system. Investigatory closure is always partial. Again, we are presented with rather different visions, the only contradiction occurring when an investigation claims to be both normative and scientific. For Archer [12], collective, constrained decision making is the underlying mechanism that creates all social outcomes. Society is made by but never under the control of human intentions. At any given time, peoples’ choices are conditioned by pre-existing social structures and organisations. We are thus externally constrained in our actions but always part of human agency is the choice to attempt to change the initial conditions that bear down on us. These adaptive choices, over time, go on to mould novel structures and changed institutions. Collectively, our present decisions congregate to form new systems, which in their own turn, constrain and enable the choices of the next generation. Society is thus patterned and re-patterned by wilful action, but as Archer reminds us, the causal outcomes never conform to anyone’s wishes—even the most powerful. Most realists would affirm this broad account of the mechanisms of social change, where structures shape actions, which shape structure, which shape actions, and so on. There are, however, some significant differences in where they locate the precise locus of that change. For Bhaskar [8], causal mechanisms sit primarily within the structural component of the social world. They reside in the power and resources that lie with the great institutional forms of society. For other realists, such as Pawson and Tilley [1], mechanisms are identified at the level of human reasoning. Thus, mechanisms can have different meanings depending on the scope of the intended explanation. Structural mechanisms come to the fore if the social scientist is attempting to explain large-scale social transformations. If, however, the researcher is attempting to discover whether a particular