Using prospective research methodology to understand policy advocacy for sexual and reproductive health and rights (SRHR) Authors: Sarah Clark, Suad Abdi, Sunungarai Dominica Chingarande, Sahro Ahmed Koshin, Rolla Khadduri, Alex le May Published: 2024 Introduction It is a widely held perception amongst funders, advocates and researchers that the impact of advocacy is challenging to measure or evaluate. This perception holds for community-level advocacy and is accentuated for advocacy that aims to change policies and laws, given the complexities of the policy world and the strategies required for advocates to operate successfully within it. In contrast to conventional retrospective evaluation – which waits until the end of a project to look back at what has or has not been achieved by advocates – prospective evaluation tracks both advocacy efforts and developments in the policy environment in “real time”. Prospective evaluation offers a chance to measure advocacy impact whilst capturing the complexity of change. This commentary comes out of the experience of a 2.5-year multi-country prospective research study into policy advocacy for sexual and gender-based violence (SGBV) in Somaliland and Puntland and for safe abortion in Zimbabwe. Supported by local researchers, we worked closely with local civil society organisations (CSOs) to track their advocacy. We begin by briefly outlining what prospective research is and what it looks like in practice before suggesting why it is particularly suited to understanding policy advocacy, drawing on examples from our prospective study. We then offer some learning points which we hope will be of value to others – advocates and researchers alike – who may be considering doing their prospective research. This paper builds on the growing body of evidence on methodologies to monitor advocacy.1–5 What is prospective research on policy advocacy? Simply put, prospective research seeks to understand developments in a specific environment over the course of time by monitoring those developments and the factors which influence them as they unfold.6 Prospective research for policy advocacy is an emerging field and was first proposed by Guthrie et al.7 It seeks to understand the influence of one factor – advocacy – on policy change. Advocacy does not happen in isolation from the policy context, shaped by many intersecting drivers. Prospective evaluation simultaneously tracks advocacy strategies and policy environment developments to see how the former influences the latter. On the ground, prospective research uses data collection techniques similar to those used in conventional qualitative policy research: semi-structured key respondent interviews, document analysis and media monitoring. However, research strategy and data analysis in prospective research are strongly shaped by process tracing methods. This pays particular attention to sequences of events, the interaction between events and trajectories of change which emerge as a result – in short, process tracing seeks to tell an accurate story of change or lack of change, as the case may be.8 For example, researchers may try to learn about the influence that a new piece of research on the magnitude of sexual and reproductive health and rights (SRHR) abuses or media coverage of a high-profile case might have on policymakers’ prioritisation of an SRHR policy issue. In this instance, process tracing would seek to document the pathways through which the research or media story caught the attention of decision-makers, the key actors who responded positively to the story to initiate discussions on policy changes, the elements of the research or stories that caught their attention, and so on. To understand why prospective research is so well suited to policy advocacy, it helps first to be clear about the nature of policy advocacy itself and how it differs from other kinds of advocacy – for example, community-level awareness programmes. Firstly, advocacy for policy change is inherently political. The policy world is one characterised by a complex interaction of institutions, interests and ideas9 or, as Klein and Marmor put it, “a strange theatre”, an understanding of which requires the researcher or the advocate to enter the “assumptive worlds”* of the policymakers which construct the problem and the policy.10 Therefore, it is the nature of politics and the complexity of the policy world that events can evolve in an unexpected, non-linear way because of often subtle changes in the “complex interaction” of factors involved. This complexity also means that policy change rarely happens quickly. Rather, it evolves over time in response to a whole host of contextual variables, branching off in any number of different directions in the process. So, on the one hand, policy advocacy work must be nimble and responsive to changes in the policy environment, taking advantage of windows of opportunity when they open and changing tack when they close – this requires much more flexibility than in other types of advocacy. On the other hand, tangible policy advocacy “impact” such as legislative change can take a long time to be seen, so smaller, more diffuse, incremental changes are important. A prospective research approach matches these features of the policy world and policy advocacy particularly well. Prospective research as a way to better understand SRHR policy advocacy In this commentary, we draw on the experiences gained from prospective research carried out by civil society organisations in Zimbabwe, Somaliland and Puntland who received grants from AmplifyChange to support advocacy for policies in favour of abortion rights, and preventing gender-based and sexual violence, respectively. The objective of the research was to observe the effects of advocacy on legal and policy change and implementation of laws and policies. Known as the “Knowledge Study”, this research study aimed at generating knowledge that would expand the grantees’ advocacy capacity and enhance their effectiveness. The study also aimed to enable better understanding by the grantees of how advocacy works in the real world and what kind of modifications may improve the chances of success. It also aimed at documenting the interim outcomes such as changes in beliefs, social attitudes and behaviours at the community and individual levels, that lay the foundation for policy change. The study was led by one of the authors of this commentary with in-country leads from each country. The case study method was used to tell a story about the mechanisms and influence of SRHR advocacy on different issues and in different contexts. Although there are few published examples of the prospective evaluations of SRHR advocacy, the method is also well-suited specifically for documenting SRHR advocacy. SRHR evokes strongly held views, is often contested in policy space, and has supporters and opposition on both sides. Global decisions reverberate locally, and “political decisions have embodied consequences”.11 For example, political decisions affecting the legality of abortion provision in the USA affect the bodily autonomy of women globally. Tracking change in prospective research acknowledges these complexities. It is a “real world” approach Prospective research recognises the complexity of the policy world. It assumes that most advocacy influence is one factor amongst many that may contribute to policy change – that is, it does not look to attribute policy change to advocacy efforts but rather to identify the contribution of advocacy to such changes. Further, prospective research recognises that judging the degree of influence over a policy development also involves a large element of subjectivity and that different stakeholders may have very different perceptions of what constitutes influence and how significant the change is. It is also a “real-time” approach Prospective research tracks shifts in advocacy efforts and policy processes as they happen. Whilst conventional retrospective evaluation will aim to identify these shifts post hoc, it relies upon respondents – advocates or policy stakeholders – not only having good memories but also having been able, even at the time, to recognise often subtle shifts as notable. When such changes occur, they may go unnoticed by advocates or be noticed but given little significance. So there is a problem for retrospective evaluation not only of “forgetting” but sometimes of an absence of anything to “remember” in the first place. By closely observing developments from moment to moment, however, prospective research is much more likely to be sensitive to non-obvious shifts in the policy environment and well placed to inquire about the contribution advocacy may have made to those shifts. Therefore, it is more likely to provide a more accurate reflection of advocacy’s impact and simply to be able to tell a richer, more nuanced story of policy change. The “real-time” nature of prospective research also means that the need to be flexible and to adapt to changing policy or advocacy circumstances is built into research design and implementation. So, when an advocacy strategy changes or a key shift in policy salience or direction occurs, the research is not derailed but rather adjusts with that change to maintain relevance and to be able to address emerging questions. Our research in Somaliland benefitted in many ways from the “real-time” nature of the prospective approach. The study focussed on advocacy around the Sexual Offences Bill, launched in 2014 and passed into law in 2018 (although currently suspended). Whilst women’s advocacy efforts appeared to be driving the Bill forward very positively as it moved through the lower house of Parliament, interviews with MPs at the time showed that many knew little about the content of the Bill and thought it wholly unimportant. So, taking into account the “assumptive worlds” of those MPs led us to wonder how much influence the hard work of advocates had and what other factors were at play. We reported on this key piece of information in our regular feedback sessions to reflect with civil society organisations (the “researched”). This more nuanced understanding of the consequences and reactions to their advocacy helped support the adaptive management of their work; it also added value to the richness of data on how advocacy challenges arise and are dealt with. Later in the study, a series of events unfolded very rapidly as religious actors spoke out in opposition to the Act just after it had been given Presidential assent, and viciously criticised civil society organisations who had advocated for it. We were able to track these events carefully and capture the effect on stakeholders and civil society in a way that would have been difficult for a retrospective evaluation several years or even months down the line. It was a challenge for us to keep track of events and to understand their significance even as we observed in the present time, so we would suggest that the passage of time would likely have obscured our understanding even further. Once again, in this situation, given the prospective evaluation methodology, research results were shared with the civil society organisations, although they were already well aware of these specific challenges. This led civil society actors to think about strategies to negotiate with religious leaders and traditional elders and strengthen community ownership of the issue so that there is support from the grassroots for the Bill. This sudden series of events in Somaliland also meant that the Sexual Offences Act was suspended and that the second part of our research question about the influence of advocacy on implementing that Act was no longer valid. The nature of the events also had a dramatic effect on the atmosphere among civil society activists. However, the fact that our research was designed not around producing particular “answers” but rather to track the process of advocacy and policy change meant that we could change our research focus and maintain our relevance, observing the unfolding of a highly significant political moment.† Prospective research can accurately identify “interim” outcomes and give due regard to incremental change Major policy change may not come until long after an advocacy initiative has ended. However, there are likely to be numerous smaller, more diffuse effects that can be observed in real-time by prospective evaluation. It is standard practice for conventional evaluations to identify interim benchmarks for progress. Still, we suggest that the close observation made possible by prospective research is more likely to accurately record these incremental changes and give them due significance. Whilst influencing policy change may be its primary goal, “progress” in advocacy should not be measured solely in those terms given how significant broader aspects of the advocacy and policy environment are: for example, establishing and strengthening advocacy coalitions can be a hugely important and necessary part of advocacy “progress” even though it may take a long time for the fruits of those coalitions to become evident in terms of policy impact. It may also be the case that the hoped-for policy change never occurs – an outcome that is all too likely in the sensitive and controversial territory of SRHR advocacy. This may be unrelated to the quality of advocacy and rather more due to political opportunities locally, globally emerging trends or other factors outside of the advocates’ control. Hence, the ability of prospective research to pay close attention to perhaps subtle interim changes and to keep a broader and arguably more accurate perspective on non-policy-related outcomes allows it to provide a more realistic portrait of progress in advocacy. Our experience in Zimbabwe showed this to be significant. In the run-up to the first post-Mugabe elections, a window of opportunity appeared to open up around safe abortion issues with greater openness and a willingness to engage on the part of high-level policymakers, which was hitherto unimaginable. Due to challenges of coordination and the lack of a clear, appropriate policy demand, advocacy efforts fell flat, and opportunities were missed. This would likely be a significant negative event in advocacy “progress”. However, our prospective study observed that an important shift in awareness amongst advocacy CSOs followed from this, that they had to work more closely together and focus on generating key asks upon which they could all agree. So, whilst the most clearly observable events in the pre-election period pointed towards a “failure” of advocacy, a close observation of the time following those events showed a step-change in attitude amongst CSOs towards coalition building and strengthening the movement. The CSOs involved were more conducive to forming a collective position and movement for change. Whilst the policy status quo remains, it is surely an important element of “progress” in the diffuse safe abortion advocacy movement in Zimbabwe. It offers good grounds for optimism about future change. It engages advocates in an iterative, reflective process Because it collects data alongside advocacy programmes rather than after their end, prospective research can offer insights to advocates and thereby help them refine their approach through a learning and adaptive approach. Having regular conversations with advocates is an essential part of the prospective research process – researchers need to keep track of advocacy strategies to know when, for example, targets for influence change. However, these conversations also offer a space for reflection on the part of advocates. In our experience in all study countries, advocates often started in these conversations by simply listing their activities. Given our research focus, we aimed to guide conversations instead towards inquiry about if and how those activities were helping to achieve policy change, indirectly or otherwise, and so help advocates reflect on the usefulness of their activities in reaching their advocacy goals. There were also instances where our interviews revealed key gaps in knowledge amongst policy stakeholders, which advocates could usefully fill, and even gaps in coordination between CSOs themselves, which highlighted the need to share information and activity plans to avoid duplication of efforts. Learning from experience Several learning points emerged for us throughout the study, many arising from the differences between prospective and conventional approaches. In prospective research, there is great value in taking time to understand all elements of policy and political context and how they interact with one another. Conventional retrospective research will naturally gain from this, too, but if the benefits of the prospective approach are to be maximised, establishing a sufficient breadth and depth of contextual understanding helps ensure that subtle changes are not missed. Our methodological recommendation is to combine local and non-local researchers to mutually support the prospective evaluation. For the non-local researcher, we recommend maintaining a humble awareness that this understanding is never complete. However, local researchers often overlooked significant contextual factors because they were “obvious”. A combination of knowledgeable local and curious non-local researchers helped foster reflective inquiry, which was important for bringing all context elements into view. Engaging in an iterative process of reflection with advocates over the course of time is a real benefit of the prospective approach. However, it is not always easy to do effectively in reality. Researchers with limited time may naturally prioritise their own data collection for the sake of the research, and it can be difficult to arrange meetings with very busy advocates for whom research is not a priority. And when those meetings occurred, we found that researchers tended to prioritise getting up to date with advocacy strategies and learning from advocates rather than sharing research findings. One relevant factor here may be that our research began sometime after the start of the advocacy initiative: embedding our research in the advocacy work from the outset, with full investment from advocates, may have helped integrate research and advocacy more fruitfully. As with all research, ethical concerns arise. One of these often pertains to the issue of researcher neutrality. It seems unlikely that any researcher would select to work on a research project concerned with advocacy for improving SRHR if they did not already have some commitments in that direction themselves – but this can be the case with any research. However, with prospective research on policy advocacy, the researcher is in regular and close contact with advocates and, in many ways, is inevitably on their “side”. As such, researchers in prospective studies need to maintain an extra layer of awareness – not to pretend any kind of spurious neutrality or lack of unconscious biases, but rather to acknowledge the impact of their values and how those may be brought even further into the research as a result of close working with advocates. The resource implications of prospective research on SRHR advocacy are significant. They require local researchers trained in qualitative research techniques, available to observe and document policy changes, and the skills to develop trusted relationships with the “researched” (in this case, the civil society advocates). Often, these researchers are part of the civic space itself, and checks and balances must be put in place to maintain objectivity. One example is having a peer review of all work and guidance from a second researcher, a technique employed in this case with a Lead Researcher guiding the work. The prospective evaluation also requires the resource of time to follow through the lengthy advocacy journey. Conclusion With a real world, real-time approach and research design and strategies that reflect the flexibility required to track complex policy and advocacy interactions, we suggest a prospective approach that is especially well suited to researching policy advocacy on SRHR. Drawing on the experience of doing prospective research in Somaliland on SGBV and Zimbabwe on abortion, we believe that many of the insights gathered may not have been available either at all or in as much richness and depth to retrospective researchers months or years down the line. Furthermore, rather than being merely extractive, contemporary research findings can be shared with advocates to help them improve advocacy strategies – although our experience also suggests that integrating prospective research into advocacy initiatives from the beginning would enhance this. However, prospective research perhaps holds the greatest promise in its ability to capture the story of advocacy with all of its twists and turns and all of its short and medium term, “outcome” and “non-outcome” related achievements across time, thereby developing a more realistic, bottom-up understanding of what “progress” might mean in the challenging world of policy advocacy. Funding Statement This work was supported by William and Flora Hewlett Foundation. Footnotes “Assumptive world” is understood to mean the assumptions or beliefs that ground and guide people. Of note, since the research, the situation remains stalled legally. Disclosure statement No potential conflict of interest was reported by the author(s). References