Monitoring and Evaluating Astronomy-for-Development Initiatives

Joyful E. Mdhluli on behalf of the IAU Office of Astronomy for Development · 2025

Read Monitoring and Evaluating Astronomy-for-Development Initiatives by Joyful E. Mdhluli on behalf of the IAU Office of Astronomy for Development (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18015.txt.

Introduction

Joyful E. Mdhluli, writing for the International Astronomical Union's Office of Astronomy for Development, offers a field guide for star based aid projects. Groups around the world use astronomy to teach science and build skills, and funders want proof that the work helps. The guide shows teams how to gather that proof from the start.

It separates day to day monitoring from deeper evaluation and lays out six kinds of review, from process to cost. Teams get steps for stating how change should happen, picking clear signs of progress, and spotting risks early. The aim is projects shaped by local needs that can show real gains at home and beyond.

Catalog record

CREATORJoyful E. Mdhluli on behalf of the IAU Office of Astronomy for Development
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-18015

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Monitoring and Evaluating Astronomy-for-Development Initiatives Joyful E. Mdhluli on behalf of the IAU Office of Astronomy for Development Abstract This paper serves as a practical guide for individuals and organisations seeking to design, implement, and evaluate astronomy-for-development initiatives, as well as those preparing proposals for the International Astronomical Union’s Office of Astronomy for Development (IAU OAD) annual Call for Proposals. The paper aims to outline how systematic evidence collection can strengthen project design, enhance accountability, and increase the likelihood of measurable impact. It explains the distinction between monitoring and evaluation, provides guidance on when and how evaluation should be undertaken, and summarises key evaluation types - process, feasibility, impact, outcome, economic, and summative, relevant to astronomy-based interventions. In addition to conceptual discussion, the paper presents a set of practical steps, reflective questions, and examples to help project teams develop a clear theory of change, define appropriate indicators, and anticipate risks and unintended consequences. By contextualising M&E within the broader goals of the OAD and the Sustainable Development Goals (SDGs), this work aims to empower practitioners to create evidence-informed, community-driven, and sustainable astronomy-for-development projects that deliver both local and global benefit. Keywords Astronomy \cdot Sustainable Development Goals \cdot Impact \cdot Monitoring \cdot Evaluation 1 Introduction The global movement to use astronomy as a tool for sustainable development has gained momentum over the past decade, driven by the work of the International Astronomical Union’s Office of Astronomy for Development (IAU OAD). By connecting the inspiration of the cosmos with the practical needs of communities, astronomy-for-development projects have demonstrated potential to advance education, equality, innovation and socio-economic wellbeing [ 1 ] - [ 9 ] . Yet, as the field matures, a central challenge has emerged: how can we measure and demonstrate the real-world impact of these interventions? Without clear evidence, even the most inspiring initiatives risk remaining anecdotal, their outcomes difficult to replicate, scale, or justify to funders and policymakers. Monitoring and Evaluation (M&E) provide the mechanism through which such impact can be systematically understood. Within development practice more broadly, M&E ensures that projects are not only well-implemented but also relevant, effective, efficient and sustainable. Applied to astronomy-for-development, M&E plays an equally vital role in refining project design, ensuring accountability, identifying unintended consequences, and fostering organisational learning. However, astronomy projects often face distinctive obstacles in this regard: they operate across disciplines, involve intangible outcomes such as inspiration or curiosity, and are frequently implemented by small teams with limited evaluation capacity. In response to these challenges, the IAU OAD has developed an M&E framework that adapts principles from the broader development sector to the specific realities of astronomy-based interventions. The framework distinguishes between monitoring, the continuous tracking of activities, progress and emerging issues, and evaluation, which systematically investigates a project’s effectiveness, feasibility, and longer-term impact. It also recognises that evaluation is not always appropriate or feasible, especially for small or exploratory projects, and that the choice of evaluation type such as process, feasibility, outcome, impact, economic or summative, should depend on project scope, purpose and available resources. This paper situates the OAD’s approach to monitoring and evaluation within the wider context of evidence-based development practice. It explores how a clear theory of change, appropriate indicators, and participatory evaluation can strengthen astronomy’s contribution to the Sustainable Development Goals (SDGs). By analysing the conceptual foundations and practical guidance of the OAD’s M&E model, this work seeks to contribute to a growing discourse on accountability, learning, and impact measurement in science-for-development initiatives. Ultimately, it argues that robust M&E is essential not only to justify investment in astronomy-for-development, but to ensure that its outcomes are meaningful, equitable, and sustainable for the communities it aims to serve. 1.1 Purpose and Structure The primary aim of this paper is to support practitioners, educators, and community organisers who wish to design and implement astronomy-for-development initiatives, as well as those seeking to submit proposals to the IAU Office of Astronomy for Development (OAD) [ 10 ] . To achieve this, the paper is structured around three complementary objectives. First, it introduces the conceptual foundations of Monitoring and Evaluation (M&E) in the context of astronomy-for-development, clarifying key distinctions between monitoring and evaluation and highlighting when each is appropriate. Second, it outlines practical guidance for developing a theory of change, selecting measurable indicators, and choosing appropriate evaluation types, drawing on the OAD framework and illustrative examples. Third, it presents a set of reflective questions and actionable steps aimed at helping project teams anticipate challenges, assess feasibility, and design interventions that are community-driven, evidence-informed, and sustainable. This structure ensures that readers can not only understand the principles behind effective M&E but also apply them directly to the planning, execution, and proposal development of astronomy-for-development projects. 2 Basic Understanding of Monitoring and Evaluation Research has shown that interventions often run into unexpected barriers and can produce unexpected negative, as well as positive, impacts [ 11 ] . As a result, non-profit organisations and other intervention providers have come under increasing pressure from funders and other stakeholders to provide information about their performance. Monitoring and evaluation refer to a combination of activities and procedures used to effectively measure, report and learn from project performance. Monitoring and evaluation are considered good practice for organisations engaged in social intervention because they enable providers to: • Determine whether a project successfully produced desired outcomes. • Understand how a project worked or did not work. • Check for unforeseen negative consequences that require attention in future. • Identify which activities produce the largest or most important positive impacts. • Identify which strategies are most cost-effective (i.e. resource efficient) in achieving project goals. • Assess how meaningful, sustainable , accessible and relevant a project was for participants and other stakeholders. • Learn from experience how to improve and build on project experience. • Demonstrate impact to others. Monitoring refers to indicators used throughout the life of a project to measure progress and record how a project was designed, implemented and delivered. Monitoring data capture whether a project is implemented in a way that is consistent with its design and whether any unanticipated barriers were encountered (for example, no one applied to take part in the project). The monitoring phase of a project also provides a framework through which to track progress and identify problems early on, thus offering a way through which corrective action and improvements can be made ‘on the ground’ and recorded without compromising project objectives. Evaluation focuses on “what works”, as well as how, for whom and under what conditions. The key difference between evaluation and monitoring is that evaluation is about using data, including monitoring and post-project outcome data, in order to draw conclusions about project impact. Different types of evaluation are used to address different dimensions of project impact and effectiveness (see the next section for a summary of evaluation types). Different research designs are used for different types of evaluation; and different types of evaluations are of interest to different stakeholders. It is considered good practice to conduct an impact or outcome evaluation in combination with an economic evaluation wherever possible; however, these two types of evaluation are also the most technically challenging. 3 Types of Evaluation Evaluation can take several forms, each serving a

Read the complete text