Mathematical modelling to estimate the impact of maternal and perinatal healthcare services and interventions on health in sub-Saharan Africa: A scoping review Authors: Joseph H. Collins, Valentina Cambiano, Andrew N. Phillips, Tim Colbourn, Ashish KC, Ashish KC, Ashish KC Published: 2024 ABSTRACT IntroductionMathematical modelling is a commonly utilised tool to predict the impact of policy on health outcomes globally. Given the persistently high levels of maternal and perinatal morbidity and mortality in sub-Saharan Africa, mathematical modelling is a potentially valuable tool to guide strategic planning for health and improve outcomes.MethodsThe aim of this scoping review was to explore the characteristics of mathematical models and modelling studies evaluating the impact of maternal and/or perinatal healthcare interventions or services on health-related outcomes in the region. A search across three databases was conducted on 2nd November 2023 which returned 8660 potentially relevant studies, from which 60 were included in the final review. Characteristics of these studies, the interventions which were evaluated, the models utilised, and the analyses conducted were extracted and summarised.ResultsFindings suggest that the popularity of modelling within this field is increasing over time with most studies published after 2015 and that population-based, deterministic, linear models were most frequently utilised, with the Lives Saved Tool being applied in over half of the reviewed studies (n = 34, 57%). Much less frequently (n = 6) models utilising system-thinking approaches, such as individual-based modelling or systems dynamics modelling, were developed and applied. Models were most applied to estimate the impact of interventions or services on maternal mortality (n = 34, 57%) or neonatal mortality outcomes (n = 39, 65%) with maternal morbidity (n = 4, 7%) and neonatal morbidity (n = 6, 10%) outcomes and stillbirth reported on much less often (n = 14, 23%).DiscussionGoing forward, given that healthcare delivery systems have long been identified as complex adaptive systems, modellers may consider the advantages of applying systems-thinking approaches to evaluate the impact of maternal and perinatal health policy. Such approaches allow for a more realistic and explicit representation of the systems- and individual- level factors which impact the effectiveness of interventions delivered within health systems. Introduction The evaluation of the impact of healthcare programmes or policies on population health is a central component of public health, epidemiological and health economics science. Whilst the effects of biomedical interventions, such as drugs, on health outcomes are almost exclusively evaluated using randomised control trials (RCTs), experimental measurement of the direct effect of health policy interventions (e.g., changes to service coverage), may not be feasible due to ethical or practical constraints [1]. In such instances, mathematical models, defined here as models which “set out a theoretical framework that represent the causal pathways and mechanisms linking exposures, interventions, and infection or disease”, can be utilised to estimate policy intervention effectiveness [1]. Types of mathematical models applied within health research vary considerably according to intended application, including simple compartment models, such as the Susceptible Infected Recovered (SIR) model, and dynamic simulation models such as systems dynamics or agent-based models in which complex systems are simulated over time [2,3]. Whilst the structure, assumptions and relative merits or limitation of such models varies considerably [1], the inherent flexibility of mathematical modelling, coupled with other intrinsic benefits such as lower relative cost when compared to experimentation, and the ability to synthesise multiple different data sources, has meant that they have come to be used extensively in the development of health policy at both the local governmental [4] and the global [5] levels. Importantly, the application of mathematical models to inform health policy has the potential to generate significant health gains, particularly within the field of global maternal and newborn health. Evidence suggests that, despite significant progress since the turn of the century [6,7], maternal and perinatal mortality remains unacceptably high, particularly in regions such as southeast Asia and sub-Saharan Africa (SSA) [8–10], due in part to insufficient coverage and quality of key maternity services [11–16]. As such, there are a substantial number of pertinent policy questions regarding how best to deliver high-quality maternity services to mothers and newborns to reduce mortality and maximise health which are of particular interest to policy makers within the region. This is especially true given the prominence of maternal and newborn health metrics within the health-related Sustainable Development Goals targets [17]. For example, significant attention is now being paid to the potential health gains associated with maternity service delivery redesign [18,19], defined as the “intentional reorganisation of a health system to improve equity, quality, and outcomes” [19] which entails redesigning maternity services so that births occur exclusively within higher level or advanced facilities in line with practice in most high-income countries [18]. Evaluation of such policies through experimentation, such as through a cluster RCT, is associated with substantial ethical constraints such as a potential lack of clinical equipoise. Additionally, certain outcomes of interest, such as maternal mortality, may be sufficiently rare that the required sample size is prohibitive to conducting a trial. In such circumstances, mathematical modelling may offer important insights into the potential impact of alternative configurations of intervention or service delivery. Whilst there is evidence of the growing use of modelling approaches within public health more generally [2], to date there has been no systematic evaluation of the broad application of mathematical modelling to evaluate maternal and newborn services within the region of SSA. The review presented here has therefore been conducted to answer the primary research question of: “What are the characteristics of mathematical models which have been applied within the academic literature to estimate the impact of the delivery of maternal and/or perinatal healthcare interventions or services on health-related outcomes in sub-Saharan Africa?”. To best answer this question, the review has three primary objectives: (i) to characterise and map the relevant literature base; (ii) to explore the characteristics of the models and modelling studies found within this literature and (iii) to critically discuss the most common modelling approaches utilised. Systematic evaluation of the relevant literature allows for identification of common approaches taken, trends in study and model characteristics and potential gaps within the literature. Due to the broad scope of the research question and inclusion criteria we considered it appropriate to conduct a scoping review as opposed to a systematic review. Materials and methods Levac et al’s. [20] framework was chosen to guide the conduct of this review as it provided the most comprehensive and clear guidance building upon the original six-stage framework for scoping review conduct developed by Arksey and O’Malley [21]. This framework was utilised in tandem to the PRISMA-ScR checklist developed by the Joanna Briggs institute [22] to ensure the content of the review is in keeping with recommended best practice. The checklist for this review is provided in the (S1 File). We did not previously develop a review protocol. Inclusion criteria Studies were eligible for inclusion if they described analyses using a mathematical model, as defined in the introduction, which reported the potential effect of the implementation or change in coverage of a maternal or perinatal health intervention on maternal or perinatal epidemiological or health related outcomes. Maternal and perinatal healthcare interventions or services (referred to as interventions for the remainder of this review) are those interventions delivered as part of antenatal, intrapartum, or postpartum care to women at any stage along the pregnancy continuum (i.e., from conception to 42 days postnatal) or their newborns (i.e., from birth to day 28). For mothers, we only consider interventions intended to prevent morbidity or mortality associated with conditions or complications directly caused by the processes of pregnancy or birth. Health outcomes include any measure of morbidity or mortality within the target population. This is not limited to the primary outcomes of the study and any studies which report outcomes partially derived from other health outcomes (e.g., Incremental Cost Effectiveness Ratio (ICER)) or that report health outcomes as secondary outcomes were included. The geographical area of focus for this review was SSA with the full list of included countries being adapted from the UN Statistics Division geographic regions [23]. Whilst the term SSA is a largely arbitrary categorisation of many extremely heterogenous and diverse countries, it was deemed a logical regional category as this grouping of African nations has been used extensively within the global health literature and therefore utilised to ensure the maximum number of relevant papers were returned. Finally, papers in which mathematical models were described but not applied were not included, however those which used models previously applied in were. In addition, only English language papers were included in the review due to unavailable resources to undertake translation and/or non-English language searches. Search strategy A multi-stage search strategy was employed to identify relevant studies for inclusion. First, a systematic search of three electronic databases was undertaken on 2nd November 2023. The databases included PubMed, Web of Science and Global Health (1973- present). Once relevant studies were identified, a hand-search of the bibliographies of selected studies was undertaken to identify any additional relevant sources of information. Table 1 presents the search terms used for searching the electronic databases. Due to the proliferation of studies identified in the first stage in which analyses were conducted using the Lives Saved Tool (LiST) [24], we undertook an additional search using the PubMed database using the search term “lives saved tool” to ensure all relevant studies were included in the final sample. 10.1371/journal.pone.0296540.t001Table 1Search terms used in database search of scoping review.Key term/conceptSearch Terms Mathematical Model(s) (“mathematical” OR “disease” OR “microsimulation” OR “deterministic” OR “stochastic” OR “compartment*” OR “individual-based” OR “individual based” OR “agent-based” OR “agent based” OR “discrete-event” OR “time to event” OR “system dynamics” OR “monte carlo” OR “markov chain” OR “simulation”) AND (“model*” OR “simulat*”) Maternal and/or Perinatal Health “matern*” OR “pregnan*” OR “obstetric*” OR “antenatal care” OR “prenatal care” OR “postnatal care” OR “postpartum care” OR “birth attendan*” OR “intrapartum care” OR “labour and delivery” OR “facility delivery” OR “child birth” OR “childbirth” OR “neonat*” OR “perinatal” OR “newborn” OR “new born” OR “BEmONC” OR “EmONC” OR “CEmONC” OR “emergency obstetric and newborn care” OR “emergency obstetric and new born care” Sub-Saharan Africa Angola* OR Benin OR Botswana* OR “British Indian Ocean Territory” OR “Burkina Faso” OR Burundi* OR “Cabo Verde” OR Cameroon* OR “Central African Republic” OR Chad OR Congo OR Comoros OR “Cote d’ivoire” OR “Democratic Republic of the Congo” OR Djibouti* OR Eswatini* OR Eritrea* OR Ethiopia* OR “equatorial guinea” OR “French Southern Territories” OR Gabon OR Gambia* OR Ghana* OR guinea OR “Guinea-Bissau” OR Kenya* OR Lesotho OR Liberia* OR Madagascar* OR Malawi* OR Mali* OR Mauritania* OR Mauriti* OR Mayotte OR Mozambi* OR Namibia* OR Niger* OR Nigeria* OR “Saint Helena” OR Reunion OR Rwanda* OR “Sao tome and Principe” OR Senegal* OR Seychell* OR “Sierra Leon*” OR Somalia* OR “South Africa*” OR “South Sudan” OR Tanzania* OR Togo* OR Uganda* OR Zambia* OR Zimbabwe* OR” sub-Saharan Africa” Search terms used in database search of scoping review. Citations returned from each database search were imported into Mendeley Desktop citation manager (v1.19.8) and pooled. Using in-built functionality automatic deduplication was undertaken followed by a manual review of returned studies to ensure any duplicates missed by the automatic search were removed. Study selection A three-step process was employed to identify relevant studies from retrieved titles; 1.) the titles of the total number of retrieved citations were screened for apparent relevance using the inclusion criteria, 2.) the potentially relevant studies were separated then screened by the contents of their abstract against the eligibility criteria, 3.) those which still appeared relevant were screened through review of the full text and included in the review if appropriate. This process was mirrored with any studies identified via the hand-search of the reference lists of the final studies selected from the database and those identified through the targeted search. Despite recommendations within current methodological frameworks that this process, and the process of extraction and analysis, should be conducted by a multidisciplinary team to improve the validity of the review’s findings [20,22,25,26], this review was initially conducted as part of the first authors Ph.D. and therefore was conducted with no additional authors. Data extraction and analysis Following the selection of relevant studies, data was abstracted from the final studies via a data abstraction form. The development and use of a unique abstraction form is central to scoping review methodology and allows researchers to identify and extract all pertinent information from a given study which relates directly to the reviews primary research question [20,27]. As such a preliminary data extraction form was first developed and trialled on a subset of five studies, in-keeping with recommended scoping review practice [20,27], however due to the significant heterogeneity in study methods and analyses a second round of trialling was conducted on a further five studies after the initial refinement of the data extraction form. Within the final form 35 unique data items are identified. They can broadly be categorised as general characteristics of the study (8 items), characteristics of modelled interventions (9 items), characteristics of the mathematical model (7 items) and characteristics of any conducted analyses (11 items). The final completed data extraction form can be found in the (S2 File). Data items relating to model characteristics were adapted from Garnett et al. [1], where the authors provide defining criteria relevant across different mathematical modelling methodologies. These criteria, which have been refined for data extraction, include how feedback between interventions and outcomes are represented in the modelled system, the role chance plays in model behaviour, how individuals are represented within the model and how variable change is governed with regards to time [1]. These criteria are briefly summarised in Fig 1. Overview of key model characteristics. Following data extraction, data items were synthesised quantitatively where appropriate (i.e., in the presentation of percentages and frequencies) and summarised under relevant subheadings presented in the following section. Results Search results A total of 10,980 potentially relevant studies were identified, which was reduced to 8,660 after the removal of duplicates. Following title screening, the abstracts of 150 papers were screened (including all papers from hand-searching) using the inclusion criteria followed by full-text screening of 90 most relevant. Of these studies a further 30 were excluded leaving a final total of 60 papers for review [28–87]. Fig 2 provides a diagrammatic representation of the search and screening processes within this review. PRISMA diagram reporting search results. General study characteristics Table 2 details the general characteristics of the included studies. The publication date of the included studies skewed towards the latter half of the 2010s, with 70% of studies published after 2015 (n = 42) and the greatest number of studies being published in 2019 (n = 9 (15%)). In over half of studies (n = 33, 55%) the modelled ‘population’ was representative of a single country, whilst the remaining studies either modelled interventions applied to populations at a regional level, such as sub-Saharan Africa (n = 8), or to two or more countries or regions (n = 19). 10.1371/journal.pone.0296540.t002Table 2General characteristics of the reviewed studies.General study characteristicsStudies(N = 60)Percentage(%)Year of publication: Pre 2010 2010–2014 2015–2019 2020–2023 4 14 34 8 7% 23% 57% 13% Single or multiple countries modelled: Single Multiple 33 27 55% 45% Most modelled countries (top 5) a Ethiopia Tanzania Uganda Kenya Malawi 21 19 18 18 16 35% 32% 30% 30% 27% In addition to health outcomes the study aimed to evaluate cost/cost-effectiveness: Yes No 22 38 37% 63% First author affiliation: Within study country Outside study country 18 42 30% 70% Any author based at institution within the/a study country: Yes No 31 29 52% 48% aSourced from studies which explicitly listed modelled countries. Additionally, multiple countries are modelled in many papers therefore values in this row when summed exceed the total number of papers. General characteristics of the reviewed studies. aSourced from studies which explicitly listed modelled countries. Additionally, multiple countries are modelled in many papers therefore values in this row when summed exceed the total number of papers. Location of the affiliated institution of the first study author was extracted, alongside whether any co-authors were based in institutions within study countries. Seventy percent (n = 40) of studies’ first authors institutions were not located in any of the study countries with nearly half of total studies led by a first author based at an institution in the United States (n = 29, 48%) and only seventeen studies (28%) were led by first authors based at institutions within SSA. As evident in Table 2, approximately half of studies (n = 29) had no authors based at an affiliated institution within any of the study countries. Finally, the primary aim of included studies was evaluated. Whilst all studies reported at least one outcome associated with either maternal or perinatal health in line with inclusion criteria, over a third (n = 22, (37%)) aimed to estimate costs associated with modelled interventions or calculate the interventions’ cost-effectiveness. Intervention characteristics Table 3 summarises extracted data relating to the interventions evaluated within the reviewed studies. Interventions were extracted, as written, from either within the main text or supplementary material if indicated by authors. They were then alphabetised to assess frequency and, where wording differed slightly between interventions which could reasonably be considered the same, this was corrected. 10.1371/journal.pone.0296540.t003Table 3Characteristics of the interventions included within the reviewed studies.Intervention characteristicsStudies (N = 60)aPercentage (%)Study evaluated a single or multiple interventions: Single Multiple 8 52 13% 87% Study modelled an intervention not currently delivered as part of routine service delivery: Yes No 7 53 12% 88% Study includes interventions delivered to: Women Neonates 57 41 95% 69% If a study modelled any interventions delivered to mothers, they were delivered: Antenatally During labour/birth Postnatally 47 43 41 78% 72% 68% Study modelled interventions targeting: Maternal health outcomes Neonatal health outcomes Stillbirths 42 46 17 70% 77% 28% Most evaluated interventions (Top 5) b: 1. Immediate assessment and stimulation / Neonatal resuscitation 2. Skilled birth attendance 3. Vitamin A supplementation 4. Clean birth or postnatal practices 5. Magnesium Sulphate 34 32 24 24 20 57%53%40%40%33%aThe values in the some of the rows exceed the total number of papers when summed, as most studies modelled multiple interventions.bExcluding those interventions which are not routinely delivered as part of antenatal, intrapartum, or postpartum care. Characteristics of the interventions included within the reviewed studies. aThe values in the some of the rows exceed the total number of papers when summed, as most studies modelled multiple interventions. bExcluding those interventions which are not routinely delivered as part of antenatal, intrapartum, or postpartum care. There was extensive heterogeneity between studies in relation to the interventions which were evaluated by mathematical models and the ways in which interventions were defined. Across the 60 included studies a total of 1055 interventions (inclusive of duplicates) were described, with most studies (n = 52 (87%)) evaluating the impact of multiple different interventions and fewer studies evaluating single interventions. This value includes all modelled interventions including those which are delivered outside routine antenatal, intrapartum, or postpartum care or represented nonclinical interventions such as improved access to clean water. Commonly, studies evaluated scale-up of interventions which could reasonably be defined as part of standard clinical practice in most settings (e.g., basic newborn resuscitation). Much less frequently, (n = 7, 12%) studies evaluated novel interventions which are not routinely available to mothers or newborns in most settings. This includes studies in which the aim was to predict the effect of an intervention on health outcomes that acts through improving coverage of other key maternity services. For example, Wilcox et al. [29] predicted the impact of a Mobile Technology for Community Health initiative in Ghana which has been shown to improve skilled birth attendance and facility delivery and modelled the effect of this intervention using LiST. Other examples include Carvalho et al. [56] in which the authors estimated the cost-effectiveness and health impacts of an inhaled oxytocin product and Ali et al. [59] who evaluated the Augmented Infant Resuscitator, a novel device which provides real-time feedback on ventilation quality during the resuscitation of newborns. Almost all studies evaluated at least one intervention which was delivered to women (N = 57 (95%)), even including those in which maternal outcomes were not evaluated or reported (e.g., evaluating the effect of maternal nutritional supplementation in ANC on newborn outcomes). As shown in Table 3 these interventions were most frequently delivered during the antenatal and intrapartum periods of pregnancy whilst postpartum interventions delivered to mothers were less frequent (n = 41, 68%). The evaluation of interventions delivered to neonates occurred slightly more frequently and was presented in over two-thirds of studies (n = 41 (68%)). Of the studies in which only neonatal interventions were evaluated (n = 2), Tsiachristas et al. [30] evaluated a task shifting intervention for routine nursing tasks delivered to neonates in a Kenyan neonatal intensive care unit (NICU) whilst Ali et al. [59] has been described above. Model characteristics Table 4 summarises the extracted data relating to the models applied within the reviewed studies. Approximately a quarter (n = 16 (27%)) of studies utilised a model which had been developed specifically for the purpose of achieving one or more of the study’s aims whilst the remaining employed models which had been developed prior to study conduct. Over half of studies (n = 34, 57%) reported analyses conducted using LiST, and eight studies (13%) using the Maternal and Neonatal Directed Assessment of Technology model (MANDATE). 10.1371/journal.pone.0296540.t004Table 4Characteristics of the models and analyses performed within the reviewed studies.Characteristics of the models and analyses performedStudies (N = 59)Percentage (%)Was the model developed to conduct this study: Yes No 16 44 27% 73% Model employed by study authors: LiST Maternal and Neonatal Directed Assessment of Technology model (MANDATE) Decision Tree/Analytic model Individual or Agent-based model Systems-dynamics model Other/Undefined 34 8 7 5 1 5 57% 13% 12% 8% 2% 8% Model structure, use or data and reporting: System feedback–Linear System feedback–Non-linear Deterministic Stochastic Population/cohort based. Individual-based Time represented as calendar time. Time represented with age Diagrammatic representation in manuscript No diagrammatic representation in manuscript 58 2 55 5 55 5 53 7 13 47 97%3%92%8%92%8%88%12%22%78%(Where relevant (n = 53)) Calendar-time horizon for analysis was: One year or less 2–5 years 6–10 years 11+ years (Where relevant (n = 7)) Age-time horizon for analysis was: A delivery A pregnancy and delivery 2 years Lifetime 20 11 5 17 3 1 1 2 34% 18% 8% 28% 5% 2% 2% 3% Sensitivity analysis was conducted and reported on: Yes No 20 40 33% 67% Study reported outcome relating to: Maternal mortality Maternal morbidity Maternal DALYs Neonatal mortality Neonatal morbidity Neonatal DALYs Stillbirths 34 4 6 39 6 7 14 57% 7% 10% 65% 10% 12% 23% For multi-country studies (n = 27) results were reported by country or as an aggregate over a region/group? Country-specific Aggregate 9 18 33%67% Characteristics of the models and analyses performed within the reviewed studies. Of the remaining studies in the sample, most utilised a decision tree/analytic model (n = 7). These models, commonly used in health economic analysis, represent potential treatment pathways as a series of ‘branches’ demarcated by decision nodes, representing some decision of interest (e.g., the decision to deliver a screening intervention) and chance nodes from which mutually exclusive probabilities of a set of outcomes following a decision are represented [88,89]. Other types of models were utilised much less frequently with only 5 (8%) studies employing an individual-based framework [28,33,35,69,87]. Model characteristics were extracted from all included studies guided in part by Garnett et al. [1] (Fig 1). Considering whether the link between a given intervention and the health outcome in the model is represented as a linear or non-linear function, 95% of models can be described as linear (n = 57). A simple linear model would assume that if a given treatment halves the risk of disease acquisition, and that treatment is delivered to everyone at risk of the condition, then the incidence of that condition would reduce by half in the population. Linear representations are common in cohort models where it is assumed that the outcome of different individuals represented in the model is independent (i.e., treatment delivered or not delivered within the model to one individual does not affect the treatment or outcomes of others). The fact that most models reviewed here are linear is unsurprising due to the number of studies using either LiST or the MANDATE model which both are self-described as linear. Alternatively, models which represent this link as non-linear functions were much less common (n = 2) [32,35]. Next, considering the incorporation of chance into the modelling framework, few models (n = 5, 8%) were found to be stochastic (i.e., events occur to an individual or population group within the model according to random draws against a probability parameter), while most utilised a deterministic approach to derive model results, meaning that multiple model runs with the same parameter set will always return the same result (n = 55). All stochastic models within the review employed an individual-based approach, where each member of the population is modelled individually with distinct characteristics which can be tracked, whilst the remaining models included representation of population level processes and trends using input parameters representing averages and leading to population-level results. Description of model structure and components varied according to model type. Only 13 (22%) papers presented any diagrammatic representation of the model’s underlying structure within the manuscript or supplementary material. However, of the papers without a model diagram over 80% of these papers utilised either LiST or MANDATE model. Diagrammatic representation of model structure is available for both these models on their associated websites [90,91]. This meant that papers in which novel models were reported were significantly more likely to include a diagram of the structure. Study analyses and outcomes Table 4 also provides broad overview of the analyses and relevant outcomes extracted from the reviewed studies. All study outcomes were extracted, as presented, from each study and then sorted according to categories presented in Table 4. Of note, cost related outcomes are not included in the table but are available in the (S2 File). Maternal and neonatal mortality outcomes were by far the most frequently reported within the sample with very few studies reporting outcomes which could reasonably be classified as relating to maternal (n = 4, 7%) or neonatal (n = 6, 10%) morbidity. Interestingly, of the studies presenting maternal morbidity outcomes [39,46,56,62] all reported some measure of postpartum haemorrhage incidence or prevalence whilst newborn morbidity outcomes ranged from the prevalence of stunting or wasting [57] to the number of cases of intrapartum related neonatal events and injury [44]. Additionally, any measure of the number or rate of stillbirths within a modelled population was reported in only around a fourth of studies within the sample (n = 14, 23%). Additionally, we considered how outcomes were presented for studies in which more than one country population was theoretically modelled. Surprisingly, of the multi-country studies (n = 27), only eight reported results from their analysis disaggregated by each included country, with the rest presenting the results for a group of countries or even an entire region, such as SSA. Whilst for some studies this was an analytical choice, for those using the MANDATE model authors were limited by the design of the model which currently only represents the region of SSA or the country of India within the model’s base assumptions (e.g., condition incidence, intervention availability). Discussion This scoping review has provided a comprehensive and descriptive overview of mathematical modelling within maternal and perinatal health research within SSA. Through application of Levac et al’s. [20] framework and guided by the recent PRISMA-ScR checklist [22], a replicable evaluation of the published academic literature has been undertaken in which the characteristics of relevant mathematical models and their application in the evaluation of maternal and/or perinatal interventions has been summarised. Given that the number of studies in the field utilising these approaches appears to have increased over time, as evidenced in this review, this is a timely and pertinent overview of commonly utilised modelling approaches. The proliferation of studies from 2015 onwards could be attributed to several factors including the utility of such methods in evaluating pathways towards achieving maternal and perinatal health related goals within the Millennium Development Goals (MDGs) and Sustainable Development Goals (SDGs), as demonstrated in several reviewed studies [80–86]. Our review found that the most often utilised model within this field was LiST, which was used in nearly sixty percent of the sample. LiST has long been recognised as a popular tool which has been utilised extensively within the field of global maternal and child health by a varied group of interdisciplinary stakeholders [92]. LiST is a linear deterministic model as it “describes fixed relationships between inputs and outputs, and the tool will produce the same outputs each time the model is run with identical inputs” [93]. The primary input is the coverage of an intervention being evaluated and the primary outputs are either change in the cause-specific mortality or one of the included “risk factors” for mortality such as stunting [93]. LiST is extremely comprehensive in both the breadth of causes of maternal and child ill-health which are represented and the range of in-built interventions which modellers can manipulate within the tool and has been utilised in the evaluation of health programmes and to inform strategic planning at the national and local level with some organisations regularly using the tool and embedding LiST into organisational workflows by developing ‘in-house’ capacity to work with the model [92]. Importantly, as demonstrated in Table 4, many of the other models in this sample share key characteristics with LIST in that they are linear, deterministic, and changes in the modelled system are expressed at the population level. However, healthcare delivery systems have long been identified as complex adaptive systems which exhibit explicitly non-linear behaviour by definition [94–96]. Variation in the coverage of established interventions, or integration of new interventions, may have unexpected down-stream effects on the outcome of interest despite evidence that the intervention is effective [97,98] which cannot be predicted using LiST or similar linear models. Within maternal and perinatal health this has been demonstrated in several Low- and middle-income countries (LMICs) in which, driven by political commitment to achieving the maternal health indicators within MDG 5 and SDG 3, the proportion of mothers who give birth within a health facility has increased significantly [97,98]. However, this has not been accompanied by an observed population-level reduction in maternal mortality, despite strong evidence for the efficacy of interventions delivered to mothers during and following labour [97,98]. The relationship between facility delivery coverage and mortality is complex, non-linear, and likely influenced by several individual and health system-level factors relating to quality of care such as the effect of increased volume of patient attendance and resource use [97,98]. Failure to understand the system environment and behaviours is often a driving factor in the failed implementation of new interventions, which may have been effective had a systems-thinking lens, one which considers the potential effect of system level phenomena on intervention or service implementation, been employed [99–101]. This issue is further compounded when the complexity of the interventions is increased, as many health systems strengthening interventions are largely programmatic service changes which mean current evaluation methodologies may be insufficient to produce valid or reliable outcomes [101]. Evaluation of relevant health processes at the population level, as taken by most models in this review, is advantageous in that it is computationally cheap and, in many circumstances, may be a sufficient level of detail to ascertain a reliable result [102]. However, in recent years, the use of individual-based model (IBMs) has become more popular within epidemiology and public health [2,103,104]. Broadly, IBMs are a subset of computational simulation models in which the model is designed to replicate the characteristics, behaviours, and actions of a set of ‘agents’, within a given environment, to reproduce complex population-level or systems phenomena [105–108]. Within epidemiological modelling, these ‘agents’ are often representative of individual people who may interact with one another to simulate a hypothetical population of interest, characterised by individual variables, and governed by sets of predetermined rules [106]. One of the primary strengths of this approach in the modelling of health processes is the ability to explicitly model individual-level variation and interactions between said individuals within the population [105]. Within epidemiological modelling, this approach has been employed in the modelling of infectious diseases, in which interactions between individuals allows for representation of complex transmission dynamics within the population [104]. This process, often referred to as ‘interference’, occurs because individuals within the model are not represented as independent, and therefore the assignment of an exposure, intervention or treatment can be influenced by outcomes of other individuals in the model [106]. Interference cannot be represented in population-level models where the assumption of non-independence is not met which means such models are less suitable to explore the complexities of healthcare delivery. This is demonstrated in the study by Nadkarni et al. [35], who explicitly represent the relationship between the acuity of a group of patients in a maternity ward, the associated demand on consumables and, in-turn, the effect on outcomes. Our review found that only 27% of research teams developed novel mathematical models to answer the research question of interest. Whilst the appeal of using a previously developed model is clear, the importance of considering country-context within the evaluation of health policy has long been identified within the literature, as national and regional context likely has significant impact on how interventions are implemented and accessed by populations [109]. Many modellers have embraced methods to embed contextual structures into model design through participatory approaches to model development [110], stakeholder workshops developing causal loop diagrams [111], or simply through explicitly representing the system of interest within a given context by supported model validation with key stakeholders [112]. Whilst such approaches were underutilised in the reviewed studies, context-informed modelling was well demonstrated by Semwanga et al. [32] who developed a novel systems-dynamics model to explore neonatal health interventions in Uganda through a process of stakeholder engagement and causal mapping with service users and policy makers. Next, considering the commonly reported outcomes of modelling analyses, this review found that studies were considerably more likely to report outcomes relating to either maternal and neonatal mortality and much less likely to predict intervention effects on morbidity or stillbirths. Limited reporting on morbidity outcomes is not surprising due to the widespread use of LiST which does not calculate the effect of interventions on most morbidity outcomes. The absence of morbidity from the outcomes of modelling studies evaluating health intervention delivery is concerning considering that many of the routine interventions delivered to mothers and newborns are intended not only to prevent mortality but to reduce the incidence of common morbidity associated with pregnancy and the newborn period to improve overall quality of life [113–115]. The absence of such outcomes may mean that the true health impact of improving intervention coverage is significantly underestimated at the population level. Finally, we found that very few of the included studies evaluated the potential impact of interventions on stillbirths. There are similarities between stillbirth research and morbidity research, with many arguing that stillbirth has historically been absent from the global maternal and perinatal health agenda for some time [116–118]. Qureshi et al. [118] suggest that stillbirths should be attributed the same ‘value’ as neonatal deaths in economic evaluation of maternal health interventions as they are commonly excluded in measurements such as life years gained or DALYs averted. This is problematic when considering very early preterm neonatal deaths are included in neonatal death statistics whilst a stillbirth at 41 weeks gestational age would not be, despite being more developmentally ‘mature’ [118]. Whilst recently a renewed focus on stillbirth prevention has led to considerable progress [119] a large number of stillbirths occur per year within SSA [8] and are associated with considerable morbidity in mothers [120]. Importantly several interventions to prevent stillbirth are well described in the literature through a Cochrane review of relevant trials [121] and through observational studies [122]. As such mathematical modelling approaches are well positioned to evaluate the context-specific effects of these interventions in high burden populations. There are several important strengths and limitations of this review to acknowledge. The primary strength of this review is the use of a systematic search strategy to identify relevant studies and due to the nature and broad scope of the research question and associated objectives, the scoping review methodology was the most appropriate choice to map the relevant literature. A traditional systematic review would not have been appropriate, as the aim of this review was not to synthesise the reported results of the modelling studies, something that would not have been possible due to the diverse set of methodologies employed within this research. To ensure that conduct of the review adhered to contemporary best-practice frameworks the PRISMA checklist [22] was used to guide the design and conduct of the review (S1 File). Considering this review’s limitations, firstly we have only included studies conducted in the English language, as this review was conducted as part of the first author’s Ph.D., meaning potentially relevant studies reported in other languages were excluded. Secondly the search strategy did not include modelling analyses reported within the grey literature. Implicit exclusion of potentially relevant modelling analyses conducted in reports or government documentation could introduce bias into the review and potentially alter the review’s conclusions [123]. Interestingly, the LiST team highlights in their most recent update supplement that many applications of the model lie outside of academic publishing, with efforts being made by the team to enhance the visibility of LiST applications by policy makers across LMICs [124]. Whilst frameworks for the systematic search of grey literature do exist, they do not alleviate common issues with comprehensive grey literature searching such as inbuilt search-engine filters which can introduce bias into source selection [125]. Thirdly, a significant number of modelling studies which evaluated solely the impact of health interventions on indirect causes of maternal morbidity/mortality were excluded. This was particularly true for modelling studies evaluating screening and treatment of HIV during pregnancy on HIV outcomes. Undoubtedly, widening the studies inclusion criteria so that such studies were reviewed would likely have changed the results of this review. This is particularly true given the proliferation of HIV models used to conduct research in SSA [126,127]. Finally, this review did not explicitly consider the quality of included studies by conducting a critical appraisal as part of the review process. Whilst evaluation of the quality of modelling studies conducted in this area is undoubtedly important, this process is outside of the remit of a scoping review [20,128] and is beyond the objectives of this review. In conclusion, in this review we have reported on the methodology, conduct and results of a scoping review to explore the breadth of mathematical modelling research within evaluation of maternal and perinatal healthcare interventions in SSA. Results from this review indicate that whilst there is variation in the reviewed studies, the literature base is dominated by two models which, whilst distinct in their design, share commonalities in how they represent the relationship between intervention and outcome, populations of interest and the role randomness plays in the model system. Individual-based or systems-thinking approaches to mathematical modelling were much less commonly applied within the field, despite potential advantages such as a more realistic and explicit representation of the systems- and individual- level factors that impact the effectiveness of interventions delivered within complex-adaptive health systems. Supporting information PRISMA-ScR checklist. (DOCX) Data extraction form and extracted data. (DOCX) 19 Jul 2024 PONE-D-23-41936Mathematical modelling to estimate the impact of maternal and perinatal healthcare services and interventions on health in sub-Saharan Africa: A scoping reviewPLOS ONE Dear Dr. Collins, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Sep 02 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Ashish KC Academic Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf Additional Editor Comments: Dear Dr. Collins I have now received the reviewer's comment and I invite you now to review the comments and make necessary revisions with point to point response letter. Best regards, Ashish [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank for inviting me to the interesting scoping review by Joesph and colleagues on the mathematical models uses to estimate the impact of maternal and perinatal health intervention in Sub-Saharan Africa". I read and reviewed the scoping review with interest as it describes the different modeling exercises done in the last 50 years to describe the impact of scaling up the intervention on perinatal mortality outcomes. This is indeed an interesting paper, which provides what modeling were being done and which interventions were focused on. Most of the modelling that were done were based on the different clinical or population-based studies done to assess the effectiveness of the intervention. What this paper has shown it that lot of modelling had been published between 2015-2019, indicating the work in the end of the MDG period and start of the SDG period. Most of the modeling were done for interventions before birth (antenatal period) and intrapartum period (skilled birth attendance, neonatal resuscitation, magnesium sulfate). While the postnatal intervention modelling has not been done such as small and sick newborn care. So, reading this scoping review, I have some major comments on the paper and some minor comments to consider. Major comments 1. Since, this was a PhD project of the first author, was there any set protocol in place and registration of the scoping review done. There are several systematic review registration sites, such as Joanna Briggs Institute, Campbell collaboration, Prospero, research registry. Prospective scoping review protocol will always help reviewers to check any deviation in the review from that of the original intent. There can be deviation, for which amendment of the registration can be done. If this was not done, the transparency of the review, a time comes into scrutiny. The process needs to be provided in the method section. 2. The researcher in the objective set out to find "how have mathematical modelling been used to evaluate the delivery of maternal and perinatal health intervention" and in your third specific objective the research explain it "to critically discuss the use of the common modelling approach". The paper discusses on "what modelling exercise, where, and why". I do not understand the scoping review entailing the use of the modelling in policy practice. I might have misunderstood, but please clarify that this undertaking was what component of different mathematical modelling. 3. In the search strategy in page 7, lines 156 to 159, you mentioned, that you originally limited your search for Lives Saving Tools, was that your original idea of the scoping review of focusing on the LiST intervention only. I think your scoping review encompasses all mathematically modelling or did you start with List and expanded your mathematically model to other. This is the reason; I am requesting for a prospective registration of the study. 4. In the result section, using table 3. a time series presentation on the different modelling being done over the years using different color codes would be very interesting. You present in the table 2, the years of publication, an elaboration will be interesting. Moreover, the year of publication to the different modeling done for timing of intervention and type of intervention will be of value for two important reasons. Global perinatal health expanded in the MDG era with the focus first on the essential care for mothers and newborns and then focusing on high-risk care. The different years when different modeling by interventions were done will be of value to the reader. Your supplementary table 2 has all the ingredients to it. 5. The main component of your work is the analysis of the different mathematical modeling i.e table 4, the explanation of the different model structure especially the linear and non-linear feedback, the deterministic vs stochastic model needs explanation, as the model output varies especially due to these two factors. I think a good table where different models used linear vs non-linear, deterministic vs stochastic is highly recommended. Minor comment Table 5 can be merged with table 2 or 3 or having a graphical presentation. Some minor comments, please do not provide or explain the details of different intervention such a between lines 268 to 279. Title is slight confusing, can you have " The mathematical models been used to evaluate the delivery of maternal and/or perinatal health interventions and their impact on health-related outcomes in sub96 Saharan Africa?”. Reviewer #2: This is an interesting manuscript by Joseph and colleagues and can provide new literature on the different mathematical models used to project coverage and mortality. I have a few comments in place - In the abstract, can you make it sub-titles with introduction, method, result and discussion. The term such as "Models were most applied to estimate impact" needs to be quantified in the result section. It would be good to provide which software's were used in different models, if possible, in the abstract. -Can you provide the list of different mathematical models in the introduction section of main text -Can authors provide the policy and programmatic implication of this in the introduction section -Why was this scoping review limited to Africa and not to Asia? - Was English language literature only searched or in other languages such as Western African countries use other European language. - I think it would be good to see the comparison of the estimates provided by different mathematical model, as it provides the variance. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. 5 Aug 2024 We thank the reviewers and the editors for their time and the review of this manuscript. Please see our response to each of theses comments in the attached file. Submitted filename: Response to reviewers comments.docx 14 Nov 2024 Mathematical modelling to estimate the impact of maternal and perinatal healthcare services and interventions on health in sub-Saharan Africa: A scoping review PONE-D-23-41936R1 Dear Dr. Collins, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Ashish KC Academic Editor PLOS ONE Additional Editor Comments (optional): Dear Dr. Collins Based on the reviewers' comments and my assessment as editor. The paper reads well. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Thank you for the revision. My comments have been addressed. I think the revision adding the year of publication to the different modeling done for timing of intervention and type of intervention will be of value for two important reasons. Global perinatal health expanded in the MDG era with the focus first on the essential care for mothers and newborns and then focusing on high-risk care has been well addressed. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No ********** 19 Nov 2024 PONE-D-23-41936R1 PLOS ONE Dear Dr. Collins, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Ashish KC Academic Editor PLOS ONE