Skip to main content
Advertisement
  • Loading metrics

Healthcare utilization and maternal and child mortality during the COVID-19 pandemic in 18 low- and middle-income countries: An interrupted time-series analysis with mathematical modeling of administrative data

  • Tashrik Ahmed ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    tahmed13@worldbank.org

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Timothy Roberton,

    Roles Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Bloomberg School of Public Health, Johns Hopkins University, Baltimore, United States of America

  • Petra Vergeer,

    Roles Conceptualization, Funding acquisition, Supervision, Writing – review & editing

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Peter M. Hansen,

    Roles Supervision, Writing – review & editing

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Michael A. Peters,

    Roles Investigation, Writing – original draft, Writing – review & editing

    Affiliation Development Research, The World Bank, Washington, United States of America

  • Anthony Adofo Ofosu,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ghana Health Service, Accra, Ghana

  • Charles Mwansambo,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministry of Health, Lilongwe, Malawi

  • Charles Nzelu,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Federal Ministry of Health, Abuja, Nigeria

  • Chea Sanford Wesseh,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministry of Health, Monrovia, Liberia

  • Francis Smart,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministry of Health and Sanitation, Freetown, Sierra Leone

  • Jean Patrick Alfred,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministère de la Sante publique et de la population, Port-au-Prince, Haiti

  • Mamoutou Diabate,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministère de la Santé et de l’Hygiène Publique, Bamako, Mali

  • Martina Baye,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministére de la Sante Publiqué, Yaoundé, Cameroon

  • Mohamed Lamine Yansane,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministère de la Sante, Conakry, Guinea

  • Naod Wendrad,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministry of Health, Addis-Ababa, Ethiopia

  • Nur Ali Mohamud,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Federal Ministry of Health & Human Services, Mogadishu, Somalia

  • Paul Mbaka,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministry of Health, Kampala, Uganda

  • Sylvain Yuma,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministére de la Sante, Kinshasa, Republique Democratique du Congo

  • Youssoupha Ndiaye,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministere de la santé et de l’action sociale, Dakar, Senegal

  • Husnia Sadat,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Helal Uddin,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministry of Health and Family Welfare, Dhaka, Bangladesh

  • Helen Kiarie,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministry of Health, Nairobi, Kenya

  • Raharison Tsihory,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation Ministère de la Sante publique, Antananarivo, Madagascar

  • George Mwinnyaa,

    Roles Formal analysis, Visualization, Writing – review & editing

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Jean de Dieu Rusatira,

    Roles Data curation, Validation, Writing – review & editing

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Pablo Amor Fernandez,

    Roles Conceptualization, Formal analysis, Investigation, Writing – review & editing

    Affiliation Development Research, The World Bank, Washington, United States of America

  • Pierre Muhoza,

    Roles Formal analysis, Investigation, Writing – review & editing

    Affiliation Development Research, The World Bank, Washington, United States of America

  • Prativa Baral,

    Roles Formal analysis, Investigation, Writing – review & editing

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Salomé Drouard,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Visualization, Writing – review & editing

    Affiliation Development Research, The World Bank, Washington, United States of America

  • Tawab Hashemi,

    Roles Conceptualization, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation The Global Financing Facility for Women, Children, and Adolescents, Washington, DC, United States of America

  • Jed Friedman,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Development Research, The World Bank, Washington, United States of America

  •  [ ... ],
  • Gil Shapira

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation Development Research, The World Bank, Washington, United States of America

  • [ view all ]
  • [ view less ]

Abstract

Background

The Coronavirus Disease 2019 (COVID-19) pandemic has had wide-reaching direct and indirect impacts on population health. In low- and middle-income countries, these impacts can halt progress toward reducing maternal and child mortality. This study estimates changes in health services utilization during the pandemic and the associated consequences for maternal, neonatal, and child mortality.

Methods and findings

Data on service utilization from January 2018 to June 2021 were extracted from health management information systems of 18 low- and lower-middle-income countries (Afghanistan, Bangladesh, Cameroon, Democratic Republic of the Congo (DRC), Ethiopia, Ghana, Guinea, Haiti, Kenya, Liberia, Madagascar, Malawi, Mali, Nigeria, Senegal, Sierra Leone, Somalia, and Uganda). An interrupted time-series design was used to estimate the percent change in the volumes of outpatient consultations and maternal and child health services delivered during the pandemic compared to projected volumes based on prepandemic trends. The Lives Saved Tool mathematical model was used to project the impact of the service utilization disruptions on child and maternal mortality. In addition, the estimated monthly disruptions were also correlated to the monthly number of COVID-19 deaths officially reported, time since the start of the pandemic, and relative severity of mobility restrictions. Across the 18 countries, we estimate an average decline in OPD volume of 13.1% and average declines of 2.6% to 4.6% for maternal and child services. We projected that decreases in essential health service utilization between March 2020 and June 2021 were associated with 113,962 excess deaths (110,686 children under 5, and 3,276 mothers), representing 3.6% and 1.5% increases in child and maternal mortality, respectively. This excess mortality is associated with the decline in utilization of the essential health services included in the analysis, but the utilization shortfalls vary substantially between countries, health services, and over time. The largest disruptions, associated with 27.5% of the excess deaths, occurred during the second quarter of 2020, regardless of whether countries reported the highest rate of COVID-19-related mortality during the same months. There is a significant relationship between the magnitude of service disruptions and the stringency of mobility restrictions. The study is limited by the extent to which administrative data, which varies in quality across countries, can accurately capture the changes in service coverage in the population.

Conclusions

Declines in healthcare utilization during the COVID-19 pandemic amplified the pandemic’s harmful impacts on health outcomes and threaten to reverse gains in reducing maternal and child mortality. As efforts and resource allocation toward prevention and treatment of COVID-19 continue, essential health services must be maintained, particularly in low- and middle-income countries.

Author summary

Why was this study done?

  • Disruptions to essential health services during the SARS-CoV-2 (COVID-19) pandemic amplify the pandemic’s impact on morbidity and mortality and pose a profound threat to the ability of low- and middle-income countries to achieve Universal Health Coverage (UHC) and the Sustainable Development Goals (SDGs).
  • While early studies projected mortality based on hypothesized scenarios, this study presents indirect child, neonatal, and maternal mortality projections during the COVID-19 pandemic based on actual service utilization data.
  • This study adds to multicountry evidence on changes in the utilization of essential health services from low- and middle-income countries.

What did the authors do and find?

  • We used data on service utilization in 18 countries to estimate the percent change in health services delivered between March 2020 and June 2021, compared to expected levels given prepandemic trends.
  • The analysis indicates that all countries experienced service disruptions, the largest of which occurred at the pandemic’s start and during months with strict mobility restrictions, regardless of the reported monthly COVID-19 mortality rates, demonstrating variation in the magnitude of disruptions across countries, services, and time.
  • Using a mathematical model, we project these disruptions are associated with an additional 113,962 deaths among women in children in the 18 countries, representing increases of 3.6% in child mortality and 1.5% in maternal mortality.

What do these findings mean?

  • The projected excess mortality caused by disruptions to essential health services is smaller than many initial projections, though still comprises a substantial increase in mortality.
  • There is strong evidence to recommend that context-specific measures to safeguard essential services be integrated into pandemic preparedness and response activities.

Introduction

By June 2021, more than a year after the World Health Organization (WHO) declared the Coronavirus Disease 2019 (COVID-19) outbreak a pandemic, nearly 4,000,000 deaths had been reported [1]. However, analysis of excess mortality in various countries has estimated that total mortality is larger than the reported number of COVID-19-related deaths [25]. While the gap between excess mortality and officially reported COVID-19-related deaths is partly explained by underreporting, previous outbreaks have demonstrated that indirect health effects caused by reductions in the delivery of routine health services could be as important as the direct consequences [6]. The threat of this double crisis is particularly worrying low- and middle-income countries, which on average have higher mortality rates, more fragile health systems, and health outcomes that are more sensitive to income shocks, such as those unleashed by the COVID-19 pandemic [6,7]. These factors heighten the risk of short-term downturns in the utilization of preventive, promotive, and curative care to erode the hard-fought progress toward reducing global maternal and child mortality and lead to a prolonged secondary health crisis.

Pandemics can affect health service utilization through numerous pathways. Health systems may have reduced capacity to supply services and implement rapid adaptations due to limitations in infrastructure, health workforce, supply chains, and financial space. Limited resources to respond to a pandemic might necessitate reallocation away from routine activities and may impact the provision of essential health services through reduced clinic hours, caps on patient intake, and changes in the types of services offered. Demand-side factors, such as mobility restrictions, shutdowns of public transportation, perceived changes in quality of services, or fear of contracting COVID-19 at health facilities, may impede service accessibility and care-seeking [8]. The economic contraction caused by the pandemic may constrain the ability to pay for health services [9].

At the start of the COVID-19 pandemic, statistical models projected maternal and child mortality increases based on hypothesized service disruption scenarios [1012]. Multiple sources have since confirmed increases in adverse maternal outcomes but lower than expected utilization of reproductive, maternal, and child (RMNCH) services during the pandemic [1316]. Studies have quantified decreases in total health facility attendance, complementing the qualitative reports by health workers and stakeholders [13,17,18]. In Nepal, a large cohort study of women found decreases of more than half in institutional delivery rates, poorer quality of care, and increases in stillbirth and neonatal mortality rates [19]. Phone surveys of households in 39 low- and middle-income countries in April to August 2020 found that a substantial proportion of households reported forgone care [20]. While there is clear evidence that service disruptions have occurred, there is substantial variation across countries, levels of care, and service types. For example, studies from Burkina Faso, Kenya, and Mozambique found limited disruptions in contraceptive use and quick recovery to expected levels. In Bangladesh, 40% of mothers reported disruptions to family planning services [2123]. The findings on disruptions to child vaccination programs are more consistent across countries, as many countries temporarily paused mass vaccination campaigns between March and May 2020 [2426].

This study estimates the reductions in essential health service utilization across low- and middle-income countries and projects indirect mortality caused by the pandemic. Most studies have involved either fully hypothetical scenarios or empirical data from only a small set of health facilities for a short duration of time. We present broader evidence of the impact of the COVID-19 pandemic on health service delivery by analyzing comprehensive data from 18 countries on essential services between March 2020 and June 2021. Based on the estimated decline in service coverage, the underlying burden of disease, and the effectiveness of different interventions in preventing deaths, we aim to generate more accurate forecasts of indirect maternal and child mortality.

Methods

We used an interrupted time-series design to estimate the percent change in the volumes of essential health services delivered during the pandemic. These estimates of lost services were translated into relative changes in coverage of interventions delivered during those periods to project the number of lives lost. The estimated monthly disruptions were also correlated to officially reported COVID-19 mortality rates, time since the start of the pandemic, and relative severity of mobility restrictions to determine which drivers are associated with changes in measured disruptions over time. The analysis was modeled on a previous study described elsewhere [27]. No changes to the analysis plan were made due to comments from reviewers or observations in the data. Data sharing agreements were established with all governments. Analysis of these secondary data did not constitute human subjects research and was considered public health practice. Thus, institutional research board approval was not required nor sought.

Data sources and preparation

Monthly administrative data on the volume of key essential health services between January 2018 and June 2021 were collated from 18 countries participating in a monitoring activity supported by the Global Financing Facility for Women, Children, and Adolescents (GFF). Eleven countries are classified as low-income by the World Bank: Afghanistan, the Democratic Republic of Congo (DRC), Ethiopia, Guinea, Liberia, Madagascar, Malawi, Mali, Sierra Leone, Somalia, and Uganda. The other 7 countries, Bangladesh, Cameroon, Ghana, Haiti, Kenya, Nigeria, and Senegal, are classified as lower-middle-income. Seven services were selected to represent the continuum of reproductive, maternal, and child health: family planning, antenatal care initiation (ANC1), antenatal care completion (ANC4), delivery, postnatal care initiation (PNC1), bacillus Calmette–Guérin (BCG) vaccine administration, and completion of pentavalent schedule (Penta3). These services were selected because they are high completeness across countries and serve as proxies for other services and interventions delivered at the same point. In addition, outpatient consultations (OPDs) were used as a proxy for the general use of health services. Outcome measures were not included since rare outcomes (e.g., maternal death, stillbirths) are difficult to accurately capture in facility data, or the data completeness was too poor for this analysis. Seven countries’ administrative data systems were missing 1 indicator, and Uganda was missing 2 indicators. Family planning volume was the most frequently missing indicator and was not reported in 5 countries (see Table A in S1 Text). The analysis used available-case analysis, where facilities with partial facility-month observations were included in the analysis. Differences in indicator definitions were observed across countries, particularly in OPD (total attendance versus total outpatient consultations), delivery (institutional deliveries versus institutional deliveries with a skilled birth attendant), and PNC1 (first postnatal visit versus time-bound PNC visits). In countries with both versions of indicators, a sensitivity check was conducted to demonstrate that both reporting methods yielded similar results (see Tables B, C, and D in S1 Text).

HMIS data validity is often assessed in the context of measuring service coverage levels and can reflect challenges due to factors such as poor representativeness and the accuracy of population denominators [28]. Despite finding shortcomings in measuring service coverage, previous authors have called for the greater use of HMIS data, specifically the absolute number of services provided each month, in research and policy decisions. In this study, we do not attempt to estimate population service coverage but rather assume that the change in service-specific utilization reported by facilities in the HMIS represents the percentage change in population service coverage. We believe this use of HMIS, not as an estimate of coverage but as an estimate of coverage change, is less subject to various potential biases. The ability to rigorously estimate changes in service volume despite limitations of facility data has been previously demonstrated [29]. With the exception of Bangladesh and Nigeria, there should be high representativeness of facilities that report to HMIS since the public sector delivers the majority of care. The primary concern is the possible differential change in utilization between reporting and nonreporting facilities. Findings from household surveys and interviews with key health system stakeholders during the pandemic confirm that private facilities and community programs did not compensate for the disruptions in the public sector, and there were substantial levels of foregone care in the population [17,20].

HMIS data were downloaded on 22 August 2021, and were prepared for analysis by removing outlier values and restricting data for indicators with low completeness. These preparation steps are detailed in the Supporting information (see Text A in S1 Text), and the advantages and disadvantages of HMIS data are discussed in previous work [14]. To further assess the quality and reliability of the data, we present a range of sensitivity tests; we describe data reporting completeness (see Fig A in S1 Text) and include a sensitivity check showing that changes in reporting patterns did not drive the results. We also specify for each country and indicator the dates dropped due to poor completeness, or data availability that may reduce the prepandemic follow-up (see Table L in S1 Text). The final dataset included 137,192 health facilities ranging from 478 facilities in Guinea to 34,701 in Nigeria. The reports cover 42 months and 8 services, for 21,421,125 nonmissing facility-month-service observations in the 18 countries.

We obtained data from 2 additional sources to assess whether service disruptions correlate with officially reported COVID-related death rates or with mobility restrictions. Data on reported COVID-19 deaths were obtained from the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University, which compiles data from official government COVID-19 surveillance reports. Official accounts are likely to underreport actual mortality in settings with limited testing capacity, particularly at the beginning of the pandemic [30]. However, even if the official reports are inaccurate, there are many mechanisms through which these reports may affect service utilization, such as changing perceptions by health providers and the population on the state of the outbreak. Therefore, one way to interpret these data is as a proxy for the perceived risk of infection. Information on the policy measures affecting population mobility was obtained from the Oxford COVID-19 Government Policy Tracker, which systematically tracks implementation dates and scores the stringency of policy interventions. We selected a subset of policies that may affect population access to health facilities: public transport closures, stay-at-home requirements, movement limitations, school closures, and workplace closures. The dataset includes ordinal severity scores for each policy to capture the stringency of restriction, ranging from no restrictions to recommendations to requirements with minimal exceptions. We constructed an index representing the daily severity of mobility restrictions using the first component of a principal component analysis of these selected indicators. There is a correlation of 0.92 between the index we construct and the Oxford response stringency index, composed of a wider set of interventions. The Oxford COVID-19 Policy Tracker captures as-written strictness of policies but not levels of enforcement. As we are unaware of a reliable source on levels of enforcement of restrictions, differences in levels of enforcement between countries were not taken into account.

Analysis of service utilization disruptions

We used an interrupted time-series approach to predict the volume of services that would have been delivered had the pandemic not occurred. The interruption period starts with the WHO pandemic declaration in March 2020, coinciding with the start of community transmission and mobility restrictions in most countries. Service and countries were modeled separately using a linear regression equation with the following form: where Ytf is the service volume reported by facility f in month t. T represents the time in months since January 2018 to account for a linear secular trend (β1), Month represents calendar months to account for seasonality (β2..12), and αf represents the facility-level fixed effect accounting for time-invariant facility characteristics. Fixed effects were replaced with facility characteristic covariates (province and facility type) in Uganda, where an update to the administrative system did not allow for consistent identification of facilities over time. PandemicMonth denotes a series of dummy variables for each of the months between March 2020 and June 2021. That is, β13..29 contain estimated disruption for each month since the pandemic.

To calculate the percentage change in service utilization during the pandemic months, we first used the estimation results to calculate the expected volume in the absence of the pandemic (counterfactual). Then, we divided the reported volumes by these expectations. The cumulative shortfall was estimated using the same model with a single pandemic period. A 2-year prepandemic time horizon was chosen to minimize confounding from changes in data collection practices, policy changes, or other health shocks while still allowing separation of seasonality effects from secular trends.

Correlate drivers of utilization changes

We further examined whether the estimated monthly changes in service volumes showed statistical association with the time elapsed since the start of the pandemic, the monthly number of official reported COVID deaths, and the stringency of mobility restrictions. These relationships were assessed by running the following linear regression separately for each service: where Dtc is the estimated monthly change in service volume for month t in country c. CovidMortalitytc represents the officially reported monthly number of COVID-19-related deaths per 100,000 people, and RestrictionStringencytc represents the average monthly stringency of the mobility restrictions. αc represents a country fixed effect, and εtc is a normally distributed error term.

Mortality estimates

We estimated the impact of the service utilization disruptions on the absolute number of child, neonatal, and maternal deaths using the Lives Saved Tool (LiST). LiST is a mathematical model that forecasts mortality estimates from the coverage of 70+ RMNCH+N health interventions, considering the specific demographic and epidemiological context of a country [31]. We assumed that the relative change in the coverage of the interventions included in the LiST model was the same as the estimated relative changes in service utilization. Each intervention was linked to the service during which the intervention is typically delivered or proxied by the service assumed to have a similar utilization pattern. For interventions without a reasonable proxy, such as child nutrition services, the conservative default assumed no change in the intervention coverage. This linking of service indicators to LiST interventions is described in Table E of S1 Text. As multiple RMNCH interventions were linked to a small set of indicators, small variations in the few service indicators significantly affect the overall mortality results. To address this, we ran a sensitivity analysis using different linking combinations to understand how these linking decisions alter the results and limit their potential effect.

For each LiST intervention and country, we obtained coverage values from the most recent household survey for the country (typically a DHS or MICS), which we took as the coverage value that we would have expected in the absence of the pandemic (i.e., as a “counterfactual”). To estimate the coverage value during the pandemic, we multiplied the counterfactual coverage value by the estimated disruption of the service (proxy) indicator. This approach assumes that, during the pandemic, the change in population-level coverage was proportional to the change in reported facility-level utilization. In this way, we obtained an estimated coverage value for each intervention, country, and period. We used 3-month periods (quarters), aggregating the service disruption for the relevant proxy indicator for each quarter and calculating disrupted coverage values for each quarter of the pandemic for each country and intervention.

We ran 2 LiST analyses for each country and quarter: first, a “without pandemic” scenario, using only the counterfactual coverage values, to obtain the expected deaths in the absence of the pandemic; and second, a “with pandemic” scenario, to obtain the expected deaths during the pandemic. LiST only takes yearly input values, so we entered quarterly values as yearly values (for 2020 or 2021, as appropriate), and divided the resulting expected deaths by 4, to obtain the expected deaths for the quarter. We took the difference in expected deaths between the “with pandemic” and “without pandemic” scenarios to represent the additional deaths due to the pandemic. For each country and age group, we report the number of deaths that we would have expected in the absence of the pandemic for the period March 2020 to June 2021, the estimated number of additional maternal and child (including neonatal) deaths due to the change in service utilization during this same period, and the relative increase in mortality because of service utilization declines during the pandemic. The RECORD checklist is included in the Supporting information (S1 RECORD Checklist). Study limitations include the assumption that the changes in service-specific utilization reported in the HMIS represents the percentage of service coverage change in the population, and the inability to account for differential changes in health-seeking behaviors across severity of need.

Results

A total of 137,192 facilities were included in the analysis, as shown in Table 1, though the number of facilities reporting information for various health services varied by country. The following sections describe findings of service disruptions, regression analysis, and LiST modeling, respectively.

thumbnail
Table 1. Sample size used in primary analysis (number of facilities).

https://doi.org/10.1371/journal.pmed.1004070.t001

Service disruptions

We focus first on the number of outpatient consultations as a proxy for general service utilization. As shown in Table 2, the cumulative number of reported outpatient consultations between March 2020 and June 2021 is significantly lower than expected, given the prepandemic trends in all countries apart from Cameroon, Liberia, and Somalia. These 3 countries also experienced substantial monthly declines in outpatient consultations compared to expected values, but the reductions over the 16-month duration are not statistically significant (see Table A in S1 Text). On average, the countries in this analysis experienced a cumulative reduction of 13% in outpatient consultations compared to historical utilization trends. The largest decline of 40% is estimated for Bangladesh, followed by 25% in Haiti and Kenya. Large declines between 10% and 20% are estimated for Ethiopia, Ghana, Guinea, Madagascar, Nigeria, Senegal, Sierra Leone, and Uganda. As seen in Fig 1, unweighted moving average monthly outpatient service volumes are below expected for all months between March 2020 and June 2021.

thumbnail
Fig 1. Percent change in volume from expected levels based on prepandemic trends by selected health services across 18 countries, March 2020–February 2021.

Note: The horizontal line at 0% represents the expected volume of services based on prepandemic trends. The gray lines plot country-specific changes in service utilization. The monthly country-specific results are presented in Table A in S1 Text. The red line is a multicountry unweighted moving average of the change in utilization plotted by a locally estimated scatterplot smoothing (LOESS) regression. Details on indicator reporting for each country can be found in Table L in S1 Text. ANC1 refers to First Antenatal Care Visit. ANC4 refers to the Fourth Antenatal Care Visit. BCG refers to bacillus Calmette–Guérin vaccination. OPD refers to Outpatient visits. Penta3 refers to the Third dose of Pentavalent vaccine. PNC1 refers to First Postnatal Care Visit.

https://doi.org/10.1371/journal.pmed.1004070.g001

thumbnail
Table 2. Cumulative change in service volumes during the pandemic period (March 2020–June 2021) compared to expected volume based on prepandemic trends.

https://doi.org/10.1371/journal.pmed.1004070.t002

The disruptions to RMNCH services are smaller on average than those observed in outpatient consultations. For child vaccination, 10 out of 18 countries experienced significant cumulative reductions in the number of children receiving the third dose of the pentavalent vaccine. Out of the 14 countries with HMIS data on administered BCG vaccine doses, 8 experienced significant cumulative reductions. In most countries, the monthly reductions in vaccination were largest at the start of the pandemic and returned to the prepandemic expectation by July 2020 (see Fig 1). While the return to the expected levels is encouraging, we do not see an increase representing facility-based catch-up for the vaccinations missed early during the pandemic. A different pattern is observed for antenatal care initiation (ANC1). An initial decrease is followed by an increase above the expected volume, indicating that some women may have delayed their visit without completely forgoing antenatal care. Reproductive and maternal health services disruptions were more context-specific than disruptions in outpatient care and child vaccination. Significant declines in the delivery indicators, for example, are estimated in 10 out of the 18 countries. At the same time, Cameroon, Ethiopia, Madagascar, and Senegal reported volumes significantly exceeding those expected based on prepandemic trends. Significant cumulative reductions in family planning services are estimated for 6 out of 12 countries with available data. Large reductions in family planning volume of at least 10% were experienced in Guinea, Mali, and Sierra Leone.

Correlates

In addition to the cross-country variation, the magnitude of service volume disruption varied during the pandemic. Fig 2 presents the example of outpatient consultations and portrays a country-specific relationship between the magnitude of the estimated disruptions, the time elapsed since the beginning of the pandemic, and the monthly number of reported COVID-related deaths. To assess the correlations of the disruptions with these factors, we present cross-country regression results in Table 3. The largest utilization reductions were experienced in April and May 2020, and this decline is unrelated to pandemic severity as proxied by reported COVID-19-related mortality. Family planning is the only service with large drops in the second quarter of 2021. Moreover, there is no significant relationship between the number of monthly officially reported COVID-19-related deaths and the magnitude of change in any service. There is, however, a significant relationship between imposed restrictions and the magnitude of the estimated disruptions in outpatient consultations, child vaccinations, and the fourth antenatal care visit. For example, a standard deviation in the mobility restrictions stringency is associated with a 3.9% reduction in outpatient consultation volume (Column 1 of Table 3).

thumbnail
Fig 2. Estimated and observed volume of outpatient consultations with officially reported COVID-19 deaths per 100,000 and mobility restrictions by country, January 2018–June 2021.

Note: Outpatient consultations are used as a proxy for the utilization of general health services. Data on officially reported COVID-19 deaths are compiled from Johns Hopkins University Coronavirus dashboard [1]. Population denominators for all countries are based on 2019 estimates from the World Bank Development Indicators database. Utilization volume and mortality data are normalized across countries by dividing by the highest observed monthly value within each country. Data on mobility restrictions is summarized by an index of public transport closures, stay-at-home requirements, movement limitations, school closures, and workplace closures stringency scores provided by the Oxford COVID-19 Government Response Tracker. The scores from this index are normalized, and the categorized into quintiles. Gaps in the service volume data are due to months removed because of low completeness. Details on indicator reporting can be found in Table L in S1 Text and data completeness can be found in Fig A in S1 Text. DRC is Democratic Republic of the Congo. Results for ANC1, delivery, BCG, and Penta3 are visualized in Fig B in S1 Text.

https://doi.org/10.1371/journal.pmed.1004070.g002

thumbnail
Table 3. Correlates of monthly disruption magnitude in service volume.

https://doi.org/10.1371/journal.pmed.1004070.t003

Mortality estimates

Table 4 shows estimates of the impact of service disruptions on child, neonatal, and maternal mortality. The country with the greatest estimated increase in mortality was Bangladesh, with a 14.9% increase in child mortality, 9.7% increase in neonatal mortality, and 3.9% increase in maternal mortality. Haiti, Kenya, Nigeria, Sierra Leone, and Uganda were also estimated to have child mortality increases of 5% or greater. Cameroon, Liberia, and Somalia were estimated to have small reductions in child mortality, and 6 countries were estimated to have minor reductions in maternal mortality. We estimate that 27.6% of the additional child deaths and 24.3% of the additional maternal deaths occurred due to utilization declines in Quarter 2 of 2020, reflecting the above results (see Table G in S1 Text). In sum, the absolute number of additional deaths across the 18 countries from March 2020 to June 2021 is estimated to be 110,686 child deaths (0 to 59 months), 32,061 neonatal deaths (<1 month), and 3,276 maternal deaths. Many factors, including population size and baseline mortality rate, drive the absolute number of additional deaths. In general, estimated increases in maternal mortality across all countries were smaller than increases in child or neonatal mortality due to smaller facility delivery reductions than those in outpatient and vaccination services.

thumbnail
Table 4. Expected and additional child, neonatal, and maternal deaths, March 2020 to June 2021.

https://doi.org/10.1371/journal.pmed.1004070.t004

We conducted 2 sensitivity analyses to understand the potential error in the mortality results. First, we used the upper and lower 95% confidence intervals of the service disruption estimates and found that the additional deaths could be 43.8% higher or 42.9% lower than the estimates in Table 4. Given the perfect correlation in the error of the disruption estimates that this approach assumes, these bounds are overly conservative. Second, we varied the linkage of service indicators to LiST interventions by setting all interventions to each service in turn and randomizing the link between interventions and services. We found that the mortality estimates could be up to 31.8% higher or 55.1% lower than Table 4. However, given the extreme assumptions that we tested related to the linkage between the HMIS indicators and the LiST interventions, these bounds are also conservative. For more detail on these sensitivity analyses, see Tables G and H in S1 Text.

Discussion

Compared to the expected volumes based on prepandemic trends, we estimate statistically significant reductions in service utilization in most countries. The magnitudes of the cumulative shortfalls vary substantially by country, type of service, and time. The largest disruptions, on average, are estimated for outpatient consultations—a proxy for general healthcare utilization. Smaller cumulative shortfalls in the number of children receiving the third dose of the pentavalent vaccine are detected in most countries. The identified disruptions between March 2020 and June 2021 were associated with 113,962 additional deaths among women and children across 18 low- and middle-income countries.

This study was not designed to estimate the share of all-cause excess mortality caused by service disruptions. The number of indirect deaths we project is higher than the COVID-19 mortality officially reported by the 18 countries over the same time. Still, the officially reported number of deaths due directly to COVID-19 is grossly underreported in many countries [32]. Estimates of all-cause excess mortality published in May 2022 by WHO indicate a much greater level of mortality, with 597,422 excess deaths estimated to have occurred in the 18 countries by June 2021. No data were provided on the relative share of direct and indirect deaths within the total estimated number of excess deaths by country or globally. Regardless of the exact numbers, our findings illustrate that indirect deaths due to reductions in service coverage threaten to reverse gains in maternal and child mortality reduction achieved over a multi-year period before the COVID-19 outbreak. Yet, there is a clear need to strengthen country systems to track levels and trends in mortality by cause.

Service disruptions were largest during the first quarter of the pandemic, regardless of the timing of high reported COVID-19-related mortality or the stringency of policies imposed to contain the virus’ spread. This pattern may suggest a process of adaptation and learning. Individuals, health systems, and governments initially responded to the pandemic with uncertainty due to limited knowledge of the virus, transmission dynamics, risk, and safety measures. As more information became available, perceptions and behaviors might have changed. Alternatively, fatigue from mobility restrictions and social distancing could have influenced behavior patterns as the months elapsed. The duration of the pandemic may also have allowed time for health systems to adapt service provision, including combining multiple services in a single visit and transitioning care to the community level.

We also show a relationship between mobility restrictions and the magnitude of disruptions, highlighting the trade-offs inherent to the difficult policy decisions governments worldwide have had to make since the beginning of the pandemic. Imposing mobility and social gathering restrictions to contain the spread of the virus and protect those at high risk of COVID-19 mortality can come at the cost of reduced utilization of life-saving essential health services. In Nigeria, for example, a third of women surveyed during exit interviews after receiving RMNCH services reported not being able to access such services at some point since the start of the pandemic, with the most cited reasons being an inability to leave their household due to the lockdown, or because of the shutdowns and increased costs of public transportation [33]. These same issues were cited in other settings [33,34]. Even when the mobility restrictions do not specifically restrict health facility attendance, their introduction might affect individuals’ perceptions of whether services are available and the infection risk associated with visiting the health facilities. When such restrictions are imposed, the population’s ability to access essential health services must be maintained.

We estimate that the service disruptions were associated with increases in U5 and maternal mortality on the order of 2% to 5% for most countries in our analysis. The magnitude of the excess mortality is well below many scenarios presented at the onset of the pandemic, including that proposed by Roberton and colleagues, which hypothesized larger reductions in service utilization and predicted a relative increase in mortality of 10% [10]. However, the impact is proportional to the extent of the service disruptions in each country: Some countries experienced indirect mortality in the range of 5% to 15% of the expected mortality in the absence of the pandemic. The type of services that were disrupted is also important. Countries that saw larger declines in the proportion of women delivering at a facility were more likely to see larger increases in maternal mortality, linked to reductions in the parenteral administration of uterotonics, antibiotics, and anticonvulsant interventions. Countries with larger disruptions to outpatient utilization saw larger increases in child mortality, driven by estimated reductions in curative child health services such as antibiotics for pneumonia and neonatal sepsis, oral rehydration solution for dehydration due to diarrhea, and artemisinin-combination therapy for malaria. Although the primary driver of mortality is the magnitude and duration of service disruptions and the consequent reduction in coverage of interventions, other factors such as a country’s baseline coverage levels, baseline mortality rates, and cause-of-death structure were also important for country-specific mortality estimates.

Our study has several important limitations. Data derived from country health management information systems used in this study predominantly reflect the utilization patterns in the public sector, and the type of public facilities reporting data can vary between indicators and countries (detailed in Table 1). Theoretically, there could be a shift between public and private providers, which our analysis would not account for as changes in utilization. Additionally, data gaps can affect the completeness and quality of the HMIS data. We conduct a robustness check confirming that these changes in reporting patterns do not drive our findings.

The mortality estimates generated by LiST are limited by the accuracy of the input data, the set of health interventions considered in the analysis, and the assumptions made in linking the disruption in specific services to the overall coverage of interventions. For some countries, the baseline coverage inputs may be inaccurate due to the most recent DHS or MICS survey being conducted several years prior to 2020. However, given that we generated our pandemic coverage estimates relative to the baseline coverage estimates and given that our LiST results are predominantly driven by this relative change (and not the absolute value of the pandemic estimate or the counterfactual), this issue is likely to have had little effect on our results. The analysis does not account for differential changes in health-seeking behaviors by the risk group of patients. Relative reductions in healthcare-seeking behavior among low-risk patients may cause overestimations in the predicted mortality. In contrast, relative reductions in the ability to access healthcare by high-risk patients may result in underestimated mortality.

The indirect effects of the COVID-19 pandemic may have changed mortality through other pathways not considered by the LiST analysis. For example, reduced quality of care may lower the effectiveness of interventions in saving lives, social distancing is likely to have changed patterns in the transmission of other communicable diseases beyond COVID-19, and people’s behaviors more broadly may have changed disease incidence in ways we do not yet understand. We also do not consider effects such as malnutrition due to economic setbacks and disruptions to food markets. Other analyses have suggested that food insecurity could increase mortality by up to 10% in some countries [35]. Likewise, disruptions to family planning could affect birth outcomes and mortality rates for several years [12]. The selected services further represent an important but narrow set of services, and disruptions to chronic disease management, testing capacity, surgical services, and other life-saving health interventions are not considered. These broader effects are likely to be substantive and will result in cascading effects into the future.

Our findings have both short-term and long-term policy implications. Given the delays in COVID-19 vaccination access in low- and middle-income countries, the direct and indirect impacts of the COVID-19 crisis will likely persist in time. The prevalence of continued service disruptions, although to a lesser extent relative to the beginning of the pandemic, implies that children and mothers remain at higher risk of mortality during the protracted outbreak period. Continuity of essential health services during COVID-19 response must be monitored and maintained to minimize these preventable deaths. This study’s findings also highlight the need to invest in health system resiliency. Future studies should investigate the reasons why certain countries experienced more (or less) severe service disruptions by studying specific causes of disruptions and adaptations made by health facilities to address them. Together, these studies can inform future efforts to strengthen health systems to better prepare for and minimize loss of life during future health emergencies.

Additionally, this work helps understand how COVID-19 poses a profound threat to countries’ ability to progress toward UHC and SDGs (SDG 3.8.1). All 4 of the UHC service coverage index indicators for reproductive, maternal, newborn, and child health are represented in our analysis (i.e., family planning, ANC4, DTP3, and care-seeking for pneumonia). Given that most countries have experienced significant cumulative decreases in service volume in at least one of these 4 services since the start of the pandemic, our study provides evidence that COVID-19 is reversing longstanding progress toward achieving UHC by reducing coverage of essential health services.

Conclusions

Service volume reported from health facilities across 18 low- and middle-income countries were disrupted for outpatient care and key reproductive, maternal, and child vaccination services during the pandemic. This use of facility data highlights the potential, with additional investment and validation, for these systems to play an important role in monitoring the resilience of health systems during times of shock. Substantial variation in the magnitude of disruption was identified during the pandemic and across services and countries. Overall, though the average disruption to maternal and child services was lower than many hypothesized scenarios as the pandemic’s onset, the decrease in intervention coverages is projected to be associated a substantial loss of life among women and children. These findings emphasize that safeguarding continuity of essential health services delivery must be maintained as part of the response to the COVID-19 pandemic and future crises particularly in low- and middle-income countries.

Supporting information

S1 Text. Supporting Information.

Table A. HMIS indicator definition and mapping. Table B. Sensitivity of disruption estimates between alternative definitions for deliveries. Table C. Sensitivity of disruption estimates between alternative definitions for outpatient consultations. Table D. Sensitivity of disruption estimates between alternative definitions for family planning. Table E. Linkage between service indicators to LiST interventions. Table F. Difference between expected and observed service coverage by month and country. Table G. Projections of mortality from LiST Model by Quarter. Table H. Bounding the mortality estimates using service disruption confidence intervals. Table I. Sensitivity analysis of linking decisions. Text A. Data notes. Fig A. Level of completeness by country and indicator. Table J. Cumulative change in service volume during the pandemic period (March 2020–June 2021) in a balanced panel of facilities. Table K. Sample size for balanced panel analysis (number of facilities). Table L. Data considerations. Table M. Percentage of reporting outliers by country in the prepandemic (January 2018–February 2020) and the pandemic (March 2020–June 2021) periods. Table N. Population totals and mortality rates references for analyzed countries. Fig B. Estimated and observed volume of additional indicators with officially reported COVID-19 deaths per 100,000 and mobility restrictions by country, January 2018–June 2021.

https://doi.org/10.1371/journal.pmed.1004070.s002

(DOCX)

References

  1. 1. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. 2020;20:533–534. pmid:32087114
  2. 2. Weinberger DM, Chen J, Cohen T, Crawford FW, Mostashari F, Olson D, et al. Estimation of Excess Deaths Associated with the COVID-19 Pandemic in the United States, March to May 2020. JAMA Intern Med. 2020;180. pmid:32609310
  3. 3. Dahal S, Banda JM, Bento AI, Mizumoto K, Chowell G. Characterizing all-cause excess mortality patterns during COVID-19 pandemic in Mexico. BMC Infect Dis. 2021;21. pmid:33962563
  4. 4. Magnani C, Azzolina D, Gallo E, Ferrante D, Gregori D. How large was the mortality increase directly and indirectly caused by the COVID-19 epidemic? An analysis on all-causes mortality data in Italy. Int J Environ Res Public Health. 2020;17. pmid:32429172
  5. 5. Karlinsky A, Kobak D. Tracking excess mortality across countries during the covid-19 pandemic with the world mortality dataset. Elife. 2021;10. pmid:34190045
  6. 6. Sochas L, Channon AA, Nam S. Counting indirect crisis-related deaths in the context of a low-resilience health system: The case of maternal and neonatal health during the Ebola epidemic in Sierra Leone. Health Policy Plan. 2017;32:iii32–iii39. pmid:29149310
  7. 7. Shapira G, de Walque D, Friedman J. How many infants may have died in low-income and middle-income countries in 2020 due to the economic contraction accompanying the COVID-19 pandemic? Mortality projections based on forecasted declines in economic growth. BMJ Open. 2021 [cited 30 Aug 2021]. pmid:34429282
  8. 8. Patabendige M, Gamage MM, Jayawardane A. The Potential Impact of COVID-19 Pandemic on the Antenatal Care as Perceived by Non-COVID-19 Pregnant Women. Women’s Experience Research Brief. J Patient Exp. 2021;8. pmid:34179402
  9. 9. Hamadani JD, Hasan MI, Baldi AJ, Hossain SJ, Shiraji S, Bhuiyan MSA, et al. Immediate impact of stay-at-home orders to control COVID-19 transmission on socioeconomic conditions, food insecurity, mental health, and intimate partner violence in Bangladeshi women and their families: an interrupted time series. Lancet Glob Health. 2020;8:e1380–e1389. pmid:32857955
  10. 10. Roberton T, Carter EDED, Chou VBVB, Stegmuller ARAR, Jackson BDBD, Tam Y, et al. Early estimates of the indirect effects of the COVID-19 pandemic on maternal and child mortality in low-income and middle-income countries: a modelling study. Lancet Glob Health. 2020;8:e901–e908. pmid:32405459
  11. 11. Hogan AB, Jewell BL, Sherrard-Smith E, Vesga JF, Watson OJ, Whittaker C, et al. Potential impact of the COVID-19 pandemic on HIV, tuberculosis, and malaria in low-income and middle-income countries: a modelling study. Lancet Glob Health. 2020;8:e1132–e1141. pmid:32673577
  12. 12. Riley T, Sully E, Ahmed Z, Biddlecom A. Estimates of the potential impact of the covid-19 pandemic on sexual and reproductive health in low-and middle-income countries. Int Perspect Sex Reprod Health. 2020. pmid:32343244
  13. 13. Chmielewska B, Barratt I, Townsend R, Kalafat E, van der Meulen J, Gurol-Urganci I, et al. Effects of the COVID-19 pandemic on maternal and perinatal outcomes: a systematic review and meta-analysis. Lancet Glob Health. 2021;9:e759–e772. pmid:33811827
  14. 14. Shapira G, Ahmed T, Drouard SHP, Amor Fernandez P, Kandpal E, Nzelu C, et al. Disruptions in maternal and child health service utilization during COVID-19: analysis from eight sub-Saharan African countries. Health Policy Plan. 2021. pmid:34146394
  15. 15. Arsenault C, Gage A, Kim MK, Kapoor NR, Akweongo P, Amponsah F, et al. COVID-19 and resilience of healthcare systems in ten countries. Nat Med. 2022. pmid:35288697
  16. 16. Amouzou A, Maïga A, Faye CM, Chakwera S, Melesse DY, Mutua MK, et al. Health service utilisation during the COVID-19 pandemic in sub-Saharan Africa in 2020: a multicountry empirical assessment with a focus on maternal, newborn and child health services. BMJ Glob Health. 2022:7. pmid:35501068
  17. 17. World Health Organization. Pulse survey on continuity of essential health services during the COVID-19 pandemic. 2020. Available from: https://www.who.int/publications/i/item/WHO-2019-nCoV-EHS_continuity-survey-2020.1
  18. 18. Rao SPN, Minckas N, Medvedev MM, Gathara D, et al. Small and sick newborn care during the COVID-19 pandemic: Global survey and thematic analysis of healthcare providers’ voices and experiences. BMJ. Glob Health. 2021;6. pmid:33716220
  19. 19. KC A, Gurung R, Kinney MV, Sunny AK, Moinuddin M, Basnet O, et al. Effect of the COVID-19 pandemic response on intrapartum care, stillbirth, and neonatal mortality outcomes in Nepal: a prospective observational study. Lancet Glob Health. 2020;8: e1273–e1281. pmid:32791117
  20. 20. Kakietek JJ, Dayton Eberwein J, Stacey N, Newhouse D, Yoshida N. Foregone Health Care During the COVID-19 Pandemic: Early Survey Estimates from 39 Low- and Middle-Income Countries. Health Policy Plan. 2022. pmid:35274688
  21. 21. Leight J, Hensly C, Chissano M, Ali L. Short-term effects of the COVID-19 state of emergency on contraceptive access and utilization in Mozambique. PLoS ONE. 2021;16. pmid:33765080
  22. 22. Karp C, Wood SN, Guiella G, Gichangi P, Bell SO, Anglewicz P, et al. Contraceptive dynamics during COVID-19 in sub-Saharan Africa: longitudinal evidence from Burkina Faso and Kenya. BMJ Sexual & Reproductive. Health. 2021:bmjsrh-2020-200944. pmid:33579717
  23. 23. Ehsan SMA, Jahan F. Analysing the impact of COVID-19 on the mothers of Bangladesh: hearing the unheard. J Public Health (Germany). 2021. pmid:33728259
  24. 24. World Health Organization. Guiding principles for immunization activities during the COVID-19 pandemic: interim guidance, 26 March 2020. Geneva: World Health Organization; 2020. Available from: https://apps.who.int/iris/handle/10665/331590
  25. 25. Shet A, Dhaliwal B, Banerjee P, Carr K, DeLuca A, Britto C, et al. COVID-19-related disruptions to routine vaccination services in India: perspectives from pediatricians. medRxiv. 2021; 2021.01.25.21250040. Available: https://doi.org/10.1101/2021.01.25.21250040
  26. 26. Buonsenso D, Cinicola B, Kallon MN, Iodice F. Child Healthcare and Immunizations in Sub-Saharan Africa During the COVID-19 Pandemic. Front Pediatr. 2020;8:6–9.
  27. 27. Shapira G, Ahmed T, Drouard SHP, Fernandez PA, Kandpal E, Nzelu C, et al. Disruptions in Essential Health Services During the First Five Months of COVID-19: Analysis of Facility-Reported Service Volumes in Eight Sub-Saharan African Countries. Health Policy Plan. 2021;1:1–21.
  28. 28. Arsenault C, Yakob B, Kassa M, Dinsa G, Verguet S. Using health management information system data: case study and verification of institutional deliveries in Ethiopia. BMJ Glob Health. 2021;6:6216. pmid:34426404
  29. 29. Wagenaar BH, Sherr K, Fernandes Q, Wagenaar AC. Using routine health information systems for well-designed health evaluations in low- and middle-income countries. Health Policy Plan. 2016;31. pmid:25887561
  30. 30. Helleringer S, Queiroz BL. Commentary: Measuring excess mortality due to the COVID-19 pandemic: Progress and persistent challenges. Int J Epidemiol. 2022. pmid:34904168
  31. 31. Walker N, Tam Y, Friberg IK. Overview of the Lives Saved Tool (LiST). BMC Public Health. 2013;13:1–6.
  32. 32. Wang H, Paulson KR, Pease SA, Watson S, Comfort H, Zheng P, et al. Estimating excess mortality due to the COVID-19 pandemic: a systematic analysis of COVID-19-related mortality, 2020–21. Lancet. 2022;399. pmid:35279232
  33. 33. Balogun MI, Banke-Thomas A, Sekoni A, Boateng IDGO, Yesufu V, Wright O, et al. Challenges in access and satisfaction with reproductive, maternal, newborn and child health services in Nigeria during the COVID-19 pandemic: A cross-sectional survey. PLoS ONE. 2021. pmid:33961682
  34. 34. Singh DR, Sunuwar DR, Shah SK, Karki K, Sah LK, Adhikari B, et al. Impact of COVID-19 on health services utilization in Province-2 of Nepal: a qualitative study among community members and stakeholders. BMC Health Serv Res. 2021;21. pmid:33627115
  35. 35. Osendarp S, Akuoku JK, Black RE, Headey D, Ruel M, Scott N, et al. The COVID-19 crisis will exacerbate maternal and child undernutrition and child mortality in low- and middle-income countries. Nat Food. 2021;2:476–484.