Early changes in intervention coverage and mortality rates following the implementation of an integrated health system intervention in Madagascar

listen audio

Study Justification:
– The study aims to evaluate the impact of a district-level health system strengthening (HSS) intervention in rural Madagascar.
– The intervention is important because Madagascar has the lowest level of financing for health in the world and faces significant challenges in providing essential health services.
– The study is justified by the need to understand the potential of integrated HSS interventions on population health and to contribute to the achievement of global convergence in child and maternal mortality rates.
Study Highlights:
– The intervention was associated with decreases in under-five and neonatal mortality rates, although these were not statistically significant.
– The composite coverage index, a measure of maternal, newborn, and child health (MNCH) coverage, increased by 30.1%.
– Deliveries in health facilities increased by 63%.
– Improvements in coverage were larger in the intervention catchment area and led to a reduction in healthcare inequalities.
– Health center utilization rates tripled for most types of care during the study period.
Study Recommendations:
– The study recommends scaling up integrated HSS interventions to further improve health outcomes in rural Madagascar.
– It suggests focusing on strengthening health systems, improving access to essential health services, and reducing healthcare inequalities.
– The study also highlights the importance of continued monitoring and evaluation to assess the impact of interventions and identify areas for improvement.
Key Role Players:
– Ministry of Health (MoH): Responsible for implementing and coordinating health interventions.
– PIVOT-MoH Partnership: Implements the integrated HSS intervention in collaboration with the MoH.
– Madagascar National Institute of Statistics (INSTAT): Conducts data collection, survey coordination, and training.
– World Bank: Funds the PAUSENS project, which provides a basic package of services in health centers.
– US Agency for International Development: Funds the Mikolo project, which supports community health workers.
Cost Items for Planning Recommendations:
– Infrastructure and sanitation improvements in health centers.
– Staffing and equipment to improve the quality of care.
– Procurement systems for medical supplies and equipment.
– Ambulance network for transportation of patients.
– Removal of user fees and provision of social support to patients.
– Trainings and supervision of health staff.
– Support for child vaccination and donations of equipment and furniture to health centers.
– Equipment, supplies, and medicines for community health workers.
Please note that the cost items provided are general categories and not actual cost estimates. Actual costs will depend on the specific context and implementation plan.

The strength of evidence for this abstract is 7 out of 10.
The evidence in the abstract is moderately strong, but there are some limitations. The study is based on a district-level health system strengthening intervention in rural Madagascar, and the results show improvements in intervention coverage and mortality rates. However, the decreases in under-five and neonatal mortality were not statistically significant. To improve the strength of the evidence, future studies could consider increasing the sample size and conducting a longer follow-up period to assess the long-term impact of the intervention. Additionally, conducting randomized controlled trials or quasi-experimental designs could help establish a causal relationship between the intervention and the observed outcomes.

Introduction The Sustainable Development Goals framed an unprecedented commitment to achieve global convergence in child and maternal mortality rates through 2030. To meet those targets, essential health services must be scaled via integration with strengthened health systems. This is especially urgent in Madagascar, the country with the lowest level of financing for health in the world. Here, we present an interim evaluation of the first 2 years of a district-level health system strengthening (HSS) initiative in rural Madagascar, using estimates of intervention coverage and mortality rates from a district-wide longitudinal cohort. Methods We carried out a district representative household survey at baseline of the HSS intervention in over 1500 households in Ifanadiana district. The first follow-up was after the first 2 years of the initiative. For each survey, we estimated maternal, newborn and child health (MNCH) coverage, healthcare inequalities and child mortality rates both in the initial intervention catchment area and in the rest of the district. We evaluated changes between the two areas through difference-in-differences analyses. We estimated annual changes in health centre per capita utilisation from 2013 to 2016. Results The intervention was associated with 19.1% and 36.4% decreases in under-five and neonatal mortality, respectively, although these were not statistically significant. The composite coverage index (a summary measure of MNCH coverage) increased by 30.1%, with a notable 63% increase in deliveries in health facilities. Improvements in coverage were substantially larger in the HSS catchment area and led to an overall reduction in healthcare inequalities. Health centre utilisation rates in the catchment tripled for most types of care during the study period. Conclusion At the earliest stages of an HSS intervention, the rapid improvements observed for Ifanadiana add to preliminary evidence supporting the untapped and poorly understood potential of integrated HSS interventions on population health.

Ifanadiana is a rural health district of approximately 200 000 people located in the region of Vatovavy-Fitovinany in Southeastern Madagascar. As per MoH norms, Ifanadiana district has one reference hospital, one primary care health centre for each of its 13 communes (subdivision of a district with ~15 000 people) and two community health workers (CHW) for each of its 195 fokontany (subdivision of a commune with ~1000 population). In 2014, our baseline survey revealed that maternal and under-five mortality rates in Ifanadiana were 1044 per 100 000 and 145 per 1000, respectively (more than twice the national mortality estimates).31 The district population relied mostly on agriculture as the primary activity (84.8%), and nearly three-quarters lived in extreme poverty.31 Poverty, geographical barriers and unreliable health services were associated with limited access to healthcare in the district, which was substantially lower than average estimates for Madagascar.31 32 The integrated HSS intervention carried out by the PIVOT-MoH partnership was guided by existing MoH policies (summarised in table 1), covers all six building blocks and is implemented across all three levels of care in the district (community, health centre and hospital). This intervention is structured through the integration of horizontal improvements in system ‘readiness’, vertically aligned clinical programmes and information systems. Readiness includes infrastructure and sanitation, staffing and equipment to improve the quality of care; procurement systems; an ambulance network; the removal of user fees and provision of social support to patients; and trainings and frequent supervision of health staff. The clinical programmes included malnutrition and integrated management of child illness (IMCI) through strengthened community health programmes, primary healthcare centres and hospital (details can be found in ref 30). The information systems included facility-based registries, routine monitoring and evaluation systems and population-based household surveys. The core activities in the first 2 years covered approximately one-third of the population of Ifanadiana (referred to as ‘PIVOT catchment’), with some activities such as medical staff recruitments spanning the whole district (table 1). Summary of HSS interventions implemented in Ifanadiana district between 2014 and 2016, classified by building block of HSS* affected. These included the PIVOT intervention at all three levels of care in its initial catchment area, the PAUSENS project at the primary care level and the Mikolo project at the community health level. Details of each intervention are provided in the main text and online supplementary appendix S1 *Building blocks of HSS: (1) service delivery; (2) health workforce; (3) health information systems; (4) medicines and supplies; (5) financing; (6) leadership and governance. †Exceptionally, these two interventions only happened in RoD, since PIVOT substituted the medicine provision and financial incentives to CHWs. CHW, community health worker; HMIS, health management information systems; HSS, health system strengthening; IMCI, integrated management of child illness; MNCH, maternal, newborn and child health; MoH, Ministry of Health; RoD, rest of the district. bmjgh-2018-000762supp001.pdf In addition to PIVOT’s intervention, the population of Ifanadiana benefited from two other notable programmes that covered both the PIVOT catchment and the rest of the district (RoD). First, the PAUSENS project, funded by the World Bank, provided a basic package of services free of charge in all 13 major health centres for every woman attending the health centre for antenatal, delivery or postnatal care (first 6 weeks) and children under age 5 with any illness.33 The project also included trainings, support for child vaccination in remote areas and some donations of equipment and furniture to health centres. Second, the Mikolo project, funded by the US Agency for International Development, provided support to a network of 150 CHWs in the remote Fokotany (further than 5 km from a health centre) of eight communes in Ifanadiana, four of which were in the PIVOT catchment and four in RoD. The project organised annual trainings and periodic supervision, provided some equipment, supplies and an initial stock of medicines to each CHW. All the interventions are explained in detail in the online supplementary appendix S1. The main difference between PIVOT catchment and RoD (our control group) was the implementation of the PIVOT HSS intervention. A longitudinal cohort study was designed to obtain demographic, health and socioeconomic information from a representative sample of 1600 households in Ifanadiana district over time. Questionnaires were adapted from the DHS,34 with additional questions from other internationally validated surveys such as the Multiple Indicator Cluster Survey.35 Data collection, survey coordination, training and oversight were carried out by the Madagascar National Institute of Statistics (INSTAT), which implements all major national health surveys in the country. A two-stage sample stratified by PIVOT’s initial catchment area and the RoD was used to estimate indicators for each of the intervention and non-intervention areas, as well as Ifanadiana district as a whole. Eighty clusters, half from each stratum, were selected at random from enumeration areas mapped for the 2009 census. Individual households were then mapped within each cluster, and 20 households were selected at random from each cluster. Between April and May of 2014, individual face-to-face interviews were conducted with all women aged 15–49 years and men aged 15–59 years (usual residents or visitors) in 1522 of the sampled households (95.1% response rate). The original 1600 households were revisited between August and September 2016; any missing or refused households were replaced with others from the same cluster using a predefined random replacement list. Overall, 1514 households were interviewed during the follow-up survey (94.6% response rate). All residents, including children, had weight and height measured (or length in the case of infants). Data collected in the questionnaires included, among others, household composition (size, genders, ages); indicators of socioeconomic status (education, employment, household durable assets); illness in the last 30 days; preventive behaviours (bed net ownership, access to water and sanitation); women’s reproductive history and care-seeking behaviours for reproductive health; children’s health, development and care-seeking for illness; and adult, maternal and child mortality. French and Malagasy questionnaires used in the cohort, as well as data collection protocols, had been standardised and validated for Madagascar during previous national surveys carried out by INSTAT. The study was approved by the Madagascar National Ethics Committee and Harvard Medical School IRB. All adults (≥15 years) provided verbal consent for the in-person interview and anthropometric measurements. Parents or guardians provided consent for children ≤5 years of age. INSTAT provided survey data to the investigators with all individual identifiers removed and with geographical information at the cluster level. Spatial boundaries of each cluster were made available to the investigators and are stored separately; this information will not be published or shared publicly. Further details on data collection and survey design are available in ref 31. For the period of January 2013 to December 2016, we obtained data from the MoH for all 13 primary care public health centres (CSB2) in Ifanadiana district on the number of new individuals per month attending each health centre for outpatient consultations or maternal care. These data were available from the health centres’ monthly activity report to the district (“revue mensuelle d’activité”, RMA), which is aggregated from the health centres’ registries every month by MoH staff. We excluded the six basic health centres (CSB1) in the district because these lack medical doctors and provide a more limited number of health services. As a component of the HSS intervention, data quality was maintained through joint MoH-PIVOT supervision of monitoring and evaluation carried out every 3 months at a subset of health centres to compare RMA values with registry data (see ref 32 for more details). From May 2015, the MoH changed the estimation and reporting of outpatient utilisation rates. Thus, we gathered all subsequent utilisation data directly from the registries to ensure consistent estimates throughout the 2013–2016 period. Information on total catchment population was obtained from official MoH records. Consistent with MoH estimates, catchment population of children under-five, expected number of pregnant women and expected number of deliveries were set at 18%, 4.5% and 4% of the total catchment population, respectively. Since official population estimates could be inaccurate, we also estimated catchment populations using available data from WorldPop36; we run additional analyses of per capita utilisation rates based on those data (see details in the online supplementary appendix S2). Population-level under-five mortality was estimated using the synthetic life table method for DHS surveys.37 Under-five mortality was defined as the probability of death before age 60 months per 1000 children born alive. For each survey wave, we used information from the 5 years prior to the survey, which comprised a sample of 4063 children for 2014, and 4037 children for 2016. In addition to these cross-sectional estimates, the observed difference in under-five mortality for the 1446 children followed up over the 2 years was also assessed in each area. From this longitudinal analysis, incidence rates of death per person-year in under-five children were calculated using Poisson regression. Coverage indicators (see list in table 3) were estimated strictly using standard definitions for DHS surveys.37 Vaccination coverage was defined as the proportion of children aged 12–23 months who received all recommended vaccines (three doses of polio and DTP, one dose of BCG and measles). Access to treatment was estimated as the proportion of children under 5 years of age who were ill with either fever, acute respiratory infection (ARI) or diarrhoea in the 2 weeks prior to the survey and sought medical treatment (at a hospital, health centre or CHW). In order to measure the effect of PIVOT’s interventions on maternal health service coverage, indicators were estimated for the last pregnancy during the last 2 years. In addition, to track a summary indicator of maternal, newborn and child health (MNCH) intervention coverage, we estimated a modified version of the composite coverage index (CCI)38 that included all standard interventions except for family planning, which was not available in the 2014 survey (see online supplementary appendix S2 for details in the estimation of CCI). Changes in health system coverage in PIVOT initial catchment and the rest of Ifanadiana district (RoD) between 2014 and 2016 *P<0.05; **P<0.01; ***P<0.001; ‡ P<0.1 †Modified CCI, does not include family planning. ARI, acute respiratory infection; CCI, composite coverage index; MNCH, maternal, newborn and child health; RoD, rest of the district. Coverage and mortality indicators were calculated for 2014 and 2016 both within PIVOT’s initial catchment area and for the RoD. Differences in coverage between PIVOT catchment and the RoD for each year were tested through Pearson Χ2 tests, adjusted by second-order Rao & Scott approximation.39 Absolute and relative trends were estimated for the 2014–2016 period and difference-in-differences (DiD) analyses were conducted to evaluate the statistical difference in the trends between the two areas.40 A separate analysis was carried out controlling for household wealth and proximity to the main (paved) road to explore whether these changed DiD estimates (online supplementary appendix S2 and table S1). Data were entered into CSPro and all analyses were done using R statistical software V.3.1.2,41 with the exception of population-level mortality rates and associated 95% CIs, which were calculated with SAS V.9.3, and the observed under-five mortality incidence rate ratios, which were calculated with Stata V.13 (College Station, TX). Sampling weights that adjusted for unequal probability of selection due to stratification and non-response were calculated for household, women’s and men’s surveys. All estimates were done using survey commands available in R package survey and applicable sampling weights.39 To assess trends in economic inequality for these coverage indicators, wealth indices were calculated for the population of Ifanadiana following standard DHS methods.37 Briefly, household physical assets were included in a principal component analysis and then the scores from the first principal component were used. Households were classified into five wealth quintiles, with cut-off points at 20%, 40%, 60% and 80% of the cumulative wealth distribution. The first two quantiles (poorest) and the last three (wealthier) were grouped together. For each indicator, we estimated wealth-specific averages in the intervention area as well as composite indicators of inequality, such as relative concentration index (RCI) and slope index of inequality (SII).42 The RCI is a measure of relative inequality based on the concentration curve, a plot of the cumulative distribution of each coverage indicator (y-axis) in the population ranked by wealth (x-axis) and adjusted by survey weights.42 The RCI is defined as twice the area between the line of equality (45° diagonal line) and the indicator’s concentration curve, and was calculated using R package decomp.43 The SII is a measure of absolute inequality that represents the difference in coverage between the highest and the lowest values of the wealth rank (normalised between 0 and 1). It was estimated at the individual level as the slope of the health outcome on the individual wealth ranks in a logistic regression, adjusted by survey weights.42 44 Using health centre data, we calculated the annual average in per capita utilisation rates for maternal care (antenatal care, first and fourth visits, deliveries and postnatal care) and outpatient care (all patients and children under-five). We estimated annual changes during the 2013–2016 period for health centres inside and outside of PIVOT’s initial catchment area using linear regression models with an interaction term and described as: where Yij is the average per capita utilisation rate for yeari and catchmentj (inside or outside); β1 is the yearly change outside the catchment area, β2 is the baseline difference in utilisation between catchments, and β3 is the yearly change associated exclusively with the intervention (p values for β3 coefficient are reported). Equation 1 is a standard DiD formulation, equivalent to the analyses carried out for survey data.

Based on the information provided, here are some potential innovations that can be used to improve access to maternal health:

1. Integrated Health System Strengthening (HSS) Initiative: Implement a district-level HSS initiative that focuses on integrating essential health services with strengthened health systems. This initiative should cover all levels of care, including community, health center, and hospital, and address key areas such as infrastructure, staffing, equipment, procurement systems, ambulance networks, removal of user fees, and training and supervision of health staff.

2. Community Health Worker (CHW) Program: Establish a network of CHWs in remote areas to provide support and care for pregnant women and children under the age of 5. These CHWs should receive regular training, supervision, and necessary equipment and supplies to effectively deliver healthcare services in their communities.

3. Free Basic Package of Services: Provide a basic package of services free of charge in health centers for pregnant women attending antenatal, delivery, or postnatal care, as well as for children under the age of 5 with any illness. This package should include essential healthcare services, trainings, support for child vaccination, and donations of equipment and furniture to health centers.

4. Improved Information Systems: Implement facility-based registries, routine monitoring and evaluation systems, and population-based household surveys to gather accurate and up-to-date data on maternal health indicators. This will help in tracking progress, identifying gaps, and making informed decisions for improving access to maternal health services.

5. Increased Health Center Utilization: Promote and encourage increased utilization of health centers for maternal care by improving access, reducing geographical barriers, and ensuring the availability of quality services. This can be achieved through measures such as improving infrastructure and sanitation, increasing staffing and equipment, providing social support to patients, and removing financial barriers.

These innovations, when implemented effectively, can contribute to improving access to maternal health services, reducing maternal and child mortality rates, and achieving the Sustainable Development Goals related to maternal and child health.
AI Innovations Description
The recommendation to improve access to maternal health based on the described intervention in Madagascar is to implement a district-level health system strengthening (HSS) initiative. This initiative should focus on integrating essential health services with strengthened health systems. The HSS intervention should cover all six building blocks of health system strengthening, including service delivery, health workforce, health information systems, medicines and supplies, financing, and leadership and governance.

Specific interventions that can be implemented include:

1. Improving infrastructure and sanitation in health facilities to enhance the quality of care.
2. Strengthening staffing and equipment in health facilities to ensure adequate healthcare provision.
3. Establishing a reliable procurement system to ensure the availability of essential medicines and supplies.
4. Implementing an ambulance network to improve transportation for pregnant women and emergency cases.
5. Removing user fees and providing social support to patients to reduce financial barriers to accessing healthcare.
6. Conducting trainings and frequent supervision of health staff to enhance their skills and knowledge.
7. Strengthening community health programs to improve community-level healthcare delivery.
8. Implementing information systems, including facility-based registries and routine monitoring and evaluation systems, to improve data collection and analysis for decision-making.

By implementing these interventions, it is expected that there will be improvements in intervention coverage and mortality rates related to maternal and child health. The interim evaluation of the HSS initiative in rural Madagascar showed promising results, including decreases in under-five and neonatal mortality rates, an increase in deliveries in health facilities, and overall reduction in healthcare inequalities.

It is important to note that the success of the HSS initiative relies on strong collaboration between the Ministry of Health, local partners, and international organizations. Continuous monitoring and evaluation of the intervention’s impact is also crucial to ensure its effectiveness and identify areas for improvement.
AI Innovations Methodology
The study mentioned in the description focuses on the implementation of a district-level health system strengthening (HSS) intervention in rural Madagascar to improve access to maternal health. The intervention includes various components such as infrastructure improvement, staffing and equipment enhancement, removal of user fees, provision of social support to patients, trainings, and supervision of health staff.

To simulate the impact of the recommendations on improving access to maternal health, a methodology was employed. Here is a brief description of the methodology used:

1. Baseline Survey: A district representative household survey was conducted at the beginning of the HSS intervention in over 1500 households in Ifanadiana district. This survey collected data on maternal, newborn, and child health (MNCH) coverage, healthcare inequalities, and child mortality rates.

2. Follow-up Survey: The first follow-up survey was conducted after the first 2 years of the HSS intervention. Similar data on MNCH coverage, healthcare inequalities, and child mortality rates were collected. Changes between the initial intervention catchment area and the rest of the district were evaluated through difference-in-differences analyses.

3. Data Analysis: The collected data were analyzed using statistical methods such as Pearson’s chi-square tests, Poisson regression, and linear regression models. These analyses were used to estimate changes in mortality rates, coverage indicators, and per capita utilization rates of health centers.

4. Coverage Indicators: Coverage indicators, such as vaccination coverage and access to treatment, were estimated using standard definitions for Demographic and Health Surveys (DHS). Changes in maternal health service coverage were also assessed for the last pregnancy during the 2-year period.

5. Inequality Analysis: Economic inequality in coverage indicators was assessed using wealth indices and measures such as the relative concentration index (RCI) and slope index of inequality (SII). These measures provide insights into the distribution of healthcare services across different wealth quintiles.

6. Per Capita Utilization Rates: Annual average per capita utilization rates for maternal care and outpatient care were calculated for health centers inside and outside of the intervention catchment area. Linear regression models were used to estimate annual changes in utilization rates.

By employing this methodology, the study was able to assess the impact of the HSS intervention on access to maternal health services, mortality rates, coverage indicators, and healthcare inequalities. The findings provide valuable insights into the effectiveness of integrated HSS interventions in improving maternal health outcomes.

Partagez ceci :
Facebook
Twitter
LinkedIn
WhatsApp
Email