Monitoring childbirth care in primary health facilities: A validity study in Gombe State, northeastern Nigeria

listen audio

Study Justification:
– Improving the quality of facility-based births is crucial for reducing maternal and neonatal mortality and morbidity.
– Accurate data on childbirth care is essential for monitoring progress.
– This study aimed to assess the validity of childbirth care indicators in a rural primary health care context in northeastern Nigeria.
Study Highlights:
– The study compared birth observations to facility exit interviews, household follow-up interviews, and health worker documentation.
– Validity was assessed for 25 childbirth care indicators.
– Women’s recall during exit interviews had high validity for 9 indicators, and additional indicators met either AUC or IF criteria for validity.
– Women’s recall during follow-up interviews had high validity for 1 indicator, and additional indicators met IF criteria only.
– Health worker documentation had high validity for 4 indicators, and additional indicators met AUC or IF criteria.
– The study recommends that monitoring of facility-based childbirth care should draw from and link multiple data sources, including routine health facility data and exit interviews with recently delivered women.
Recommendations for Lay Reader and Policy Maker:
– Consider using multiple data sources, including routine health facility data and exit interviews, for monitoring facility-based childbirth care.
– Ensure that indicators used for monitoring are valid and accurately reflect the quality of care provided during childbirth.
Key Role Players Needed to Address Recommendations:
– Health workers and facility staff responsible for data collection and documentation.
– Researchers and data analysts to analyze and interpret the data.
– Policy makers and program managers to implement changes based on the study findings.
Cost Items to Include in Planning Recommendations:
– Training and capacity building for health workers and facility staff.
– Data collection tools and equipment.
– Data analysis and interpretation.
– Implementation of changes based on study findings, such as improving data recording and monitoring systems.

The strength of evidence for this abstract is 7 out of 10.
The evidence in the abstract is rated 7 because the study conducted a validity assessment of childbirth care indicators in a rural primary health care context in northeastern Nigeria. The study compared birth observations to facility exit interviews, household follow-up interviews, and health worker documentation. The study calculated sensitivity, specificity, and area under the receiver operating curve (AUC) to determine individual-level reporting accuracy, and the inflation factor (IF) to determine population-level validity. The study found high validity for some indicators, but there is room for improvement. To improve the evidence, the study could consider increasing the sample size, ensuring consistency of rating between observers, and conducting interrater reliability checks.

Background Improving the quality of facility-based births is a critical strategy for reducing the high burden of maternal and neonatal mortality and morbidity across all settings. Accurate data on childbirth care is essential for monitoring progress. In northeastern Nigeria, we assessed the validity of childbirth care indicators in a rural primary health care context, as documented by health workers and reported by women at different recall periods. Methods We compared birth observations (gold standard) to: (i) facility exit interviews with observed women; (ii) household follow-up interviews 9-22 months after childbirth; and (iii) health worker documentation in the maternity register. We calculated sensitivity, specificity, and area under the receiver operating curve (AUC) to determine individual-level reporting accuracy. We calculated the inflation factor (IF) to determine population- level validity. Results Twenty-five childbirth care indicators were assessed to validate health worker documentation and women’s self-reports. During exit interviews, women’s recall had high validity (AUC≥0.70 and 0.75 < IF < 1.25) for 9 of 20 indicators assessed; six additional indicators met either AUC or IF criteria for validity. During follow-up interviews, women's recall had high validity for one of 15 indicators assessed, placing the newborn skinto- skin; two additional indicators met IF criteria only. Health worker documentation had high validity for four of 10 indicators assessed; three additional indicators met AUC or IF criteria. Conclusions In addition to standard household surveys, monitoring of facility-based childbirth care should consider drawing from and linking multiple data sources, including routine health facility data and exit interviews with recently delivered women.

Study approvals were obtained from the London School of Hygiene & Tropical Medicine (reference 14091) and the Health Research Ethics Committees for Nigeria (reference NHREC/01/01/2007) and Gombe State (reference ADM/S/658/Vol. II/66). Gombe State, northeastern Nigeria, has high maternal and newborn mortality at 814 per 100 000 live births and 35 per 1000 live births, respectively; nationally, maternal mortality estimates are also 814 per 100 000 live births and neonatal mortality estimates are 39 per 1000 live births [3,4,14,15]. Gombe is predominantly rural and 44% of the population have some primary school education. Most women access maternity care through public facilities. Seventy-two percent of women reported at least one antenatal care visit during their last pregnancy and 29% gave birth in a health facility [15]. In 2018, over 70% of facility deliveries took place in rural primary health facilities [32]. Twenty-five indicators were selected, focusing on the content of childbirth care (Table 1): skilled birth attendance and companionship during labor and delivery; care for the woman (maternal background characteristics, provider practices and respectful care, clinical care); and care for the newborn (immediate postnatal care and newborn outcomes). To select these indicators, we referred to the Ending Preventable Maternal Mortality and Every Newborn Action Plan strategy documents for priority indicators to monitor progress towards Sustainable Development Goals targets [33,34]. We also sought to complement indicators collected in the Nigeria Demographic and Health Survey as well as earlier studies validating childbirth care indicators [14,16-20]. Childbirth care indicators and data recording methods compared with birth observations (gold standard) for validation analyses *Observed women were interviewed before discharge from the facility (exit interview) and at home nine to 22 mo after childbirth (follow-up interview). Health workers documented childbirth events in facility maternity registers. †For validation analyses, the following indicators were converted into binary variables: age at delivery (adolescent births); prior parity (prior parity, four or more births); and baby’s birthweight (low birthweight, <2500 g). ‡In the facility maternity register, essential newborn care is a composite indicator for (i) immediate initiation of breastfeeding and (ii) baby kept warm. In Gombe, maternity registers defined essential newborn care as the immediate initiation of breastfeeding and the baby being kept warm within 30 minutes of birth [35]. To determine if the maternity register provided a sufficient approximation to globally-defined indicators, we compared the maternity register’s essential newborn care data to being kept warm and the initiation of breastfeeding within the first hour of birth [34]. For validation analyses, the following indicators were converted into binary variables: maternal age at delivery (adolescent births); prior parity (prior parity, four or more births); and baby’s birthweight (low birthweight, <2500 g). As part of an initiative to improve care in Gombe State, data were collected between 2016-2018, including facility-based birth observations [36]. A summary of each data recording method is provided in Figure 1; detailed descriptions follow. Data recording methods, data collection rounds, and the number of women observed and interviewed. *Of the 1889 women observed, 115 (6%) did not participate in an exit interview: 11 (0.5%) were discharged with their newborn and refused to be interviewed; 104 (5.5%) women were not interviewed (21 were referred to another facility; 61 still births with 1 maternal death; 22 newborn deaths). †A total of 445 women were followed up at home in March 2018, 9-22 months after their observed childbirth: 147 women from deliveries in June 2016; 146 women from deliveries in March 2017; 152 women from deliveries in August 2017. Starting in June 2016, five rounds of birth observations took place in 10 primary health facilities. Each round took place roughly every six months and lasted three weeks. To select the facilities for birth observations, a state-wide random sample of 107 facilities was drawn in November 2015 from approximately 500 government-owned primary health facilities. The maternity registers were reviewed to determine the volume of births occurring in the previous six months. The 10 facilities with the highest number of births were selected for birth observations [37]. An average of 15.7 births (standard deviation SD = 12.0) occurred per month in the 10 primary health facilities, compared to the state-level average of 4.3 births (SD = 6.3) per month in primary health facilities [38]. All women attending the facility for delivery were invited to participate, excluding women admitted for monitoring before the onset of labor. Women were given a description of the study and the procedures, including the right to withdraw participation at any time. A trained observer (local midwives, not employees of the assigned facility) stayed in the same room to continuously document labor and delivery processes through the first hour after birth, using a structured checklist. Labor and delivery took place in the same room. The mother and newborn were usually kept together until discharged from the facility. Two observers and one clinical supervisor were assigned per facility to work in shifts and cover all deliveries. Although observers were trained midwives, they had no legal right to intervene in clinical care during the observation period because they were not employed in the same facilities where they were doing the observations. At all times during the observation, the observer prioritized safety of the mother and newborn over data collection; protocols were established on how to seek help in the event of any life-threatening event. Priorities for the supervisor were (i) to ensure that consenting procedures were carried out; (ii) to observe data collection and carry out interrater reliability checks; (iii) to assist in the case of a query from facility employees or from clients and families; (iv) to collect and check digital data at the end of each day. Before each round, observers underwent four days of practical training to conduct unobtrusive observations, train on safety and confidentiality protocols, and ensure consistency of rating between observers. Observations were recorded onto a Lenovo A3300 tablet using CSPro version 7.0 (United States Census Bureau and ICF Macro, Suitland, MD, USA). Each observed woman was assigned a unique observation number to facilitate linking information to other data sets. Following the birth observation, regardless of newborn outcome, the observer extracted data about the woman from the maternity register. Data extraction took place on the same day as the observed birth after the first hour of birth. Data were directly entered into the tablet. Women were usually discharged within 24 hours of delivery. Each observed woman leaving the facility with a live newborn was invited to participate in an exit interview. The exit interview covered information recorded during the observation and harmonized with questions asked in the DHS and MICS. Each interview was conducted in Hausa by a member of the observation team assigned to the facility. Interview questions are available in Table S1 in Online Supplementary Document. In addition to recall during exit interviews, it was of interest to understand the validity of women’s recall in the context of household surveys, such as DHS and MICS. For this purpose, we conducted household-level follow-up interviews with a subset of the observed women to recall childbirth events. To represent a range of recall periods that may be encountered during a household survey, in March 2018 we selected approximately 150 women from each of the first three rounds of birth observations which occurred in June 2016 (22 months recall), March 2017 (15 months recall), and August 2017 (9 months recall); this selection was done by a simple random sample of a de-identified list of women observed per round. Each interview was conducted in Hausa and the women were asked the same questions as in the exit interview. To estimate the sample size, 50% prevalence from clinical observations (gold standard) was set for all indicators as we expected variability in the frequency of indicators. Sensitivity was set at 60% ± 7% precision and specificity at 70% ± 7% precision. Type 1 error was set at 0.05, assuming a normal approximation to a binomial distribution. Thus, a minimum sample size of 400 was required for observed women at exit interviews, at follow-up interviews, and in the maternity register. To combine the data from five rounds of data collection, we tested for marginal homogeneity using Yang’s chi-square test for clustered binary matched pair data using the clust.bin.pair package in R [39,40]. Of the 45 matched pairs analyzed (see Table 1), one indicator showed evidence of clustering across time when comparing birth observations and women’s self-reports at exit and follow-up interviews: birth attendant washed hands with soap before examinations. Given the number of matched pairs analyzed, we considered there to be sufficient evidence that the data collection rounds could be combined. Validation analyses were performed using Stata 14.2 (Stata Corp, College Station, TX, USA) [41]. Using birth observations as the gold standard, we assessed each indicator’s validity at the individual- and population-level. To measure individual-level reporting accuracy, we constructed three two-by-two tables for each indicator which compared the birth observation to each data recording method [16,18-20,23]. Missing and “don’t know” responses were excluded from the two-by-two tables. We calculated percent agreement between the birth observation and each data recording method. For two-by-two tables with at least five observations per cell, we calculated the sensitivity (true positive rate) and specificity (true negative rate) for each indicator. We quantified the area under the receiver operating characteristic curve (AUC) and estimated 95% confidence intervals (CI) assuming a binomial distribution. AUC values range from 0 to 1, with 0.5 representing a random guess and 1 representing complete accuracy. An AUC value of 0.7 or higher was chosen as the cutoff criteria for high individual-level reporting accuracy [23]. To measure the population-level validity, we calculated each indicator’s inflation factor (IF), which is the ratio of the estimated population-based survey prevalence to the gold standard’s prevalence. The IF reflects the degree to which an indicator would be over- or under-estimated in a population-based survey. To estimate the population-based survey prevalence, we used the following equation [42]: estimated population survey prevalence = (gold standard prevalence × sensitivity) + [(1 – gold standard prevalence) × (1 – specificity)]. An IF value between 0.75 and 1.25 was the chosen cut-off criteria for low population-level bias [23].

Based on the provided information, here are some potential innovations that can be used to improve access to maternal health:

1. Mobile Health (mHealth) Applications: Develop mobile applications that can be used by health workers to accurately document childbirth care indicators in real-time. This can improve data collection and monitoring of progress in maternal health.

2. Electronic Health Records (EHR): Implement electronic health record systems in primary health facilities to ensure accurate and efficient documentation of childbirth care. This can facilitate data sharing and improve coordination of care between different healthcare providers.

3. Telemedicine: Utilize telemedicine technologies to provide remote consultations and support for maternal health. This can improve access to healthcare services, especially in rural areas where there may be a shortage of healthcare providers.

4. Community Health Workers: Train and empower community health workers to provide basic maternal health services and education in remote areas. This can help bridge the gap between communities and healthcare facilities, improving access to care and promoting early detection of complications.

5. Public-Private Partnerships: Foster collaborations between public and private sectors to improve access to maternal health services. This can involve leveraging private sector resources and expertise to strengthen healthcare infrastructure and service delivery.

6. Transportation Solutions: Develop innovative transportation solutions, such as ambulances or mobile clinics, to ensure timely access to maternal health services, particularly in areas with limited transportation infrastructure.

7. Financial Incentives: Implement financial incentives, such as conditional cash transfers or health insurance schemes, to encourage pregnant women to seek and utilize maternal health services. This can help reduce financial barriers and increase access to quality care.

8. Health Education and Awareness Campaigns: Conduct targeted health education and awareness campaigns to empower women and communities with knowledge about maternal health, including the importance of antenatal care, skilled birth attendance, and postnatal care.

9. Task Shifting: Explore opportunities for task shifting, where certain responsibilities and tasks traditionally performed by doctors or nurses are delegated to other healthcare professionals, such as midwives or community health workers. This can help alleviate workforce shortages and improve access to maternal health services.

10. Quality Improvement Initiatives: Implement quality improvement initiatives in healthcare facilities to ensure the provision of evidence-based and respectful maternal health care. This can involve training healthcare providers, improving infrastructure and equipment, and strengthening referral systems.

These innovations can help address the challenges in accessing maternal health services and improve the quality of care provided to pregnant women, ultimately reducing maternal and neonatal mortality and morbidity.
AI Innovations Description
Based on the description provided, the recommendation to improve access to maternal health is to implement a comprehensive monitoring system that utilizes multiple data sources. This includes:

1. Conducting facility exit interviews with observed women: This involves interviewing women before they are discharged from the facility to gather accurate data on childbirth care. The validity of women’s recall during exit interviews was found to be high for several indicators.

2. Conducting household follow-up interviews: This involves conducting interviews with women at their homes 9-22 months after childbirth to recall childbirth events. This helps to understand the validity of women’s recall in the context of household surveys. Validity was found to be high for some indicators during follow-up interviews.

3. Utilizing health worker documentation in the maternity register: Health worker documentation in the maternity register can provide valuable data on childbirth care. The validity of health worker documentation was found to be high for certain indicators.

By drawing from and linking multiple data sources, such as exit interviews, follow-up interviews, and health worker documentation, a more comprehensive and accurate picture of childbirth care can be obtained. This can help in monitoring progress and identifying areas for improvement in maternal health access.
AI Innovations Methodology
Based on the provided description, here are some potential recommendations to improve access to maternal health:

1. Strengthening data collection methods: Implementing standardized data collection methods across primary health facilities can improve the accuracy and reliability of childbirth care indicators. This can include training health workers on proper documentation techniques and ensuring consistent data entry practices.

2. Enhancing facility-based monitoring: Establishing a system for regular monitoring of facility-based childbirth care can help identify gaps and areas for improvement. This can involve conducting regular audits or assessments to evaluate the quality of care provided and ensure adherence to best practices.

3. Integrating multiple data sources: Drawing from and linking multiple data sources, such as routine health facility data, exit interviews with recently delivered women, and household follow-up interviews, can provide a more comprehensive understanding of childbirth care. This can help capture different perspectives and validate the accuracy of reported data.

4. Improving communication and coordination: Enhancing communication and coordination between health facilities and communities can facilitate better access to maternal health services. This can involve strengthening referral systems, promoting community engagement, and ensuring timely and accurate information sharing.

To simulate the impact of these recommendations on improving access to maternal health, a methodology could be developed as follows:

1. Define the indicators: Identify specific indicators that reflect the desired outcomes of improved access to maternal health. These indicators could include metrics such as the percentage of women receiving antenatal care, the percentage of facility-based births, and the percentage of women receiving skilled birth attendance.

2. Collect baseline data: Gather data on the current status of the selected indicators. This can be done through surveys, interviews, or analysis of existing data sources. The baseline data will serve as a reference point for comparison.

3. Implement the recommendations: Introduce the recommended interventions, such as strengthening data collection methods, enhancing facility-based monitoring, integrating multiple data sources, and improving communication and coordination. Ensure that these interventions are implemented consistently across the target areas.

4. Monitor and evaluate: Continuously monitor the selected indicators to assess the impact of the implemented recommendations. This can involve collecting data at regular intervals using the same data collection methods as the baseline. Compare the new data with the baseline data to determine any changes or improvements.

5. Analyze the impact: Analyze the collected data to evaluate the impact of the implemented recommendations on improving access to maternal health. This can be done by comparing the indicators before and after the interventions and calculating the percentage change or improvement.

6. Adjust and refine: Based on the analysis of the impact, make any necessary adjustments or refinements to the interventions. This could involve scaling up successful interventions, addressing any identified challenges or barriers, and continuously improving the strategies to further enhance access to maternal health.

By following this methodology, it will be possible to simulate the impact of the recommendations on improving access to maternal health and make informed decisions for further interventions and improvements.

Yabelana ngalokhu:
Facebook
Twitter
LinkedIn
WhatsApp
Email