‘We allwork together to vaccinate the child’: A formative evaluation of a community-engagement strategy aimed at closing the immunization gap in North-West Ethiopia

listen audio

Study Justification:
The study aimed to evaluate a community engagement strategy called ‘The Fifth Child Project’ in North-West Ethiopia. The purpose was to investigate the role of community engagement in improving demand for immunization services. The study aimed to assess the integration of the project within the local health system, community co-management, and the acceptability and utilization of the project tools.
Highlights:
– The project was suitably integrated within the health extension program and established a practical system for defaulter-tracing.
– The color-coded health calendar facilitated personalized interactions between health workers and caregivers and was a catalyst for health discussions within homes.
– A regulation exercise of sanctions was observed at the community level, serving as a deterrent against vaccine default.
– Pre-existing community accountability mechanisms supported community engagement, although varying levels of engagement between leaders and health workers were observed.
– The benefits of shared responsibility for immunization were evident, but more transparency was required about community self-regulatory measures to ensure positive health-related discussions.
Recommendations:
– Strengthen the integration of the project within the local health system to ensure sustainability and scalability.
– Enhance transparency and communication about community self-regulatory measures to maintain positive health-related discussions.
– Foster increased engagement between community leaders and health workers to strengthen community co-management.
– Continuously evaluate and refine the project tools, such as the defaulter-tracing tool and the color-coded health calendar, based on feedback from caregivers and health workers.
Key Role Players:
– Health Extension Workers (HEWs)
– Health Development Army members (HDAs)
– Health Development Army Leaders (HDALs)
– Nurses seconded to health posts
– Kebele leaders (KLs)
– Other community leaders (e.g., teachers)
– Women Health Officers (WoHOs)
Cost Items for Planning Recommendations:
– Training and capacity building for health workers and community leaders
– Printing and distribution of project tools (e.g., defaulter-tracing tool, health calendar)
– Communication and awareness campaigns
– Monitoring and evaluation activities
– Stakeholder engagement and coordination efforts

The strength of evidence for this abstract is 7 out of 10.
The evidence in the abstract is based on a formative evaluation of a community-engagement strategy in North-West Ethiopia. The study utilized a mixed-methods approach, including participant observations, interviews, and focus groups. The data was transcribed, anonymized, translated, and thematically analyzed. Additional data was collected to verify findings. The study provides insights into the integration of the project within the local health system, community co-management, and the acceptability and utilization of the project tools. However, the abstract does not provide specific details about the sample size or the representativeness of the participants. To improve the evidence, it would be helpful to include information about the sample size and the recruitment process, as well as the limitations of the study. Additionally, providing more specific findings and conclusions would enhance the clarity and usefulness of the abstract.

The role of community engagement (CE) in improving demand for immunization merits investigation. The International Rescue Committee developed a CE strategy to implement a vaccine defaulter-tracing tool and a color-coded health calendar aimed at increasing uptake of immunization services in north-west Ethiopia (‘The Fifth Child Project’). We report findings from a formative evaluation of this project. In May/June 2016 we conducted 18 participant observations of project activities, 46 semi-structured interviews and 6 focus groups with caregivers, health workers, community members/leaders. Audio-recordings and fieldnotes were transcribed, anonymized, translated and analyzed thematically using inductive and deductive coding. Additional data was collected in November 2016 to verify findings. The project was suitably integrated within the health extension program and established a practical system for defaulter-tracing. The calendar facilitated personalized interactions between health workers and caregivers and was a catalyst for health discussions within homes. At the community level, a regulation exercise of sanctions was observed, which served as a deterrent against vaccine default. Pre-existing community accountability mechanisms supported the CE, although varying levels of engagement between leaders and health workers were observed. The benefits of shared responsibility for immunization were evident; however, more transparency was required about community self-regulatory measures to ensure health-related discussions remain positive.

The purpose of the qualitative study was to evaluate the FCP in terms of integration into the local health system, community co-management and the acceptability and utilisation of the FCP tools. A series of interviews, focus group discussions (FGDs) and observations were conducted between May–July 2016. As part of this research, IRC developed a ToC (Supplementary Materials), which depicted the inputs and activities required and key assumptions made for the FCP to achieve specified outputs and outcomes. The ToC provided a framework for evaluating the project and findings were used to refine the ToC and improve the implementation of the FCP. Three kebeles from BGRS were selected for the evaluation to include study sites with different population size, cultural and religious affiliation and distance from an urban centre (Table 1). Mugfude and Jematsa were mainly inhabited by indigenous Muslim populations and Amba 17 by Christian settler groups. The primary income-generating activity was agriculture, supplemented by gold mining in Mugfude and Jematsa. Composition of selected study sites. HEWs: Health Extension Workers; HDAs: Health Development Army member; HDALs: Health Development Army Leader. The sample frame within these sites included people who played a role in the FCP: caregivers, HDA(L)s, HEWs, HEW supervisors, nurses (seconded to health posts), kebele leaders (KLs), other community leaders (e.g., teachers) and WoHO. We included all HEWs/nurses and all KLs from the kebeles and key WoHOs responsible for immunization in these kebeles and used purposive sampling to select a set number of HDA(L)s, caregivers and other community leaders with maximum variation in terms of age, education level, gender and caregiver relationship to the infant across the three kebeles. While this mix of recruitment strategies was the only option due to the limited number of HEWs, nurses and KLs available in the three kebeles, the possible impact on the representativeness of the different sampling groups was taken into account by analysing and reporting data by type of participant. A local team of research assistants (‘research team’) from BGRS with English, Amharic and Rutana language skills were trained to conduct interviews, FGDs and observations in order to limit the influence of the European London School of Hygiene and Tropical Medicine (LSHTM) researchers on participants. The local research team lead (SW) was well known from the community as he had previously worked as a clinical officer in the regional hospital’s maternity wing. This facilitated rapport with the participants, including caregivers and district-level leaders, but could have also influenced some of the results. TC was present for a few initial interviews and focus groups to provide support and feedback to the newly trained research team, which could have influenced some of the participants’ responses. Interviews and FGDs took place in private settings and lasted 1–1.5 h. The interview style was semi-structured to cover pre-defined topics and shape exchanges according to interviewees’ roles, experiences and responses. FGDs were conducted with caregivers (mothers and fathers) and HDAs to facilitate discussions about immunization, the tools, and their engagement among themselves. With the interviewees’ permission, the research team collected basic socio-demographic information, compiled field notes, and audio-recorded interviews and FGDs. Participant observations, conducted to obtain more information about how the DTT and calendars are used along with the community’s engagement, focussed on two FCP activities: (1) monthly command post meetings with kebele leaders, HEWs, HDALs, and representatives of youth and women groups; and (2) HEW/HDA routine visits to caregivers’ homes. The research assistants conducted the observations in pairs and compiled field notes summarising the event, the type and number of people present, the purpose of the activity, and discussions held. The LSHTM researchers were not present during the observations to limit their influence on interactions and activities, but this also created a limitation as the local research team, including SW, was not fully trained on this methodology that would have required a different set of skills and more time and immersion in the field. The research team transcribed the audio recordings into Amharic with secretarial support. The transcripts were anonymised by allocating a numerical identification to each participant and storing these separately from the participant database. The transcripts were translated from Amharic to English by a firm in Addis Ababa, emailed securely to TC and EK and uploaded to NVivo, a qualitative data analysis software program. The approach to data analysis was thematic [14] and used the FCP’s ToC as a reference point. TC and EK developed a coding framework by drawing parent codes from the topic guides deductively and developing sub-codes inductively. They coded the first five transcripts separately, and met to compare findings and to start developing the framework. A report on data collection and findings compiled by SW, and field notes from the observations, were also used to inform the interpretation of the data and the identification of themes. TC coded the remaining transcripts, meeting several additional times with EK to refine the framework. SW also commented on the framework in bi-monthly phone calls. Codes were organized together with quotes from the transcripts to compare and contrast the data, including the recurrence of certain themes and the terminology used by participants. Categories and typologies were drawn from the codes and developed into emerging themes to further discuss the meaning of the data. An Ethiopian researcher based in the UK (BS) supported this data analysis by conducting translation checks and acting as a cultural interlocutor (although she was not originally from BGRS, she worked closely with the local research team lead (SW)). This analysis and initial findings were discussed with members of the research team, IRC FCP implementers, district and regional health offices, health extension workers and health development army members and some research participants during dissemination activities in BGRS in November 2016. During this time, SW, BS and TC conducted additional interviews with a WoHO, two KLs, two HEWs and two FGDs with caregivers (all mothers) and HDAs to verify some analyses, specifically those relating to the use of the Enat Mastawesha and maternal literacy levels and the application of community-agreed sanctions for non-immunization. This data was analyzed as described above. Potential participants received a study information letter in Amharic from the local research team and had the opportunity to ask questions before agreeing to be interviewed. Verbal consent is the preferred practice for obtaining agreement for participating in research in this region, hence participants audio-recorded a statement citing their name, date and willingness to participate. To preserve participants’ confidentiality, all transcripts and observation sheets were anonymised, and only the research team had access to the names of participants. The LSHTM Observational and Interventions Research Ethics Committee (Ref 10542) and the Regional Health Bureau of BGRS in Ethiopia approved this research (Ref 674/□□ m-o1).

Based on the provided description, the innovation for improving access to maternal health is the development and implementation of a community engagement strategy called “The Fifth Child Project” (FCP). This strategy includes a vaccine defaulter-tracing tool and a color-coded health calendar aimed at increasing uptake of immunization services in north-west Ethiopia. The FCP was integrated within the health extension program and established a practical system for defaulter-tracing. The calendar facilitated personalized interactions between health workers and caregivers and served as a catalyst for health discussions within homes. The FCP also utilized community accountability mechanisms and shared responsibility for immunization. The qualitative study evaluated the integration of the FCP into the local health system, community co-management, and the acceptability and utilization of the FCP tools. The findings from the study were used to refine the Theory of Change (ToC) and improve the implementation of the FCP.
AI Innovations Description
The recommendation that can be used to develop an innovation to improve access to maternal health is the implementation of a community-engagement strategy. This strategy involves developing tools and activities aimed at increasing uptake of maternal health services. The strategy should include the following components:

1. Vaccine defaulter-tracing tool: Develop a practical system for tracking and following up with pregnant women who have missed their scheduled vaccinations. This tool will help identify and address barriers to immunization and ensure that all pregnant women receive the necessary vaccines.

2. Color-coded health calendar: Create a personalized health calendar for pregnant women that includes important dates and reminders for prenatal care visits, vaccinations, and other maternal health services. This calendar will facilitate interactions between healthcare providers and pregnant women and serve as a catalyst for health discussions within homes.

3. Community accountability mechanisms: Utilize existing community accountability mechanisms to support the community engagement strategy. These mechanisms can include community leaders, health workers, and other stakeholders who can help promote and enforce the importance of maternal health services.

4. Transparency and communication: Ensure transparency and open communication about community self-regulatory measures to ensure that health-related discussions remain positive. This will help build trust and encourage active participation from community members.

By implementing this community-engagement strategy, access to maternal health services can be improved, leading to better health outcomes for pregnant women and their babies.
AI Innovations Methodology
Based on the provided description, it seems that the study is focused on evaluating the effectiveness of a community engagement strategy called “The Fifth Child Project” (FCP) in improving immunization rates in north-west Ethiopia. The project implemented a vaccine defaulter-tracing tool and a color-coded health calendar to increase uptake of immunization services. The study used qualitative research methods such as interviews, focus group discussions, and participant observations to evaluate the integration of the FCP into the local health system, community co-management, and the acceptability and utilization of the FCP tools.

To simulate the impact of recommendations on improving access to maternal health, a methodology could include the following steps:

1. Identify the recommendations: Based on the findings of the formative evaluation, identify specific recommendations that could improve access to maternal health. These recommendations could include strategies to enhance community engagement, improve communication between health workers and caregivers, strengthen accountability mechanisms, or increase transparency about health-related discussions.

2. Define the indicators: Determine the indicators that will be used to measure the impact of the recommendations on improving access to maternal health. These indicators could include metrics such as the percentage of pregnant women receiving prenatal care, the percentage of women delivering in a healthcare facility, or the reduction in maternal mortality rates.

3. Collect baseline data: Gather baseline data on the selected indicators before implementing the recommendations. This data will serve as a reference point for comparison and evaluation.

4. Implement the recommendations: Put the identified recommendations into practice. This may involve training health workers, implementing new communication strategies, or establishing community-led initiatives.

5. Monitor and measure progress: Continuously monitor the implementation of the recommendations and collect data on the selected indicators. This can be done through routine data collection systems, surveys, or interviews.

6. Analyze the data: Analyze the collected data to assess the impact of the recommendations on improving access to maternal health. Compare the post-implementation data with the baseline data to identify any changes or improvements.

7. Draw conclusions and make recommendations: Based on the analysis of the data, draw conclusions about the effectiveness of the recommendations in improving access to maternal health. Identify any challenges or barriers encountered during the implementation process and make recommendations for further improvement.

8. Iterate and refine: Use the findings from the simulation to refine the recommendations and iterate the process. This may involve adjusting strategies, addressing identified challenges, or scaling up successful interventions.

By following this methodology, it is possible to simulate the impact of recommendations on improving access to maternal health and inform future interventions and policies in this area.

Partilhar isto:
Facebook
Twitter
LinkedIn
WhatsApp
Email