Country-level assessment of missed opportunities for vaccination in south africa: Protocol for multilevel analysis

listen audio

Study Justification:
– Vaccination is one of the greatest public health interventions, but there are districts in South Africa with suboptimal vaccination coverage.
– Missed opportunities for vaccination are a major driver of suboptimal coverage.
– This study aims to understand the magnitude and determinants of missed opportunities for vaccination in South Africa.
– The findings will inform national and subnational policy implementation on vaccinations and help design interventions to improve coverage.
Study Highlights:
– The study will use the 2016 South African Demographic and Health Survey (SADHS) data.
– Multilevel regression analyses will be conducted to determine individual and contextual factors associated with missed opportunities for vaccination.
– Perspectives of parents and health care providers will be explored through exit interviews and focus group discussions.
– The study will be conducted in the Western Cape and Eastern Cape provinces to represent urban and rural settings.
– The sample size will include 620 participants, including parents and health care providers.
Study Recommendations:
– Design tailor-made interventions to improve vaccination coverage in districts with suboptimal coverage.
– Implement national and subnational policies based on the study findings.
– Address health facility obstacles identified as major causes of missed opportunities for vaccination.
– Collaboratively find interventions suited for different health care settings.
Key Role Players:
– Researchers and study team members
– South African Medical Research Council
– South African Department of Health
– Primary health care facilities
– Health care workers
– Parents and caregivers
– Professional transcriptionists
– Data analysts
Cost Items for Planning Recommendations:
– Research team salaries and stipends
– Ethical review submission fees
– Data collection tools (mobile tablets, audiorecorders)
– Transcription services
– Data storage and security measures
– Travel and accommodation for fieldwork
– Analysis software (REDCap, NVivo, MLwinN)
– Publication and dissemination costs

The strength of evidence for this abstract is 8 out of 10.
The evidence in the abstract is strong as it outlines a detailed research protocol and methodology for assessing missed opportunities for vaccination in South Africa. The study will use the 2016 South African Demographic and Health Survey, conduct multilevel regression analyses, and explore the perspectives of parents and healthcare providers. The study design includes both quantitative and qualitative data collection methods, allowing for a comprehensive understanding of the factors contributing to missed opportunities for vaccination. To improve the evidence, the abstract could provide more information on the sample size calculation and statistical analysis plan.

Background: Vaccination is one of the greatest public health interventions of all time. Vaccination coverage in South Africa has shown a steady improvement in reaching the national target. However, while there is progress nationally, there are districts within the country that are below the set target for vaccination coverage. One of the main drivers of suboptimal vaccination coverage is thought to be missed opportunities for vaccination. Objective: This study aims to understand the magnitude and determinants of missed opportunities for vaccination in South Africa. Methods: The 2016 South African Demographic and Health Survey will be used to conduct multilevel regression analyses to determine individual and contextual factors associated with missed opportunities for vaccination in South Africa. The perspectives of parents attending health care facilities in South Africa will be explored through exit interviews and focus group discussions. Similarly, perspectives of the health care providers will be sought to understand enablers and barriers to vaccination coverage at the facility level. Insights to such factors will aid in designing tailor-made interventions to improve vaccination coverage in South Africa. Results: Ethical review submission is planned for October 2020. Data collection is expected to be underway in January 2021. Conclusions: The extent of missed opportunities in South Africa coupled with the associated factors presents an opportunity for efforts to increase uptake in districts where vaccination coverage is below the national target. Population-level data such as those from the 2016 South African Demographic Health Survey will provide an idea of the magnitude of missed opportunities for vaccination in South Africa at the national and subnational levels. The findings of the study will inform national and subnational policy implementation on vaccinations and help to find context-specific interventions to improve vaccination coverage.

We will use the 2016 South African Demographic and Health Survey (SADHS). This will be a cross-sectional study. Briefly, the SADHS is a nationally representative household survey conducted in South Africa which uses a multistage, stratified sampling design with households as the sampling unit. Within each sample household, women and men meeting the eligibility criteria are interviewed. The survey findings represent the full target population because the samples are not self-weighting, and therefore, account for unequal selection probabilities as well as nonresponses [16]. SADHS is composed of a household questionnaire, a women’s questionnaire, and in most countries, a men’s questionnaire. We will use the WHO’s definition of missed opportunities for vaccination as the outcome variable, defined as a binary variable that takes the value of 1 if the child 12-23 months had any contact with health services but remained unvaccinated to any vaccination dose for which the child is eligible. Contact with health services will be defined using the following 6 variables: skilled birth attendance, baby postnatal check within 2 months, received vitamin A dose in first 2 months after delivery, had health care and medical treatment of diarrhea, fever, or cough. We will limit the analysis to one child per woman to minimize the overrepresentation of women with more than one child in the age category. Individual-level factors will be included in the models: child’s age, sex of the child (male versus female), high birth order (>4 birth order), child’s birth weight, number of children under the age of 5 years in the household, maternal age completed years (15 to 24, 25 to 34, 35 or older), employment status (working or not working), maternal education (no education, primary, or secondary or higher), and media access (radio, television, internet, or newspaper). SADHS does not collect direct information on household income and expenditures. We will use the SADHS wealth index as a proxy indicator for socioeconomic status. The methods used in calculating the SADHS wealth index have been described elsewhere [17,18]. An index of economic status for each household will be constructed using principal components analysis based on the following household variables: number of rooms per house and ownership of a car, motorcycle, bicycle, fridge, television, and telephone, as well as any kind of heating device. From these criteria, the SADHS wealth index quintiles (poorest, poorer, middle, richer, and richest) will be calculated and used in the subsequent modeling. Clustering within the same geographical living environment will be described as a neighborhood. Neighborhoods will be based on sharing a common primary sample unit within the SADHS data [19,20]. We will consider neighborhood socioeconomic disadvantage for the community-level variable in this study. Neighborhood socioeconomic disadvantage will be operationalized with a principal component comprised of the proportion of respondents with no education (illiterate), unemployed, rural resident, and living below the poverty level (asset index below 20% poorest quintile). A standardized score with mean 0 and standard deviation 1 will be generated from this index; with higher scores indicative of lower socioeconomic position. We will divide the resultant scores into 5 quintiles to allow for nonlinear effects and provide results that are more readily interpretable in the policy arena. We purposively selected the Western Cape and Eastern Cape provinces for the study to represent the urban and rural settings. The minimum sample required is estimated at 620 in the two provinces which will include both the parents and health care providers This sample size will be used for quantitative surveys and focus group discussion data collection. While the sample size has been estimated, this type of analysis allows reiteration to ensure that saturation is obtained. The estimation is based on the following assumptions: a prevalence of missed opportunities for vaccination of 32.2%, from a previous study [21]; an acceptable margin of error of 5%; nonresponse rate of 20%; and a design effect of 1.5 [21-23]. Design effect will be considered to account for clustering since respondents are embedded within specific health facilities [22-24]. For feasibility and logistical reasons, 10 primary health care facilities in each of the 2 districts—OR Tambo District in the Eastern Cape Province and Cape Town Metropolitan Municipality in Western Cape Province—will be randomly selected by cluster sampling technique. Each selected primary health care facility will be considered as a cluster. From each selected primary health care facility, all eligible and consenting caregivers with a child aged 0-23 months will be included. For the focus group discussions, a purposively selected group of parents of children aged 0-23 months attending the selected facilities will be sampled from the participating primary health care facilities, based on findings from the quantitative analyses to incorporate diversity in terms of socioeconomic status, race, and class. Each group will comprise of 6 to 10 mothers. Selected parents (or caregivers) will be homogenous in terms of place of residence which allows the views by class, socioeconomic status, and level of education. In each province, at least 3 focus group discussions will be conducted. If necessary, additional sessions will be held until data saturation is reached. For the in-depth interviews, we will purposively select 10 health facility staff, including vaccinators, clinical staff, and facility managers. Participants will be selected by taking into consideration roles, gender, and geographic location. Before participant recruitment, all necessary approvals from the regulatory and provincial health departments will be obtained. Participants will be recruited in the selected primary health care clusters with the assistance of the health care workers in those facilities. We will recruit parents (or caregivers) bringing their children for vaccinations to take part in the exit interviews. All participants will be asked to consent to participating by signing an informed consent form. Once participants enrolled in the study complete their exit interviews, appointments for the focus group discussions will be organized. Previous research in South Africa [25,26] has identified that the vast majority of missed opportunities for vaccinations are caused by health facility obstacles, and thus health care workers will also provide informed consent to participate in the study to understand service provider-perspective on missed opportunities for vaccination and collaboratively find interventions that are most suited for those settings. Face-to-face interviews will be conducted for both parents (or caregivers) and health care providers. For parents, quantitative data will be collected through face-to-face exit interviews using an interviewer-administered structured questionnaire. This questionnaire is an adaptation of a WHO tool for assessing missed opportunities for vaccination in health care settings [27]. The exit interview questionnaire that will be used in this study has 6 sections: (1) data on the child; (2) data on the child’s caregiver (or mother); (3) use of vaccination card and information on vaccination administered; (4) today’s vaccination; (5) quality of the vaccination service; (6) reasons for getting vaccinated. Exit interviews will be conducted by trained (male and female) staff, who are fluent in both English and the South African Language most spoken in the study area. They will administer the structured questionnaire using mobile tablets. Pilot testing of the questionnaire will be conducted in a separate local area to ensure clarity and suitability of the questions. Data will be collected using REDCap (Vanderbilt University) mobile app on mobile tablets. Data quality assurance will be done using key/value pairs. Data collected will be stored on a secured database. After quantitative data collection, the data file will then be exported from REDCap to STATA (version 14.1; StataCorp LLC) for analysis. For the qualitative data, we will use NVivo (version 1.0; QSR International) to assist with data management and analysis. All personal identifiers will be removed from the interview and discussion transcripts before analysis. All recordings will be deleted upon completion of the study. Semistructured interviews will allow for in-depth exploration of the contextual factors and mechanisms of missed opportunities for vaccination from the experiences and perspectives of health workers and facility managers in the selected primary health care facilities. All sessions will be conducted in private rooms within the selected health facilities, at a convenient time for the participants. The interview process will be open-ended and flexible, allowing participants the freedom to develop and deeply express their responses. A qualitative research design will be used to explore the reasons for missed opportunities for vaccination from the perspectives of parents (or caregivers) [28]. Focus group discussion will be conducted face-to-face in a private room within the health facilities, at a convenient time for the participants. Discussions will last approximately one hour each. Each participant will be allowed to contribute during discussion and will maintain a circular sitting arrangement. A semistructured question guide will be used during the discussion. Participants will be asked about their experiences, and perception regarding vaccination, vaccination services and missed opportunities for vaccination. This question guide will be piloted in a primary health facility in South Africa to ensure clarity and suitability of questions. For SADHS data, descriptive analysis will be used to describe the distribution of respondents by key variables. Multivariable logistic multilevel regression models will be used to analyze the association between individual compositional and contextual factors associated with missed opportunities for vaccination. We will specify a 3-level model for binary response reporting missed opportunity for vaccination or not, for a child (at level 1), in a neighborhood (at level 2), living in a province (at level 3). Models will be constructed as (1) an empty or unconditional model without any explanatory variables, specified to decompose the amount of variance that exists between province and neighborhood levels; (2) containing only individual-level factors; (3) containing only neighborhood-level factors; (4) containing only province-level factors; and (5) simultaneously controlled for individual-, neighborhood- and province-level factors (full model). For quantitative data from exit-interviews, missed opportunities for vaccination will be calculated using child’s date of birth and date at which the last vaccination doses were administered. This will then be compared to the standard due date to determine if a missed opportunity has occurred. Children who are fully immunized for age will be categorized as no missed opportunities for vaccination while those who are not fully immunized for age will be categorized as missed opportunities for vaccination. Explanatory variables will be grouped into 3 levels as follows: (1) child-related factors (age of child, sex of the child, birth order); (2) caregiver-related factors (relationship with a child, marital status, level of education, occupation, mode of transport to the health facility, duration of transport to the health facility, exposure to media); and (3) health facility–related factors (refusal to offer vaccination, checking of vaccination card, charged fee for vaccination, charged fees for vaccination card, location characteristics, type of health facility, number of health workers, number of vaccinators). The distribution of explanatory variables (child, parent, and facility-related factors) by the outcome (missed opportunity for vaccination) will be calculated. We will specify a 2-level model for binary response reporting missed opportunity for vaccination or not with child and parent (or caregiver) as level 1, both nested within primary health care facilities (as level 2). Models will be constructed as (1) an empty (null) model with no explanatory variable; (2) containing only individual-level (child and caregiver) factors; (3) containing only facility-level factors; and (4) simultaneously controlled for child and caregiver-related and facility-level factors (full model). The results of fixed effects (measures of association) will be reported as odds ratios with 95% credible intervals—95% CrIs. This Bayesian statistical inference approach provides probability distributions for measures of association, which can be summarized with 95% credible intervals, rather than 95% confidence intervals. A 95% credible interval can be interpreted as a 95% probability that the parameter takes a value in the specified range. The possible contextual effects will be measured by the intraclass correlation and median odds ratio [29,30]. We will measure the similarity between respondents in the same neighborhood and within the same province using intraclass correlation. The intraclass correlation represents the percentage of the total variance in the probability of missed opportunities for vaccination that is related to the neighborhood- and province-level (ie, measure of clustering of odds of missed opportunities for vaccination in the same neighborhood and province). The median odds ratio measures the second- or third-level (neighborhood or province) variance as odds ratios and estimates the probability of missed opportunities for vaccination that can be attributed to neighborhood and provincial context. A median odds ratio equal to one indicates no neighborhood or province variance. Conversely, the higher the median odds ratio, the more important the contextual effects are for understanding the probability of missed opportunities for vaccination. We will check for multicollinearity among explanatory variables by examining the variance inflation factor [31], all diagonal elements in the variance-covariance matrix for correlations between –1 and 1, and diagonal elements for any elements close to 0. MLwinN software (version 3.0; University of Bristol) will be used for the analyses [32]. Parameters will be estimated using the Markov chain Monte Carlo procedure [32]. The Bayesian deviance information criterion will be used as a measure of how well the different models fitted the data. A lower value on deviance information criterion indicates a better fit of the model [33]. Scatter plots of performance, as a percentage, against the number of missed opportunities for vaccination children (the denominator for the percentage) will be generated. The mean provincial performance and exact binomial 3-sigma limits will be calculated for all possible values for the number of cases and used to create a funnel plot using the method described by Spiegelhalter [34,35]. If a province lies with the 99% CI, it has a crude missed opportunities for vaccination rate that is statistically consistent with the average rate (common-cause variation). If a country lies outside the 99% CI, then it has a crude missed opportunities for vaccination rate that is statistically different from the average rate (special-cause variation). Focus group discussions will be recorded using a portable audiorecorder and transcribed verbatim. Transcription will be done by a professional; however, each transcript will be checked for accuracy by the principal investigator. For the in-depth interviews, the template analysis approach will be used for coding and organizing data segments for analysis [36]. This method allows for flexible thematic analysis as the codebook can be adapted to the context of the study [37]. Two codebooks will be developed. The first codebook will specify factors identified from the discussion. For this codebook, the themes will be identified inductively [38]. In the second codebook, domains of the theoretical domains framework will be specified [39]. This is a validated framework with 14 domains that is useful for identifying barriers in implementation research [39]. The themes identified in the first codebook will be deductively adapted to domains of the theoretical domains’ framework. The coder will identify causes of missed opportunities for vaccination from the interview transcripts, and then map each identified factor to a domain of theoretical domains framework. To avoid overlapping codes, only the most relevant code will be mapped to a particular domain. Coded data will be used for analysis. Analysis summaries for a combination of factors will be used to populate an analytic matrix. Illustrative quotations will be used in analytical summaries. We will conduct a mixed methods approach to integrate the quantitative data collected through the 2016 SADHS and structured questionnaires from exit interviews of caregivers, the qualitative data collected through the focus group discussions of parents (or caregivers) of children aged 0-23 month, and the qualitative data collected from the in-depth interviews of health care providers. Methodological integration considerations will be taken in the design, analysis, and reporting stages of the study. We will adopt the convergent design to better understand the complexity of missed opportunities for vaccination from the perspectives of caregivers and health care providers. The convergent design will compare both quantitative and qualitative data analyzed at the same time followed by an integrative analysis [40]. From the thematic analysis of the qualitative data, themes will be compared with the corresponding variable from questionnaires, and the results will be displayed as qualitative summaries and quotations for each domain-participant combination, thus allowing a full understanding of the complexity surrounding missed opportunities for vaccination from the health care service user [40,41]. Ethical approval will be obtained from the South African Medical Research Council. We will also obtain permission from the appropriate authority of the South African Department of Health. The study process will comply with the requirements of the latest version of the Declaration of Helsinki (7th revision, 2013). Verbal and written information about the study will be provided to all participants taking part in interviews and focus group discussions. For the qualitative data, with permission of participants, all interviews and focus groups will be digitally recorded and subsequently transcribed verbatim. All digital recordings will be erased following transcription, and all identifying information will be removed from transcripts. Participant confidentiality and anonymity will thus be ensured. The consent form will make explicit the following aspects: the voluntary nature of participation, that there will be no negative consequences if they decide not to participate, that they will explicitly be asked for permission for the interview to be digitally recorded, and that this is also voluntary. Written consent will be obtained from all research participants before proceeding with interviews or focus groups. Details from interviews and focus group discussions will be entered into a study-specific database on the day of collection (stakeholder group, participant ID, etc). Study data, including audio recordings, will be stored on password-protected computers and shared with the study team only. All digital recordings on recorders will be destroyed following safe storage and transcription, and identifying information will be removed from all transcripts. Reports of the findings will not identify individual participants. Participant anonymity and confidentiality will thus be ensured. No risks to participants or researchers are expected. All potential participants for interviews or focus groups are not considered to be vulnerable individuals or groups. However, participants may be uncomfortable expressing criticisms of vaccination programs. Where there is this potential, and where participants identify concerns, we will reassure participants of the steps that will be taken to ensure confidentiality. For participants in focus groups, we will remind participants at the outset that while the researchers undertake to maintain confidentiality, we cannot guarantee that other focus group participants will. At the start of the focus group, we will discuss the importance of everyone involved maintaining confidentiality after the focus group but will explain that there is an inherent risk of breaches of confidentiality in this method. We will ensure that participants are aware of this risk.

N/A

Based on the provided information, here are some potential recommendations for innovations to improve access to maternal health:

1. Mobile Health (mHealth) Solutions: Develop mobile applications or SMS-based systems to provide information and reminders about maternal health services, including vaccination schedules, to pregnant women and new mothers. These tools can help increase awareness and adherence to vaccination programs.

2. Telemedicine: Implement telemedicine services to provide remote consultations and support for pregnant women and new mothers. This can help overcome geographical barriers and improve access to healthcare professionals, especially in rural areas.

3. Community Health Workers: Train and deploy community health workers to provide education, counseling, and support to pregnant women and new mothers in their communities. These workers can help increase awareness about the importance of vaccinations and provide guidance on accessing healthcare services.

4. Transportation Support: Establish transportation services or subsidies to help pregnant women and new mothers travel to healthcare facilities for vaccinations and other maternal health services. Lack of transportation is a common barrier to accessing healthcare, especially in remote areas.

5. Health Facility Improvements: Invest in improving the infrastructure and resources of healthcare facilities, particularly in districts with low vaccination coverage. This can include ensuring adequate vaccine supply, trained staff, and efficient service delivery processes.

6. Public Awareness Campaigns: Launch targeted public awareness campaigns to educate the general population about the importance of maternal health and vaccinations. These campaigns can address misconceptions, promote positive attitudes towards vaccinations, and encourage community support.

7. Data-driven Decision Making: Use data from surveys, like the South African Demographic and Health Survey, to identify districts or communities with low vaccination coverage and prioritize interventions accordingly. Data analysis can help identify specific factors contributing to missed opportunities for vaccination and inform targeted interventions.

8. Collaboration and Partnerships: Foster collaboration between government agencies, healthcare providers, non-governmental organizations, and community stakeholders to collectively address barriers to maternal health access. Partnerships can leverage resources, expertise, and community engagement to implement effective interventions.

It is important to note that the specific context and needs of South Africa should be considered when implementing these recommendations.
AI Innovations Description
The recommendation to improve access to maternal health based on the provided description is to conduct a country-level assessment of missed opportunities for vaccination in South Africa. This assessment aims to understand the magnitude and determinants of missed opportunities for vaccination in the country. The study will use the 2016 South African Demographic and Health Survey (SADHS) data to conduct multilevel regression analyses and explore the perspectives of parents and healthcare providers through exit interviews and focus group discussions.

The findings of this assessment will provide insights into the factors contributing to suboptimal vaccination coverage in certain districts of South Africa. This information can then be used to design tailor-made interventions to improve vaccination coverage in those areas. By addressing missed opportunities for vaccination, access to maternal health can be improved, leading to better health outcomes for mothers and their children.

It is important to note that this recommendation focuses specifically on vaccination coverage and its impact on maternal health. Other factors related to maternal health, such as prenatal care, postnatal care, and access to healthcare facilities, may also need to be addressed to comprehensively improve maternal health outcomes.
AI Innovations Methodology
The study described in the provided text aims to understand the magnitude and determinants of missed opportunities for vaccination in South Africa. The methodology involves using the 2016 South African Demographic and Health Survey (SADHS) data to conduct multilevel regression analyses. The study will also include exit interviews and focus group discussions with parents and health care providers to gather their perspectives on vaccination coverage and missed opportunities.

To simulate the impact of recommendations on improving access to maternal health, a methodology could include the following steps:

1. Identify potential recommendations: Review existing literature, consult experts, and analyze data to identify potential recommendations that could improve access to maternal health. These recommendations could include interventions such as improving health facility infrastructure, increasing the availability of skilled health care providers, implementing community-based outreach programs, or enhancing health education and awareness campaigns.

2. Define indicators: Determine the indicators that will be used to measure the impact of the recommendations on improving access to maternal health. These indicators could include metrics such as the percentage of pregnant women receiving antenatal care, the percentage of births attended by skilled health personnel, or the maternal mortality ratio.

3. Collect baseline data: Gather baseline data on the current status of maternal health access in the target population. This could involve conducting surveys, analyzing existing data sources, or using other research methods to collect relevant data.

4. Develop a simulation model: Create a simulation model that incorporates the potential recommendations and their expected impact on the selected indicators. The model should consider factors such as population demographics, health system capacity, and resource availability.

5. Input data and run simulations: Input the baseline data into the simulation model and run multiple simulations to assess the impact of different combinations of recommendations on improving access to maternal health. The simulations should consider various scenarios and assumptions to provide a comprehensive analysis.

6. Analyze results: Analyze the results of the simulations to determine the potential impact of the recommendations on improving access to maternal health. Assess the effectiveness of different interventions and identify the most promising strategies for implementation.

7. Refine recommendations: Based on the simulation results, refine the recommendations to optimize their impact on improving access to maternal health. Consider factors such as feasibility, cost-effectiveness, and sustainability when refining the recommendations.

8. Implement and monitor: Implement the refined recommendations and closely monitor their implementation and impact. Continuously collect data and evaluate the progress to ensure that the desired improvements in access to maternal health are being achieved.

By following this methodology, policymakers and stakeholders can make informed decisions about implementing interventions that have the potential to improve access to maternal health. The simulation model allows for the assessment of different scenarios and helps identify the most effective strategies for achieving the desired outcomes.

Share this:
Facebook
Twitter
LinkedIn
WhatsApp
Email