Article Text

Quasi-experimental evaluation of a financial incentive for first-dose COVID-19 vaccination among adults aged ≥60 years in South Africa
  1. Candice Maylene Chetty-Makkan1,
  2. Harsha Thirumurthy2,
  3. Elizabeth F Bair2,
  4. Simamkele Bokolo1,
  5. Candy Day3,
  6. Korstiaan Wapenaar4,
  7. Jesse Werner4,
  8. Lawrence Long1,5,
  9. Brendan Maughan-Brown6,7,
  10. Jacqui Miot1,
  11. Sophie J S Pascoe1,
  12. Alison M Buttenheim8
  1. 1Research, Health Economics and Epidemiology Research Office, Faculty of Health Sciences, University of Witwatersrand, Johannesburg, South Africa
  2. 2Department of Medical Ethics and Health Policy, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
  3. 3DG Murray Trust, Cape Town, South Africa
  4. 4Genesis Analytics, Johannesburg, South Africa
  5. 5Department of Global Health, Boston University School of Public Health, Boston, Massachusetts, USA
  6. 6Southern Africa Labour and Development Research Unit, University of Cape Town, Cape Town, South Africa
  7. 7University of Cape Town, Rondebosch, South Africa
  8. 8Family and Community Health, University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania, USA
  1. Correspondence to Dr Candice Maylene Chetty-Makkan; cchetty{at}heroza.org

Abstract

Introduction COVID-19 vaccination coverage in South Africa (RSA) remains low despite increased access to vaccines. On 1 November 2021, RSA introduced the Vooma Voucher programme which provided a small guaranteed financial incentive, a Vooma Voucher redeemable at grocery stores, for COVID-19 vaccination among older adults, a population most vulnerable to serious illness, hospitalisation and death. However, the association of financial incentives with vaccination coverage remains unclear.

Methods We evaluated the association of the conditional economic incentive programme with first-dose vaccination rates among adults (aged ≥60 years) through a quasi-experimental cohort study. The Vooma Voucher programme was a nationwide vaccination incentive programme implemented for adults aged ≥60 years from 1 November 2021 to 28 February 2022. We ran ITS models to evaluate the Vooma Voucher programme at national and provincial levels. We used data between 1 October 2021 and 27 November 2021 in models estimated at the daily level. Individuals who received their first vaccine dose received a text message to access a ZAR100 ($~7) voucher that was redeemable at grocery stores.

Results The Vooma Voucher programme was associated with a 7.15%–12.01% increase in daily first-dose vaccinations in November 2021 compared with late October 2021. Overall, the incentive accounted for 6476–10 874 additional first vaccine doses from 1 November to 27 November 2021, or 8.31%–13.95% of all doses administered to those aged ≥60 years during that period. This result is robust to the inclusion of controls for the number of active vaccine delivery sites and for the nationwide Vooma vaccination weekend initiative (12 November to 14 November), both of which also increased vaccinations through expanded access to vaccines and demand creation activities.

Conclusions Financial incentives for COVID-19 vaccination led to a modest increase in first-dose vaccinations among older adults in RSA. Financial incentives and expanded access to vaccines may result in higher vaccination coverage.

Trial registration number (SANCTR) DOH-27-012022-9116.

  • COVID-19
  • Health policy
  • Public Health
  • Vaccines

Data availability statement

Data are available upon reasonable request.

https://creativecommons.org/licenses/by/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

WHAT IS ALREADY KNOWN ABOUT THIS TOPIC

  • There is a lack of evidence on whether financial incentives for COVID-19 vaccinations are effective in low-income and middle-income countries.

WHAT DOES THIS STUDY ADD

  • We found that a ZAR100 (~US$7) incentive for adults aged ≥60 years increased additional first vaccine doses between 1 November and 27 November 2021 to those aged ≥60 years during that period.

HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY

  • Small guaranteed financial incentives may be an effective strategy to increase vaccine demand among older adults in low-income and middle-income countries.

Introduction

COVID-19 infections in sub-Saharan Africa were high when compared with many other countries due to the highly transmissible Delta variant.1 2 South Africa recorded its first COVID-19 case on 5 March 2020 and enforced a strict lockdown and other mitigation measures.3 These restrictions, while effective, were insufficient to prevent multiple waves of COVID-19 infections4 with significant morbidity and mortality.1

South Africa had one of the earliest and most robust vaccination programmes on the continent. The South African National Department of Health (NDoH) ensured equitable access to free COVID-19 vaccination services5 6 through a network of vaccination sites and stimulated demand through mass media campaigns. In South Africa, COVID-19 vaccines were widely available for individuals aged ≥60 years by May 2021.1 2 Despite robust efforts to promote vaccines and ensure easy access, by October 2021, only 63% of older adults had received at least one vaccine dose, well below the NDoH targets to protect vulnerable populations.2

As in other countries, there was substantial interest for financial incentives to increase vaccine uptake. Financial incentives increase the immediate benefits of vaccination and can mitigate perceived costs of and barriers to vaccination, including hesitancy related to vaccine safety and hassle factors associated with accessing vaccination services.7 Evidence on the effectiveness of incentives for COVID-19 vaccination comes almost exclusively from high-income countries and is mixed8–15: some studies found that guaranteed rewards can increase vaccination,8 9 while others showed no effect of guaranteed or lottery incentives,10 16 17 or indicated that incentives may backfire by decreasing vaccination intentions.11 Low and middle-income countries (LMICs) have faced a substantial burden of COVID-19, but there is lack of evidence on whether incentives for COVID-19 are effective in LMICs.

In South Africa, like other African regions, low levels of education among the elderly and limited competence with digital technologies were barriers to accessing COVID-19 vaccination services.3 Around 73% of people over the age of 60 live off South Africa’s old age pension grant that is approximately ZAR 1980 (~$139) per month.3 4 In order to increase inclusion of the elderly into the national-level COVID-19 response plan, the Vooma Voucher programme was one opportunity to mitigate the financial constraints experienced by the elderly to access vaccination services, findings of which can be generalised to other LMICs.

To increase vaccination among older adults in advance of an anticipated COVID-19 fourth wave, the NDoH Vooma Voucher programme was launched on 1 November 2021 to reach the vulnerable and impoverished. The voucher programme was promoted through multiple communication channels (online supplemental efigures) and continued until 28 February 2022, with some changes in eligibility and voucher amounts (online supplemental eMethods). These approaches included use of the Electronic Vaccination Data System to send invites to any individual who was eligible to receive the vaccine. There were also social media posts on NDoH channels (WhatsApp groups, Facebook, Instagram and Twitter, the RSA coronavirus website, FAQ Knowledge base (which is a helpdesk system linked to the RSA coronavirus website), other media (press briefings, media statements by the Minister of Health) and radio public service announcements. In addition, awareness of the Vooma Voucher programme took place through the network of district communicators, Short message service (SMSs) via the Government Communication and Information System and secondary promotion through general media stories.2 These communication platforms were extensive and vast when compared with other settings where targeted recruitment methods were used.12 17

Supplemental material

The Vooma Voucher programme was initially available to adults aged ≥60 years. Individuals who received their first vaccine dose received a ZAR100 (~$7) voucher by text message that was redeemable at local grocery stores. For many individuals ≥60 years, their monthly income will come from the Old Age Pension.4 For those individuals receiving the old age pension (ie, individuals at the bottom of the income distribution in this age range), the voucher value was equivalent to approximately 1.5 days of income. The purpose of the voucher was to compensate a person for the travel and costs that might be incurred by going for vaccination. The voucher value was intended to reduce financial barriers to vaccination while not being so high as to increase the risk of undue influence. Relative to local income levels, the incentive amount in South Africa was higher than the amounts offered in several studies in the USA and Europe.17

We assessed the short-term association of the Vooma Voucher incentive programme on first-dose vaccination rates among those aged ≥60 years.

Methods

The South African population is 60.1 million comprising 81% black South Africans, with Gauteng and KwaZulu-Natal provinces accounting for 45.4% of the population. In the Gauteng and KwaZulu-Natal provinces, the proportion of those ≥60 years is 8.5% and 8.2%, respectively. Gauteng also has the highest net inflow of migrants.18 During the COVID-19 pandemic waves, the crude death rate within a year increased from 8.7 deaths per 1000 in 2020 to 11.6 deaths per 1000 people in 2021. According to the Medical Research Council weekly reports, there were more than 180 000 excess deaths in South Africa since March 2020.18

We used national data on the number of first doses of the COVID-19 vaccine that were administered daily. The analysis was based on data provided by the NDoH for purposes of evaluating the incentive programme. Using population data from the South African Community Survey 2016,19 we calculated the number of first COVID-19 vaccine doses administered daily per 10 000 individuals aged ≥60 years. The Vooma Voucher programme was extended to those ≥50 years on 18 November 2021 and the voucher amount was increased to ZAR200 (US$14) on 1 December 2021. We did not include those 50–59 years in the analysis, as we only had data for 10 days on these individuals. A sensitivity analysis with weekly doses is in online supplemental eMethods. First dose vaccination rates were calculated separately at the national and province levels.

Patient and public involvement

For this analysis, deidentified, aggregate routine data from the NDoH COVID-19 Vaccination programme were used. Results from this analysis will be disseminated through policy briefs, social media platforms and published reports.

Data analysis

In the absence of a randomised control trial, we selected the most rigorous study design in the form of a quasi-experimental method for this evaluation. Assumptions for the difference-in-differences approach were violated; therefore, we did not use this model. Instead, we estimated four separate interrupted time series (ITS) models to estimate the association between the Vooma Voucher programmes and trends in vaccination rates: unadjusted and adjusted national models as well as unadjusted and adjusted provincial models. The primary outcome was the daily vaccination rate per 10 000 individuals aged ≥60 years in South Africa. National models used linear regression with Newey-West SEs, while provincial models used generalised estimating equations with robust SEs to account for province-level clustering of observations across time. Daily models included day of the week indicators to control for temporal patterns within each week and week-specific fixed effects. Unadjusted models included no additional covariates; adjusted models included additional measures of vaccine supply (daily active vaccine delivery sites per 100 000 individuals and an indicator variable for the 3 days of the Vooma Vaccination Weekend). The Vooma Vaccination Weekend was a nationwide initiative to open more vaccination sites to boost demand.2

Province-level adjusted models included an indicator for KwaZulu-Natal and Gauteng provinces as well as an interaction term to assess the impact of the voucher programme in these provinces versus the rest of the country. Gauteng (15.8M) and KwaZulu-Natal (11.5M) are South Africa’s two most populous provinces accounting for almost half (45.4%) of the country’s population.18 The vaccination coverage in these provinces was low and remains low, and addressing this gap was critical to the COVID-19 response. The first dose vaccination coverage in the Gauteng (5.79 per 10 000) and KwaZulu-Natal (4.81 per 10 000) provinces were also much lower than the rest of the country (7.41 per 10 000) in the week before the introduction of the Vooma Voucher. Due to the population size and low vaccination rates in these areas, we selected these provinces for comparison to the rest of the country.

Our analysis included data from 1 October 2021 to 27 November 2021. Although the Vooma Voucher programme continued until 28 February 2022, the announcement of the Omicron variant on 24 November 2022 would likely confound the effect of the incentive programme on days that followed the announcement. Analyses were conducted using Stata V.17.0 (StataCorp, College Station, Texas). This study was approved by the University of Witwatersrand Human Research Ethics Committee (Medical) (211123).

Results

In the weeks preceding introduction of the Vooma Voucher programme, the 7-day rolling average of daily first vaccine doses administered declined from 13 to 15 doses per 10 000 individuals aged ≥60 years in early-September to <10 doses by late-October 2021 (figure 1). For the first 27 days, the Vooma Voucher programme was associated with an increase in daily first vaccine doses administered of 0.89 per 10 000 individuals (95% CI 0.52 to 1.27; p<0.001) (table 1); that equated to 10 874 additional doses compared with the number of first doses expected to be administered in the absence of the Vooma Voucher programme. Adjusting for vaccine delivery sites and for the Vooma Vaccination Weekend reduced the increase associated with the Vooma Voucher programme (+0.65 daily first doses per 10 000 individuals; 95% CI 0.33 to 0.96; p<0.001, 7942 additional doses). Taken together, these results suggest that 8.31%–13.95% of the 77 947 first doses administered to individuals aged ≥60 years between 1 November and 27 November 2021 may be attributed to the Vooma Voucher programme (figure 2). Using the last week of October 2021 as a reference, the percentage increase in vaccinations is estimated at 7.15% to 12.01% per 10 000 individuals per day.

Figure 1

Daily first dose vaccinations per 10 000 adults aged ≥60 years in South Africa, 1 August 2021–27 November 2021, with launch of the Vooma Voucher programme shown on 1 November 2021. The pre-intervention period is marked by the grey box. The Vooma vaccination weekend, 12–14 November 2021, is marked by the light blue box.

Table 1

Results from interrupted time-series analyses estimating the association of the Vooma voucher programme with changes in the number of first vaccine doses delivered per day per 10 000 adults ≥60 years in South Africa

Figure 2

Percentage of all 77 947 first doses administered to individuals aged ≥60 years between 1 November and 27 November 2021, attributed to the Vooma voucher programme.

Provincial models showed directionally similar results (unadjusted: +0.80 daily first doses per 10 000 individuals; 95% CI 0.43 to 1.18; p<0.001, 9790 additional doses; adjusted: +0.53 daily first doses per 10 000 individuals; 95% CI 0.17 to 0.89; p=0.004, 6476 additional doses), (table 1 and figure 3). The Vooma Voucher programme was more effective in Gauteng and KwaZulu-Natal relative to other provinces (unadjusted: +1.96 daily first doses per 10 000 individuals; 95% CI 1.01 to 2.91; p<0.001; adjusted +1.39 daily first doses per 10 000 individuals; 95% CI 0.34 to 2.45; p=0.010). Weekly models and implications of supply and demand creation adjustments are found in online supplemental etable 1.

Figure 3

Daily first dose vaccination rate per 10 000 population comparing Gauteng and KwaZulu natal provinces to other provinces.

Discussion

A nationwide financial incentive programme that provided vouchers redeemable at grocery stores to older adults who received a first dose of a COVID-19 vaccine was associated with increased vaccinations in South Africa. In the first month of the programme, before vaccine demand may have been influenced by the announcement of the Omicron variant, 8.31% to 13.95% of all first vaccine doses administered to older adults could be attributed to the programme. This represents a meaningful increase in vaccinations in response to a ZAR100 (~US$7) incentive.

This study is among the first to evaluate financial incentives for COVID-19 vaccination in LMICs. Evaluations of such incentives have primarily been conducted in high-income countries.8–10 16 17 An incentive of US$24 increased vaccination rates by 4% in a randomised trial in Sweden.8 Moreover, several studies found that lotteries and guaranteed incentives offered by US states did not increase vaccination rates.17 However, the findings from this evaluation show that providing small financial incentives to the elderly in resource limited settings can be one tool that boosts vaccine uptake. These findings contribute to the limited body of literature on financial incentives and COVID-19 vaccine uptake and provide the groundwork for further analyses that could inform policy changes.

Our results also show that the Vooma Voucher programme was able to increase first dose vaccine uptake in specific provinces such as Gauteng and KwaZulu-Natal relative to other provinces. Due to the high population and high mobility of individuals within Gauteng and KwaZulu-Natal, it is possible that there was a higher uptake of the Vooma Vouchers when compared with other provinces. Although there was some mistrust in the community during the roll-out of the COVID-19 vaccine programme, it is plausible that endorsement of the Vooma Voucher programme20 by key figures and Vooma Vaccination Weekends through various platforms were associated with higher vaccination rates.

The Vooma Voucher may have had better results due to substantial advertisement of the programme and the amount of the incentive relative to income level of the target population in South Africa. From our evaluation, it is helpful to know that the Vooma Voucher of ZAR100 ($7) is one potentially effective tool in the toolkit; however, we will need all costs for the programme in order to be able to draw any conclusions regarding the feasibility and scalability of this programme. Given the available data, we are only able to speak directly to its effectiveness.

A key limitation is the assumption in our ITS models that there were no other factors that coincided with the introduction of the Vooma Voucher programme and affected vaccine demand. The robustness of our findings to the inclusion of supply and demand creation measures, and to provincial and weekly specifications, increases confidence in our findings. Another limitation is that we only study short-term effects of the incentive programme, as the announcement of the Omicron variant made it challenging to study effects of incentives beyond that date using ITS analysis. We also did not control for infection rate due to the low testing rate in this context. According to the updated prioritised COVID-19 testing guidance, hospitalised patients, persons with symptoms of COVID-19 infection and individuals who were in close contact with confirmed cases including asymptomatic contacts were eligible for testing.21 This limited testing showed that the general population did not have access to widespread testing. There were also constraints on testing during the waves. Therefore, it is not clear that infection rate was a major driver of population-level behaviour.

Given the vulnerability of older adults to serious illness, hospitalisation, and death as a result of COVID-19, identifying effective strategies to increase vaccine demand is crucial. More generally, as LMICs struggle to achieve sufficiently high vaccine demand despite expansions in vaccine delivery and access, our findings suggest that small financial incentives may be effective in increasing vaccination coverage.

Data availability statement

Data are available upon reasonable request.

Ethics statements

Patient consent for publication

Ethics approval

This study involves human participants and was approved by University of Witwatersrand Human Research Ethics Committee (Medical) Reference number: 211123. We used national data on the number of first doses of the COVID-19 vaccine that were administered daily. The analysis was based on data provided by the NDoH for purposes of evaluating the incentive programme. We did not include any identifiable individual data.

Acknowledgments

We would like to thank Dr Zameer Brey, from the Bill and Melinda Gates Foundation, and Mr Gaurang Tanna, formerly from the National Department of Health, for their technical support and guidance in this study. We would also like to thank the National Department of Health COVID-19 Vaccination Management Team for access to data.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Handling editor Valery Ridde

  • Twitter @CandiceC_M, @abuttenheim

  • Contributors CMC-M, HT, EFB, SB, CD, KW, JW and AMB had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Concept and design: CMC-M, HT, EFB, SB and SB. Drafting of the manuscript: CMC-M, HT, EFB, SB and SB. Critical revision of the manuscript for important intellectual content: HT, LL, BM-B, JM, SJSP, SB. Statistical analysis: HT, EFB and SB. Obtained funding: CMC-M, BM-B, SJSP, JM and AMB. Administrative, technical or material support: CMC-M, EFB, SB, CD, KW, JW, AMB. Supervision: HT and AMB. CMC-M will be responsible for the overall content as the guarantor.

  • Funding The work was supported in whole or in part, by the Bill and Melinda Gates Foundation (INV 036204). Under the grant conditions of the foundation, a Creative Commons Attribution 4.0 Generic License has already been assigned to the Author Accepted manuscript version that might arise from this submission.

  • Competing interests JM is a member of the National Ministerial Advisory Committee on COVID-19 in South Africa. All other authors have declared no conflict of interest.

  • Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.