Background Vaccine hesitancy (VH) and the global decline of vaccine coverage are a major global health threat, and novel approaches for increasing vaccine confidence and uptake are urgently needed. ‘Nudging’, defined as altering the environmental context in which a decision is made or a certain behaviour is enacted, has shown promising results in several health promotion strategies. We present a comprehensive synthesis of evidence regarding the value and impact of nudges to address VH.
Methods We conducted a systematic review to determine if nudging can mitigate VH and improve vaccine uptake. Our search strategy used Medical Subject Headings (MeSH) and non-MeSH terms to identify articles related to nudging and vaccination in nine research databases. 15 177 titles were extracted and assessed following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The final list of included articles was evaluated using the Mixed Methods Appraisal Tool and the Grading of Recommendations, Assessment, Development and Evaluations framework.
Findings Identified interventions are presented according to a framework for behaviour change, MINDSPACE. Articles (n=48) from 10 primarily high-income countries were included in the review. Nudging-based interventions identified include using reminders and recall, changing the way information is framed and delivered to an intended audience, changing the messenger delivering information, invoking social norms and emotional affect (eg, through storytelling, dramatic narratives and graphical presentations), and offering incentives or changing defaults. The most promising evidence exists for nudges that offer incentives to parents and healthcare workers, that make information more salient or that use trusted messengers to deliver information. The effectiveness of nudging interventions and the direction of the effect varies substantially by context. Evidence for some approaches is mixed, highlighting a need for further research, including how successful interventions can be adapted across settings.
Conclusion Nudging-based interventions show potential to increase vaccine confidence and uptake, but further evidence is needed for the development of clear recommendations. The ongoing COVID-19 pandemic increases the urgency of undertaking nudging-focused research.
PROSPERO registration number CRD42020185817.
Key questions
What is already known?
Nudging interventions addressing vaccine hesitancy primarily stem from high-income countries. Little information is available from low- and middle-income countries, many of which are currently facing declining public confidence in vaccines and pointed interest in potential interventions.
What are the new findings?
Nudges that entail changing vaccine defaults (opt-out), giving incentives, and providing reminders and recalls (directly generated from the central data or delivered by trusted health authorities via text messages, emails or personalised letter) have proven efficacious in some settings, are considered viable options when communicating vaccination schedules, and could bolster intention to vaccinate.
What do the new findings imply?
An in-depth understanding of the complexity of the target population is highly recommended to ensure the acceptability and effectiveness of nudging interventions.
In light of the COVID-19 pandemic and public discourse around risks and chances of novel vaccines, exploring new pathways for interventions, including nudges, that foster vaccine trust and confidence is required. This review provides a comprehensive starting point for such research.
Introduction
Vaccines have a tremendous impact on disease control and are one of the world’s leading public health achievements, responsible for the eradication of smallpox, the prevention of lifelong disabilities, and major reductions in childhood morbidity and mortality.1 2 Vaccination is also a key element for controlling the ongoing COVID-19 pandemic.3 However, a growing body of literature highlights that vaccination coverage for an array of vaccine-preventable illnesses, is stagnating or declining globally.4 Furthermore, studies that examine routine vaccination for adults (influenza vaccine) and vaccines administered later in life (human papillomavirus (HPV), pneumococcal, and herpes zoster vaccines) also indicate challenges with uptake.5–7
Vaccines have become a source of anxiety among many families and individuals globally due to scientifically unfounded fears that they can cause autism and other health problems, and other concerns about vaccine safety.8 9 Vaccine hesitancy (VH), defined as ‘the reluctance or refusal to vaccinate despite vaccine availability,’ has gained recognition globally as a top threat to global health, as it risks undermining successful and cost-effective vaccination programmes worldwide.10 Contrary to common portrayal, vaccination attitudes are more nuanced than the duality of provaccination and antivaccination attitudes,11 and antecedents of VH range from a lack of knowledge and awareness, to culturally rooted misgivings, to concerns regarding vaccines’ short-term or long-term side effects.4 VH scholars and stakeholders are increasingly acknowledging this spectrum and noting that successful strategies require an appreciation of the VH continuum, ranging from complete acceptance to active refusal.12–14 Mistrust in vaccines, including concerns regarding safety and effectiveness, has spread on several social media platforms (eg, Facebook and Twitter) thereby amplifying the antivaccination movement.15 16
The degree of decline in vaccination varies between and within countries, but its potential to overrun health systems due to outbreaks of vaccine-preventable diseases is most acute in low- and middle-income countries (LMICs),17 which has led to numerous calls to identify approaches that increase or maintain vaccine coverage at levels that ensure population immunity.18
Several health promotion approaches have been proposed and tested to address VH, including video-based vaccine promotion and educational messages in the form of anecdotes, storybooks, and mobile applications.9 19–22 A majority of these interventions were focused on changing attitudes and behaviours pertaining to vaccine misinformation and/or safety concerns.23 While some of these interventions show promising results in increasing vaccine confidence and uptake, a systematic review conducted in 201318 highlighted that studies were often underpowered and mostly provided observational or indirect evidence for intervention effects. Similarly, a more recent discussion paper24 noted that many interventions that aim to change an individual’s perceptions of and feelings toward vaccination demonstrate limited effectiveness.
In contrast to changing attitudes, another stream of health intervention research emphasises ‘nudging’ or changing the environmental context in which a decision is made or behaviour is enacted.25 Using nudging, a person’s behaviour can be predictably modified towards a desired end-point.25 Examples of nudges include the rearrangement of food on supermarket shelves to place healthy options at eye level (increasing healthy nutrition), displaying arrows leading to sinks in public restrooms (increasing handwashing), or pasting stickers in the centre of men’s urinals (decreasing urinal spillage due to men aiming at the stickers).26–28 Evidence suggests that instead of allocating considerable cognitive resources to make a ‘rational’ or ‘smart’ decision, people tend to choose what is easily accessible.28 29 In this vein, nudging has been shown to be effective in the context of various health promotion strategies such as increasing healthy food choices and dietary change,30 31 self-management of chronic diseases,32 and improving HIV and malaria testing.33 34
To date, a systematic evaluation of nudging’s efficacy, feasibility, and acceptability in terms of how it affects vaccine knowledge and awareness, intentions and behaviours is lacking. To address this gap, we conducted a systematic review mapping existing evidence regarding nudges’ acceptability, feasibility, and effectiveness in increasing knowledge, intentions, and behaviours (including uptake) related to vaccines. This review aims to contribute to the literature on nudging interventions in this field, to inform policy discussions, and to provide insights around whether and to what degree nudging can affect vaccination decision making.
Methods
Design
We employed a systematic literature review methodology35 in accordance with the principles of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses.36
Protocol registration
We searched the International Prospective Register of Systematic Reviews (PROSPERO) and Cochrane database for protocols matching this study’s title, aim, and objectives, or for any previously published primary research and reviews on the subject matter. Both databases had no ongoing or published systematic review about nudging in promoting childhood and adolescent vaccine uptake. We registered a protocol for this review on PROSPERO (registration ID: CRD42020185817).
Search strategies
The two lead authors (MDCR and JL, the latter a biomedical librarian by training) discussed the key words and core concepts. Further, to avoid missing studies that did not directly draw on nudging literature but whose interventions aligned with the selection criteria, we included Medical Subject Headings (MeSH): ‘behavioral control’, ‘decision making’, ‘vaccination’, and ‘vaccines’, as well as the following non-MeSH terms: ‘behavioral intervention’, ‘behavioral strategy’, ‘nudge’ and ‘nudging’, using Boolean operators ‘AND’, ‘OR’ and ‘NOT’ to combine keywords for the final search strings (online supplemental table 1). We excluded the MeSH term ‘immunization’, defined as the ‘deliberate stimulation of the host’s immune response’,37 because our emphasis was on behaviour rather than the biological processes by which a body acquires immunity.
The two lead authors pilot tested the final search strings in two research databases (PubMed and Science Direct) to identify potential problems. We searched nine platforms on both commercial and non-commercial databases to ensure that we captured academic and grey literature (online supplemental table 1). JL independently ran the finalised search strings in the selected research databases (figure 1). MDCR then reran the final search strings in five of the research databases for validation purposes. There were no discrepancies or disagreements noted.
MDCR and JL conducted data extraction and validation of included studies. Results from all search strings were initially tabulated per database, including duplicates between strings and between databases. All relevant papers collected were stored in a citation manager (EndNote, V.20) and Microsoft Excel (Microsoft corporation, V.2019).
Titles and abstracts of papers were screened by MDCR and JL based on predefined eligibility criteria (table 1). Initially, we prioritised the inclusion of randomised controlled trials (RCTs), but as the screening identified an inadequate number of RCTs, non-randomised trials (including those in which baseline data were collected before exposure), quantitative descriptive studies, qualitative studies and mixed-methods studies were also considered for inclusion. Full texts of articles were screened in cases where titles and abstracts were not sufficient to clearly indicate exclusion. As part of full-text screening, several articles were found focusing on nudging approaches for adult vaccination. In light of the global urgency regarding the COVID-19 vaccine roll-out, we broadened the scope beyond childhood vaccination. MDCR and JL reran the full-text screening to ensure that all relevant articles were included. This change in review scope was also included in the PROSPERO registration.
Table 1
|
Inclusion and exclusion criteria
We excluded systematic review articles that were captured during the full-text screening, but we manually screened all references listed in these systematic reviews to ensure that no relevant articles were missed during the initial search. In cases of discrepancies, JW served as a third reviewer and articles were discussed until consensus was reached.
Quality appraisal
The final set of included studies underwent independent quality assessment by MDCR and JL. The assessment was carried out on study level, focusing on study designs and whether study aims and objectives were achieved, adequately reported and synthesised. The Mixed Methods Appraisal Tool (MMAT) V.2018 facilitated the process.38 Scores were assigned to each paper per design category and detailed score sheets were saved in Microsoft Excel (online supplemental tables 2–6). Additionally, we used the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) guidelines to assess all certainty of outcomes (ie, consistency, precision, directness and magnitude of the observed effect) of all included RCTs on a high, moderate, low or very low scale.39 40
Collating and summarising
Data collected from the included studies were synthesised and summarised. Relevant data were extracted using a predesigned and piloted evidence summary tool, with categories based on the aims and objectives of the study and additional information on themes emerging during analysis. JL and MDCR piloted the extraction form using five randomly selected studies from all study design groups within the final list of included studies; this process found consistency across the results.
Data analysis
We prepared descriptive summaries, followed by presentation of results in a tabulated format (eg, including study design, publication details and outcome measures). We followed the MINDSPACE framework41 as well as more recent MINDSPACE modifications42 43 to structure and categorise the type of nudging approach across the studies.
We performed a mixed integrative and interpretative synthesis of the findings from included studies, structured around the type of nudging employed, ways the intervention was implemented and any measure of impact of the intervention.35 We present an in-depth descriptive analysis of the selected studies with an aim to highlight nudges that promote vaccine uptake.
Results
We performed all searches from 15 May 2020 to 31 May 2021 and identified 15 177 articles (figure 1). After removing 1093 duplicates, the titles and abstracts of 14 084 articles were screened, of which 272 were included for full-text screening, leading to the exclusion of another 230 articles. We identified six additional relevant studies as part of our manual screening of all references listed in six relevant systematic reviews. A total of 48 peer-reviewed articles were included in the final analysis.
Study characteristics
Key characteristics of the 48 included studies such as study population, sample size and outcome measures are detailed in table 2. A majority of studies (46 of 48) were conducted in high-income or upper middle-income countries (USA (n=31), UK (n=5), China (n=3), Australia (n=2), Japan (n=2), Italy (n=1), Israel (n=1) and Ireland (n=1)). Only 2 studies were conducted in LMICs (one in Bangladesh and one in India). A majority of studies (28 of 48) are RCTs testing interventions, with 4 RCTs piloting an intervention or assessing its feasibility. The remaining 20 articles include 9 non-randomised designs (quasi-experimental, observational and cross-sectional studies), 4 descriptive studies (surveys and quality improvement), 5 mixed-methods design and 2 qualitative studies. A total of 27 studies incorporated control groups that received no intervention or standard of care. A total of 12 studies were published before 2015. All included studies were published as research articles in peer reviewed journals, with more than one study being published in Vaccine (n=8), Pediatrics (n=3), PLoS One (n=3), and The American Journal of Public Health (n=2).
Table 2
|
Characteristics of eligible studies
Quality of evidence in included studies
According to the MMAT-based scoring (online supplemental tables 2–6), all included studies had clear research questions, data collection procedures, and a study design suitable to achieve the aims and objectives. However, some studies lacked explanations regarding how the sample size was determined. Mixed-methods studies sometimes demonstrated a lack of coherence between the qualitative and quantitative components, especially regarding the joint analysis of the main outcomes. Quality scores were relatively similar within study design groups. No study was eliminated because of a low MMAT score.
According to the GRADE scoring of the 28 RCTs included in the review (online supplemental table 7), nine studies were ranked as high quality, whereas six studies were graded as very low quality. The presence of biases (ie, information and selection), lack of clear blinding procedures, large losses to follow-up, and unclear or missing sample size calculations were among the most common reasons for quality score downgrades.
Nudging interventions: descriptions and timing
Drawing on the MINDSPACE framework and the nudging literature,41–43 we identified a total of seven types of nudging interventions employed across the selected studies (table 3). Intervention delivery varied across studies depending on the type of nudging technique employed, target population, as well as the timing of intervention delivery (eg, postpartum) and duration of intervention exposure. We present our results in descending order of strength of evidence rather than following the lettering of the acronym MINDSPACE. In cases when a study drew on multiple nudges (n=2),44 45 we describe the study’s findings in multiple nudge subsections.
Table 3
|
Summary of nudging interventions derived from this systematic review
Make available information salient
Nearly half of the included studies (21 of 48) used different ways of salient messaging (eg, novel, accessible and simple information) to capture attention and directly relate it to the target population’s personal experiences to promote vaccination behaviours.
A qualitative study in the UK assessed the feasibility and acceptability of a personalised ‘celebration card’ (codesigned with parents/caregivers) to accompany the child’s vaccination record, alongside an information leaflet preceding the vaccination schedule.46 Parents perceived the intervention as an effective way to prompt them to take the necessary action.46
An RCT in Australia evaluated the use of individualised letters (with Aboriginal artwork and information on vaccines highlighting the word ‘FREE’ to indicate they were free of cost) and pamphlets (with photographs of Aboriginal families and the same informational material) among Aboriginal Australians.47 The findings showed that the letter intervention resulted in significantly higher influenza vaccination rates compared with the control and the pamphlet groups.47 A study in the USA evaluated the use of reminders via postcards and text messages, including the conduct of motivational interviewing phone calls guided by a licensed clinical psychologist, which proved feasible and acceptable to parents who were targeted with HPV vaccine reminder messages.48 The results echoed findings in another study in the USA that used 19 different text-based nudges (varied based on timing and contents of the messages) developed by behavioural scientists and designed to increase influenza vaccine uptake.49 Overall, results showed a statistically significant boost in vaccination across the nudges, but the top-performing nudge was a reminder that said ‘an influenza vaccine has been reserved for you’, which was associated with an 11% increase in vaccination uptake.49 A mixed-methods study in Italy demonstrated that a personalised individual letter significantly increases influenza vaccine intentions among healthcare workers (HCWs) who received the nudge intervention compared with the control group.50 An RCT in the USA showed that sending reminder postcards to elderly adults who were late for at least one vaccine significantly increases vaccination rates.51 On the other hand, using the same approach in terms of frequency and nature of reminders, an RCT in a large acute care hospital in the UK found no evidence that influenza vaccine uptake is affected by reminder letters.52
In Bangladesh, an RCT demonstrated that the use of an application called ‘mTika’ to automatically generate reminder messages for mothers in hard-to-reach rural and urban areas was effective in improving vaccination coverage.53 However, a similar approach in an RCT of 90 parents of newborns in the USA found that the automated reminders 7 days before babies’ next scheduled vaccination (at 2, 4 and 6 months of age) did not increase uptake.54 On the other hand, an observational study also in the USA evaluated the use of active choice (ie, a method that requires providers to accept or decline vaccination orders) through electronic health records, which demonstrated a substantial increase in adult influenza vaccination rates compared with the control group over time (>2 years observation period).55 Two studies in the USA using a comparable approach among patients of primary clinics showed a significant increase in influenza vaccination uptake over a 2-year to 3-year period compared with the control groups.56 57
Automatic notifications were found to be more successful among vaccine providers. Duvall,58 for example, developed a collaborative approach (integrating nursing, pharmacy, providers and information technology) to improve the process of ordering influenza vaccines for patients. Physicians and nurses were trained to become ‘champions’ on influenza vaccine screening and administration. Results showed that combining these automatic provider notifications with a vaccine-screening tool significantly increased influenza vaccination uptake. An RCT in the USA designed an email prompt to bolster influenza vaccination rates among 3272 employees (≥50 years old) of a large utility firm.59 Participants were randomly assigned to receive personalised email prompts; employees who received a prompt around a date and time they planned to be vaccinated had a significant increase in vaccine uptake compared with the control group.59
Also, in the USA, findings from an RCT compared the impact of mailing postcards (directly mailed by the national immunisation information system to families) with practice-based reminders (HCWs delivered the postcards).60 Directly mailed postcards achieved a significant increase in vaccination rates, whereas only 5% of reminders were delivered to families in the practice-based approach, suggesting (the study’s authors argue) that a high workload in primary care facilities can affect the implementation of facility-based reminders.60 Similar findings in an RCT in the USA demonstrated a small although significant effect among intervention groups on influenza vaccine uptake compared with control groups that received no reminders.61 These findings suggest that technological interfaces can be a central resource to support health facilities experiencing difficulties in efforts to remind parents of vaccination schedules.
An RCT conducted in Japan used a stepwise vaccination education programme with a focus on salient messaging for mothers, which entailed delivery of educational leaflets. The messaging approach began before giving birth until 3–4 days postpartum and 1 month after delivery to assess the infant vaccination uptake.62 While the results showed no difference in Haemophilus influenzae type b (Hib) and pneumococcal conjugate (PCV13) vaccine uptake, the findings revealed an increase in parents’ perception of the benefits of vaccines, viewing vaccines as a component of motherhood.62 In the USA, three studies that sought to use tailored messages to improve HPV vaccine uptake specifically demonstrated no intervention effects.63–65 While one of the US studies showed increase in participants’ knowledge about HPV vaccines,64 others did not.63 65
Based on an RCT conducted in Israel, an invitation (‘getting early shot to increase vaccine effectiveness’) combined with traditional information approaches about stock (‘vaccine is more likely to run out of stock’), benefits (‘early shot carries monetary benefits’) and costs (‘early shot is free while the late costs a fee’) is effective compared with the intentions of getting influenza shots late.66
Offer incentives
Five studies used incentives as a mechanism to motivate behaviour change. Recognising that the cost of vaccines is a key barrier to uptake in China, a cross-sectional survey compared a free policy and non-free policy of influenza vaccination among parents of young children and found that influenza vaccination coverage was higher with the free policy (34.2%) compared with the non-free policy (3.1%).67 In the USA, a study assessed the feasibility of delivering vouchers (for free and discounted vaccines) to parents of infants to increase pertussis vaccination uptake.45 The study also combined the experimental use of vouchers with a video on the importance of the Tdap (tetanus, diphtheria, pertussis) vaccine featuring Jennifer Lopez (a celebrity) as a means to increase salience and establish social norms about vaccination. Although the results indicated an increase of awareness regarding pertussis risk, vaccine uptake remained very low across the four-arm intervention design.45 Also in the USA, an RCT examined the use of a routine email highlighting monetary incentives to vaccinate among college students.68 The findings suggest a significant increase in influenza vaccine intentions among students who received a message about a financial incentive (email subject line: ‘Influenza vaccine (get $30)’), compared with the control group.68 A different approach was performed in the UK, wherein participants were incentivised via a lottery to return informed consent forms; regardless of whether forms included or withheld signatures, winning participants could receive US$50/€60 in a prize draw.69 Qualitatively, participants in the consent raffle described feeling generally good about the intervention as a whole, but several questioned the ethics of incentivising vaccine-related behaviours as this could be too akin to bribery.69
In rural India, an RCT evaluated vaccination campaigns with and without incentives.70 A control group was compared with groups that included (1) an ‘immunisation camp’ (where immunisation services were provided by a nurse and an assistant on a fixed schedule); and (2) an ‘immunisation camp plus’ model that also included a non-financial incentive (1 kg of raw lentils per vaccination conducted on schedule and a set of metal plates on completion of all childhood vaccines).70 Parents who received non-financial incentives were more likely to complete vaccination compared with controls, as long as vaccines were reliably available at respective health facilities.70
Change defaults
Setting defaults has also been used with regard to vaccination-related patient–provider communication. A cross-sectional study in the USA used participatory (built on the principle of shared decision making) and presumptive (presupposing those parents would decide to vaccinate their child the same day) approaches to increase vaccination acceptance. The presumptive format was associated with an increase in parental vaccine acceptance but also with reduced satisfaction in the clinical experience, while the participatory format showed the opposite pattern.71 An RCT in the USA supported these results in a study that examined the effectiveness of announcements (presumptive) and conversations (participatory) as compared with the usual care for increasing HPV vaccination uptake in 30 primary care clinics with 100 or more patients aged 11–12 years.72 Their findings also indicated an increased vaccination uptake among those randomised to the announcement group; no statistical difference was noted among the conversation group compared with the control group.72
A survey in the UK investigated the use of defaults to increase catch-up vaccines (ie, for those who missed or did not complete a vaccine regimen) on measles, mumps and rubella (MMR) among members of the general population (62% of whom are parents with children).73 Researchers sought participants’ opinions regarding five possible policies for secondary schools: (1) no MMR catch-up vaccination at school, (2) catch-up MMR vaccination with explicit parental consent (3) MMR catch-up vaccination offered based on general parental permission at school enrolment, (4) vaccination voluntary but permission generally assumed unless parents explicitly indicate otherwise (opt-out) and (5) mandatory MMR catch-up vaccinations at secondary schools.73 Participants were most favourable of opt-out and general permission policies, and highly opposed to the mandatory and no vaccination policies.
An RCT in the USA presented parents with a hypothetical scenario of moving to a new state where their adolescent son is starting at a new school.74 Participants were randomly assigned to one of three groups: (1) the new school had an opt-in vaccination policy (new students being vaccinated only if parents consented), or (2) an opt-out vaccination policy (vaccination occurs by default unless parents object) or (3) a neutral condition where parents had to complete a form whether or not their child would be vaccinated. Afterwards, parents were asked about their intention to vaccinate against HPV only, or HPV vaccine along with seasonal influenza and meningococcal vaccine. Results showed that those parents in the opt-in policy group were more likely to vaccinate compared with the opt-out group, contradicting common assumptions with regard to the power of defaults.74 Additionally, there was no effect of different defaults among parents who were undecided as to whether their adolescent son should receive the vaccine, suggesting that strong, conflicting feelings about the HPV vaccine in general might hinder the effect of default policies on vaccination uptake.74
Change the messenger
Two studies focused their nudging intervention on changing the messenger assigned with communicating vaccine-related health information.44 75 In the USA, a mixed-methods study used a community approach (‘immunity community’) to shift the perceived authority to parents themselves, aiming to build a stronger connection among peers.75 The intervention mobilised parent advocates to establish dialogues about vaccines through approaches such as one-on-one communication with peers, social media advocacy, events and distribution of immunisation educational materials.75 The results showed statistically significant improvements in parental knowledge and attitudes towards vaccines, but parental vaccine-related behaviours did not change significantly.75
Change the way outcomes are framed
A non-RCT in Ireland presented 72 parents of young girls with a one-page summary describing risks of an HPV infection. Parents were then randomly assigned to either receive a gain-framed message (describing the benefits of getting the vaccine) or a loss-framed message (describing the risks of not getting the vaccine).76 The findings suggest a strong intention to vaccinate against HPV regardless of the framed messages but found no significant effect of framing in vaccination attitudes, normative beliefs or perceived behavioural control.76
In the USA, a mixed-methods study investigated the effects of different ways of framing vaccine-related information on HPV vaccine intentions among three cultural groups (n=150, 50 per ethnic group) (Hispanic, non-Hispanic white, and non-Hispanic African-American).77 The results revealed significant differences: for the Hispanic group, both frames equally increased vaccine intentions, while for the other two study groups, a loss frame message was more effective in increasing intentions to vaccinate. An RCT in the USA, conducted prior to the roll-out of COVID-19 vaccines, found that intentions to vaccinate against COVID-19 increased significantly when the messages are framed towards personal health risks, consequences of not getting the vaccine, and if these framed messages come from medical experts.44 In a similar approach, in the UK, an RCT demonstrated that the use of personal benefit messages was more effective among individuals who are strongly hesitant about COVID-19 vaccines compared with those who received information on collective benefits.78
In China, a study examined women’s (aged 18–45 years old) intention to vaccinate their children (and future children) with HPV vaccines using three types of messages: (1) gain-framed (lower chance of contracting cervical cancer and genital warts), (2) loss-framed (higher chance of contracting cervical cancer and genital warts), and (3) narrative (participants were presented with a story of a young mother related to HPV and HPV vaccine).79 Vaccine intentions did not vary significantly by group; however, gain-framed messages seemed to appeal more to future-minded women, and narrative messages appealed more to present-minded women.79 On the other hand, another study in China demonstrated that the loss-framed messages lead to a more favourable intention towards HPV vaccines as opposed to the gain-framed messages.80 Using a similar approach, a longitudinal study among minority pregnant women in the USA showed no significant difference of either gain-framed or loss-framed messages on influencing maternal vaccination rates.81
Employing a different framing approach in the USA, an RCT demonstrated that framing vaccine benefits on an individual level (the vaccine recipient) significantly increased vaccination intentions compared with the same information being framed in terms of societal benefits.82 Meanwhile, another RCT trialled the use of ‘positive–negative message order’ (information on vaccine effectiveness presented first, followed by vaccine side effects) and compared it to ‘negative–positive message order’ combined with message calendar (with or without plans of getting the vaccine).83 However, the findings found no statistically significant effects of message order on vaccine intentions.83
Invoke social norms
Three studies highlighted the use of social norms (eg, normalising vaccination as a socially acceptable behaviour or featuring a celebrity to establish a norm) in existing social networks (eg, network members, friends, family and healthcare providers) to shape their knowledge and intention to vaccinate.45 84 85 A pilot RCT among Cambodian–Americans in the USA found that the use of a storytelling narrative video could increase engagement and persuasion.84 The video showed Khmer mothers and Khmer physicians discussing issues around getting vaccinated, eventually normalising vaccines and depicting vaccination as a desirable behaviour that benefits the entire community.84 Results showed higher intention to vaccinate in the intervention group versus the control group, which only received educational flyers on the HPV vaccine, but the study focused on feasibility, and vaccine uptake was not evaluated.84 The acceptability of the intervention was relatively high, and participants reported an emotional connection and relatability to the images and stories.84
On the other hand, a mixed-methods study in Australia concluded that using a values-based approach can in fact polarise vaccination attitudes and therefore be counterproductive.85 The ‘I Immunise’ campaign used community advocates and featured their alternative lifestyle (attributes including home birthing, breast feeding, baby-wearing wraps and cloth nappies, and eating wholefoods) in a photograph combined with testimonial of how vaccines were a part of their alternative lifestyle.85 Results, however, did not support this novel approach: some participants expressed more negative attitudes regarding vaccination postcampaign as compared with baseline, and the campaign led to complaints that the presented material was one-sided and could reinforce stereotypes regarding lifestyle and vaccine decisions.85
Encourage emotional affects
Six studies employed dramatic narratives and graphics in the context of vaccine messaging. A non-RCT in the USA found that using pictures of patients with vaccine-preventable diseases could improve parental perception about vaccines and vaccine schedule adherence.86 Parents of infants in the intervention group demonstrated increased vaccination knowledge and were more satisfied with their providers compared with those parents who received no intervention, although changes in the perception of vaccine effectiveness and comfort with decision making was not statistically significant. Another non-RCT conducted in the USA demonstrated that the use of graphical images, videos and interactive scenarios can substantially improve high school students’ knowledge, attitudes and beliefs in vaccines.87 Also, in the USA, an RCT was conducted that used five different videos ranging from personal stories to statistical or narrative science-supporting messages.88 The findings suggest that science-supporting messages (ie, a video with Dr. Anthony Fauci, Director of National Institute of Allergy and Infectious Diseases, providing statistical information about the contagiousness of measles, vaccine safety and vaccine effectiveness) influence provaccine views and vaccine intentions among American adults.88
An RCT in the USA found that a vaccination-related radionovela (a dramatic story broadcast on the radio) of a young girl’s journey of hearing about and ultimately receiving the HPV vaccine improved knowledge and attitudes about vaccines among US Hispanic parents or guardians of young children.89 Furthermore, another RCT, also in the USA, found that showing mothers a presentation on cancer prevalence and lives saved by the vaccine, combined with rhetorical questions (such as ‘Do you want to protect your daughter from cancer?’), could increase message comprehension and had an overall positive effect on mothers’ intention to vaccinate, versus a non-graphical presentation and a control group.90
In the USA, Nyhan and colleagues91 used ‘disease images’ and dramatic narratives of an infant who almost died of measles to portray the risk of not vaccinating to parents with children under 17, and found no significant positive effects of these provaccine messages. Instead, they highlighted that using emotionalised stories designed to instil fear could increase vaccine safety concerns among those who were already hesitant to vaccinate.
Effect of nudging interventions
A variety of outcome measures were used to assess the effect of nudging interventions. The most frequent were vaccination uptake, intention to vaccinate, parental knowledge and attitudes towards childhood vaccinations, and vaccination acceptability and satisfaction. To better illustrate the results across approaches, we plotted the results on a matrix (‘harvest plot’92) to summarise and compare the evidence of individual studies (see table 4). Each of the three table columns lists studies that disfavour (no significant effect) or favour (significant effect) nudges, or that present mixed results. Each study is presented as a bar highlighting certainty of evidence; darker shaded bars are RCTs (graded on a 4-point GRADE scale) and lighter shades represent non-RCTs and other study designs (graded on a 5-point MMAT scale) (see online supplemental tables 2–7). Higher bars represent lower risk of study bias. Finally, numbers within each bar refer to study references as cited in the reference list.
Table 4
|
Harvest plot of nudging outcomes among the general population included in this systematic review*
In a majority of studies assessing how participants perceived a given nudging intervention (10 of 16), participants reported that the approach was acceptable, feasible and satisfactory. In 6 of the 10 studies that assessed vaccination knowledge and awareness, the nudge of providing incentives, saliency of information, framing messages, encouraging emotional affect and changing the messenger were reported to have a positive effect. Among the 19 studies that looked at vaccination uptake as the primary outcome of interest, 12 studies found statistically significant increases in vaccination coverage compared with control groups. Roughly half (12 of 21 studies) showed a positive effect on vaccination intention among study participants.
Discussion
This systematic review is an up-to-date synthesis of available evidence on how nudging affects intentions and behaviours related to vaccines and vaccine uptake, thus providing important guidance related to the ongoing COVID-19 pandemic and beyond. We identify a number of nudging approaches, including some codeveloped by scientists, community members and HCWs, several of which have shown promising results in changing vaccination attitudes or behaviours. Arguably, the most promising evidence in terms of vaccine uptake exists for nudging interventions that make available information more salient, offer incentives to parents and HCWs, and change defaults. While some studies seem to be efficacious in increasing vaccine uptake, only five included studies were designed within a controlled experimental setting.49 51 59–61 Of these studies, nudges such as ‘use of reminders and recalls’, ‘providing tangible and intangible incentives’ and the ‘use of emotional associations (eg, videos and images)’ increased favoured behaviours towards vaccines. Additionally, our findings highlight that a majority of studies have assessed the impact of nudging on vaccination attitudes and intentions instead of observed vaccination behaviour. While we acknowledge the challenges of assessing actual vaccination uptake as a result of nudging interventions, approximating it via attitudes and intentions holds risk of biases, especially in light of studies highlighting that the effect of nudges tends to be less long-lived.24
Some of the identified nudging interventions are driven by emotional appeals using salient messages, with evidence showing they could increase vaccination intentions and uptake.53 55 56 58 60 However, one must be cautious and provide a targeted nudging approach only to those parents who are ‘fence sitters’ with concrete doubts or questions regarding vaccines.74 85 Some studies suggest that using nudging interventions with those groups already experiencing strong and conflicting feelings towards vaccination can backfire.74 85 Indeed, Smith and colleagues93 discuss the influence of heuristics and beliefs in building vaccine confidence, highlighting how facts contradicting previously held beliefs are often difficult to accept. Screening parents to ascertain their views on vaccination before nudging may be a viable option and is likely a critical step prior to implementation of any vaccine nudge intervention.
Several studies showed evidence of the role of the ‘antivaxxers’ movement in the sudden decline of vaccine confidence and uptake of childhood vaccinations.15 94 95 These groups are relatively small in number, but their internet reach and coverage are extensive.96 Several scholars have outlined ways to counter antivaccination groups and address VH by developing provaccine messages rooted in narratives and social norms, using visually enhanced education materials and interventions that are focused on regaining trust.97–100 However, Attwell and Freeman85 found that while their value-based approach gained large amounts of social media mileage, efforts redoubled from antivaccination groups to warn communities of side effects of the vaccines, and to attack the material as one-sided and stereotypical. This highlights how the antivaccination community must be considered when promoting a new intervention, especially on platforms and social media with a history of a highly emotionalised vaccine-related discourse (eg, Facebook).96 101 Similarly, emotionalised stories and shocking images designed to inflict fear can increase vaccine safety concerns among parents.91
Several LMICs are currently experiencing sudden declines of vaccine confidence,102 a development which is particularly alarming as the risks of an outbreak of a vaccine-preventable disease for individuals and health systems are disproportionally larger in resource-poor settings.17 103 104 While our findings hold relevance for countries across the globe, nudging interventions are often considered to be less costly than many other large-scale health intervention programmes,41 105 106 highlighting their potential for LMICs or other resource-limited settings. We also found that a nudging approach that is implemented successfully in one setting cannot always be successfully transferred to another setting or another group of people, underscoring the importance of design research to determine how to best adapt and trial optimal nudges.107
Several studies highlighted ethical concerns, including that nudging restricts individual freedom of choice73 108 and promotes coercion of parents and HCWs.109–111 Thaler and Sunstein112 refer to ‘libertarian paternalism’ as an approach that preserves and promotes autonomy but allows authorities to direct individuals in a positive direction by providing options that are subtly more or less accessible. However, a number of authors have highlighted the importance of distinguishing between nudges and shoves.113 114 Shoves, as opposed to the nudges described in this paper, use a much more directive approach, as described in the ‘ladder of interventions’ of the Nuffield Council on Bioethics,113 such as in the ‘no jab, no pay’ policy in Australia, denying unvaccinated children access to public places in the USA, or charging parents of unvaccinated children substantial fines in Germany.109–111
Health systems in general and vaccination challenges in particular are complex and generally not resolved through single interventions at the family or individual levels alone. Instead, multipronged approaches including communities, hospitals or points of care, and policymakers are needed and essential.115 A number of scholars around the world have demonstrated that there is no ‘one-size-fits-all’ approach for nudges to promote vaccination uptake and address VH.116–118 This is particularly true for LMICs with unique patterns of VH and structural conditions such as unreliable availability of vaccines,17 and where relevant scientific evidence remains limited.
VH is an urgent public health problem not only in the context of already existing vaccines with well-established efficacy and safety, but also with regard to novel vaccines, where limited uptake by the population could have disastrous implications.119 With COVID-19 vaccines currently being rolled out in many countries, several studies already highlighted concerns that acceptance of such a novel vaccine could be limited, with significant implications for vaccination programme effectiveness at the population level.120 121 The problem of VH requires exploring new pathways for how interventions, including nudges, can be implemented, including soon after vaccine introduction and in fluidly evolving contexts. In light of this need for novel approaches, our review also highlights that several nudging approaches (ie, the use of ‘priming’, ‘commitments’ and ‘ego’) which have shown promising results in other areas of health promotion, but have not yet been applied to VH and merit consideration.41 While a general review of nudges not yet applied to VH was beyond the scope of this paper, we do encourage further work on transferring otherwise successful nudging approaches to the field of vaccine confidence promotion.
Recommendations
In light of our review, we present the following recommendations. For policymakers aiming at introducing VH interventions in their respective settings, we want to highlight the promising results of nudging-based interventions, particularly with regard to making available information salient, offering incentives, and changing defaults or the messenger. However, policymakers should be aware of the limited number of large-scale RCTs and the mixed evidence regarding the efficacy of the same nudge in different settings, especially with regard to LMICs. We therefore discourage transferring nudging interventions one-to-one to drastically different settings. Instead, a detailed understanding of the complexity of the target population, as well as comprehensive design research, is highly recommended to ensure the acceptability and effectiveness of the nudging intervention in the particular setting. Additionally, policymakers should look beyond vaccine recipients as intervention targets and consider broadening the scope to also include medical professionals and other stakeholders, and be aware of the risks of certain nudging interventions (eg, aimed at instilling fears) that may increase public doubt and provide additional arguments for antivaccination groups.9 93
With regard to future research, the gaps in terms of study design, sample size calculation and risk of biases highlight opportunities for more rigorous research to gauge the broader applicability of the nudging approach. Our results underscore that a relatively small number of studies have drawn on the concept of nudging regarding vaccination uptake, but promising results and the complexity of the concept, especially its applicability to different settings, call for further research. We also highlight a number of nudges which, to the best of our knowledge, have not yet been applied to VH but have shown promising results in other health promotion contexts, meriting further research. Furthermore, there is exceptionally limited information from LMICs informing this discourse, and qualitative research exploring acceptability regarding nudging interventions, both among policymakers and the general community, is similarly limited. The potential value and impact of nudging, and how nudges can profit from rigorous adaptation and acceptance from the community members are then paramount. We therefore urge scholars to consider these angles of investigation for future research.
Strengths and limitations
The key strength of this systematic review is the rigorous search and identification of eligible studies across several databases using extensive search strings, overseen by a biomedical librarian (JL). The use of an iterative process at the outset of literature extraction ensured that we systematically considered all behavioural interventions and improved our chances of capturing nudging interventions. Nevertheless, some factors limit the generalisability of our results. The current small number of studies and the high variability with regard to quality, methods, measurement of VH, and outcomes across studies do not allow for a meaningful meta-analysis to ascertain its primary effects on vaccination uptake. The fact that most studies (46 of 48) took place in higher-income settings also conditions the interpretation of our findings, given the demonstrated variability of effects according to context. Also, we restricted this review to studies published since 2008, when the term nudging emerged.25 We note, however, that the concept of nudges as applied in healthcare predates this, and we encourage a more historical examination of nudges and other interventions to promote vaccinations. Finally, we excluded the term ‘immunization’ in the search criteria, and while we later identified and included several papers that employed this term following a hand screening of reviews, it is nevertheless possible that papers that employed the term ‘immunization’ rather than vaccination and were not in these reviews were missed.
Conclusion
Nudging takes different forms and is delivered via different interventions. Early evidence suggests nudging may be a feasible and promising approach to increase public confidence in vaccines. Nudges targeting the vaccine recipients close to the decision whether or not to vaccinate (such as offering incentives, making more information salient, changing defaults and purposefully selecting the messenger) show the most promise. However, nudges targeting providers to facilitate vaccination uptake among their clients (eg, reminder systems) and therefore addressing VH from another angle are also valuable to consider and explore further. Successful public health programmes designed to increase vaccination uptake require context-specific adaptations to address target groups’ specific concerns and the understandings of vaccine-hesitant individuals. Further research, specifically in relation to nudging interventions in LMICs, is required.
Contributors: MDCR and JL conceptualised the study, designed the study methods and extracted data. MDCR wrote the first draft of the manuscript with important contributions from JL. JW acted as a data validator and contributed to the literature review. JW, KB, SLD, TB and SM contributed to the writing and edited the manuscript. SM supervised all the writing and editing of the manuscript. All authors read, critically revised the paper and approved the final version of the manuscript.
Funding: This work was supported by the Bill & Melinda Gates Foundation (OPP1217275), which funded the open access publication. Under the grant conditions of the Foundation, a Creative Commons Attribution 4.0 Generic License has already been assigned to the Author Accepted Manuscript version that might arise from this submission.
Disclaimer: The funders had no role in the decision to publish or in the preparation of the manuscript. The content is the responsibility of the authors and does not necessarily represent the views of any funder.
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
Ethics statements
Patient consent for publication:
Not required.
Ethics approval:
The institutional review board of the Research Institute for Tropical Medicine, Philippines, reviewed the protocol and granted exemption from ethical review (IRB number 2020-17).
Acknowledgements
The authors thank Jarren Arshlle Arao of the Department of Epidemiology and Biostatistics, Research Institute for Tropical Medicine, who contributed during the data extraction process (running of duplicates). We are also grateful to Professor Volker Winkler, Dr Virginia Fonner, Dr Rachel Chase and Khatia Antia for their expert advice on the review methodology and data visualisation.
Andre FE, Booy R, Bock HL, et al. Vaccination greatly reduces disease, disability, death and inequity worldwide. Bull World Health Organ2008; 86:140–6. doi:10.2471/blt.07.040089•Google Scholar•PubMed
Lane S, MacDonald NE, Marti M, et al. Vaccine hesitancy around the globe: analysis of three years of WHO/UNICEF joint reporting form data-2015-2017. Vaccine2018; 36:3861–7. doi:10.1016/j.vaccine.2018.03.063•Google Scholar•PubMed
Markowitz LE, Naleway AL, Lewis RM, et al. Declines in HPV vaccine type prevalence in women screened for cervical cancer in the United States: evidence of direct and herd effects of vaccination. Vaccine2019; 37:3918–24. doi:10.1016/j.vaccine.2019.04.099•Google Scholar•PubMed
Manzoli L, Gabutti G, Siliquini R, et al. Association between vaccination coverage decline and influenza incidence rise among Italian elderly. Eur J Public Health2018; 28:740–2. doi:10.1093/eurpub/cky053•Google Scholar•PubMed
Brunson EK, Sobo EJ. Framing childhood vaccination in the United States: getting past polarization in the public discourse. Hum Organ2017; 76:38–47. doi:10.17730/0018-7259.76.1.38•Google Scholar
Dubé E, Vivion M, MacDonald NE, et al. Vaccine hesitancy, vaccine refusal and the anti-vaccine movement: influence, impact and implications. Expert Rev Vaccines2015; 14:99–117. doi:10.1586/14760584.2015.964212•Google Scholar•PubMed
Kata A. Anti-vaccine activists, Web 2.0, and the postmodern paradigm--an overview of tactics and tropes used online by the anti-vaccination movement. Vaccine2012; 30:3778–89. doi:10.1016/j.vaccine.2011.11.112•Google Scholar•PubMed
Cobos Muñoz D, Monzón Llamas L, Bosch-Capblanch X, et al. Exposing concerns about vaccination in low- and middle-income countries: a systematic review. Int J Public Health2015; 60:767–80. doi:10.1007/s00038-015-0715-6•Google Scholar•PubMed
Chamberlain AT, Limaye RJ, O'Leary ST, et al. Development and acceptability of a video-based vaccine promotion tutorial for obstetric care providers. Vaccine2019; 37:2532–6. doi:10.1016/j.vaccine.2019.03.005•Google Scholar•PubMed
Cunningham R, Boom J, Baker C, et al. Vaccine-preventable disease: the forgotten story. United States of America, Center for Vaccine Awareness and Research, Texas Children’s Hospital2010; Google Scholar
Seeber L, Conrad T, Hoppe C, et al. Educating parents about the vaccination status of their children: a user-centered mobile application. Prev Med Rep2017; 5:241–50. doi:10.1016/j.pmedr.2017.01.002•Google Scholar•PubMed
ECDC. Catalogue of interventions addressing vaccine hesitancy. Stokholm, European Centre for Disease Prevention and Control2017; Google Scholar
Brewer NT, Chapman GB, Rothman AJ, et al. Increasing vaccination: putting psychological science into action. Psychol Sci Public Interest2017; 18:149–207. doi:10.1177/1529100618760521•Google Scholar•PubMed
Thaler RH, Sunstein CR. Nudge: improving decisions about health, wealth and happiness. New Haven, CT, Yale University Press2008; Google Scholar
Ingraham C. What’s a urinal fly and what does it have to with winning a Nobel Prize? The Washington Post2017; Google Scholar
Blackwell C, Goya-Tocchetto D, Sturman Z, et al. Nudges in the restroom: how hand-washing can be impacted by environmental cues. J Behav Economic Pol2018; 2:41–7. Google Scholar
Hansen PG, Schilling M, Malthesen MS, et al. Nudging healthy and sustainable food choices: three randomized controlled field experiments using a vegetarian lunch-default as a normative signal. J Public Health2019; Google Scholar
Arno A, Thomas S. The efficacy of nudge theory strategies in influencing adult dietary behaviour: a systematic review and meta-analysis. BMC Public Health2016; 16. doi:10.1186/s12889-016-3272-x•Google Scholar•PubMed
Broers VJV, De Breucker C, Van den Broucke S, et al. A systematic review and meta-analysis of the effectiveness of nudging to increase fruit and vegetable choice. Eur J Public Health2017; 27:912–20. doi:10.1093/eurpub/ckx085•Google Scholar•PubMed
Möllenkamp M, Zeppernick M, Schreyögg J, et al. The effectiveness of nudges in improving the self-management of patients with chronic diseases: a systematic literature review. Health Policy2019; 123:1199–209. doi:10.1016/j.healthpol.2019.09.008•Google Scholar•PubMed
Modrek S, Schatzkin E, De La Cruz A, et al. SMS messages increase adherence to rapid diagnostic test results among malaria patients: results from a pilot study in Nigeria. Malar J2014; 13. doi:10.1186/1475-2875-13-69•Google Scholar•PubMed
Macis M, Grunauer M, Gutierrez E, et al. Using incentives and Nudging to improve non-targeted HIV testing in Ecuador: a randomized trial. AIDS Behav2021; 25:2542–50. doi:10.1007/s10461-021-03215-x•Google Scholar•PubMed
Tawfik GM, Dila KAS, Mohamed MYF, et al. A step by step guide for conducting a systematic review and meta-analysis with simulation data. Trop Med Health2019; 47. doi:10.1186/s41182-019-0165-6•Google Scholar•PubMed
Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev2015; 4. doi:10.1186/2046-4053-4-1•Google Scholar•PubMed
Hong QN, Gonzalez-Reyes A, Pluye P, et al. Improving the usefulness of a tool for appraising the quality of qualitative, quantitative and mixed methods studies, the mixed methods appraisal tool (MMAT). J Eval Clin Pract2018; 24:459–67. doi:10.1111/jep.12884•Google Scholar•PubMed
Schünemann H, Brożek J, Guyatt G, et al. Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. 2013;
Digital nudging: altering user behavior in digital environments. St. Gallen, Switzerland, Internationalen Tagung Wirtschaftsinformatik2017; Google Scholar
Motta M, Sylvester S, Callaghan T, et al. Encouraging COVID-19 vaccine uptake through effective health communication. Frontiers in Political Science2021; 3. Google Scholar
Buttenheim AM, Fiks AG, Burson RC, et al. A behavioral economics intervention to increase pertussis vaccination among infant caregivers: a randomized feasibility trial. Vaccine2016; 34:839–45. doi:10.1016/j.vaccine.2015.11.068•Google Scholar•PubMed
Lwembe S, Green SA, Tanna N, et al. A qualitative evaluation to explore the suitability, feasibility and acceptability of using a 'celebration card' intervention in primary care to improve the uptake of childhood vaccinations. BMC Fam Pract2016; 17. doi:10.1186/s12875-016-0497-9•Google Scholar•PubMed
Borg K, Sutton K, Beasley M, et al. Communication-based interventions for increasing influenza vaccination rates among Aboriginal children: a randomised controlled trial. Vaccine2018; 36:6790–5. doi:10.1016/j.vaccine.2018.09.020•Google Scholar•PubMed
Staras SAS, Richardson E, Merlo LJ, et al. A feasibility trial of parent HPV vaccine reminders and phone-based motivational interviewing. BMC Public Health2021; 21. doi:10.1186/s12889-020-10132-6•Google Scholar•PubMed
Milkman KL, Patel MS, Gandhi L, et al. A megastudy of text-based nudges encouraging patients to get vaccinated at an upcoming doctor's appointment. Proc Natl Acad Sci U S A2021; 118. doi:10.1073/pnas.2101165118•Google Scholar•PubMed
Lorini C, Ierardi F, Gatteschi C, et al. Promoting influenza vaccination among staff of nursing homes according to behavioral insights: analyzing the choice architecture during a nudge-based intervention. Vaccines2020; 8. doi:10.3390/vaccines8040600•Google Scholar•PubMed
Chen N, Trump S, Hall S, et al. The effect of postcard reminders on vaccinations among the elderly: a block-randomized experiment. Behavioural Public Policy2020; Google Scholar
Schmidtke KA, Nightingale PG, Reeves K, et al. Randomised controlled trial of a theory-based intervention to prompt front-line staff to take up the seasonal influenza vaccine. BMJ Qual Saf2020; 29:189–97. doi:10.1136/bmjqs-2019-009775•Google Scholar•PubMed
Uddin MJ, Shamsuzzaman M, Horng L, et al. Use of mobile phones for improving vaccination coverage among children living in rural hard-to-reach areas and urban streets of Bangladesh. Vaccine2016; 34:276–83. doi:10.1016/j.vaccine.2015.11.024•Google Scholar•PubMed
Ahlers-Schmidt CR, Chesser AK, Nguyen T, et al. Feasibility of a randomized controlled trial to evaluate text reminders for immunization compliance in kids (TRICKs). Vaccine2012; 30:5305–9. doi:10.1016/j.vaccine.2012.06.058•Google Scholar•PubMed
Patel MS, Volpp KG, Small DS, et al. Using active choice within the electronic health record to increase influenza vaccination rates. J Gen Intern Med2017; 32:790–5. doi:10.1007/s11606-017-4046-6•Google Scholar•PubMed
Kim RH, Day SC, Small DS, et al. Variations in influenza vaccination by clinic appointment time and an active choice intervention in the electronic health record to increase influenza vaccination. JAMA Netw Open2018; 1. doi:10.1001/jamanetworkopen.2018.1770•Google Scholar•PubMed
Changolkar S, Rewley J, Balachandran M, et al. Phenotyping physician practice patterns and associations with response to a nudge in the electronic health record for influenza vaccination: a quasi-experimental study. PLoS One2020; 15. doi:10.1371/journal.pone.0232895•Google Scholar•PubMed
Duvall A. Improving influenza vaccination rates among pediatric hematology and oncology inpatients. Pediat Nurs2019; 45:142–54. Google Scholar
Milkman KL, Beshears J, Choi JJ, et al. Using implementation intentions prompts to enhance influenza vaccination rates. Proc Natl Acad Sci U S A2011; 108:10415–20. doi:10.1073/pnas.1103170108•Google Scholar•PubMed
Kempe A, Saville A, Dickinson LM, et al. Population-based versus practice-based recall for childhood immunizations: a randomized controlled comparative effectiveness trial. Am J Public Health2013; 103:1116–23. doi:10.2105/AJPH.2012.301035•Google Scholar•PubMed
Szilagyi PG, Albertin C, Casillas A, et al. Effect of patient portal reminders sent by a health care system on influenza vaccination rates: a randomized clinical trial. JAMA Intern Med2020; 180:962–70. doi:10.1001/jamainternmed.2020.1602•Google Scholar•PubMed
Porter RM, Amin AB, Bednarczyk RA, et al. Cancer-salient messaging for human papillomavirus vaccine uptake: a randomized controlled trial. Vaccine2018; 36:2494–500. doi:10.1016/j.vaccine.2018.01.040•Google Scholar•PubMed
Joseph NP, Bernstein J, Pelton S, et al. Brief Client-Centered motivational and behavioral intervention to promote HPV vaccination in a hard-to-reach population: a pilot randomized controlled trial. Clin Pediatr2016; 55:851–9. doi:10.1177/0009922815616244•Google Scholar•PubMed
Panozzo CA, Head KJ, Kornides ML, et al. Tailored messages addressing human papillomavirus vaccination concerns improves behavioral intent among mothers: a randomized controlled trial. J Adolesc Health2020; 67:253–61. doi:10.1016/j.jadohealth.2020.01.024•Google Scholar•PubMed
Zeng Y, Yuan Z, Yin J, et al. Factors affecting parental intention to vaccinate kindergarten children against influenza: a cross-sectional survey in China. Vaccine2019; 37:1449–56. doi:10.1016/j.vaccine.2019.01.071•Google Scholar•PubMed
Bronchetti E, Huffman D, Attention ME, et al. Intentions, and follow-through in preventive health behavior: field experimental evidence on flu vaccination. Journal of Economic Behavior and Organization2015; 116:270–91. Google Scholar
Rockliffe L, Stearns S, Forster AS, et al. A qualitative exploration of using financial incentives to improve vaccination uptake via consent form return in female adolescents in London. PLoS One2020; 15. doi:10.1371/journal.pone.0237805•Google Scholar•PubMed
Banerjee AV, Duflo E, Glennerster R, et al. Improving immunisation coverage in rural India: clustered randomised controlled evaluation of immunisation campaigns with and without incentives. BMJ2010; 340. doi:10.1136/bmj.c2220•Google Scholar•PubMed
Opel DJ, Mangione-Smith R, Robinson JD, et al. The influence of provider communication behaviors on parental vaccine acceptance and visit experience. Am J Public Health2015; 105:1998–2004. doi:10.2105/AJPH.2014.302425•Google Scholar•PubMed
Brewer NT, Hall ME, Malo TL, et al. Announcements versus conversations to improve HPV vaccination coverage: a randomized trial. Pediatrics2017; 139. doi:10.1542/peds.2016-1764•Google Scholar•PubMed
Schoeppe J, Cheadle A, Melton M, et al. The immunity community: a community engagement strategy for reducing vaccine Hesitancy. Health Promot Pract2017; 18:654–61. doi:10.1177/1524839917697303•Google Scholar•PubMed
Lechuga J, Swain GR, Weinhardt LS, et al. Impact of framing on intentions to vaccinate daughters against HPV: a cross-cultural perspective. Ann Behav Med2011; 42:221–6. doi:10.1007/s12160-011-9273-1•Google Scholar•PubMed
Freeman D, Loe BS, Yu L-M, et al. Effects of different types of written vaccination information on COVID-19 vaccine hesitancy in the UK (OCEANS-III): a single-blind, parallel-group, randomised controlled trial. Lancet Public Health2021; 6:e416–27. doi:10.1016/S2468-2667(21)00096-7•Google Scholar•PubMed
Liu S, Yang JZ, Chu H, et al. Now or future? Analyzing the effects of message frame and format in motivating Chinese females to get HPV vaccines for their children. Patient Educ Couns2019; 102:61–7. doi:10.1016/j.pec.2018.09.005•Google Scholar•PubMed
Xu X, Yang M, Zhao YC, et al. Effects of message framing and evidence type on health information behavior: the case of promoting HPV vaccination. Aslib J Inform Manag2020; 73:63–79. doi:10.1108/AJIM-02-2020-0055•Google Scholar
Frew PM, Saint-Victor DS, Owens LE, et al. Socioecological and message framing factors influencing maternal influenza immunization among minority women. Vaccine2014; 32:1736–44. doi:10.1016/j.vaccine.2014.01.030•Google Scholar•PubMed
Hendrix KS, Finnell SME, Zimet GD, et al. Vaccine message framing and parents' intent to immunize their infants for MMR. Pediatrics2014; 134:e675–83. doi:10.1542/peds.2013-4077•Google Scholar•PubMed
Okuno H, Satoh H, Iitake C, et al. Effects of message order and active participation on vaccine risk communication. Pediatr Int2021; doi:10.1111/ped.14662•Google Scholar•PubMed
Lee H, Kim M, Cooley ME, et al. Using narrative intervention for HPV vaccine behavior change among Khmer mothers and daughters: a pilot RCT to examine feasibility, acceptability, and preliminary effectiveness. Appl Nurs Res2018; 40:51–60. doi:10.1016/j.apnr.2017.12.008•Google Scholar•PubMed
Papapchrisanthou MM, Loman DG. Visually enhanced education and immunization perceptions in low-income parents. Public Health Nurs2018; 35:109–17. doi:10.1111/phn.12366•Google Scholar•PubMed
Blanchard J-L, Johnson C, McIntyre M, et al. A pre and post intervention study measuring the effect of interactive education on adolescent perceptions of vaccines, vaccine safety and disease risk. J Public Health2020; 42:e272–7. doi:10.1093/pubmed/fdz089•Google Scholar•PubMed
Kepka D, Coronado GD, Rodriguez HP, et al. Evaluation of a radionovela to promote HPV vaccine awareness and knowledge among Hispanic parents. J Community Health2011; 36:957–65. doi:10.1007/s10900-011-9395-1•Google Scholar•PubMed
Cox DS, Cox AD, Sturm L, et al. Behavioral interventions to increase HPV vaccination acceptability among mothers of young girls. Health Psychol2010; 29:29–39. doi:10.1037/a0016942•Google Scholar•PubMed
Ogilvie D, Fayter D, Petticrew M, et al. The harvest plot: a method for synthesising evidence about the differential effects of interventions. BMC Med Res Methodol2008; 8. doi:10.1186/1471-2288-8-8•Google Scholar•PubMed
Control ECfDPa. Catalogue of interventions addressing vaccine hesitancy. Stockholm, European Centre for Disease Prevention and Control2017; Google Scholar
de Figueiredo A, Simas C, Karafillakis E, et al. Mapping global trends in vaccine confidence and investigating barriers to vaccine uptake: a large-scale retrospective temporal modelling study. Lancet2020; 396:898–908. doi:10.1016/S0140-6736(20)31558-0•Google Scholar•PubMed
Madhav N, Oppenheim B, Gallivan M, et al. Pandemics: risks, Impacts, and mitigation, Disease control priorities: improving health and reducing poverty. Washington, DC2017; Google Scholar
Omer SB, Salmon DA, Orenstein WA, et al. Vaccine refusal, mandatory immunization, and the risks of vaccine-preventable diseases. N Engl J Med2009; 360:1981–8. doi:10.1056/NEJMsa0806477•Google Scholar•PubMed