Figures
Abstract
Objective
To support efforts to address parental hesitancy towards early childhood vaccination, we sought to validate the Vaccination Confidence Scale using data from a large, population-based sample of U.S. parents.
Methods
We used weighted data from 9,354 parents who completed the 2011 National Immunization Survey. Parents reported on the immunization history of a 19- to 35-month-old child in their households. Healthcare providers then verified children’s vaccination status for vaccines including measles, mumps, and rubella (MMR), varicella, and seasonal flu. We used separate multivariable logistic regression models to assess associations between parents’ mean scores on the 8-item Vaccination Confidence Scale and vaccine refusal, vaccine delay, and vaccination status.
Results
A substantial minority of parents reported a history of vaccine refusal (15%) or delay (27%). Vaccination confidence was negatively associated with refusal of any vaccine (odds ratio [OR] = 0.58, 95% confidence interval [CI], 0.54–0.63) as well as refusal of MMR, varicella, and flu vaccines specifically. Negative associations between vaccination confidence and measures of vaccine delay were more moderate, including delay of any vaccine (OR = 0.81, 95% CI, 0.76–0.86). Vaccination confidence was positively associated with having received vaccines, including MMR (OR = 1.53, 95% CI, 1.40–1.68), varicella (OR = 1.54, 95% CI, 1.42–1.66), and flu vaccines (OR = 1.32, 95% CI, 1.23–1.42).
Citation: Gilkey MB, McRee A-L, Magnus BE, Reiter PL, Dempsey AF, Brewer NT (2016) Vaccination Confidence and Parental Refusal/Delay of Early Childhood Vaccines. PLoS ONE 11(7): e0159087. https://doi.org/10.1371/journal.pone.0159087
Editor: Anne C. Moore, University College Cork, IRELAND
Received: January 15, 2016; Accepted: June 27, 2016; Published: July 8, 2016
Copyright: © 2016 Gilkey et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Due to NCHS restrictions aimed at ensuring participants’ confidentiality, we do not have access to the dataset. However, investigators wishing to use NIS data may contact the NCHS Research Data Center (http://www.cdc.gov/rdc/) to complete a proposal and receive ethics approval. Upon approval, NIS data are available to all interested researchers.
Funding: This study was supported by: 1. An Academic Pediatric Association Young Investigator Award (no award number, to MG, https://www.academicpeds.org/research/research_YIA_APA.cfm) 2. The National Cancer Institute (R25 CA57726 to MG, K22 CA186979 to MG, http://www.cancer.gov/) The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors of this manuscript have the following competing interests. PR has received HPV vaccine-related grants from Merck Sharp & Dohme Corp. and from Cervical Cancer-Free America whose funding came from an unrestricted educational grant from GlaxoSmithKline. AD serves on advisory boards for Merck and Pfizer, but has not received any research funding from these companies. NB has received HPV vaccine-related grants from or been on advisory boards for GlaxoSmithKline and Merck. MG, BM, and ALM have no disclosures to report. This does not alter the authors' adherence to PLOS ONE polices on sharing data and materials.
Introduction
From January 2014 to June 2015, the Centers for Disease Control and Prevention documented over 800 cases of measles in the United States, including a cluster of 117 cases linked to a California amusement park [1]. The highly publicized “Disneyland outbreak” brought national attention to the rising incidence of measles specifically as well as to the issue of parents’ hesitancy to vaccinate their children against infectious diseases more generally [2]. Public health research to date largely supports assertions made in the popular press that parents’ confidence in routine vaccination has eroded in recent years, leading to vaccine refusal and delay [3–6]. Evidence of this trend comes indirectly from several sources, including studies that show that parents are more often requesting exemptions to school entry requirements for vaccination and that providers perceive parental vaccine refusal as being more common than in the past [3–6]. However, neither vaccine refusal and delay, nor the underlying concerns that motivate these behaviors, are routinely assessed in the National Immunization Survey or other ongoing, large-scale surveillance efforts. For this reason, our ability to more directly quantify changes in the prevalence of vaccine hesitancy is limited.
Public health experts, including the National Vaccine Advisory Committee (NVAC), have highlighted the need to address this gap through additional research on vaccine refusal and delay [7]. In a recent report, the NVAC Vaccine Confidence Working Group placed special emphasis on developing valid and reliable measures to assess parental beliefs and other determinants of forgone vaccination [7]. Toward this end, we developed the Vaccination Confidence Scale, an 8-item, 3-factor scale that measures beliefs related to the perceived benefits of vaccination, the perceived harms of vaccination, and trust in vaccine providers [8]. We originally created our scale to assess parental beliefs related to adolescent vaccination, and in a prior validation study, we found that parents’ mean Vaccination Confidence Scale scores were consistently associated with vaccine refusal and vaccination status for vaccines in the adolescent platform, including meningococcal and human papillomavirus (HPV) vaccines [9]. This success raises the possibility that a modified version of our scale could be useful for assessing vaccination beliefs related to early childhood vaccines, including measles, mumps, and rubella (MMR) vaccine.
To investigate this question, we conducted a second validation study of the Vaccination Confidence Scale. Using data from a nationally-representative sample of parents, we sought to assess associations between vaccination confidence and vaccine refusal, vaccine delay, and vaccination status for vaccines administered in early childhood. By broadening our scale’s application to include early childhood vaccination, this study aims to support ongoing efforts to understand and increase the public’s vaccination confidence so as to reduce vaccine refusal and delay across the life course.
Methods
Participants and Data Source
Data came from the 2011 National Immunization Survey (NIS). As described previously, the NIS is a population-based survey conducted annually by the Centers for Disease Control and Prevention with the primary goal of assessing children’s vaccination status; in 2011, the survey also included questions to assess parents’ vaccination beliefs [10]. In the first phase of data collection, a probability sample of parents and guardians participated in a landline or cellular telephone survey; the purpose of this survey was to assess the immunization history of a randomly selected 19- to 35-month-old child in the household. (To facilitate reporting, we refer to respondents hereafter as “parents.”) For those parents who gave consent, a second phase of data collection involved a mail-based survey sent to children’s vaccine providers; the purpose of this survey was to assess children’s vaccination status using medical records.
The response rate for the 2011 NIS household survey was 62% for the landline telephone sample and 25% for the cellular telephone sample [11]. Across the samples, providers returned adequate data for 72% of all respondents. We drew our analytic sample from 12,580 parents with adequate provider-confirmed vaccination data who completed the “Parental Concerns Module,” a special set of questions included in the 2011 NIS. We excluded parents who had missing data on variables related to vaccination beliefs or behaviors (n = 2,461) or who completed the survey in a language other than English (n = 765). Our final analytic sample consisted of the remaining 9,354 parents.
The National Center for Health Statistics (NCHS) Research Ethics Review Board approved data collection for the 2011 NIS. Analysis of de-identified data from the survey is exempt from the federal regulations for the protection of human research participants. We accessed data from the Parental Concerns Module through the NCHS Research Data Center because these restricted variables are not included in the public-use dataset. Analysis of restricted data through the NCHS Research Data Center was approved by the NCHS Ethics Review Board. The University of North Carolina Institutional Review Board determined that this study was exempt from further review.
Measures
The 2011 NIS Parental Concerns Module assessed parents’ vaccination beliefs with survey items that used an 11-point response scale ranging from 0 (“strongly disagree”) to 10 (“strongly agree”). The module included items corresponding to the 8 items from the 2010 NIS-Teen that we used to develop the Vaccination Confidence Scale in a prior study, with the difference being that NIS-Teen items referred to “teenagers” while NIS items referred to “children” [8]. The resulting scale consisted of factors assessing perceived benefits of adolescent vaccination (i.e., “Benefits,” α = 0.78), perceived harms (“Harms,” α = 0.56), and trust in healthcare providers (“Trust,” α = 0.55) (Fig 1). To assess overall confidence, we calculated mean scale scores for each parent by averaging responses for all 8 items, after reverse coding negative beliefs in the Harms factor. The resulting scores had a possible range of 0 to 10 with higher scores indicating more positive beliefs about vaccination. We next calculated mean scores for the Benefits, Harms (without reverse coding), and Trust factors by averaging the item responses within each factor.
The Parental Concerns Module also assessed parental refusal and delay of early childhood vaccines. The survey assessed history of any vaccine refusal with a single item: “Has there ever been a time when you refused or decided not to get a vaccination for [CHILD NAME]?” For those reporting any refusal, separate items with yes/no response options assessed whether parents had refused specific vaccines, including measles/measles-mumps-rubella/MMR; chicken pox/varicella; and seasonal influenza/flu shot/flu nasal spray/FluMist. The survey also assessed history of any vaccine delay: “Has there ever been a time when you delayed or put off getting a vaccination for [CHILD NAME]?” For those reporting any delay, parents reported which vaccines they had delayed as for vaccine refusal. Items on refusal and delay used yes/no response options.
The 2011 NIS household survey assessed demographic characteristics including the child’s age, sex, and race/ethnicity (Table 1). NCHS analysts used demographic data to determine children’s eligibility for the Vaccines for Children (VFC) program, which provides free vaccines for children whose families have limited ability to pay [12]. Survey respondents indicated their relationship to the child, the age and educational attainment of the child’s mother, and the annual income and geographic location of the household.
The 2011 NIS provider survey assessed the child’s vaccination status for vaccines in the routine immunization schedule. Providers used medical records to indicate the dates on which the child received vaccine doses, and NCHS analysts then determined whether the child was up-to-date by age 36 months for vaccinations including ≥1 dose of MMR, ≥1 dose of varicella, and ≥1 dose of seasonal flu vaccines [10,11]. The NCHS also reported whether children were up-to-date for the 4:3:1:-:3:1:4 combined series, which included ≥4 doses of tetanus-containing vaccine, ≥3 doses of poliovirus vaccine, ≥1 dose of measles-containing vaccine, ≥3 doses of hepatitis B, ≥1 dose of varicella vaccine, and ≥4 doses of pneumococcal conjugate vaccine (PCV). As indicated by the dash (-), this series excluded Haemophilus influenzae type b (Hib) due to a shortage of that vaccine during the study period.
Statistical Analyses
To investigate the relationship between overall vaccination confidence and vaccination behavior, we used separate logistic regression models to assess the association between mean Vaccination Confidence Scale scores and vaccine refusal and delay. We examined these outcomes for any vaccine, as well as for MMR, varicella, and flu vaccines specifically. We also used logistic regression to assess the association between mean scale scores and vaccination status for the combined series, as well as for MMR, varicella, and flu vaccines separately. To explore the relative influence of each scale factor, we re-ran logistic regression models using all three factors, instead of a single overall scale score. Models controlled for three demographic factors that prior research indicates are associated with vaccine refusal or delay: child’s race/ethnicity, mother’s educational attainment, and annual household income [13–14].
Our analyses used survey weights developed by NCHS analysts to obtain nationally representative estimates. We report raw frequencies and weighted means, percentages, and odds ratios. Conducted in SAS 9.3 (Cary, NC), all statistical tests were 2-tailed with a critical alpha of 0.05.
Results
Sample Characteristics
Parents reported on roughly equal numbers of male (53%) and female (47%) children (Table 1). Most children were non-Hispanic white (61%), non-Hispanic black (14%), or Hispanic (15%). Almost half were eligible for the Vaccines for Children program (45%). About three-quarters of parents were mothers or female guardians (78%). A substantial minority of parents had a high school degree or less education (39%) or lived below the poverty threshold (29%).
Vaccination Confidence
Parents reported high levels of vaccination confidence. The mean score for the full, 8-item scale was 8.30 (standard error [SE] = 0.03). Factor score means were 8.72 (SE = 0.03) for Benefits, 3.58 (SE = 0.05) for Harms (without reverse coding), and 9.34 (SE = 0.03) for Trust.
Scale Validation
Vaccine refusal.
Fifteen percent of parents reported having refused any vaccine for their child, with refusal of specific vaccines being 3% for MMR, 3% for varicella, and 10% for flu (Table 2). Overall vaccination confidence was negatively associated with refusal of any vaccine such that every one point increase in the scale mean corresponded with a 42% decrease in the odds of refusal (odds ratio [OR] = 0.58, 95% confidence interval [CI], 0.54–0.63). Vaccination confidence was also negatively associated with refusal of MMR, varicella, and flu vaccines.
In models that included the three factors separately, the Benefits factor was most strongly associated with refusal of any vaccine (OR = 0.73, 95% CI, 0.68–0.78), as well as with the refusal of MMR, varicella, and flu vaccines specifically. The Harms factor was less strongly associated with refusal of any vaccine (OR = 1.19, 95% CI, 1.15–1.24), as well as with the refusal of MMR, varicella, and flu vaccines. Trust was not associated with refusal of any vaccine, but was positively associated with refusal of MMR and varicella vaccines, contrary to our expectations.
Vaccine delay
Twenty-seven percent of parents reported having delayed any vaccine for their child, with delay of specific vaccines being 8% for MMR, 7% for varicella, and 11% for flu (Table 3). In models using the full 8-item scale, vaccination confidence was negatively associated with delay of any vaccine (OR = 0.81, 95% CI, 0.76–0.86), as well as with delay of MMR, varicella, and flu vaccines.
In models using the three factors, Benefits again demonstrated the strongest association with delay of any vaccine (OR = 0.83, 95% CI, 0.87–0.99), as well as with delay of MMR, varicella, and flu vaccines. The Harms factor was positively associated with any vaccine delay (OR = 1.08, 95% CI, 1.05–1.12), as well as with delay of MMR, varicella, and flu vaccines. Trust was not associated with any of the four measures of vaccine delay.
Vaccination status.
Seventy-four percent of children were up-to-date for the combined vaccine series, with vaccine-specific coverage being 91% for MMR, 91% for varicella, and 35% for flu (Table 4). In models using the full 8-item scale, vaccination confidence was positively associated with coverage for the combined series (OR = 1.35, 95% CI, 1.27–1.44), as well as with coverage of MMR, varicella, and flu vaccines.
In models using the three factors, Benefits was positively associated with coverage for the combined series (OR = 1.16, 95% CI, 1.09–1.23), as well as coverage of MMR, varicella, and flu vaccines. The Harms factor was negatively associated with coverage for the combined series (OR = 0.93, 95% CI, 0.90, 0.96), as well as coverage of MMR, varicella, and flu vaccines. Trust was associated with coverage for the combined series only (OR = 1.08, 95% CI, 1.01–1.17).
Discussion
Using data from a large, nationally-representative sample of parents, we found that vaccination confidence was consistently associated with behaviors related to early childhood vaccination. Mean scores on the Vaccination Confidence Scale were most strongly associated with measures of vaccine refusal, with each one point increase in mean scale scores corresponding with a reduction in the odds of refusal ranging from 42% for any vaccine to 61% for MMR. Although we identified a similar pattern of findings in a prior study focusing on adolescent vaccines [9], the associations between mean scale scores and measures of vaccine refusal were greater in magnitude for the early childhood vaccines that were the focus of the present study. These findings suggest that vaccination confidence may be particularly salient for parents of young children, who are faced with relatively frequent decisions about whether or not to accept vaccinations [13–17].
In addition to vaccine refusal, we found that vaccination confidence was consistently associated with measures of vaccine delay and vaccination status. Each one point increase in mean scale scores was associated with a reduction in the odds of delay ranging from 19% for any vaccine to 33% for varicella vaccine. Here again, our scale appeared to perform more strongly for early childhood vaccines than adolescent vaccines, as our prior study found that scale scores were only weakly and inconsistently associated with adolescent vaccine delay [9]. In the case of vaccination status, each one point increase in mean scale scores was associated with an improvement in the odds of vaccination ranging from 32% for flu vaccine to 54% for varicella vaccine. These findings on early childhood vaccination status are comparable to the associations we observed in our prior study of adolescent vaccines [9].
When we examined the performance of individual factors within our scale, we found that, across our measures of refusal, delay, and vaccination status, the Benefits factor was most strongly associated with vaccination behavior. As in our prior study [9], our findings suggest that the Benefits items offer a possible “short form” of our scale. The Harms factor was also associated with these measures, although somewhat less strongly. These findings are consistent with the well-established literature on the Health Belief Model, which documents the influence of perceived risks and benefits on vaccination behavior [13,18–19]. In contrast to Benefits and Harms, we were surprised to note that the Trust factor was associated with only three measures of vaccination behavior, and in two instances, these associations were not in the expected direction. Given the extent to which prior research has emphasized the importance of the parent-provider relationship in parents’ vaccine-related decision making [13,20–22], our findings likely reflect shortcomings in our measure of trust. For example, our measure was specific to healthcare providers; trust in other entities, such as pharmaceutical companies or governmental bodies, may also be relevant, as well as trust in vaccines themselves. Furthermore, the high mean value for this construct suggests a possible ceiling effect, whereby respondents endorsed trust items so highly that meaningful variation was lacking. Future research can extend the present study by developing and evaluating items that better capture variation with regard to parents’ trust of their children’s vaccine providers or the healthcare system more generally.
Overall, our findings provide strong support for broadening the application of the Vaccination Confidence Scale to measure parents’ beliefs about early childhood vaccination. Specifically, we anticipate that our brief scale can complement existing measures [23–26] to expand our ability to conduct surveillance of vaccine hesitancy, a goal prioritized by the NVAC Vaccine Confidence Working Group [7]. Similarly, our scale could also be used for evaluating interventions to address vaccine hesitancy and for segmenting audiences to facilitate the development and delivery of messages targeted by parents’ level of vaccination confidence. Such targeting is important because parents’ informational needs vary according to the extent of their vaccine-related concerns [27]. Although the Vaccination Confidence Scale may have clinical applications as a screening tool to identify parents at risk for refusing or delaying early childhood vaccines, additional research will be needed to assess the effectiveness of using our scale as an individual- versus population-level measure.
Strengths of this study include the validation of our scale with regard to vaccine refusal and delay, two behaviors that are more relevant than vaccination status alone to understanding parents’ participation in immunization programs. This study is also strengthened by the use of data from the NIS, a large, nationally-representative survey of parents which also offers provider-reported data on children’s vaccination status. Limitations of this study include its cross-sectional design, which limits our ability to establish the directionality of the relationship between vaccination confidence and behavior. Future research can build upon the present study by prospectively assessing Vaccination Confidence Scale scores and subsequent refusal or delay of early childhood vaccines. This study was also limited by its focus on parents’ vaccination beliefs. Although this focus served the study’s primary goal of validating the Vaccination Confidence Scale, we acknowledge that other factors, such as provider recommendations and clinical systems for patient recall and reminders, are also important determinants of early childhood vaccination coverage [28–31].
In conclusion, the findings of this study suggest that vaccination confidence is closely tied to early childhood vaccination behavior. Parents’ mean scores on the 8-item Vaccination Confidence Scale were consistently associated with vaccine refusal, vaccine delay, and vaccination status across a variety of early childhood vaccines. Indeed, although we originally developed our scale to investigate parental beliefs about adolescent vaccines, the findings of this study suggest that our measure is even more relevant to the context of early childhood vaccination. Additional prospective research will be needed to characterize causal pathways between vaccination confidence and behavior, but we believe that the present study suggests considerable promise for using the Vaccination Confidence Scale as a brief measure of vaccination beliefs relevant to vaccine hesitancy. In this way, our scale can offer a measurement tool to support public health efforts to build parents’ confidence in immunization programs so as to protect individuals and communities from vaccine preventable diseases.
Author Contributions
Conceived and designed the experiments: MG BM NB. Analyzed the data: MG BM NB. Wrote the paper: MG ALM BM PR AD NB.
References
- 1.
Centers for Disease Control and Prevention. Measles cases and outbreaks. 2015. Available: http://www.cdc.gov/measles/cases-outbreaks.html.
- 2. Clemmons NS, Gastanaduy PA, Fiebelkorn AP, Redd SB, Wallace GS. Measles—United States, January 4-April 2, 2015. MMWR Morb Mortal Wkly Rep. 2015;64: 373–376. pmid:25879894
- 3. Omer SB, Pan WK, Halsey NA, Stokley S, Moulton LH, Navar AM, et al. Nonmedical exemptions to school immunization requirements: secular trends and association of state policies with pertussis incidence. JAMA. 2006;296: 1757–1763. pmid:17032989
- 4. Kempe A, Daley MF, McCauley MM, Crane LA, Suh CA, Kennedy AM, et al. Prevalence of parental concerns about childhood vaccines: the experience of primary care physicians. Am J Prev Med. 2011;40: 548–555. pmid:21496754
- 5. Imdad A, Tserenpuntsag B, Blog DS, Halsey NA, Easton DE, Shaw J. Religious exemptions for immunization and risk of pertussis in New York State, 2000–2011. Pediatrics. 2013;132: 37–43. pmid:23733795
- 6. Robison SG1, Groom H, Young C. Frequency of alternative immunization schedule use in a metropolitan area. Pediatrics. 2012;130: 32–38. pmid:22711719
- 7.
U.S. Department of Health and Human Services. NVAC Vaccine Confidence Working Group. Assessing the State of Vaccine Confidence in the United States: Recommendations from the National Vaccine Advisory Committee. 2015. Available: http://www.hhs.gov/nvpo/nvac/reports/nvac-vaccine-confidence-public-health-report-2015.pdf. http://www.hhs.gov/nvpo/nvac/subgroups/nvac-vaccine-confidence-wg.html.
- 8. Gilkey MB, Magnus BE, Reiter PL, McRee AL, Dempsey AF, Brewer NT. The Vaccination Confidence Scale: a brief measure of parents' vaccination beliefs. Vaccine. 2014;32: 6259–6265. pmid:25258098
- 9. Gilkey MB, Reiter PL, Magnus BE, McRee AL, Dempsey AF, Brewer NT. Validation of the Vaccination Confidence Scale: a brief measure to identify parents at risk for refusing adolescent vaccines. Acad Pediatr. 2015 Aug 20. pii: S1876-2859(15)00215-6.
- 10.
Centers for Disease Control and Prevention. Datasets and related documentation for the National Immunization Survey, 2010–2014. 2015. Available: http://www.cdc.gov/nchs/nis/data_files.htm.
- 11.
Centers for Disease Control and Prevention. National Immunization Survey: a user’s guide for the 2011 public-use data file. 2015. Available: ftp://ftp.cdc.gov/pub/Health_Statistics/NCHS/Dataset_Documentation/NIS/NISPUF11_DUG.PDF.
- 12.
Centers for Disease Control and Prevention. Vaccines for Children (VFC) Program. 2015. Available: http://www.cdc.gov/vaccines/programs/vfc/index.html.
- 13. Smith PJ, Humiston SG, Marcuse EK, Zhao Z, Dorell CG, Howes C, et al. Parental delay or refusal of vaccine doses, childhood vaccination coverage at 24 months of age, and the Health Belief Model. Public Health Rep. 2011;126 Suppl 2: 135–146. pmid:21812176
- 14. Gilkey MB, McRee AL, Brewer NT. Forgone vaccination during childhood and adolescence: findings of a statewide survey of parents. Prev Med. 2013;56: 202–206. pmid:23295175
- 15. Fredrickson DD, Davis TC, Arnould CL, Kennen EM, Hurniston SG, Cross JT, et al. Childhood immunization refusal: provider and patient perceptions. Fam Med. 2004;36: 431–439. pmid:15181556
- 16. Gust DA, Strine TW, Maurice E, Smith P, Yusuf H, Wilkinson M, et al. Underimmunization among children: effects of vaccine safety concerns on immunization status. Pediatrics. 2004;114: e16–e22. pmid:15231968
- 17. Dempsey AF, Schaffer S, Singer D, Butchart A, Davis M, Freed GL. Alternative vaccination schedule preferences among parents of young children. Pediatrics. 2011;128: 848–856. pmid:21969290
- 18. Rosenstock IM. Historical origins of the Health Belief model. Health Educ Behav. 1974;2: 328–335.
- 19. Reiter PL, Brewer NT, Gottlieb SL, McRee AL, Smith JS. Parents' health beliefs and HPV vaccination of their adolescent daughters. Soc Sci Med. 2009;69: 475–480. pmid:19540642
- 20. Benin AL, Wisler-Scher DJ, Colson E, Shapiro ED, Homnboe ES. Qualitative analysis of mothers’ decision-making about vaccines for infants: the importance of trust. Pediatrics. 2006;117: 1532–1541. pmid:16651306
- 21. Gust DA, Darling N, Kennedy A, Schwartz B. Parents with doubts about vaccines: which vaccines and reasons why. Pediatrics. 2008;122: 718–725. pmid:18829793
- 22. Senier L. “It’s your most precious thing”: worst-case thinking, trust, and parental decision making about vaccination. Sociol Inq. 2008;78: 207–229.
- 23. Opel DJ, Taylor JA, Zhou C, Catz S, Myaing M, Mangione-Smith R. The relationship between parent attitudes about childhood vaccines survey scores and future child immunization status: a validation study. JAMA Pediatr. 2013;167: 1065–1071. pmid:24061681
- 24. McRee AL, Brewer NT, Reiter PL, Gottlieb SL, Smith JS. The Carolina HPV immunization attitudes and beliefs scale (CHIAS): scale development and associations with intentions to vaccinate. Sex Transm Dis. 2010;37: 234–239. pmid:19940807
- 25. Larson HJ, Jarrett C, Schulz WS, Chaudhuri M, Zhou Y, Dube E, et al. Measuring vaccine hesitancy: the development of a survey tool. Vaccine. 2015;33:4165–4175. pmid:25896384
- 26. Larson HJ, Schulz WS, Tucker JD, Smith DM. Measuring vaccine confidence: introducing a global vaccine confidence index. PLoS Curr. 2015 Feb 25;7.
- 27. Nyhan B, Reifler J, Richey S, Freed GL. Effective messages in vaccine promotion: a randomized trial. Pediatrics. 2014;133: e835–e842. pmid:24590751
- 28. Smith PJ, Marcuse EK, Seward JF, Zhao Z, Orenstein WA. Children and adolescents unvaccinated against measles: geographic clustering, parents’ beliefs, and missed opportunities. Public Health Rep. 2015;130: 1–20.
- 29. Szilagyi PG, Rodewald LE. Missed opportunities for immunizations: a review of the evidence. J Public Health Manag Pract. 1996;2: 18–25. pmid:10186652
- 30. Dubé E, Laberge C, Guay M, Bramadat P, Roy R, Bettinger J. Vaccine hesitancy: an overview. Hum Vaccin Immunother. 2013;9: 1763–1773. pmid:23584253
- 31. Opel DJ, Heritage J, Taylor JA, Mangione-Smith R, Salas HS, Devere V, et al. The architecture of provider-parent vaccine discussions at health supervision visits. Pediatrics. 2013;132: 1037–1046. pmid:24190677