Skip to main content
Log in

Can incentives undermine intrinsic motivation to participate in epidemiologic surveys?

  • METHODS
  • Published:
European Journal of Epidemiology Aims and scope Submit manuscript

Abstract

Response rates to surveys are decreasing. The purpose of this study was to evaluate the use of lottery tickets as incentives in an epidemiologic control group. A self-administered questionnaire was sent to parents in the municipality of Stockholm, Sweden, who were to be used as a control group in a study addressing stress in parents of children with cancer. A stratified random sample of 450 parents were randomized into three incentive groups: (a) no incentive; (b) a promised incentive of one lottery ticket to be received upon reply; (c) a promised incentive of one lottery ticket to be received upon reply and an additional lottery ticket upon reply within 1 week. The overall response rate across the three groups was 65.3%. The response rate was highest in the no incentive group (69.3%) and lowest in the one plus one lottery ticket group (62.0%). In a survival analysis, the difference between the two response curves was significant by the log-rank test (P = 0.04), with the no incentive group having a shorter time to response than the incentive group. Our findings suggest that the use of lottery tickets as incentives to increase participation in a mail questionnaire among parents may be less valuable or even harmful. Incentives may undermine motivation in studies in which the intrinsic motivation of the respondents is already high.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. De Leeuw ED, De Heer W. Trends in household survey nonresponse: a longitudinal and international comparison. In: Groves RM, Dillman DA, Eltinge JL, Little RJA, editors. Survey nonresponse. New York: Wiley; 2002. p. 41–54.

    Google Scholar 

  2. Tolonen H, Helakorpi S, Talala K, Helasoja V, Martelin T, Prättälä R. 25-year trends and socio-demographic differences in response rates: finnish adult health behaviour survey. Eur J Epidemiol. 2006;21:409–15.

    Article  PubMed  Google Scholar 

  3. Edwards PJ, Roberts IG, Clarke MJ, et al. Methods to increase response rates to postal questionnaires. Cochrane Database Syst Rev. 2007;(2):MR000008 (doi:10.1002/14651858.MR000008.pub3).

  4. Church AH. Estimating the Effect of incentives on mail survey response rates: a meta-analysis. Public Opin Q. 1993;57:62–79.

    Article  Google Scholar 

  5. Ulrich CM, Danis M, Koziol D, Garrett-Mayer E, Hubbard R, Grady C. Does it pay to pay? A randomized trial of prepaid financial incentives and lottery incentives in surveys of nonphysician healthcare professionals. Nurs Res. 2005;54:178–83.

    Article  PubMed  Google Scholar 

  6. Moyer A, Brown M. Effect of participation incentives on the composition of national health surveys. J Health Psychol. 2008;13:870–3.

    Article  PubMed  Google Scholar 

  7. Finsen V, Storeheier AH. Scratch lottery tickets are a poor incentive to respond to mailed questionnaires. BMC Med Res Methodol. 2006;6:19.

    Article  PubMed  Google Scholar 

  8. Whiteman MK, Langenberg P, Kjerulff K, McCarter R, Flaws JA. A randomized trial of incentives to improve response rates to a mailed women’s health questionnaire. J Womens Health. 2003;12:821–8.

    Article  Google Scholar 

  9. Robertson J, Walkom EJ, McGettigan P. Response rates and representativeness: a lottery incentive improves physician survey return rates. Pharmacoepidemiol Drug Saf. 2005;14:571–7.

    Article  PubMed  Google Scholar 

  10. Koloski NA, Talley NJ, Boyce PM, Morris-Yates AD. The effects of questionnaire length and lottery ticket inducement on the response rate in mail surveys. Psychol Health. 2001;16:67–75.

    Article  Google Scholar 

  11. Pandeya N, Williams GM, Green AC, Webb PM, Whiteman DC. Do low control response rates always affect the findings? Assessments of smoking and obesity in two Australian case-control studies of cancer. Aust N Z J Public Health. 2009;33:312–9.

    Article  PubMed  Google Scholar 

  12. Gilbart E, Kreiger N. Improvement in cumulative response rates following implementation of a financial incentive. Am J Epidemiol. 1998;148:97–9.

    CAS  PubMed  Google Scholar 

  13. Marrett LD, Kreiger N, Dodds L, Hilditch S. The effect on response rates of offering a small incentive with a mailed questionnaire. Ann Epidemiol. 1992;2:745–53.

    Article  CAS  PubMed  Google Scholar 

  14. Coogan PF, Rosenberg L. Impact of a financial incentive on case and control participation in a telephone interview. Am J Epidemiol. 2004;160:295–8.

    Article  PubMed  Google Scholar 

  15. Lindahl Norberg A. Burnout in mothers and fathers of children surviving brain tumour. J Clin Psychol Med Settings. 2007;14:130–7.

    Article  Google Scholar 

  16. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24:385–96.

    Article  CAS  PubMed  Google Scholar 

  17. Melamed S, Kushnir T, Shirom A. Burnout and risk factors for cardiovascular diseases. Behav Med. 1992;18:53–60.

    CAS  PubMed  Google Scholar 

  18. Sanne B, Torp S, Mykletun A, Dahl AA. The Swedish demand-control-support questionnaire (DCSQ): factor structure, item analyses, and internal consistency in a large population. Scand J Public Health. 2005;33:166–74.

    Article  PubMed  Google Scholar 

  19. Grambsch PM, Therneau TM. Proportional hazards test and diagnostics based on weighted residuals. Biometrika. 1994;81:515–26.

    Article  Google Scholar 

  20. Blomberg J, Sandell R. Does a material incentive affect response on a psychotherapy follow-up questionnaire? Psychother Res. 1996;6:155–63.

    Google Scholar 

  21. Harris IA, Khoo OK, Young JM, Solomon MJ, Rae H. Lottery incentives did not improve response rate to a mailed survey: a randomized controlled trial. J Clin Epidemiol. 2008;61:609–10.

    Article  PubMed  Google Scholar 

  22. Nakash RA, Hutton JL, Lamb SE, Gates S, Fisher J. Response and non-response to postal questionnaire follow-up in a clinical trial—a qualitative study of the patient’s perspective. J Eval Clin Pract. 2008;14:226–35.

    Article  PubMed  Google Scholar 

  23. Groves RM, Couper MP. Nonresponse in household interview surveys. New York: Wiley; 1998.

    Google Scholar 

  24. Biemer PP, Lyberg LE. Introduction to survey quality. Hoboken: Wiley; 2003.

    Book  Google Scholar 

  25. McColl E. Commentary: methods to increase response rates to postal questionnaires. Int J Epidemiol. 2007;36:968.

    PubMed  Google Scholar 

  26. Deci EL, Ryan RM. Intrinsic motivation and self-determination in human behavior. New York: Plenum Press; 1985.

    Google Scholar 

  27. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55:68–78.

    Article  CAS  PubMed  Google Scholar 

  28. Gagne M, Forest J. The study of compensation systems through the lens of self-determination theory: reconciling 35 years of debate. Can Psychol. 2008;49:225–32.

    Google Scholar 

Download references

Acknowledgments

The authors gratefully acknowledge the time and energy contributed by the participating parents—with or without incentives.

Funding

This work was supported by the Children’s Cancer Foundation of Sweden [RKT05/006].

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marika Wenemark.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wenemark, M., Vernby, Å. & Norberg, A.L. Can incentives undermine intrinsic motivation to participate in epidemiologic surveys?. Eur J Epidemiol 25, 231–235 (2010). https://doi.org/10.1007/s10654-010-9434-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10654-010-9434-8

Keywords

Navigation