Abstract
Response rates to surveys are decreasing. The purpose of this study was to evaluate the use of lottery tickets as incentives in an epidemiologic control group. A self-administered questionnaire was sent to parents in the municipality of Stockholm, Sweden, who were to be used as a control group in a study addressing stress in parents of children with cancer. A stratified random sample of 450 parents were randomized into three incentive groups: (a) no incentive; (b) a promised incentive of one lottery ticket to be received upon reply; (c) a promised incentive of one lottery ticket to be received upon reply and an additional lottery ticket upon reply within 1 week. The overall response rate across the three groups was 65.3%. The response rate was highest in the no incentive group (69.3%) and lowest in the one plus one lottery ticket group (62.0%). In a survival analysis, the difference between the two response curves was significant by the log-rank test (P = 0.04), with the no incentive group having a shorter time to response than the incentive group. Our findings suggest that the use of lottery tickets as incentives to increase participation in a mail questionnaire among parents may be less valuable or even harmful. Incentives may undermine motivation in studies in which the intrinsic motivation of the respondents is already high.
Similar content being viewed by others
References
De Leeuw ED, De Heer W. Trends in household survey nonresponse: a longitudinal and international comparison. In: Groves RM, Dillman DA, Eltinge JL, Little RJA, editors. Survey nonresponse. New York: Wiley; 2002. p. 41–54.
Tolonen H, Helakorpi S, Talala K, Helasoja V, Martelin T, Prättälä R. 25-year trends and socio-demographic differences in response rates: finnish adult health behaviour survey. Eur J Epidemiol. 2006;21:409–15.
Edwards PJ, Roberts IG, Clarke MJ, et al. Methods to increase response rates to postal questionnaires. Cochrane Database Syst Rev. 2007;(2):MR000008 (doi:10.1002/14651858.MR000008.pub3).
Church AH. Estimating the Effect of incentives on mail survey response rates: a meta-analysis. Public Opin Q. 1993;57:62–79.
Ulrich CM, Danis M, Koziol D, Garrett-Mayer E, Hubbard R, Grady C. Does it pay to pay? A randomized trial of prepaid financial incentives and lottery incentives in surveys of nonphysician healthcare professionals. Nurs Res. 2005;54:178–83.
Moyer A, Brown M. Effect of participation incentives on the composition of national health surveys. J Health Psychol. 2008;13:870–3.
Finsen V, Storeheier AH. Scratch lottery tickets are a poor incentive to respond to mailed questionnaires. BMC Med Res Methodol. 2006;6:19.
Whiteman MK, Langenberg P, Kjerulff K, McCarter R, Flaws JA. A randomized trial of incentives to improve response rates to a mailed women’s health questionnaire. J Womens Health. 2003;12:821–8.
Robertson J, Walkom EJ, McGettigan P. Response rates and representativeness: a lottery incentive improves physician survey return rates. Pharmacoepidemiol Drug Saf. 2005;14:571–7.
Koloski NA, Talley NJ, Boyce PM, Morris-Yates AD. The effects of questionnaire length and lottery ticket inducement on the response rate in mail surveys. Psychol Health. 2001;16:67–75.
Pandeya N, Williams GM, Green AC, Webb PM, Whiteman DC. Do low control response rates always affect the findings? Assessments of smoking and obesity in two Australian case-control studies of cancer. Aust N Z J Public Health. 2009;33:312–9.
Gilbart E, Kreiger N. Improvement in cumulative response rates following implementation of a financial incentive. Am J Epidemiol. 1998;148:97–9.
Marrett LD, Kreiger N, Dodds L, Hilditch S. The effect on response rates of offering a small incentive with a mailed questionnaire. Ann Epidemiol. 1992;2:745–53.
Coogan PF, Rosenberg L. Impact of a financial incentive on case and control participation in a telephone interview. Am J Epidemiol. 2004;160:295–8.
Lindahl Norberg A. Burnout in mothers and fathers of children surviving brain tumour. J Clin Psychol Med Settings. 2007;14:130–7.
Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24:385–96.
Melamed S, Kushnir T, Shirom A. Burnout and risk factors for cardiovascular diseases. Behav Med. 1992;18:53–60.
Sanne B, Torp S, Mykletun A, Dahl AA. The Swedish demand-control-support questionnaire (DCSQ): factor structure, item analyses, and internal consistency in a large population. Scand J Public Health. 2005;33:166–74.
Grambsch PM, Therneau TM. Proportional hazards test and diagnostics based on weighted residuals. Biometrika. 1994;81:515–26.
Blomberg J, Sandell R. Does a material incentive affect response on a psychotherapy follow-up questionnaire? Psychother Res. 1996;6:155–63.
Harris IA, Khoo OK, Young JM, Solomon MJ, Rae H. Lottery incentives did not improve response rate to a mailed survey: a randomized controlled trial. J Clin Epidemiol. 2008;61:609–10.
Nakash RA, Hutton JL, Lamb SE, Gates S, Fisher J. Response and non-response to postal questionnaire follow-up in a clinical trial—a qualitative study of the patient’s perspective. J Eval Clin Pract. 2008;14:226–35.
Groves RM, Couper MP. Nonresponse in household interview surveys. New York: Wiley; 1998.
Biemer PP, Lyberg LE. Introduction to survey quality. Hoboken: Wiley; 2003.
McColl E. Commentary: methods to increase response rates to postal questionnaires. Int J Epidemiol. 2007;36:968.
Deci EL, Ryan RM. Intrinsic motivation and self-determination in human behavior. New York: Plenum Press; 1985.
Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55:68–78.
Gagne M, Forest J. The study of compensation systems through the lens of self-determination theory: reconciling 35 years of debate. Can Psychol. 2008;49:225–32.
Acknowledgments
The authors gratefully acknowledge the time and energy contributed by the participating parents—with or without incentives.
Funding
This work was supported by the Children’s Cancer Foundation of Sweden [RKT05/006].
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wenemark, M., Vernby, Å. & Norberg, A.L. Can incentives undermine intrinsic motivation to participate in epidemiologic surveys?. Eur J Epidemiol 25, 231–235 (2010). https://doi.org/10.1007/s10654-010-9434-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10654-010-9434-8