Material incentives and other potential factors associated with response rates to Internet surveys of American Evaluation Association Members: Findings from a randomized experiment

Chris L.S. Coryn, Lyssa W. Becho, Carl D. Westine, Pedro F. Mateu, Ruqayyah N. Abu-Obaid, Kristin A. Hobson, Daniela C. Schröter, Erica L. Dodds, Anne T. Vo, Mary Ramlow

Research output: Contribution to journalArticle in a journalpeer-review

2 Scopus citations

Abstract

Internet surveys of American Evaluation Association (AEA) members are a common method for studying evaluation practice. Response rates obtained from Internet surveys of AEA members are, however, frequently very small. To investigate whether or not material incentives increase response rates to Internet surveys of AEA members, a between-subjects three-treatment and one control randomized experiment in which a randomly selected sample of AEA members were randomly assigned to a no-incentive control condition, lottery condition, token incentive condition, or philanthropic donation incentive condition was utilized. The overall response rate to the survey was 39.66% and the response rates for each of the four conditions were control = 36.24%, lottery = 44.39%, token incentive = 43.28%, and philanthropic donation = 34.67%, respectively. The cost-effectiveness of each of the four conditions also was examined, demonstrating that the lottery was the most cost-effective. Other factors potentially influencing response or nonresponse decisions also are discussed.
Original languageEnglish
Pages (from-to)277-296
Number of pages20
JournalAmerican Journal of Evaluation
Volume41
Issue number2
DOIs
StatePublished - 1 Jun 2020

Bibliographical note

Funding text: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Interdisciplinary PhD in Evaluation (IDPE) program at Western Michigan University (WMU).

Keywords

  • American Evaluation Association
  • research on evaluation
  • survey incentives
  • survey response rates

Fingerprint

Dive into the research topics of 'Material incentives and other potential factors associated with response rates to Internet surveys of American Evaluation Association Members: Findings from a randomized experiment'. Together they form a unique fingerprint.

Cite this