TY - JOUR
T1 - Material incentives and other potential factors associated with response rates to Internet surveys of American Evaluation Association Members
T2 - Findings from a randomized experiment
AU - Coryn, Chris L.S.
AU - Becho, Lyssa W.
AU - Westine, Carl D.
AU - Mateu, Pedro F.
AU - Abu-Obaid, Ruqayyah N.
AU - Hobson, Kristin A.
AU - Schröter, Daniela C.
AU - Dodds, Erica L.
AU - Vo, Anne T.
AU - Ramlow, Mary
N1 - Funding text: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Interdisciplinary PhD in Evaluation (IDPE) program at Western Michigan University (WMU).
Publisher Copyright:
© The Author(s) 2019.
PY - 2020/6/1
Y1 - 2020/6/1
N2 - Internet surveys of American Evaluation Association (AEA) members are a common method for studying evaluation practice. Response rates obtained from Internet surveys of AEA members are, however, frequently very small. To investigate whether or not material incentives increase response rates to Internet surveys of AEA members, a between-subjects three-treatment and one control randomized experiment in which a randomly selected sample of AEA members were randomly assigned to a no-incentive control condition, lottery condition, token incentive condition, or philanthropic donation incentive condition was utilized. The overall response rate to the survey was 39.66% and the response rates for each of the four conditions were control = 36.24%, lottery = 44.39%, token incentive = 43.28%, and philanthropic donation = 34.67%, respectively. The cost-effectiveness of each of the four conditions also was examined, demonstrating that the lottery was the most cost-effective. Other factors potentially influencing response or nonresponse decisions also are discussed.
AB - Internet surveys of American Evaluation Association (AEA) members are a common method for studying evaluation practice. Response rates obtained from Internet surveys of AEA members are, however, frequently very small. To investigate whether or not material incentives increase response rates to Internet surveys of AEA members, a between-subjects three-treatment and one control randomized experiment in which a randomly selected sample of AEA members were randomly assigned to a no-incentive control condition, lottery condition, token incentive condition, or philanthropic donation incentive condition was utilized. The overall response rate to the survey was 39.66% and the response rates for each of the four conditions were control = 36.24%, lottery = 44.39%, token incentive = 43.28%, and philanthropic donation = 34.67%, respectively. The cost-effectiveness of each of the four conditions also was examined, demonstrating that the lottery was the most cost-effective. Other factors potentially influencing response or nonresponse decisions also are discussed.
KW - American Evaluation Association
KW - research on evaluation
KW - survey incentives
KW - survey response rates
KW - American Evaluation Association
KW - research on evaluation
KW - survey incentives
KW - survey response rates
UR - https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85061091623&origin=inward
UR - https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=85061091623&origin=inward
UR - https://www.mendeley.com/catalogue/8b68173f-8cf9-37b4-b223-d70f815b3222/
U2 - 10.1177/1098214018818371
DO - 10.1177/1098214018818371
M3 - Article in a journal
SN - 1098-2140
VL - 41
SP - 277
EP - 296
JO - American Journal of Evaluation
JF - American Journal of Evaluation
IS - 2
ER -
