Recruitment and Retention in Multi-Mode Survey Panels

Abstract:

This study builds on a previously published panel recruitment experiment (Rao, Kaminska, and McCutcheon 2010), extending that analysis to an examination of the effectiveness of pre-recruitment factors such as mode and response inducements on three post-recruitment panel participation effects: attrition rates, survey completion rates, and panel data quality. The panel recruitment experiment, conducted with the Gallup Panel, netted 1,282 households with 2,042 panel members. For these recruited members, we collected data on panel participation and retention, and use it for analysis in this study.

This investigation is an important contribution to the growing body of literature on the use of probability-based panels that use multiple modes (i.e., Web and mail).  While previous studies have typically looked at factors affecting panel recruitment, participation, and retention in isolation, we employ an integrated framework for examining the role of these factors on post-recruitment panel participation effects such as attrition, survey completion, and data quality.

Preliminary analysis indicates a number of interesting findings. First, higher panel survey burden (i.e., survey assignment rate) places higher expectations on members to be an active participant in the panel, while negatively impacting their survival in the panel. Second, the effect of incentive at the time of recruitment continues to operate beyond the life of the recruitment phase; those who received the incentive to join the panel completed a greater number of surveys, compared to their non-incentivized counterparts. Interestingly, while incentivizing panel members helps in keeping them in the panel, it does not have the same effect on their performance in the panel, i.e. on panel survey completion rates.

Recommended Citation:

McCutcheon, A. L., Rao, K., & Kaminska, O. (2012). Recruitment and Retention in Multi-Mode Survey Panels. Paper presented at the American Association for Public Opinion Research, Hollywood, FL.

Attached Documents:

  • AAPOR 2012 Program (see page #144 for the mention)
  • For a copy of this presentation, please send me a comment with your email address in the box below.
  • Trackback are closed
  • Comments (1)
    • Brenda
    • January 6th, 2015

    Hi,

    I am working on a project to better analyze our panelists and find which incentives work in order to try and drive most of our metrics up. I think this article will be of great resource. Thanks

Comment are closed.