Dealing With Extremely Long Response Lists in a Mixed-Mode Survey Environment

Abstract:

In some surveys, respondents are confronted with selecting a response from an extremely long list of response options. For example, in the National Survey of College Graduates (NSCG) mail survey, respondents are asked to select the job code that best describes their work from a long list of job codes (listed on a different page) that are categorized and arranged alphabetically to facilitate easy selection. While various aspects of the findings from this survey have been published, for instance, the effect of previously sent token incentives on subsequent contact rates (see Dillman (2007), page 241), little is known about the measurement error aspect of using extremely long response lists. Read more

Public Opinion toward NAFTA in the United States, Canada and Mexico: Insights from the Gallup World Poll

Abstract:

A commitment to continental free trade has been a major part of the trade policies of the United States, Canada and Mexico for the last 15 years – one embodied in the North American Free Trade Agreement (NAFTA). Public support for NAFTA and impressions of its effects have, however, remained mixed, and have varied over time. Still, attempts to examine public opinion across all three countries in the trade bloc remain few, with most studies limited to a single country. Drawing on data from the Gallup World Poll, we endeavor to remedy this situation by examining public impressions of NAFTA across all three member countries. Read more

Recruitment of Minorities Using Address-Based Sampling (ABS): A Pilot Study

Abstract:

The crisis in coverage of the landline telephone frame has reached a point where researchers are testing alternatives to (or at a minimum, complements to) traditional landline random digit dialing (RDD). Ideally, a new sampling methodology would address not only the coverage challenges posed by cell phone only households and unlisted households in zero-listed banks, but also provide a basis for developing survey designs that could address the growing nonresponse issue which also plagues traditional RDD approaches. One such approach proven to be promising and potentially cost effective involves use of address-based samples using large comprehensive databases, such as the U.S. Postal Service Delivery Sequence File (DSF). Read more

Examining the Relationship Between Survey Response Elicitation Efforts, Respondent Motivation, and Satisficing: A Case Study of Web-based Panel Survey

Abstract:

Understanding the dynamics of survey participation, particularly about why people take part in surveys and, perhaps more importantly, why they do not, is often a challenging task at hand for survey researchers. A part of this challenge involves expending some form (e.g., e-mail or postcard reminder) of survey elicitation effort in obtaining a response. The general assumption as it pertains to Web-based surveys is that more motivated survey invitees respond with minimal elicitation effort (i.e., they respond even before the first reminder is sent), while their less motivated counterparts respond only with a subsequent increase in such efforts (i.e., sending more than one reminder) or choose to not respond. Read more

Clarifying the “Progress” Of Progress Indicators

Abstract:

In Web surveys, progress indicators inform respondents of their progress, using a variety of design approaches. A graphic-based method usually involves the image of a progress bar, while a text-based method involves using simple text (often percent completed).  Sometimes a combination of graphic- and text-based designs is used (see Couper, Traugott, & Lamias, 2001; Heerwegh & Loosveldt, 2006). Progress indicators can also be displayed on every screen or intermittently, or at the respondents’ request (see Conrad et al., 2005).  The main argument for using a progress indicator is that it motivates respondents to complete the survey by making the end of the survey appear visibly nearer with every question answered. Read more

Produce Food Safety in the Marketing Channel and the American Consumer

Abstract:

Publicity surrounding recent outbreaks of food-borne illness has raised concern among American consumers about the microbial safety of produce delivered through food marketing channels. In 2006 an E. coli outbreak was traced to spinach, resulting in millions of dollars in losses for the produce industry; in early 2008 a large salmonella scare linked to tomatoes also dampened industry profits. To investigate the effects of these concerns, a large random survey of American consumers from the Gallup Panel was performed in October 2008 to investigate the extent to which consumers were concerned about the microbial safety of produce and how they coped with those concerns in the food marketing channel. Read more

The Role of Survey Response Timing on Web Survey Results: Cross-Sectional and Longitudinal Analyses

Abstract:

Decreasing survey response rates are a growing concern in survey research, principally because survey estimates may be biased by selective nonresponse (Kypri, Stephenson, & Langley, 2004). One of the methods of assessing nonresponse bias is to compare those who respond late to a survey with those who respond early, in terms of the topic of interest. In this paper, we draw upon data obtained from multiple panel surveys conducted by the Gallup Panel in order to examine whether early, intermediate, and late respondents differ significantly – either in terms of demographics or in terms of the answers that they provide to survey questions. Read more

Effects of Incentives, Advance Letters, and Telephone Follow-up in RDD Recruitment for a Consumer Research Panel

Abstract:

Survey response rates have been declining over the last several decades, particularly for random-digit-dial (RDD) telephone surveys (see de Leeuw, et al., 2002; Steeh, 1981). This trend affects research panels such as the Gallup Panel, which uses RDD methodology to recruit its members. If significant improvements in panel recruitment response rates are to be achieved, new approaches must be considered. This paper presents the findings of an experiment conducted by the Gallup Panel to analyze the individual and combined effects of incentives, advance letters, and follow-up telephone calls on the panel recruitment response rate. Read more

Response Patterns in a Long Question Grid in a Mail Survey Questionnaire

Abstract:

In mail surveys, researchers often face the challenge of too little space in the questionnaire for the number of questions they wish to administer. Oftentimes certain structuring methods are used in order to maximize the data gathering efficiency of a given set of questions. One such method involves using a grid format in which two or more questions with the same response options are grouped together in a ‘grid’ of rows and columns. In this way, the response options are not repeated for every question in the grid, which minimizes not only the use of space in the questionnaire, but also respondent’s burden of comprehending new scale for each question in the grid. Read more

My Cell Phone’s Ringing, Caller Unknown, Now What? Usage Behavior Patterns Among Recent Landline Cord Cutters Who Have Become Cell Phone-Only Users

Abstract:

A growing number of Americans are considering cutting their landline telephone cords in favor of becoming cell phone-only. To date, survey researchers have begun to understand that cell phone-only users tend to be “heavy users” of cell phones compared with those who have both landlines and cell phones. Recent studies on cell phones (either in conjunction with/without a landline phone) have explored behaviors such as types of plans (individual/family), type of usage (sharing,/personal) and frequency of usage (most/some calls, emergency calls). Read more