Posts Tagged ‘ AAPOR

How Can We Believe What They Say? The Role of Missing and Validating Data in Panelists Demographic Information

Abstract:

The use of online panels (probability-based or volunteer opt-in) as a mode of data collection has become increasingly popular in market, social, psychological, and medical research (Callegaro and DiSogra 2009). The Nielsen online panel is one of the opt-in panels in the United States that is composed of respondents who voluntarily sign up (opt-in) to become members of the panel. Read more

Are you who you say you are? Using a Multisource Cross-validation Methodology for Panel Membership Information

Abstract:

Over the past few years, market researchers and clients working with data from non-probability online panels have voiced a number of data quality concerns over issues such as respondent identity, increased satisficing, and possible professionalization of survey taking. Recognizing the importance of having real, unique, and engaged panelists, panel companies are responding to these issues by introducing a variety of remedial measures such as name-address verification, email address verification, and validation of key demographic information against third-party databases. Read more

Understanding How Consumers Cope with Food Safety Concerns: Using Qualitative Panel Data to Obtain a Complete Picture

Abstract:

American consumers are increasingly concerned about the microbial safety of the fruits and vegetables they consume.  A random survey of 3,619 consumers from the Gallup Panel performed in October 2008 investigated the extent to which American consumers were concerned about the microbial safety of produce and how they coped with those concerns in the food marketing channel. Read more

Do One-Time Inducements Help Long-Term Survey Participation? – A Case for Survival Analysis

Abstract:

In a recent study involving a mixed-mode experiment to recruit members to a consumer panel, Rao et al. (2010) tested the effect of various response-inducement techniques such as advance letters, monetary incentives, and telephone follow-up on panel recruitment. The experiment was successful in recruiting individuals to a non-incentive-driven consumer panel (i.e., members do not receive any form of monetary incentives for their participation in the panel). While the experiment used response inducements as a onetime stimulus to motivate individuals to join the panel, no such response inducements were provided for their subsequent panel participation. Read more

A Comparison of Web and Mail Survey Respondents within a Mixed Mode National Survey

Abstract:

Web surveys are being increasingly incorporated into national survey data collection programs in the United States because of their cost/time-efficiencies. Yet, response rates and data quality issues in web surveys remain important challenges. As a basic study designed to better understand data quality, this paper investigates the degree to which survey modes themselves affect response rates and data quality in a national mixed mode survey. Read more

The Theory and Evaluation of Anchoring Effect in Visually Administered Extremely Long Response Lists

Abstract:

Numerous studies (Payne 1971; Krosnick and Alwin 1987; Ayidiya and McClendon 1990; Schwarz, Hippler, and Noelle-Neumann 1992; Malhotra 2009; Malhotra 2008) have examined response order effects in visually administered questionnaires. A number of theories have also been proposed to explain this effect, with the most popular one being the theory of satisficing (Krosnick and Alwin 1987; Krosnick 1991). According to this theory, when response alternatives are presented visually, respondents begin at the top of the list and consider each alternative individually, all while establishing a cognitive framework for evaluating later response alternatives. Read more

Public Opinion toward NAFTA in the United States, Canada and Mexico: Insights from the Gallup World Poll

Abstract:

A commitment to continental free trade has been a major part of the trade policies of the United States, Canada and Mexico for the last 15 years – one embodied in the North American Free Trade Agreement (NAFTA). Public support for NAFTA and impressions of its effects have, however, remained mixed, and have varied over time. Still, attempts to examine public opinion across all three countries in the trade bloc remain few, with most studies limited to a single country. Drawing on data from the Gallup World Poll, we endeavor to remedy this situation by examining public impressions of NAFTA across all three member countries. Read more

Recruitment of Minorities Using Address-Based Sampling (ABS): A Pilot Study

Abstract:

The crisis in coverage of the landline telephone frame has reached a point where researchers are testing alternatives to (or at a minimum, complements to) traditional landline random digit dialing (RDD). Ideally, a new sampling methodology would address not only the coverage challenges posed by cell phone only households and unlisted households in zero-listed banks, but also provide a basis for developing survey designs that could address the growing nonresponse issue which also plagues traditional RDD approaches. One such approach proven to be promising and potentially cost effective involves use of address-based samples using large comprehensive databases, such as the U.S. Postal Service Delivery Sequence File (DSF). Read more

Examining the Relationship Between Survey Response Elicitation Efforts, Respondent Motivation, and Satisficing: A Case Study of Web-based Panel Survey

Abstract:

Understanding the dynamics of survey participation, particularly about why people take part in surveys and, perhaps more importantly, why they do not, is often a challenging task at hand for survey researchers. A part of this challenge involves expending some form (e.g., e-mail or postcard reminder) of survey elicitation effort in obtaining a response. The general assumption as it pertains to Web-based surveys is that more motivated survey invitees respond with minimal elicitation effort (i.e., they respond even before the first reminder is sent), while their less motivated counterparts respond only with a subsequent increase in such efforts (i.e., sending more than one reminder) or choose to not respond. Read more

Clarifying the “Progress” Of Progress Indicators

Abstract:

In Web surveys, progress indicators inform respondents of their progress, using a variety of design approaches. A graphic-based method usually involves the image of a progress bar, while a text-based method involves using simple text (often percent completed).  Sometimes a combination of graphic- and text-based designs is used (see Couper, Traugott, & Lamias, 2001; Heerwegh & Loosveldt, 2006). Progress indicators can also be displayed on every screen or intermittently, or at the respondents’ request (see Conrad et al., 2005).  The main argument for using a progress indicator is that it motivates respondents to complete the survey by making the end of the survey appear visibly nearer with every question answered. Read more