Experiments in Producing Nonresponse Bias

While nonresponse rates in household surveys are increasingin most industrialized nations, the increasing rates do notalways produce nonresponse bias in survey estimates. The linkagebetween nonresponse rates and nonresponse bias arises from thepresence of a covariance between response propensity and thesurvey variables of interest. To understand the covariance term,researchers must think about the common influences on responsepropensity and the survey variable. Three variables appear tobe especially relevant in this regard: interest in the surveytopic, reactions to the survey sponsor, and the use of incentives.A set of randomized experiments tests whether those likely tobe interested in the stated survey topic participate at higherrates and whether nonresponse bias on estimates involving variablescentral to the survey topic is affected by this. The experimentsalso test whether incentives disproportionately increase theparticipation of those less interested in the topic. The experimentsshow mixed results in support of these key hypotheses.     

Web Survey Design: Paging versus Scrolling

A key choice in the design of Web surveys is whether to placethe survey questions in a multitude of short pages or in longscrollable pages. There are advantages and disadvantages ofeach approach, but little empirical evidence to guide the choice.In 2003 we conducted a survey of over 21,000 undergraduate students.Ten percent of the 10,000 respondents were directed to the scrollableversion of the survey, containing a single form for each ofthe major sections. The balance was assigned to the paging version,in which questions were presented to be visible without scrolling.The instrument contained a maximum of 268 possible questions,including topics that varied in sensitivity and desirability.The survey also permitted comparison of the effect of skip patternsby implementing skip instructions and hyperlinks in the scrollabledesign, and also recorded time at the end of each of the fivetopical sections. Differences between designs are evaluatedin terms of various forms of nonresponse, univariate and bivariatemeasurement properties, and proxies for respondent burden.     

Visual Context Effects in Web Surveys

There are many examples of context effects in survey measurement.Responses to survey questions can be shaped by the order ofquestions, the format of response options, the broader surveyenvironment, and so on. For Web surveys, the inclusion of visualimages is a trivial design issue, but may have consequencesfor the responses obtained because they change the visual context.We report a series of experiments examining how responses maybe affected by the use of images in Web surveys. Specifically,we examine the effect that pictures of a healthy woman exercisingversus a sick woman in a hospital bed have on self-rated health.We replicated the experiments in three different surveys, varyingsuch factors as the size and placement of the image and thelocation of the question within the questionnaire. In general,we find that when exposed to a picture of a fit woman, respondentsconsistently rate their own health lower than when exposed toa picture of a sick woman.     

Keeping Track of Panel Members: An Experimental Test of a Between-Wave Contact Strategy

The Panel Study of Income Dynamics (PSID) is a nationally representative longitudinal survey of approximately 9,000 families and their descendants that has been ongoing since 1968. Since 1969, families have been sent a mailing asking them to update or verify their contact information to keep track of their whereabouts between waves. Having updated contact information prior to data collection is associated with fewer call attempts and refusal conversion efforts, less tracking, and lower attrition. Given these apparent advantages, a study was designed in advance of the 2009 PSID field effort to improve the response rate of the contact update mailing. Families were randomly assigned to the following conditions: mailing design (traditional versus new), $10 as a prepaid versus postpaid incentive, timing and frequency of the mailing (July 2008 versus October 2008 versus both times) and whether or not they were sent a study newsletter. This paper reports on findings with regards to response rates to the mailing and the effect on production outcomes including tracking rates and number of calls during 2009 by these different conditions, examines whether the treatment effects differ by key characteristics of panel members including likelihood of moving and anticipated difficulty in completing an interview, and provides some recommendations for the use of contact update strategies in panel studies.     

Fathers who use domestic violence: Organisational capacity building and practice development

It is well established in the literature that fathers who use violence harm women and children. Statutory child protection workers and other human service professionals now face strong injunctions to work with these men. However, insufficient attention has been given to considering the processes for intervening with fathers who use violence and the organisational context to support workers in refocusing their practice. Workers lack clear guidance, and organisations lack specific understandings of how to support workers in this complex area of practice. Australian research used co‐design with professionals in Communities of Practice supported by the Safe & Together Institute to explore the organisational context required to work with fathers who use violence. This paper presents findings of qualitative data gathered from surveys, focus groups, and ethnographic notes of 30 Community of Practice sessions. Working together, practitioners and researchers identified four essential elements to support organisational development and improve practice: leadership by senior managers; recognition that domestic violence work needs to strengthen collaborative working; extensive training, supervising, and coaching; and enhanced worker safety. Worker perspectives are critical in developing practice principles and identifying organisational mechanisms that support practitioners to work safely and effectively with fathers who use violence.     

Design catalogue for eco-engineering of coastal artificial structures: a multifunctional approach for stakeholders and end-users

Urban Ecosystems - Coastal urbanisation, energy extraction, food production, shipping and transportation have led to the global proliferation of artificial structures within the coastal and marine...     

Comparisons in Gender Wage Differentials and Discrimination between Germany and the United Kingdom

Due to the lack of consistent data, direct and robust comparisons of cross‐country labour markets have been virtually impossible. This study uses a new panel data series that controls for inconsistencies, thus overcoming this problem. This study estimates gender wage differentials and gender discrimination in the German and UK labour markets. Panel estimates are used to identify general wage differences between the two countries, with cross‐sectional comparisons undertaken to identify changes that have occurred between 1991 and 1993, that are consistent with known labour market policies. It is found that gender wage differentials are greater in the UK than Germany with employer discrimination against females attributed with the majority of the difference in both countries.     

The Effect of Question Framing and Response Options on the Relationship between Racial Attitudes and Beliefs about Genes as Causes of Behavior

Prior research suggests that the attribution of individual and group differences to genetic causes is correlated with prejudiced attitudes toward minority groups. Our study suggests that these findings may be due to the wording of the questions and to the choice of response options. Using a series of vignettes in an online survey, we find a relationship between racial attitudes and genetic attributions when respondents are asked to make causal attributions of differences between racial groups. However, when they are asked to make causal attributions for characteristics shown by individuals, no such relationship is found. The response scale used appears to make less, if any, difference in the results. These findings indicate that the way questions about genetic causation of behavior are framed makes a significant contribution to the answers obtained because it significantly changes the meaning of the questions. We argue that such framing needs to be carefully attended to, not only in posing research questions but also in discourse about genetics more generally.