Effects of Presenting One Versus Two Sides of an Issue in Survey Questions

Data from a split-ballot experiment show that offering respondentsan alternative position on an issue not only affects the marginals,it also influences whether respondents will give an opinionat all. Furthermore, the study demonstrates that these formeffects can occur despite the use of filter questions whichtheoretically screen out those who tend to be most susceptibleto such effects: the less educated or uninformed. The analysisdoes provide evidence, however, that less educated respondentsare indeed more affected by differences in question format andthat they are much more likely to "acquiesce" to one-sided agree/disagreeforms. In discussing the results the authors develop an information-processingmodel of question form effects and a methodological strategyto generate further research on a much-needed theory of thesurvey instrument.     

An Experiment on the Measurement of Political Knowledge in Surveys

In a series of articles, Mondak and colleagues argue that theconventional way of measuring political knowledge in surveysis flawed. Personality related "propensity to guess" underestimatesthe level of political knowledge in the population and distortsestimates of between group differences, when a DK alternativeis offered. This has led Mondak to recommend the use of closed-endeditems on which DKs are not explicitly offered, following bestpractice in the field of educational testing. In this article,we present the results of an experimental study which callsinto question the wisdom of this approach. Our results showlittle evidence of partial knowledge concealed within DK responses;when people who initially select a DK alternative are subsequentlyasked to provide a "best guess," they fare statistically nobetter than chance. We conclude that opinion researchers shouldbe cautious about adopting Mondak's recommendations for thedesign of political knowledge items in surveys. Received for publication February 22, 2005. Revision received October 19, 2006. Accepted for publication October 25, 2006.     

DO SURVEYS OVERSTATE PUBLIC CONCERNS?

Because the item, "How concerned are you about...?" asks respondentsto indicate their level of concern about an issue, some respondentsmay sense it assumes they are concerned or should be concernedabout the issue. Using a filter question to first determineif people are concerned about the issue before asking for theirdegree of concern may help solve this problem. To test thishypothesis, a split-ballot experiment was embedded in a nationalrandom digit dialing telephone survey on food-related issues.For the four items included in the experiment, the group receivingthe filter versions of the questions gave roughly double thepercentages of "not concerned" responses as the group receivingstandard items, and the filter group also gave fewer responsesat the upper end of the response scale.     

Uncertainty and framing in a valuation task

Many stated preference studies report framing effects in responses to valuation questions. Framing in stated preference studies occurs when respondents use irrelevant information contained in the question to help them value the good. This may occur because respondents are uncertain or do not hold well-formed preferences for the good in question. We investigate if respondent certainty explains framing effects in a contingent valuation study, using data from a double bounded dichotomous elicitation format and a follow-up certainty question. We investigate if respondent certainty influences anchoring and the shift effect. We find evidence that the anchoring effect is stronger for respondents who are less certain about their response to the contingent valuation question compared to respondents who are very certain. However, the shift effect is significant and negative only for respondents who are very certain. Our results indicate that certain respondents are more consistent with the predictions of rational behaviour than uncertain respondents.     

The Social Roots of the Partisan Gender Gap

I suggest that the gender gap in party identification is dependenton question wording and asymmetric stereotypes about men's andwomen's partisan preferences. A survey experiment reanalyzesthe gender gap by comparing the standard partisan battery toan alternative version that emphasizes feelings rather thanthoughts. Bringing question wording into closer alignment withtheory causes the gender gap to shrink. This happens in partbecause the "feel" questions find women to be less Democraticthan did the "think" questions. Moreover, reduction of the gendergap occurs mostly among highly sophisticated women and not thoseusually susceptible to question wording effects. Contrary topopular wisdom, men and women appear to be more, not less, alikepolitically when feelings are primed.     

‘Where are you from?’: Identifying place1

Many social research projects, such as interviews, focus groups, and surveys, take local place as a given: they choose participants from a particular place, take this place as background for what the participants say, ask them about place‐related issues, and correlate responses with different places. But people can identify places in different ways, in geographical or relational terms, and in different levels of scale. This study analyses passages in focus groups in which participants say where they are from, shows that participants generally take the question and answer as routine, and then shows the ways the interaction develops when this routineness is broken, amended, or called into question. When a participant revises their statement of where they are from, they adapt to what they see as the knowledge and stance of their interlocutor, they re‐present themselves, and they create possibilities for further talk, defending, telling stories, or showing entitlement to an opinion. I argue that the ways people answer this question, interactively, can tell us about them, and us, as well as about their map of the world.     

Social Desirability Effects and Support for a Female American President

Public opinion polls show consistently that a substantial portionof the American public would vote for a qualified female presidentialcandidate. Because of the controversial nature of such questions,however, the responses may suffer from social desirability effects.In other words, respondents may be purposely giving false answersas not to violate societal norms. Using an unobtrusive measurecalled the "list experiment," we find that public opinion pollsare indeed exaggerating support for a female president. Roughly26 percent of the public is "angry or upset" about the prospectof a female president. Moreover, this level of dissatisfactionis constant across several demographic groups. Received for publication June 5, 2006. Revision received September 11, 2006. Accepted for publication October 25, 2006.     

Playing the Race Card in the Post-Willie Horton Era: The Impact of Racialized Code Words on Support for Punitive Crime Policy

To date, little is known about the precise impact of raciallycoded words and phrases. Instead, most of what we know aboutracialized messages comes from studies that focus on pictorialracial cues (for example, the infamous "Willie Horton" ad) oron messages with an extensive textual narrative that is lacedwith implicit racial cues. Because in a "post-Horton" era strategicuse of racially coded words will often be far more subtle thanthose explored in past studies, we investigate the power ofa single phrase believed by many to carry strong racial connotations:"inner city." We do so by embedding an experiment in a nationalsurvey of whites, where a random half of respondents was askedwhether they support spending money for prisons (versus antipovertyprograms) to lock up "violent criminals," while the other halfwas asked about "violent inner city criminals." Consistent withthe literature on issue framing, we find that whites’racial attitudes (for example, racial stereotypes) were muchmore important in shaping preferences for punitive policieswhen they receive the racially coded, "inner city" question.Our results demonstrate how easy it is to continue "playingthe race card" in the post–Willie Horton era, as wellas some of the limits of such framing effects among whites withmore positive racial attitudes.     

Straightening the Seam Effect in Panel Surveys

Panel surveys, such as the Survey of Income and Program Participationand the Consumer Expenditure Survey, interview respondents every3 or 4 months, but ask the respondents for monthly data. A typicalfinding in such surveys is that changes in responses to a questionare relatively small for adjacent months within a referenceperiod but much more abrupt for adjacent months across referenceperiods. Previous studies have attributed this "seam effect"either to underreporting of changes within the periods or tooverreporting of changes across them. In the present studies,we attempt to distinguish these possibilities, using an experimentalmethod that allows us to gauge respondents' accuracy as wellas the number of times they change their answers. The studiesproduced seam effects and accompanying evidence for forgettingof queried information and bias toward constant responses withinthe reference period. In general, seam effects appear to increaseas a function of the demands on memory. We also find that separatingquestions with the same content in the survey instrument decreasesthe seam effect. To account for these data, we propose a modelin which respondents' answers are initially based on attemptedmemory retrieval. Inability to recall leads to (possibly biased)guessing or subsequent repetition of an earlier answer.     

"DON'T KNOW" BOXES IN FACTUAL QUESTIONS IN A MAIL QUESTIONNAIRE: EFFECTS ON LEVEL AND QUALITY OF RESPONSE

This article summarizes the findings of an experiment to evaluatethe effect of "Don't Know" (DK) boxes in a mail questionnaireconsisting of factual questions. In a split-panel test, halfof the respondents received a questionnaire with DK boxes andthe other half received a questionnaire without DK boxes. Theoverall response rates were the same for the two versions. Thequestionnaire version without DK boxes obtained an appreciablyhigher rate of substantive responses for many items. However,there were few large substantive changes in response distributionsbetween the two versions, and there was no appreciable differencein the response error rates.     

Flexible Work Options and Mothers' Perceptions of Career Harm

Whether or not mothers, who often struggle with balancing work and parenting responsibilities, perceive that they face career harm in exchange for control over flexible work options at their jobs is an unanswered question. Using 2009 original data from a random‐digit‐dial telephone survey of 441 mothers located across the United States, this study focuses on how control over two latent variables measuring flexibility, flexible work arrangements (such as scheduling and place of work) and time‐off options, influences mothers' career harm perceptions in a total of three work domains: (1) wages/earnings, (2) raises or promotions, and (3) job evaluations. We find perceptions of career harm among only one‐fifth of mothers; in addition, control over time‐off options reduced perceived career damage related to parenting duties. Mothers may have less to fear than previously hypothesized about the potential sacrifices they have to make when they have significant control over certain flexibility options.     

How to search a social network

We address the question of how participants in a small world experiment are able to find short paths in a social network using only local information about their immediate contacts. We simulate such experiments on a network of actual email contacts within an organization as well as on a student social networking website. On the email network we find that small world search strategies using a contact’s position in physical space or in an organizational hierarchy relative to the target can effectively be used to locate most individuals. However, we find that in the online student network, where the data is incomplete and hierarchical structures are not well defined, local search strategies are less effective. We compare our findings to recent theoretical hypotheses about underlying social structure that would enable these simple search strategies to succeed and discuss the implications to social software design.     

HERE WE GO AGAIN: MAPS, TERRITORIES, INTERPRETATIONS, AND THE DISTINCTION BETWEEN "THE" AND "A" OR "AN"

Humpty Dumpty was dead wrong when he said, "When I use a word hellip; it means just what I choose it to mean-neither more nor less.""The question is," said Alice, "whether you can make words mean so many different things" (Carroll, 1972, p. 90).
And Humpty Dumpty was quite right when he continued, "The question is hellip; which is to be master-that's all" (Carroll, 1972, p. 90). And the answer is, it is the word that is master not its user. A word always means more and less than we, as users, as authors, mean it to mean.     

Differences between the public and private communication of rumors. A pilot survey in Belgium

Liu et al. (2010) and Gelders et al. (2007) called for evidence-based research on differences between public and private sector communication. This article offers such data by focusing on an increasingly important domain of public relations (i.e., corporate communication about rumors vis-à-vis internal and external stakeholders).Our results show government communicators are more frequently confronted with harmful rumors than business communicators but a similar number of respondents from each group have experienced the listed effects and these respondents rate the effects as equally severe. However, fewer public sector communicators have applied most of the proposed strategies, and those who did found them to be in most cases less effective than private sector respondents. In other words, government communicators hear more rumors, experience equally often the negative effects and find them equally severe as business communicators, but they often do not react to them and if they do, they do not find the strategies to be very effective.This study suggests that typical features of public sector organizations, such as the capricious political climate and the influence of party politics, might offer an explanation for these findings.     

Gendering graffiti in Brazil

Gender expressions in a person’s daily rituals or representations in the media are critical in understanding gender relations. Studies on representations have generally focused those presented in textbooks and in advertisements. However, studies rarely examine gender representation in graffiti. In his analysis of advertisements, Goffman argues that advertisers do not create the ritualised expressions they employ but draw upon what we already know, and thus rendering readable images. Using the same logic, I posit that graffiti artists also base their images, at least in part, on socially readable and acceptable representations of gender. This effort may not be conscious and deliberate, but consistent with the social constructionist perspective, is an attempt to draw upon that with which we are familiar. As such, graffiti (like advertisements) become a source of data that we can analyse to examine gender representation. Examining graffiti in Brazil, I find graffiti with human images are present in two forms: cartoons, and life-portraits. Hyper-feminisation and sexualised images of women are prevalent. In contrast, images of men are less sexualised, particularly in terms of nudity. In addition, both the portrayal and interpretation of these images reflect a heterosexual bias.     

Ratings checklist for warnings: a prototype tool to aid experts in the adequacy evaluation of proposed or existing warnings

In the field of forensic human factors, experts are often called upon to assess and evaluate the adequacy of new or existing products' warnings or warnings systems. The usual goal of this evaluation is to arrive at a simple binary decision regarding the warning in question (i.e., does it "pass/fail", or is it "adequate/inadequate"). However, such a warning assessment process may in fact be quite complex and multidimensional in its execution. The existing warnings research literature has identified a fairly large number of warnings features or factors likely to have an impact on a given warning's effectiveness or adequacy. The tool addressed in this article is intended for use by a warnings expert (as opposed to one less knowledgeable and informed about complex warnings issues), and can serve as a reminder checklist to help ensure that the expert has taken into consideration the most relevant features or factors during such a warnings adequacy assessment.     

A Chronological Bibliography of the College Novel

Abstract

Although Muslims in the United States are highly assimilated into American society, they represent less than 1 percent of the total population. Therefore, most of the information Americans receive about this group comes from secondary sources. Two theoretical perspectives of opinion formation—image of God and low information rationality—shed light on the subject of trust in this marginalized group. For highly religious Americans, nearly two-thirds of the 2005 Baylor Religion Survey's national sample, Muslims may represent the ultimate outsiders. We compare the effect of the central religious narrative, or an image of God as creator or judge, to the effect of political ideology, or the likely exposure to forms of low information rationality such as framing, spinning, and buzzwords. We use indicators of these concepts in a multivariate analysis of trust in Muslims as a test of these competing perspectives of opinion formation. Using the 2005 Baylor Religion Survey data, we find that not only does trust in Muslims decrease with both a more conservative political ideology and a stronger view of God as vengeful and angry but that these effects interact to produce individuals who are far less likely to trust Muslims compared to their Democrat, Independent, and “loving God” counterparts.     

INTERPRETING THE SOCIOLOGICAL CLASSICS: CAN THERE BE A “TRUE” MEANING OF MEAD?

Many sociologists have tried in vain to find the “true” meaning of the classic works in the discipline. An interactionist perspective suggests that this search is not a valid one for sociologists, especially symbolic interactionists. Although there can be no “true” meaning, some authors use conventions of writing that make their work more or less clear. Using Mead's Mind, Self and Society as an example, we discuss the dimensions of clarity. We then argue that the sociological classics should be read to (I) simulate new theories and research (pragmatic analysis), (2) determine how sociologists have used that classic to support or refute particular theories or perspectives (rhetorical analysis), and (3) provide information about the sociological concerns of the author and his/her contemporaries (historical analysis).     

Fertility Preferences and Cognition: Religiosity and Experimental Effects of Decision Context on College Women

Better models of culture and cognition may help researchers understand fertility and family formation. The authors examine cognition about fertility using an experimental survey design to investigate how fertility preferences of college women are affected by two prompts that bring to mind fertility‐relevant factors: career aspirations and financial limitations. The authors test the effects of these prompts on fertility preferences and ask how effects vary with respondent religiosity, an aspect of social identity related to fertility preferences. The authors find significant effects of treatment on fertility preferences when accounting for religiosity: Less religious women who considered their career aspirations or financial limitations reported smaller desired family size, but this effect was attenuated for more religious women. This study demonstrates how fertility preferences are shaped by decision contexts for some sociodemographic groups. The authors discuss how the findings support a social–cognitive model of fertility.