PART-WHOLE QUESTION ORDER EFFECTS: VIEWS OF RURALITY

A split-ballot design was used to assess part-whole questionorder effects in a mail survey. A general question asked forthe respondent's perceptions of the overall life quality inrural areas relative to other areas; a series of 19 similarquestions asked for the relative quality of specific aspectsof rural life. When the general question was asked after thespecific items, subjects were more likely to answer the generalquestion, less likely to respond that rural areas were "thesame" as other areas, and more positive in their opinions aboutrural places. The addition of a preamble–instructing subjectsto read both the general and the list of specific items beforeanswering either–failed to alter these findings. The ordereffects on responses to the general question did not appearto represent either a simple assimilation (carryover) effector a contrast (backfire) effect, both of which have been foundby other researchers. Possible reasons for the conificting findingsare discussed.     

Measuring satisfaction with organizations. Predictions from information accessibility

The study explored the process through which customers assess their satisfaction with service organizations. Our theoretical analysis suggests that when a general satisfaction question appears after questions about specific domains were asked (SG order), the earlier questions increase the accessibility of both positive and negative information. In contrast, when a general satisfaction question appears prior to any other question (GS order), negative information is more accessible than positive information. On the basis of these differences in accessibility we predicted (1) greater asymmetry in the impact of positive and negative information on the general satisfaction response in the GS order, (2) higher correspondence between domain-specific satisfaction and general satisfaction in the SG order, and (3) higher levels of general satisfaction in the SG order. These predictions were supported in analyses of customers' responses in a national survey of satisfaction with the Israel Telecommunication Corporation (Bezeq).     

ASSIMILATION AND CONTRAST EFFECTS IN PART-WHOLE QUESTION SEQUENCES: A CONVERSATIONAL LOGIC ANALYSIS

A theoretical model of the emergence of assimilation and contrasteffects in part-whole question sequences is presented. Whenone specific question precedes a general question and the twoare not assigned to the same conversational context, respondentsuse the information primed by the specific question to formthe general judgment. This results in part-whole assimilationeffects. If both questions are perceived as belonging to gether,however, conversational norms of nonredundancy prohibit therepeated use of information that has already been provided inresponse to the specific question when making the general judgment.Accordingly, respondents interpret the general question to referto aspects other than the ones covered by the specific question.Contrast effects may emerge in that case under specified conditions.If several specific questions precede the general question,however, the general one is always interpreted as a requestfor a summary judgment. This results in assimilation effects,even under conditions that would foster contrast effects ifonly one specific question is asked. The model is supportedby experimental data and provides a coherent account of apparentlycontradictory findings previously reported in the survey literature.     

Context Effects on Survey Responses to Questions About Abortion

The proportion of favorable responses to a general questionabout abortion was significantly smaller in an NORC survey thanwere responses to the same item in an SRC survey. We hypothesizedthat questionnaire context was the main source of the difference–inone survey the general item followed a more specific questionabout abortion–and carried out two split-ballot questionorder experiments that provide strong support for the hypothesis.The context effect seems to arise from the generality of theabortion question; the specific question itself showed no changedue to context. Furthermore, there is some evidence that ambivalencetoward the issue of abortion is a factor in the sensitivityof the general question to context. The context effect in theseexperiments is also notable for producing contrast rather thanconsistency between responses to adjacent questions on the sameissue. Implications of the findings for the study of socialchange are emphasized.     

Getting the story straight: evaluating the test-retest reliability of a university health history questionnaire.

This study was designed to establish the reliability of a health history questionnaire used as a screening tool for incoming university students. The authors used a test-retest design, with a test interval of 6 months, on a sample of medical and nursing students. The analysis focused on overall reliability of the questionnaire and reproducibility of specific items, based on question format. Questionnaire items of specific interest were those with dichotomous yes/no response options versus open-ended format questions, those using the words frequently or recently, or those that asked multiple questions. Demographic characteristics of the subjects were considered in the evaluation of reliability. Overall reliability of the questionnaire (93.6%) was above the anticipated level of 90%, and subject sex or program of study did not show any significant differences in reproducibility of responses. Although wording of questions did not affect item reliability, dichotomous format questions demonstrated a higher degree of reliability (96.4%) than the overall reliability of the questionnaire. Recommendations for enhancing the reliability of the questionnaire are based on item analysis and information gathered from interviews with subjects.     

Response-Order Effects and the Early Gallup Split-Ballots

A meta-analysis of split-ballots conducted by the Gallup Organizationin the 1930s, 1940s, and early 1950s shows that response-ordereffects were generally small in magnitude when averaged acrossa great variety of topics and questions—and as comparedwith many of those reported in the response-effects literaturetoday. When analyzed by various question characteristics, theresults provided some support for predictions derived from currentcognitive models of response-order effects, particularly thosefrom satisficing theory. As predicted, questions asked orallywere more likely to generate a statistically significant patternof recency effects if the response alternatives or the questionsas a whole were longer rather than shorter. Other predictedpatterns of primacy and recency effects failed to materialize,however, perhaps largely because of the inherent design limitationsand partial confounding of question attributes in any such secondaryanalysis of archival survey data, but perhaps, too, becauseof simple chance variations. The data from these early experimentsnonetheless provide a partial, albeit limited, test of rivalhypotheses and explanations of response-order effects in theliterature.     

The accessibility and applicability of knowledge: predicting context effects in national surveys

Using data from the National Health Interview Survey on Disability from 1994 and 1995, this research demonstrates that the size of accessibility effects (increased likelihood of using information activated by initial questions in responding to subsequent questions) can be modeled as a function of the applicability of the initial to the subsequent questions. When respondents reported a disability and were asked about the main condition causing the disability, they were more likely to report conditions they had been asked about earlier in the interview than alternative conditions. This accessibility effect was inversely related to the effect on reports of "other" or unclassifiable conditions. The more reports of primed conditions, the fewer reports of unclassifiable conditions. A log-linear model of the accessibility bias fit the data for all disabilities. For reports of specific conditions, a measure of the applicability of context accounted for 74.4 percent of the variance of the accessibility bias; for unclassifiable or "other" conditions, it accounted for 61 percent. When limited to "well-defined" disabilities, applicability accounted for 91.9 percent of the variance (a multiple correlation of.96). Finally, models of the context effects derived from the 1994 data were tested against the actual effects for the 1995 data. The correlation between predicted and actual effects was.80 across disabilities. The theoretical and the practical implications of the findings are discussed.     

Asking Only “Did You Use a Condom?” Underestimates the Prevalence of Unprotected Sex Among Perinatally HIV Infected and Perinatally Exposed But Uninfected Youth

Among young adults who use condoms, incomplete condom use (putting a condom on after beginning or taking a condom off before finishing sex) and condom failure (condom breaking or slipping off during sex) are common. Therefore, sexual behavior surveys that ask only if a condom was used are likely to underestimate the actual prevalence of unprotected sex. This study examined data from 135 sexually active perinatally HIV-infected (PHIV+) youth and perinatally exposed but uninfected (PHIV?) youth, ages 13 to 24. Participants were asked whether they used a condom on their first and their most recent occasion of vaginal sex. Youth who reported using a condom were asked a follow-up question about whether there was any time during that occasion when sex was not protected by a condom. This follow-up question identified additional participants— almost double the proportions who initially said they did not use a condom—who had unprotected sex. Incomplete condom use was similar among PHIV+ and PHIV?youth, boys and girls, Latinos and African Americans, and younger and older youth. These findings illustrate the importance of asking specifically about whether any unprotected behavior occurred from start to finish of sex to achieve more valid estimates of sexual risk behavior.     

Comparing results from different styles of cognitive interviewing: ‘verbal probing’ vs. ‘thinking aloud’

Two styles of cognitive interviewing exist, thinking aloud (TA) and verbal probing (VP), but there have been few studies undertaken which compare the two. This paper reports on such a comparison, which was undertaken in order to understand the merits and drawbacks of each approach. VP finds more problems than TA. TA appears to be better at examining respondents’ understandings of the underlying concepts behind each question; VP is better for exploring specific terms in each question. TA interviews appeared to generate more information about how respondents used information from their past experiences to select codes in closed‐ended questions. However, in terms of the eventual redrafting of the questions respondents were asked about, there was very little difference between the VP and TA interviews.     

Effects of Question Order on Survey Responses

Two question orders were used in a Kentucky statewide randomsurvey. In nonoverlapping sections, four questions which askedthe respondents to express their general interests in politicsand religion and their general evaluations of the gravity ofthe economic and energy situations either preceded or followedseries of specific questions on the same issues. The respondentsexpressed significantly greater interest in politics and religionwhen these general questions followed the specific questions,but evaluations of the economic and energy crises were not significantlyaffected by question placement. Implications for the arrangementof questions within surveys are discussed.     

Prevalence of Sexual Trauma History Using Behaviorally Specific Methods of Assessment in First Year College Students

There are several challenges associated with evaluating the prevalence of sexual trauma, including child sexual abuse and adult sexual assault. The aim of this study was to assess sexual trauma prevalence rates among first year college students (N = 954) using behaviorally specific questions and a more representative recruitment sample that did not rely on self-selection. Participants completed a list of sexual trauma questions, including general questions containing labels such as “rape” or “abuse” as well as behaviorally specific questions that describe specific behaviors that qualify as sexual trauma without labels. Results indicated that 6.7% of the sample reported at least one incident of child sexual abuse, with similar rates for men and women. Women were more likely to report a history of adult sexual assault, which was reported by 12.4% of the total sample. Participants were also more likely to endorse a history of sexual trauma when answering behaviorally specific rather than general “label” questions. Women survivors in particular were more likely than men to identify their experiences as abuse/assault (66.7% versus 21.1% for child sexual abuse), which may help explain prevalence differences between men and women in prior research. Men may be less likely than women to label their experiences as abuse and may be underidentified in sexual trauma research without the use of behaviorally specific questions. Overall, the results of this study suggest that the prevalence of sexual trauma is better assessed using behaviorally specific questions and that this is an important topic of study among both men and women.     

Documenting Pornography Use in America: A Comparative Analysis of Methodological Approaches

Estimates of pornography use in the United States range widely. We explore the reasons for the variation in such estimates among U.S. adults using data from four different recent nationally representative samples—each of which asked a different type of question about pornography use. We attribute the notable variation in estimates to differences in question wording and answer options, and assert that a survey question asking respondents about their most recent use of pornography minimizes recall bias and is better poised to assess the overall prevalence of pornography in a population than is the more common approach of asking respondents about their historical general-use pattern. When we privileged the most-recent-use approach, survey data from 2014 reveal that 46% of men and 16% of women between the ages of 18 and 39 intentionally viewed pornography in a given week. These numbers are notably higher than most previous population estimates employing different types of questions. The results have ramifications for methods of surveying sensitive self-reported behaviors and for contextualizing scholars’ claims as well as popular conversations about the reach and implications of pornography use in the United States.     

Brief Report: Attitudes About Responding to Survey Questions Concerning Childhood Sexual Abuse by Hispanic Female College Students

In no studies have research participants been asked how they feel about answering questions concerning childhood sexual abuse. We have performed searches from two different search engines again and have found nothing published which specifically addresses this question in the way we have. A questionnaire about childhood sexual abuse was administered to a sample of Mexican-American female college students. Over 32% reported positive histories of childhood sexual abuse before age 18. These subjects were more uncomfortable (37%) than those who did not experience childhood sexual abuse when answering questions about childhood sexual abuse (12%; p < 0.00001), but they were not more uncomfortable in answering questions about alcohol or drug use. Women who were sexually abused in childhood also readily disclosed childhood sexual abuse histories despite revealing discomfort about being asked questions concerning childhood sexual abuse. Our findings support concerns by researchers that childhood sexual abuse is neglected because researchers have an unwarranted perception about how fragile sexually abused subjects are as subjects.     

Listening Is… Five Personal Worlds of Listening: An Auto-Ethnographic Approach

What is effective listening? This question intrigues both scholars and the general public. Theoretical explorations provide insight into the listening process as well as pragmatic guidelines for how to be a good listener. But even the most learned listening scholar will often fall back on the observation that they know effective listening best when they experience it.

Five renowned listening experts were asked to respond to the question, “What is listening from the perspective of your lived experience?” Each was asked to work from an auto-ethnographic methodology. The five lifeworlds described in this study represent their responses to this question and offer unique, individual ethnographic contexts describing the listening experience of each of the participants.     

What Must My Interest in Politics Be If I Just Told You "I Don't Know"?

How much people think they follow what's going on in governmentand public affairs depends upon the context in which they areasked the question. If asked immediately after difficult questionsabout what they know of their congressman's record, they aremuch less likely to think they pay attention to public affairsthan if they are asked, first, how interested they are in suchmatters. More important, data from two independent experimentsshow that this context effect cannot be eliminated, or significantlyreduced, by interposing a buffer of questions on unrelated topicsbetween the items that are known to affect one another. Theauthors discuss the psychological significance of these findingsand their implications for survey research.     

SUBSEQUENT QUESTIONS MAY INFLUENCE ANSWERS TO PRECEDING QUESTIONS IN MAIL SURVEYS

Data of a mode experiment demonstrate that the emergence ofcontext effects may be independent of question order under mailsurvey conditions. Under telephone interview conditions, substantivelyrelated questions affected responses to the target questiononly when asked first. However, the same questions affectedresponses under mail survey conditions independent of whetherthey preceded or followed the target question.     

Wahlbeteiligung im Lebensverlauf

This empirical investigation attempts to answer the question whether the change in voter turnout at the German general elections is related to cohort specific voting behavior of political generations, also taking into account age and period effects. Furthermore, it is asked whether the decline of voter turnout after the 1972 German general election is a statistical artefact of official statistics. Both questions are investigated with retrospective life history data about voting behavior of individuals from several birth cohorts. It is analyzed that the voter turnout has really declined in the 1980s because of the increased number of determined non-voters. There is evidence that the changes of the voting behavior of younger individuals in successive political generations results in the social change of the general voter turnout. While the effects of the citizens’ age on the voter turnout are minimal for the whole period between 1953 and 1987, the impact of period effects are less important for the historical change of voter turnout as often assumed.     

Effects on reliability and validity of egocentered network measurements

This paper examines the reliability and validity of egocentered networks. Reliability and validity are estimated by the multitrait-multimethod (MTMM) approach. A split ballot MTMM design [Saris, W.E., 1999. Forced choice or agree/disagree questions? An evaluation by the split ballot MTMM experiment. In: Proceeding of the Meeting of the IRMCS, pp. 122–146; Kogovšek, T., Ferligoj, A., Coenders, G. Saris, W. E., 2002. Estimating the reliability and validity of personal support measures: full information ml estimation with planned incomplete data. Social Networks 24, 1–20] is used, in which separate groups of respondents received different combinations of two methods. The effect of factors such as the methods used and the personal characteristics of respondents that can affect the quality of data was estimated by a meta analysis.Measurement method, type of question, network size, age, gender, extraversion and emotional stability all had statistically significant effects on the validity of measurement. After the list of alters is obtained with name generators, name interpreter questions can be asked in two ways. One way (“by alters”) is to take each alter individually and to ask all the questions about him/her, going alter by alter until the end of the list of alters. The other way (“by questions”) is to take the question and ask this question for all alters on the list, going question by question until the end of the list of name interpreter questions. Telephone interviewing (both by alters and by questions) gave more valid measurements than face-to-face interviews.Behavioral questions were more valid than questions with emotional content. The characteristics of ties were more validly measured in smaller networks. With reference to respondents’ personal characteristics younger respondents, men, extraverted and emotionally stable respondents all had more valid measurements. Reliability was significantly affected by the measurement method, the type of question and age. The telephone/by alters method was the most reliable measurement method. Behavioral questions were more reliable than questions with emotional content. Measurements among younger respondents were also more reliable.     

Assimilation and Contrast Effects in General/Specific Questions1

Abstract Data from five surveys that included specific and general questions on a similar topic are examined. Results suggest that when specific and general questions are paired in surveys, significant patterns will appear. In each of the five studies, correlations between pairs of questions were significantly different when the general followed the specific item compared with the general/specific order. But there was no consistent pattern of assimilation (answers to second item agree with the first) or contrast (response to second question opposite that of the first). One study showed clear evidence of assimilation; the other four showed varying degrees of contrast effects.     

Do the Characteristics of Seconded or Sponsored Social Work Students in England Differ from Those of Other Social Work Students?—A Quantitative Analysis Using National Data

Amongst initiatives by social work employers in the United Kingdom (UK) to resolve recruitment difficulties is the use of secondment and sponsorship to attract entrants to the profession; commonly known as Grow Your Own schemes. This paper reports on part of a mixed-method research study that asked ‘What works in Grow Your Own (GYO) schemes?’ in England. One important research question for this study was whether the characteristics of seconded or sponsored social work students differ from those of other social work students. To explore this, the researchers analysed around 41,000 students' anonymous data records supplied by the General Social Care Council covering enrolments on social work programmes from 1998 to 2007. The findings indicate that GYO schemes have facilitated the participation of men, Asian groups and older applicants in social work qualifying programmes when compared to the general population of social work students. However, students from Black ethnic backgrounds and those with disabilities have been more likely to be under-represented in such schemes. The findings are discussed within the wider study remits and messages for educationalists and social work employers are drawn out.