SURVEY QUESTIONS ABOUT THE FREQUENCY OF VAGUELY DEFINED EVENTS: THE EFFECTS OF RESPONSE ALTERNATIVES

Experimental research has shown that the choice of responsealternatives can influence responses to questions about thefrequency of vaguely defined target events (e.g., feeling annoyed);the set of response alternatives is treated as information thatcontributes to the interpretation of the question. In a seriesof split ballot experiments we investigate whether such effectsoccur in a large-scale survey context for sets of response alternativesthat might be used interchangeably by survey researchers. Thepredicted response shifts were found in our field experiments.Those presented with response alternatives discriminating atlow frequencies reported fewer of the target episodes than thosepresented with higher-frequency response alternatives. However,the size of the observed shifts varied from zero to 13 percentand depended on a number of characteristics of the survey, forexample, the presence of "priming" questions and the orientationof the response scales. Response alternatives are not neutraland therefore must be carefully considered when constructinga survey question.     

A PARTIAL INDEPENDENCE ITEM RESPONSE MODEL FOR SURVEYS WITH FILTER QUESTIONS

In many surveys, responses to earlier questions determine whether later questions are asked. The probability of an affirmative response to a given item is therefore nonzero only if the participant responded affirmatively to some set of logically prior items, known as "filter items." In such surveys, the usual conditional independence assumption of standard item response models fails. A weaker "partial independence" assumption may hold, however, if an individual's responses to different items are independent conditional on the item parameters, the individual's latent trait, and the participant's affirmative responses to each of a set of filter items. In this paper, we propose an item response model for such "partially independent" item response data. We model such item response patterns as a function of a person-specific latent trait and a set of item parameters. Our model can be seen as a generalized hybrid of a discrete-time hazard model and a Rasch model. The proposed procedure yields estimates of (1) person-specific, interval-scale measures of a latent trait (or traits), along with person-specific standard errors of measurement; (2) conditional and marginal item severities for each item in a protocol; (3) person-specific conditional and marginal probabilities of an affirmative response to each item in a protocol; and (4) item information and total survey information. In addition, we show here how to investigate and test alternative conceptions of the dimensionality of the latent trait(s) being measured. Finally, we compare our procedure with a simpler alternative approach to summarizing data of this type.     

THE ANSWERING MACHINE POSES MANY QUESTIONS FOR TELEPHONE SURVEY RESEARCHERS

The proliferation of the telephone answering machine raisesa number of questions about the continued efficiency of thetelephone as a data-gathering mechanism. The most critical ofthese is what effect the use of these machines might have onestablishing contact with potential respondents. If individualsroutinely use these machines to screen calls, then their accessibilityto telephone survey researchers will be restricted. A secondquestion is the degree to which respondents who own answeringmachines and are reachable are likely to participate in a survey.A third question is the extent to which the incidence of theanswering machine as a response disposition might vary by thetime of calling and the respondent's place of residence. Thefindings of this study, based on a nationwide survey, pointto a significant proportion of answering machine owners beingreachable and willing to participate. Furthermore, the answeringmachine appears to be in use more on weekends than on weekdayevenings and in more urbanized areas than in areas with fewerinhabitants.     

TASK CONDITIONS, RESPONSE FORMULATION PROCESSES, AND RESPONSE ACCURACY FOR BEHAVIORAL FREQUENCY QUESTIONS IN SURVEYS

Results from two studies confirm recent findings that (1) surveyrespondents often use nonepisodic processes to answer frequencyquestions about autobiographical events, and (2) task conditions,such as the number of events to be reported and the time usedin response formulation, affect the processes used. Resultssuggest that cognitive mechanisms other than episode omissionand episode telescoping contribute to response errors. It appearsthat new methodological approaches, such as directly or indirectlymanipulating the response formulation process, may be usefulin attempts to improve the accuracy of behavioral frequencyreports in surveys.     

IMPROVEMENT OF THE QUALITY OF RESPONSES TO FACTUAL SURVEY QUESTIONS BY INTERVIEWER TRAINING

In this study we analyze the effects of interviewer trainingon the quality of responses. Data from a field experiment reveala number of significant differences between trained and untrainedinterviewers in terms of nonresponse and the amount of informationobtained. For some questions, an interaction effect occurredbetween interviewer training, the use of tape recorders, andthe kind of responses. The effects of training appear to bedependent on the structure of the questions. Since such effectsoccur primarily with questions that assume a great deal of intervieweractivity, it is suggested that they are indeed due to the applicationof the techniques acquired by training, namely giving instructions,probing, and feedback. A brief analysis of the interviewer-respondentinteraction supports this interpretation.     

RESPONSE LATENCY VERSUS CERTAINTY AS INDEXES OF THE STRENGTH OF VOTING INTENTIONS IN A CATI SURVEY

This CATI study compares two measures of attitude strength,accessibility and certainty, for the purpose of predicting discrepanciesbetween voting intentions and voting behavior. Accessibilitywas indexed by response latency to a voting intention questionand certainty by a question about the finality of the votingintention. Logistic regression showed response latency to bea better predictor of discrepancies between voting intentionsand voting behavior than certainty. The theoretical implicationsof this finding as well as the practical implications of a methodfor measuring response latencies in CATI election studies arediscussed.     

RESPONSE LATENCY AS A SIGNAL TO QUESTION PROBLEMS IN SURVEY RESEARCH

This research explores the potential utility of response latencyas an index of question problems in survey research. The timerespondents took to answer three types of bad questions wascompared to the time they took to answer the repaired versionsof the questions. Questions containing a superfluous negativeand double-barreled questions took longer to answer than nearlyidentical questions without these problems. Repaired versionsof questions soliciting frequency estimates, however, took longerto answer than their problematic counter parts. The resultsare discussed in the context of a model of question answering,and their implications for survey methodology are explored.     

EFFECTS OF A PREPAID NONMONETARY INCENTIVE ON RESPONSE RATES AND RESPONSE QUALITY IN A FACE-TO-FACE SURVEY

We conducted a randomized experiment on a face-to-face interviewsurvey in order to test the effects on response rates of a prepaidnonmonetary incentive. Results showed a statistically significantincrease in response rates, mostly through reduction in refusalrates, in the half sample that received the incentive (a gift-typeballpoint pen) as compared with a no incentive control group.The effect appears to be due to greater cooperation from incentiverecipients at the initial visit by an interviewer. Unexpectedly,the incentive group also showed a significantly higher rateof sample ineligibility, possibly due to easier identificationof vacant residences or nonexistent addresses. In addition,evidence suggests greater response completeness among respondingincentive recipients early in the interview, with no evidenceof increased measurement error due to the incentive.     

PHYSICIAN RESPONSE TO A MAILED SURVEY AN EXPERIMENT IN TIMING OF PAYMENT

This article reports the results of an experiment in obtainingphysician response to a mailed questionnaire. Each physicianwas eligible for a payment of $20. A randomly selected halfreceived the payment with their initial questionnaire and coverletter; half were told they would receive their payment afterthey completed and returned the questionnaire. The same mailand telephone followup procedures were used for both groups.Overall, prepayment had significant positive effects on responserates. This paper examines these effects in terms of responserates for various specialties, field efficiencies, cost, andrepresentativeness of the sample.     

THE EXPERIMENTS OF REDUCED WORKING HOURS IN FINLAND

This paper examines experiments of shorter working hours in Finnish municipalities between 1996 and 1998 in terms of the effects of the experiments on work–family interaction and which of the ways of reducing working time had the most positive effect. We analyse the experiment in respect of the Finnish working time regime, and in addition, from the perspective of community time. The analysis combines questionnaire and interview data. The results indicated that the experiment had a positive effect on work–family interaction. Six-hour shifts, in comparison to other forms of working time reductions, had the strongest impact on the decrease in conflict arising from work and affecting family. The interviews demonstrated various effects of the working time experiment on family, including the negative effects caused by unsocial working hours and the loss of time autonomy at work among the highly educated. Furthermore, reduced working hours in a culture based on the principle of full-time work caused some negative effects, such as feelings of guilt. The impact of the experiment on community time depended on the way the experiment was implemented.     

UNDERSTANDING MAIL SURVEY RESPONSE BEHAVIOR A META-ANALYSIS

A meta-analysis of prior studies of techniques designed to inducemail survey response rates was conducted. Research encompassing184 effects (study outcomes) in 115 studies (articles) for 17predictors of response rate was examined. The average effectsize across all manipulations was r=.065, indicating an averageincrease of about 6.5 percent in response rates for manipulations.Effect sizes for specific predictors and two potential moderatorsof effects were examined. Results indicated that repeated contactsin the form of preliminary notification and follow-ups, appeals,inclusion of a return envelope, postage, and monetary incentives,were effective in increasing survey response rates. Significanteffect sizes for the predictors ranged from an increase in responseof 2 percent to 31 percent. Implications of the results forthe conduct of mail surveys and future research on mail surveyresponse behavior are discussed.     

NORMS OF PUNISHMENT: EXPERIMENTS WITH STUDENTS AND THE GENERAL POPULATION

Norms of cooperation and punishment differ across societies, but also within a single society. In an experiment with two subject pools sharing the same geographical and cultural origins, we show that opportunities for peer punishment increase cooperation among students but not in the general population. In previous studies, punishment magnified the differences across societies in people's ability to cooperate. Here, punishment reversed the order: with punishment, students cooperate more than the general population while they cooperate less without it. (JEL C72, C90, Z13)     

THE FEMINIST CRITIQUE IN EPISTEMOLOGICAL PERSPECTIVE: QUESTIONS OF CONTEXT IN FAMILY THERAPY

Family therapy's neglect of social context as a factor in its continuing distortion of women's issues has led feminist critics to wonder if systems-based psychotherapy truly serves women. Rather than heralding the demise of family therapy, however, the feminist critique is here taken to open up concerns central to the epistemological discussion underway in the field. At first, these have to do with the functions of "punctuation,""boundary" and "closure" in systemic epistemology. Later, the central question becomes that of the place given to context in systems epistemology generally, as well as family therapy in particular. Several implications of a more lively interest in context for family therapy's work are explored. These are discussed with respect to women's issues, clinical epistemology, and the challenge to raise novel questions in family therapy.     

UNDERSTANDING THE DECISION TO PARTICIPATE IN A SURVEY

The lack of full participation in sample surveys threatens theinferential value of the survey method. We review a set of conceptualdevelopments and experimental findings that appear to be informativeabout causes of survey participation; offer an integration ofthat work with findings from the more traditional statisticaland survey methodological literature on nonresponse; and, giventhe theoretical structure, deduce potentially promising pathsof research toward the understanding of survey participation.     

DIAGNOSTICS FOR REDESIGNING SURVEY QUESTIONNAIRES: MEASURING WORK IN THE CURRENT POPULATION SURVEY

Between 1986 and 1993, a program of questionnaire design andcognitive research was conducted by the Census Bureau and Bureauof Labor Statistics, to improve labor force measurements inthe Current Population Survey (CPS). As part of the researchprogram, diagnostic measures for systematically testing andevaluating alternative questionnaire versions were developedand applied. This article reports results of applying two methods,special follow-up probes and hypothetical vignettes, to themeasurement of "work" in the CPS. These measures provided bothdirect and indirect information about problems of respondentcomprehension and reporting errors. In this article, we analyzeresults using these diagnostic measures to evaluate the effectof questionnaire revisions on reporting of work activities,and we assess the consistency and usefulness of the informationprovided by alternative diagnostic measures for pretesting andselecting questions.     

INTENSIFIERS IN BEHAVIORAL FREQUENCY QUESTIONS

Intensifiers, words such as "very" and "extremely", are usedto magnify the meaning of the phrases to which they are applied.In a series of studies we investigate how intensifiers in questionstems affect response patterns in social surveys. Our researchindicates that even apparently important differences in questionwording may in some situations have little or no impact; addingan intensifier to a root did not create a response shift forseveral intensifier/root combinations in large-scale surveys.Using both field and laboratory techniques we explore the situationsin which shifts do occur and go some lengths toward describingwhy this happens. Response shifts were observed for two situations.First, when "extreme" was applied to "physical pain" there wasa substantial and significant response shift. Second, when respondentswere asked a question without an intensifier and then had thequestion repeated immediately afterward with an intensifier,a response shift was produced. In addition to the practicalsignificance for survey methodologists, these results are importantto cognitive psychologists interested in word meaning.     

MAIL SURVEY RESPONSE RATE: A META-ANALYSIS OF SELECTED TECHNIQUES FOR INDUCING RESPONSE

This article reports the results of a meta-analysis of experimentalstudies which have examined ten different factors felt to influenceresponse rates to mail surveys. The form of meta-analysis usedclearly defines the individual impact of each of the factorsexamined. Results indicate that prenotification and follow-upsincrease the response rate, as does the type of outgoing postageused. Furthermore, studies sponsored by a university receivegreater returns. Increases in the size of the monetary incentiveused appear to have decreasing marginal gains. Finally, someevidence exists to suggest that the color of the questionnaireinfluences response rate.     

SUBSEQUENT QUESTIONS MAY INFLUENCE ANSWERS TO PRECEDING QUESTIONS IN MAIL SURVEYS

Data of a mode experiment demonstrate that the emergence ofcontext effects may be independent of question order under mailsurvey conditions. Under telephone interview conditions, substantivelyrelated questions affected responses to the target questiononly when asked first. However, the same questions affectedresponses under mail survey conditions independent of whetherthey preceded or followed the target question.