EFFECTS OF INTERVIEW MODE ON SELF-REPORTED DRUG USE

The effects of interview mode on 18- to 34-year-olds' self-reportedtobacco, alcohol, marijuna, and cocaine use were investigated.RDD telephone and personal drug use surveys of the state ofNew Jersey were conducted in 1986–87. In the personalinterview, respondents recorded their drug use on self-administratedanswer sheets. Compared to the area probability sample in thepersonal interview, RDD yielded a sample of blacks higher inincome and education, and more likely to be married and currentlyemployed; white SES was also higher in the telephone sample,but to a lesser degree than for blacks. Controlling for demographiccharacteristics and RDD's exclusion of non-telephone households,the telephone survey yielded significantly lower estimates ofblacks' alcohol consumption, and lifetime and recent marijuanause. Whites' alcohol consumption was slightly lower by telephone;otherwise, estimates of whites' use of the four substances werenearly identical in the two modes. Sample coverage, respondentdemographic characteristics, and racial matching of interviewerand respondent did not account for the significant mode differences.Characteristics of the interview situation itself, such as provisionof privacy in the self-administered format, may have influencedtendencies toward socially desirable responding to a threateningtopic such as drug use.     

Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias

The last 50 years have seen a gradual replacement of face-to-faceinterviewing with telephone interviewing as the dominant modeof survey data collection in the United States. But some ofthe most expensive and large-scale nationally funded, long-termsurvey research projects involving national area-probabilitysamples and long questionnaires retain face-to-face interviewingas their mode. In this article, we propose two ways in whichshifting such surveys to random digit dialing (RDD) telephoneinterviewing might affect the quality of data acquired, andwe test these hypotheses using data from three national modeexperiments. Random digit dialing telephone respondents weremore likely to satisfice (as evidenced by no-opinion responding,nondifferentiation, and acquiescence), to be less cooperativeand engaged in the interview, and were more likely to expressdissatisfaction with the length of the interview than were face-to-facerespondents, despite the fact that the telephone interviewswere completed more quickly than the face-to-face interviews.Telephone respondents were also more suspicious about the interviewprocess and more likely to present themselves in socially desirableways than were face-to-face respondents. These findings shedlight on the nature of the survey response process, on the costsand benefits associated with particular survey modes, and onthe nature of social interaction generally.     

Does Telephone Audio Computer-Assisted Self-Interviewing Improve the Accuracy of Prevalence Estimates of Youth Smoking? Evidence from the UMass Tobacco Study

Despite their advantage for obtaining representative samplesof adolescents, telephone surveys have been regarded as an inferiormethod for collecting data on youth tobacco use because theyyield lower estimates than school-based, self-administered surveys.Although no gold standard for smoking estimates exists, thelower estimates in telephone surveys have been attributed tounderreporting due to youths’ concern that parents orothers may overhear their responses. Telephone audio computer-assistedself-interviewing (T-ACASI) is a cost-effective method for obtaininga representative sample of youths and provides increased privacyfor the respondent. We hypothesize that using T-ACASI wouldencourage youths to report more fully smoking behavior comparedto traditional interviewer-administered telephone methods. Ouranalysis further assesses whether respondent age, gender, race/ethnicity,and parental attitude toward smoking moderated the relationshipbetween survey mode and smoking reports. Using data from a statewidetobacco use survey that randomly assigned youth respondentsto either T-ACASI or interviewer-administered modes, we findthat youths were more likely to report smoking behaviors inT-ACASI mode and that this was especially true for girls, particularlythose who believed their parents would disapprove strongly oftheir smoking. The findings suggest that traditional telephonesurveys may underestimate smoking prevalence in most girls bya factor of two, and that a technique for ensuring privacy forthese respondents is an important component of effective telephonesurvey methodology.     

Presentation matters: how mode effects in item non-response depend on the presentation of response options

Comparability of data across modes is an important issue in survey research. In this paper we discuss item non-response to attitudinal questions in telephone and web surveys. We present results from a survey experiment conducted in Italy and in Spain that compares different presentations of response options in an online setting with a benchmark telephone survey. In line with earlier studies we find that (A), the share of non substantial answers in the online survey depends on how the response option is presented. Comparing different presentations in an online survey to the standard approach of telephone surveys using propensity score matching, we find that (B), the share and pattern of non substantial answers, is most similar across the two modes in the online survey when the it is captured in an instruction on each screen for the online survey. Our findings are of particular relevance for the design of multiple mode or mix-mode surveys of attitudinal questions using online and telephone modes.     

Assessment of Cigarette Smoking and Smoking Susceptibility among Youth: Telephone Computer-Assisted Self-Interviews versus Computer-Assisted Telephone Interviews

This experimental study assesses the effect of two survey methods,telephone audio computer-assisted self-interviewing (T-ACASI)and computer-assisted telephone interviewing (CATI), on self-reportsof smoking behavior and smoking susceptibility among adolescents12–17 years of age in California. In T-ACASI, participantslisten to prerecorded, computer-controlled questions and respondby pressing the keypad on a touch-tone telephone. In CATI, interviewersadminister the questions and enter responses into a computer.Prior research suggests that youth may be more likely to reportsensitive behaviors in a self-administered survey like T-ACASIcompared to an interviewer-administered survey like CATI, dueto greater perceived confidentiality. Logistic regression analyseswere conducted on unweighted data, controlling for demographicdifferences. Adjusted estimates of current smoking (past 30days) were significantly greater in T-ACASI (8.3 percent) thanCATI (4.5 percent). Smoking susceptibility (i.e., lack of afirm commitment not to smoke among those who have never smoked)was also greater in T-ACASI (45.0 percent) than CATI (34.9 percent).In both surveys, social desirability response bias was negativelyassociated with smoking, which suggests that response bias wasproblematic for both modes. Many respondents reported that aparent was present during the interview (59.4 percent in CATI;42.0 percent in T-ACASI). In both surveys, parental presencewas negatively associated with smoking, which suggests thatthis factor could also contribute to underreporting. Applicationof sample weights to the data eliminated the survey mode effects;however, the CATI current smoking estimate (9.3 percent) fromthis study was significantly less than an estimate (14.2 percent)obtained from a self-administered, school-based survey conductedthe same year on California adolescents.     

Does "Yes or No" on the Telephone Mean the Same as "Check-All-That-Apply" on the Web?

Recent experimental research has shown that respondents to forced-choicequestions endorse significantly more options than respondentsto check-all questions. This research has challenged the commonassumption that these two question formats can be used interchangeablybut has been limited to comparisons within a single survey mode.In this paper we use data from a 2004 random sample survey ofuniversity students to compare the forced-choice and check-allquestion formats across web self-administered and telephoneinterviewer-administered surveys as they are commonly used insurvey practice. We find that the within-mode question formateffects revealed by previous research and reaffirmed in thecurrent study appear to persist across modes as well; the telephoneforced-choice format produces higher endorsement than the webcheck-all format. These results provide further support forthe argument that the check-all and forced-choice question formatsdo not produce comparable results and are not interchangeableformats. Additional comparisons show that the forced-choiceformat performs similarly across telephone and web modes.     

The relative costs and benefits of telephone interviews versus self-administered diaries for daily data collection

This article compares two methods of collecting daily data: self-administered diaries and telephone interviews. Study participants included 44 men and 56 women between the ages of 16 and 35 who participated in a larger study of drinking, drug use, and sexual activity. Participants were randomly assigned to either the written diary or the telephone interview conditions; question wording and format were identical in both conditions. Daily data were collected for a period of 8 weeks. Results indicate that although telephone interviews resulted in slightly more missed days of data collection, they generally yielded less item-level missing data, produced cleaner data and therefore were less costly to process, and were as palatable to participants as self-administered diaries. Except for reports of drinking and vegetable consumption, telephone and diary conditions did not differ in the amount of behavior reported; more drinking and vegetable consumption were reported with telephone interviews, however. Telephone interviews also imposed considerably higher overall personnel costs.     

Effects of method on participants and disclosure rates in research on sensitive topics

This study replicates and extends the research of Rosenbaum, Rabenhorst, Reddy, Fleming, and Howells, which also appears in this special issue. Responses from 398 randomly assigned participants regarding differentially sensitive topics were collected via four methods of data collection: written questionnaires, face-to-face interviews, telephone interviews, and an automated telephonic data collection system (ATDC). Several significant differences in data collection methodology and topic area were found, including greater disclosure of sensitive information via the ATDC system than via face-to-face and paper-and-pencil conditions. Participants who were assigned to the ATDC condition felt significantly more comfortable answering questions compared to those in the face-to-face interview condition. Participants in the telephone interview condition reported answering significantly more carefully than participants answering via written questionnaire. Taken together, the results of this study and the previous one it replicates suggest that the ATDC produces disclosure rates that are at least equivalent to, if not greater than, those generated using traditional methods for collecting sensitive data.     

Measuring depression in the community: a comparison of telephone and personal interviews

Interview method effects in response to the Center for Epidemiologic Studies-Depression Scale (CES-D) are compared among a community sample (N = 546) of adults randomly assigned to either telephone or in-person interviews. The interviews were conducted in Los Angeles during 1980. No significant differences were observed between the two interview methods in nonresponse to symptom items, preference for specific response categories, reliability, mean level of depression, or proportion classified as depressed. Furthermore, no significant interactions were found between sociodemographic characteristics and the method of interview.     

Interviewers' Voices and Refusal Rates in Telephone Surveys

Interviewers' voice characteristics are related to refusal ratesin telephone interviews. Judges reliably rated vocal and personalcharacteristics of telephone interviewers from recordings ofthe first one-half minute of interview introductions. Interviewerswith low refusal rates were judged as having comparatively higherpitched voices, greater ranges of variation in pitch, greaterloudness, faster rates of speaking, and clearer and more distinctpronunciation. They also were judged as more competent and ashaving a more positive approach to the respondent and the interview.     

Interview effects in the reporting of domestic violence

Victims of domestic abuse sometimes have the opportunity to discuss their experiences in interviews with researchers and subsequently to report their victimization. Beyond the reporting decision—a non-trivial information–revelation decision—they frequently must decide whether to have someone they know present at the interview and whether to conduct the interview in person or by telephone. Having an associate present at the interview may provide a respondent victim greater comfort or social support than she might have conducting the interview by herself, but perhaps only to the extent that the abusive partner does not pose a continuing household threat. Undertaking a personal interview may facilitate a greater degree of empathy or deeper understanding from the information gatherer likely unavailable over the telephone, but personal interviews generally take more time and incur more significant marginal opportunity costs. This paper examines conceptually and empirically how the parameters of these interviews, endogenously determined by victims themselves, affect the decision to report domestic violence.     

Interviewing Older Adults: A Comparison of Telephone and Face-to-Face Modalities

This article examines telephone interviewing of older adultsand compares it with face-to-face interviews. Specifically,the following issues are examined in several national surveys:(1) differences in age distributions between the samples ofadults reached in both modes; (2) explanations for potentialdifferences in age distributions; (3) differences between thetwo modes in demographic characteristics in the adults reached,in interview process and in response quality, and how thesemode differences vary by age of the respondents. Telephone surveystend to underrepresent older persons, and older persons whodo participate in a telephone survey are disproportion atelywell educated. Implications of the lower response rate amongolder persons are softened by the fact that reponse distributionsacross a range of questions show little difference by interviewmode between older persons and persons of other age groups.     

The ties that bind: the role of migrants in the uneven geography of international telephone traffic

Recent work suggests that migrants have been a major driving force in the dramatic growth of international telephony over recent decades, accounting for large rises in telephone calls between countries with strong immigrant/emigrant connections. Yet, the existing literature has done a poor job of evaluating the substantive importance of migrants in explaining large disparities in levels of bilateral voice traffic observed between different countries. It has also failed to go very far in examining how domestic and relational factors moderate (namely amplify or attenuate) the influence of migrant stocks on international calling. Our contribution addresses these gaps in the literature. For a sample, which includes a far larger number of countries than previous studies, we show that, together with shorter‐term visitors, bilateral migrant stocks emerge as the relational variable with one of the substantively largest influences over cross‐national patterns of telephone calls. We also find that the effect of bilateral migrant stocks on inter‐country telephone traffic is greater where the country pairs are richer and more spatially distant from one another.     

Digital Inequality and Place: The Effects of Technological Diffusion on Internet Proficiency and Usage across Rural,Suburban, and Urban Counties*

Recently researchers have made efforts to reconceptualize digital inequality into discrete levels. These levels reflect access to and diffusion of technologies, proficiency in Internet usage, and propensity to take advantage of the opportunities afforded by information and communication technologies for assistance in daily life. We assess the utility of this approach for studying digital inequality across rural, suburban, and urban counties. Based on data from a 2005 nationally representative random sample telephone survey of 2,185 adults, the results provide mixed support for using this approach to studying digital inequality. In particular, we find that rural residents use Internet technologies less for assistance in helping with economics and other daily activities when compared with individuals from suburban and urban areas; however, our results suggest that this relationship is the product of the slow diffusion of advanced technologies to rural areas. The implications of these findings for understanding this under‐theorized form of inequality are discussed, and we make contributions to this literature through empirically addressing issues of digital capital.     

Beyond performative talk: critical observations on the radical critique of reading interview data

ABSTRACT

We centrally consider the question of what interview data can be used to ‘say’ through a dialogue with advocates of the ‘radical critique’ of interview studies. We propose that while the critique has considerable utility in drawing to ‘the social life of interviews’ and the pervasiveness of notions of the ‘romantic subject’, it simultaneously goes too far in its reduction of interviews to narrative performance, and not far enough in its own critical departure from core characteristics of the romantic subject. We show how the critique leaves intact imagery of a seemingly unbridgeable divide between the experienced and the expressed, and involves a related conflation of what can be said at interview with what interviews can be used to say. We explore how the radical critique might productively be built upon via more ‘synthetic’ forms of research engagement, outlining alternative modes of apprehending interview data through a further critical departure from the romantic subject. Accordingly, we advance a move beyond a sole engagement with questions of how data are constructed and produced and towards how such data might otherwise be used to speak about the social world beyond the social nexus that constitutes an interview encounter.     

The Great Interview: 25 Strategies for Studying People in Bed

Interviewing is among the most central methods in social science research. While common as a method, there are identifiable characteristics that distinguish good interviews from outstanding ones. Great interviewing is deceptively difficult, partly because it is an acquired ability that takes time to develop, partly because people often remain bound to conventional norms of behavior while interviewing that precludes open access to the people interviewed. While several texts are available on interviewing, few of them venture to draw the explicit distinction among characteristics that separate ordinary from outstanding interviews. Consequently, a concise and accessible guidepost that directs people to the essentials of outstanding interviewing is difficult to find. Based on interviews with a range of people about varied subjects, the author offers 25 directions that will, when followed in combination, point the interviewer along the road from the good (or not-so-good) interview to the great interview.     

Effects and Costs of Tracing Strategies on Nonresponse Bias in a Survey of Workers with Low-Back Injury

Declining rates of participation are an increasing challengefor studies that involve telephone surveys. This study examinedthe costs of a telephone survey methodology that used increasinglyintensive tracing methods to track a pool of claimants who hadsustained occupational back injuries. It also compared the respondentsample to people who refused the survey and/or were not locatedor contacted. 3,181 claimants were drawn from a database maintainedby the Missouri Division of Workers’ Compensation (DWC)and 1,475 completed a telephone interview. The DWC databaseprovided data reflecting monetary and disability outcomes forall potential participants; telephone interviews provided additionalself-reported data. More intensive tracing strategies improvedthe representativeness of the sample, yielding more women andminority participants. Relative to less intensive techniques,advanced tracing efforts located people whose DWC records weremore similar to claimants not located. While the hands-on tracingefforts reduced the apparent bias of the respondent sample,costs increased as tracing strategies intensified – over$98,000 was spent to trace 1,027 claimants who were never locatedor contacted. The results suggest some guidelines that may facilitatedecision-making for researchers and funders who must balancethe trade-off between costs and nonresponse bias when planningsurveys.     

Reaching the U.S. Cell Phone Generation: Comparison of Cell Phone Survey Results with an Ongoing Landline Telephone Survey

Noncoverage rates in U.S. landline-based telephone samples dueto cell phone only households (i.e., households with no landlinebut accessible by cell phone) and the corresponding potentialfor bias in estimates from surveys that sample only from landlineframes are growing issues. Building on some of the few publishedstudies that focus on this problem, a study was conducted inthree states (Georgia, New Mexico, and Pennsylvania) as partof the Behavioral Risk Factor Surveillance System (BRFSS), theworld's largest ongoing public health telephone survey, to evaluatethe effectiveness of conducting the BRFSS interview with a sampledrawn from dedicated cell phone telephone exchanges and mixed-use(landline and cell phone) exchanges. Approximately 600 interviewswere conducted in each of two groups: cell phone only adults(n = 572) and adults with both a landline and a cell phone (n= 592). Making comparisons with data from the ongoing, landline-basedBRFSS survey, we report on response rates, demographic characteristicsof respondents, key survey estimates of health conditions andrisk behaviors, and survey costs. The methods used in this studyhave wide application for other U.S. telephone surveys.     

Environmental Racial Inequality in Detroit

This study uses industrial pollution data from the Environmental Protection Agency's Toxics Release Inventory (TRI) and tract-level demographic data from the 2000 U.S. census to determine whether environmental racial inequality existed in the Detroit metropolitan area in the year 2000. This study differs from prior environmental inequality research in two important ways. First, it offers a positive rationale for using hazard proximity indicators. Second, it uses a distance decay modeling technique to estimate hazard proximity. This technique weights each hazard's estimated negative effect by distance such that the estimated negative effect declines continuously as distance from the hazard increases, thus providing more accurate estimates of proximity-based environmental risk than can be obtained using other variable construction techniques currently found in the literature. Using this technique, I find that Detroit's black neighborhoods were disproportionately burdened by TRI facility activity in 2000 and that neighborhood racial composition had a strong independent effect on neighborhood proximity to TRI activity.     

The effects of response rate changes on the index of consumer sentiment

From 1979 to 1996, the Survey of Consumer Attitudes response rate remained roughly 70 percent. But number of calls to complete an interview and proportion of interviews requiring refusal conversion doubled. Using call-record histories, we explore what the consequences of lower response rates would have been if these additional efforts had not been undertaken. Both number of calls and initially cooperating (vs. initially refusing) are related to the Index of Consumer Sentiment (ICS), but only number of calls survives a control for demographic characteristics. We assess the impact of excluding respondents who required refusal conversion (which reduces the response rate 5-10 percentage points), respondents who required more than five calls to complete the interview (reducing the response rate about 25 percentage points), and those who required more than two calls (a reduction of about 50 percentage points). We found no effect of excluding any of these respondent groups on cross-sectional estimates of the ICS using monthly samples of hundreds of cases. For yearly estimates, based on thousands of cases, the exclusion of respondents who required more calls (though not of initial refusers) had an effect, but a very small one. One of the exclusions generally affected estimates of change over time in the ICS, irrespective of sample size.