SUBSTANCE USE ESTIMATES FROM RDD AND AREA PROBABILITY SAMPLES: IMPACT OF DIFFERENTIAL SCREENING METHODS AND UNIT NONRESPONSE

Survey mode effects linked to unit nonresponse and screeningprocedures were estimated in a study of self-reported to bacco,alcohol, and illicit drug use. Two samples of the same population were drawn: a random digit dial (RDD) sample with telephonescreening and a multistage area probability sample with in-personscreening. Respondents in both samples were interviewed by telephoneto control mode of communication effects. Households with outtelephones were excluded from both samples to control samplecoverage effects. Although results show substantially lowerresponse rates in the telephone survey due to screening refusals,the two survey procedures produced samples that were very similarin demographic characteristics and in substance use profiles.Differential screening operations and differential nonresponserates between the RDD and area probability designs did not appearto be a major source of mode effects in comparing telephoneand face-to-face surveys of substance use.     

Comparison of telephone RDD and online panel survey modes on CPGI scores and co-morbidities

The purpose of this study was to compare the influence of two survey modes – telephone random digit dialling (RDD) and stratified sampling of an online panel – on Canadian Problem Gambling Index (CPGI) scores and co-morbidities. An identical gambling survey was administered to 4000 South Koreans selected via random dialling of cell phone numbers and to 4330 South Korean members of an online panel. The online panelists were found to have significantly higher levels of tobacco use, drug or alcohol problems and mental health problems, higher employment status and lower happiness levels. However, even when controlling for these variables, CPGI scores for the online panel were significantly higher than those for the telephone interview. This appears to be due to higher levels of pathology among online panelists combined with potentially more valid self-reports due to enhanced anonymity.     

Monitoring youth behavior in response to structural changes. Alternative approaches for measuring adolescent drinking

Random digit dial (RDD) telephone and self-administered school-based surveys of drinking and drinking and driving were compared for adolescents from two Northern California communities. The RDD and school-based surveys resulted in very different samples. The telephone sample contained a greater proportion of European Americans and a smaller proportion of Asian Americans and "other" ethnicities. Respondents to the telephone sample also tended to be older and of higher socioeconomic status (SES). The telephone survey captured very few school dropouts. Moreover, it resulted in lower self-reports of drinking and drinking and driving. Survey mode appeared to influence respondents equally, regardless of their gender, age, ethnicity, or SES.     

Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey

Declining contact and cooperation rates in random digit dial(RDD) national telephone surveys raise serious concerns aboutthe validity of estimates drawn from such research. While researchin the 1990s indicated that nonresponse bias was relativelysmall, response rates have continued to fall since then. Thecurrent study replicates a 1997 methodological experiment thatcompared results from a "Standard" 5-day survey employing thePew Research Center’s usual methodology with results froma "Rigorous" survey conducted over a much longer field periodand achieving a significantly higher response rate. As withthe 1997 study, there is little to suggest that unit nonresponsewithin the range of response rates obtained seriously threatensthe quality of survey estimates. In 77 out of 84 comparableitems, the two surveys yielded results that were statisticallyindistinguishable. While the "Rigorous" study respondents tendedto be somewhat less politically engaged, they did not reportconsistently different behaviors or attitudes on other kindsof questions. With respect to sample composition, the Standardsurvey was closely aligned with estimates from the U.S. Censusand other large government surveys on most variables. We extendour analysis of nonresponse to include comparisons with thehardest-to-reach respondents and with respondents who terminatedthe interview prior to completion.     

A Comparison of Address-Based Sampling (ABS) Versus Random-Digit Dialing (RDD) for General Population Surveys

Valid and reliable public health data are becoming more difficultto obtain through random-digit dial (RDD) telephone surveys.As a result, researchers are evaluating different survey designs(i.e., sampling frame and survey mode combinations) as complementsor alternatives to RDD. Traditionally, mail surveys of the generalpublic have been limited due to a lack of a complete samplingframe of households. Recent advances in electronic record keeping,however, have allowed researchers to develop a sample from aframe of addresses (e.g., the U.S. Postal Service Delivery SequenceFile, which appears to provide coverage which rivals or possiblyexceeds that obtained through RDD sampling methods). To testthe use of this frame for surveying adults aged 18 years andolder across a wide geographic area, a pilot study was conductedas part of the 2005 Behavioral Risk Factor Surveillance System(BRFSS). The pilot compared use of a traditional, RDD telephonesurvey methodology to an approach using a mail version of thequestionnaire completed by a random sample of households drawnfrom an address-based frame. The findings indicate that themail survey approach can achieve higher response rates in low-response-ratestates (<40%) than RDD (particularly when two mailings aresent). Additionally, the address frame with mail survey designprovides access to cell phone only households and offers costsavings over the telephone approach. The resulting sample, however,significantly overrepresents non-Hispanic whites and peoplewith higher levels of education.     

INTERVIEW MODE EFFECTS IN SURVEYS OF DRUG AND ALCOHOL USE: A FIELD EXPERIMENT

This research explores the impact of interview mode on respondents'willingness to reveal illicit or undesirable behavior and mechanismsby which interview mode influences response tendencies. A fieldexperiment was designed to control mode effects due to samplingand screening so that the impact of response anonymity (throughuse of self-administered questionnaires ([SAQs]) and socialdistance in the interviewer-respondent relationship (telephonevs. personal communication) could be tested. Respondents aged18–45 were randomly as-signed to interview mode: telephone,face-to-face, or self-administered. Admission of illicit druguse and alcohol use was most likely in the personal mode withSAQs, slightly less likely in personal mode without SAQs, andleast likely in the telephone mode. The magnitude of the modedifferentials was larger for blacks than for whites, and largeramong respondents who are more mistrustful of others. Resultssupport the notion that response effects due to mode of interviewderive, at least in part, from interview mode differences inability to assuage respondents' confidentiality concerns. Greatersocial distance between interviewer and respondent in the telephoneinterview, compared with face-to-face communication, makes itmore difficult for the researcher to make convincing confidentialityguarantees. The response anonymity provided by SAQs also appearsto increase respondents' willingness to reveal sensitive behavior,especially among racial/ethnic minorities.     

The relative costs and benefits of telephone interviews versus self-administered diaries for daily data collection

This article compares two methods of collecting daily data: self-administered diaries and telephone interviews. Study participants included 44 men and 56 women between the ages of 16 and 35 who participated in a larger study of drinking, drug use, and sexual activity. Participants were randomly assigned to either the written diary or the telephone interview conditions; question wording and format were identical in both conditions. Daily data were collected for a period of 8 weeks. Results indicate that although telephone interviews resulted in slightly more missed days of data collection, they generally yielded less item-level missing data, produced cleaner data and therefore were less costly to process, and were as palatable to participants as self-administered diaries. Except for reports of drinking and vegetable consumption, telephone and diary conditions did not differ in the amount of behavior reported; more drinking and vegetable consumption were reported with telephone interviews, however. Telephone interviews also imposed considerably higher overall personnel costs.     

BIAS IN LIST-ASSISTED TELEPHONE SAMPLES

A number of researchers have suggested list-assisted samplingfor the selection of telephone households to overcome some ofthe operational difficulties associated with the Mitofsky-Waksbergmethods of random digit dialing (RDD). An advantage of a list-assistedmethod of RDD is that an equal probability systematic sampleof telephone numbers can be selected and the variances of estimatesfrom such a sample are usually lower than from a clustered designlike the Mitofsky-Waksberg method. The main disadvantage ofthe list-assisted method is that it excludes some householdsfrom the sample, thus creating a coverage bias in the estimates.This article describes research on the coverage bias for a particularmethod of list-assisted sampling. The two key determinants ofcoverage bias are the proportion of households that are noteligible for the sample and the differences in the characteristicsof the covered and not covered populations. The results showthat about 4 percent of all households are excluded in nationalsamples using this method of sampling. Furthermore, they showthat the differences between the covered and uncovered populationsare generally not large. The coverage bias resulting from theseconditions may often be small.     

Estimating Residency Rates for Undetermined Telephone Numbers

The method for estimating residency rates in random digit dial(RDD) telephone surveys is important for computing responserates. This article reviews existing methods of estimating residencyrates and introduces a new "survival" method that takes advantageof more information to provide improved estimates. Examplesof applying this to large RDD samples are given along with suggestionsfor use of the method in other surveys.     

Survey mode effects on measured income inequality

We study the effect of interview modes on estimates of economic inequality which are based on survey data. We exploit variation in interview modes in the Austrian EU-SILC panel, where between 2007 and 2008 the interview mode was switched from personal interviews to telephone interviews for some but not all participants. We combine methods from the program evaluation literature with methods from the distributional decomposition literature to obtain causal estimates of the effect of interview mode on estimated inequality. We find that the interview mode has a large effect on estimated inequality, where telephone interviews lead to a larger downward bias. The effect of the mode is much smaller for robust inequality measures such as interquantile ranges, as these are not sensitive to the tails of the distribution. The magnitude of effects we find are of a similar order as the differences in many international and intertemporal comparisons of inequality.     

Household Telephone Service and Usage Patterns in the United states in 2004: Implications for Telephone Samples

Changes in the U.S. telephone system, especially the rapid growthin the prevalence and use of cell phones, raise concerns aboutundercoverage error in random digit dial (RDD) telephone samples.A supplement to the Current Population Survey (CPS) was conductedin 2004 to examine telephone service and usage in U.S. households.This article explores the potential for biases in RDD surveysresulting from the increases in cell phones by presenting estimatesof the percentage of households with different types of telephoneservice, including the percentage of cell-only households, andgiving demographic profiles of households by type of telephoneservice. Logistic regression models examine variables that predictwhether households are without a telephone or only have cellphones. These predictors may be used for weighting adjustmentsto reduce undercoverage biases. We address some additional issues,including the wording of questions for measuring telephone service,that are relevant if telephone-sampling methods are revisedto include cell phones. The estimates from the CPS supplementare also used to help understand some of the new sampling andweighting problems associated with selecting samples from cellphone numbers.     

Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias

The last 50 years have seen a gradual replacement of face-to-faceinterviewing with telephone interviewing as the dominant modeof survey data collection in the United States. But some ofthe most expensive and large-scale nationally funded, long-termsurvey research projects involving national area-probabilitysamples and long questionnaires retain face-to-face interviewingas their mode. In this article, we propose two ways in whichshifting such surveys to random digit dialing (RDD) telephoneinterviewing might affect the quality of data acquired, andwe test these hypotheses using data from three national modeexperiments. Random digit dialing telephone respondents weremore likely to satisfice (as evidenced by no-opinion responding,nondifferentiation, and acquiescence), to be less cooperativeand engaged in the interview, and were more likely to expressdissatisfaction with the length of the interview than were face-to-facerespondents, despite the fact that the telephone interviewswere completed more quickly than the face-to-face interviews.Telephone respondents were also more suspicious about the interviewprocess and more likely to present themselves in socially desirableways than were face-to-face respondents. These findings shedlight on the nature of the survey response process, on the costsand benefits associated with particular survey modes, and onthe nature of social interaction generally.     

Does Telephone Audio Computer-Assisted Self-Interviewing Improve the Accuracy of Prevalence Estimates of Youth Smoking? Evidence from the UMass Tobacco Study

Despite their advantage for obtaining representative samplesof adolescents, telephone surveys have been regarded as an inferiormethod for collecting data on youth tobacco use because theyyield lower estimates than school-based, self-administered surveys.Although no gold standard for smoking estimates exists, thelower estimates in telephone surveys have been attributed tounderreporting due to youths’ concern that parents orothers may overhear their responses. Telephone audio computer-assistedself-interviewing (T-ACASI) is a cost-effective method for obtaininga representative sample of youths and provides increased privacyfor the respondent. We hypothesize that using T-ACASI wouldencourage youths to report more fully smoking behavior comparedto traditional interviewer-administered telephone methods. Ouranalysis further assesses whether respondent age, gender, race/ethnicity,and parental attitude toward smoking moderated the relationshipbetween survey mode and smoking reports. Using data from a statewidetobacco use survey that randomly assigned youth respondentsto either T-ACASI or interviewer-administered modes, we findthat youths were more likely to report smoking behaviors inT-ACASI mode and that this was especially true for girls, particularlythose who believed their parents would disapprove strongly oftheir smoking. The findings suggest that traditional telephonesurveys may underestimate smoking prevalence in most girls bya factor of two, and that a technique for ensuring privacy forthese respondents is an important component of effective telephonesurvey methodology.     

Patterns of Alcohol and Marijuana Use at School

The problem of adolescent substance use has been examined extensively. Beyond simple prevalence estimates, however, little research has been conducted on substance use in the school context. The present investigation was an in‐depth study of students' attitudes and behaviors regarding alcohol and marijuana use during the school day. Based on a representative sample of 1123 high school students, this study assessed the frequency of alcohol and marijuana use at school among demographic subgroups, the accessibility of drugs in school, and students' perceived consequences of being caught using drugs in school. The results showed that male and Hispanic students had higher levels of drug use at school than female and white students, respectively; that school drug use increased with age, and that alcohol and marijuana were easily obtained and used on school grounds. A large percentage of students were not aware of the specific actions taken in their schools to punish drug use. The need for additional research on school‐related drug use is emphasized.     

Negative consequences of alcohol use among college students: victims or victimizers?

Focusing on reciprocity between primary and secondary consequences resulting from alcohol use among college students, this study hypothesizes that college students should not be dichotomously viewed as those who generate alcohol-related negative consequences and those who suffer from the consequences generated by fellow students; instead, since students usually live closely together and most of them use alcohol, they constantly affect one another with consequences of their alcohol use. Five colleges in New York State were randomly selected for the study. The telephone interview method was employed to survey college students during the spring semester of 1998. Within each participating college, students were randomly selected through the use of complete student telephone directories provided by the college administration. A total of 813 students were interviewed. Findings indicate that negative consequences of alcohol use among college students may be understood more in a form of group process than in separate individual circumstances. Through association and interaction with other alcohol users, students are frequently victimizing fellow students and being victimized by others in terms of alcohol-related consequences; the severity of alcohol-related hazard for students, thus, tends to be twice as severe as that for individuals who are not in a college environment.     

The State of the Union: Sexual Health Disparities in a National Sample of US College Students

Abstract

Objective: To examine sexual health disparities between blacks and whites in a national sample of US college students. Participants and Method Summary: Analyses utilized secondary data from 44,165 nonmarried undergraduates (aged 18–24; M = 20.1) responding to the Spring 2007 American College Health Association–National College Health Assessment; 64% were female and 94.7% were white. Results: Whites reported more experience in oral and anal sex, were less likely to use condoms for oral, anal, and vaginal sex, and less likely to have been tested for HIV (human immunodeficiency virus) compared with blacks. However, blacks reported more sex partners, lower use of hormonal contraceptives, and higher rates of adverse sexual health outcomes, such as sexually transmitted infections (STIs) and unintended pregnancy. Sexual behaviors and outcomes also varied across gender. Conclusions: This study highlights a need to increase access to hormonal contraceptives and early STI screening/treatment among blacks, improve HIV testing among whites, and increase condom use promotion for all students.     

Discerning the epidemiology of drug use among a sample of college students

Although estimates concerning the prevalence of various forms of substance abuse vary considerably, it is critical to note that even the more conservative estimates indicate a major public health problem. Furthermore, increased drug experimentation has been frequently associated with the college experience. Utilizing a slightly modified version of the National Institute on Drug Abuse (NIDA) Monitoring the Future Survey, the present study examined the epidemiology of self-reported drug taking behaviors (e.g., alcohol, marijuana, tranquilizers, stimulants, psychedelics, etc.) among a sample (n = 683) of students attending a major public university. Data analyses focused on the specific settings and social groupings in which drug use occurred as well as on the frequency and type(s) of drug taking behaviors. Based on the results yielded from a disjoint cluster analysis, four distinct groups of drug users were identified. These four groups then served as categories of the dependent variable in a discriminant function analysis. A general linear models procedure was employed to identify the more efficacious discriminating (i.e., independent) variables.     

Gender,race, and the use of prayer to manage anger

ABSTRACT

Women and blacks are more likely than men and whites to use prayer to manage negative emotions such as anger. However, the pathways explaining these associations are not fully understood. Using data from the 1996 General Social Survey’s emotion module, we evaluate four potential mechanisms that might account for these associations: women’s and blacks’ relatively high levels of religious participation, relatively low socioeconomic status, extended duration of their negative emotional experiences, and relatively lower perceived control. Women’s and blacks’ higher likelihood of using prayer to manage anger is partially accounted for by their higher levels of religious participation, lower socioeconomic status, and duration of anger. Lower levels of perceived control contribute only to blacks’ use of prayer to manage anger. Our findings highlight the importance of identifying pathways that explain why particular social groups use particular emotion management strategies.     

Heavy alcohol use compared to alcohol and marijuana use: do college students experience a difference in substance use problems?

This study examines the risk for alcohol and other drug (AOD) problems resulting from alcohol plus marijuana use compared to alcohol-only use. Data are from telephone interviews with 1113 randomly selected college students attending two large urban universities in the southwestern United States. Alcohol and marijuana users (dual users) were more likely to be younger and report a higher mean number of drinks per occasion and experiencing all AOD problems studied compared to alcohol-only users. Multivariate logistic regression analysis findings reveal the relationship between dual-substance use and increased risk for AOD problems remained after controlling for demographics and alcohol use behaviors. Such problems include greater odds of legal problems and riding with or being an intoxicated driver. College students using alcohol and marijuana are at much higher risk for AOD problems than are students who use alcohol only, even when heavy drinking is taken into account.     

Comparison of web and mail surveys in collecting illicit drug use data: a randomized experiment

This randomized experiment examined survey mode effects for self-reporting illicit drug use by comparing prevalence estimates between a Web-based survey and a mail-based survey. A random sample of 7,000 traditional-aged undergraduate students attending a large public university in the United States was selected to participate in the spring of 2001. Students were randomly assigned to self-administer a survey via the Web or U.S. mail. The Web survey produced a significantly higher response rate than the U.S. mail survey. The prevalence estimates of illicit drug use (lifetime and past year) did not differ significantly between the two survey modes. The findings provide preliminary evidence that Web and U.S. mail surveys produce similar results regarding illicit drug use among undergraduate students. Although additional research is needed involving more diverse samples, these findings bode well for using Web surveys in college-based research.