Comparing Check-All and Forced-Choice Question Formats in Web Surveys

For survey researchers, it is common practice to use the check-allquestion format in Web and mail surveys but to convert to theforced-choice question format in telephone surveys. The assumptionunderlying this practice is that respondents will answer thetwo formats similarly. In this research note we report resultsfrom 16 experimental comparisons in two Web surveys and a papersurvey conducted in 2002 and 2003 that test whether the check-alland forced-choice formats produce similar results. In all 16comparisons, we find that the two question formats do not performsimilarly; respondents endorse more options and take longerto answer in the forced-choice format than in the check-allformat. These findings suggest that the forced-choice questionformat encourages deeper processing of response options and,as such, is preferable to the check-all format, which may encouragea weak satisficing response strategy. Additional analyses showthat neither acquiescence bias nor item nonresponse seem topose substantial problems for use of the forced-choice questionformat in Web surveys.     

Effects of Personal Salutations in E-mail Invitations to Participate in a Web Survey

Effects of personalizing survey invitations on response rateshave been extensively researched in the realm of mail surveys.Commonly, it is found that response rates increase when personalizationis applied. Recently, efforts have been made to investigatewhether these findings extend to the field of Web surveys thatuse e-mail invitations. Using data from a Web experiment conductedamong first-year university students, personalization of e-mailinvitations is shown to have significantly increased the responserate by 7.8 percentage points. From the theory that personalizationdecreases the level of anonymity and perceived privacy, differencesin responses to sensitive questions were expected. However,no effects of personalization on the responses to a questionprobing for respondents’ sexual behavior were found.     

A Comparison of Address-Based Sampling (ABS) Versus Random-Digit Dialing (RDD) for General Population Surveys

Valid and reliable public health data are becoming more difficultto obtain through random-digit dial (RDD) telephone surveys.As a result, researchers are evaluating different survey designs(i.e., sampling frame and survey mode combinations) as complementsor alternatives to RDD. Traditionally, mail surveys of the generalpublic have been limited due to a lack of a complete samplingframe of households. Recent advances in electronic record keeping,however, have allowed researchers to develop a sample from aframe of addresses (e.g., the U.S. Postal Service Delivery SequenceFile, which appears to provide coverage which rivals or possiblyexceeds that obtained through RDD sampling methods). To testthe use of this frame for surveying adults aged 18 years andolder across a wide geographic area, a pilot study was conductedas part of the 2005 Behavioral Risk Factor Surveillance System(BRFSS). The pilot compared use of a traditional, RDD telephonesurvey methodology to an approach using a mail version of thequestionnaire completed by a random sample of households drawnfrom an address-based frame. The findings indicate that themail survey approach can achieve higher response rates in low-response-ratestates (<40%) than RDD (particularly when two mailings aresent). Additionally, the address frame with mail survey designprovides access to cell phone only households and offers costsavings over the telephone approach. The resulting sample, however,significantly overrepresents non-Hispanic whites and peoplewith higher levels of education.     

Substance Use and Psychosocial Predictors of High School Dropout in Cape Town, South Africa

The aims of this study were to examine whether use of tobacco, alcohol, and illicit drugs predicts dropout among secondary school students in Cape Town, South Africa. A self-report instrument was administered to 1,470 Grade 8 students. The proportion of students that dropped out of school between the onset of the study and 4 years later was 54.9%. After adjusting for a range of confounders, dropout was significantly predicted by absenteeism, poverty (as assessed by a possession index), and past month cigarette use, but not by past month alcohol use and lifetime illicit drug use. Contrary to findings from developed countries, alcohol and illicit drug use did not predict dropout. It is possible that predictors of dropout documented elsewhere may not be pertinent in developing countries.     

Mental health need, awareness, and use of counseling services among international graduate students

OBJECTIVE AND PARTICIPANTS: The authors examined the prevalence of mental health needs in international graduate students, their knowledge of mental health services, and their use of on-campus and off-campus counseling services. METHODS: All registered graduate students in the Spring 2004 semester received an e-mail invitation to participate in a Web survey. Of the 3,121 completed surveys, 551 completed surveys were from international graduate students. RESULTS: Approximately 44% of international graduate students responded that they had had an emotional or stress-related problem that significantly affected their well-being or academic performance within the past year. International students who reported a more functional relationship with their advisors were less likely to report having an emotional or stress-related problem in the past year and using counseling services. International students who reported higher financial confidence were also less likely to use counseling services. CONCLUSIONS: There is an unmet mental health need among international graduate students. Special mental health outreach efforts should be directed at international graduate students, with particular attention on the relationship between students and their advisors and on adequate financial support for students.     

Effects of Category Order on Answers in Mail and Telephone Surveys1

Abstract Past research suggests that mail surveys encourage a primacy effect, which is a tendency to choose the first answers from a list, whereas telephone surveys encourage a recency effect, a tendency to choose the last answers from a list. This paper summarizes results from 82 new experiments conducted in 12 separate surveys in seven states. Only four of 33 mail survey comparisons exhibited significant primacy effects, while five of 26 experiments in telephone surveys exhibited recency effects. In addition, only three of 23 cross-method comparisons produced a significant primacy/recency effect in the expected manner. The conclusion is that the prevalence of primacy and recency effects has been over-estimated by past research and a new theoretical approach that takes into account multiple causation is needed for examining these effects.     

Life events and peer substance use and their relation to substance use problems in college students

Substance use disorders among college students are not well understood, and the present study examined the relationship of two environmental factors to alcohol and drug use problems in 616 (316 women) college students. Participants completed measures assessing substance use problems, life events, and substance use among peers. Alcohol use problems were significantly associated with higher drug use problems and regular use of illicit drugs among friends. Drug use problems were significantly associated with male gender, higher alcohol use problems, regular use of alcohol and drugs among friends, illicit drug use among romantic partners, and higher numbers of negative life events. Results extend previous research and suggest that college students who experience multiple negative life events and/or affiliate with substance using friends and romantic partners may be at risk for developing a substance use problem.     

A Life-course Perspective on the "Gateway Hypothesis"

Drawing on stress and life-course perspectives and using panel data from 1,286 south Florida young adults, we assess three critical questions regarding the role of marijuana in the "gateway hypothesis." First, does teen marijuana use independently (causally) affect subsequent use of more dangerous substances? Second, if so, does that effect apply to the abuse of other illicit substances, as defined by the DSM-IV, or only to the use of such substances? Finally, does any causal effect of teen marijuana use survive beyond adolescence, or is it a short-term effect that subsides as adolescents transition to adulthood? Our results indicate a moderate relation between early teen marijuana use and young adult abuse of other illicit substances; however, this association fades from statistical significance with adjustments for stress and life-course variables. Likewise, our findings show that any causal influence of teen marijuana use on other illicit substance use is contingent upon employment status and is short-term, subsiding entirely by the age of 21. In light of these findings, we urge U.S. drug control policymakers to consider stress and life-course approaches in their pursuit of solutions to the "drug problem."     

An examination of sexual risk behaviors in adolescent substance users

ABSTRACT. Objectives: This study examined the risk for engaging in high-risk sexual behavior associated with substance use in a sample of U.S. adolescents. Methods: The sample (N = 15,425) was obtained via the Youth Risk Behavior Surveillance System, a survey of public high school students. Results: Substance use was associated with sexual risk behaviors, with odds ratios being greatest for adolescents who used cigarettes and illicit substances, as well as those who engaged in injection drug use. Conclusions: Results highlight the need for prevention and intervention programs targeting sexual risk behaviors in substance-using adolescents as a means to decrease the spread of sexually transmitted infections.     

Feasibility and efficacy of a binge drinking prevention intervention for college students delivered via the Internet versus postal mail

In this study, the authors evaluated the feasibility and efficacy of a binge drinking prevention intervention for college students delivered via the Internet versus a parallel print-based intervention delivered via postal mail. A total of 116 college students completed the baseline survey. The authors then randomized the students into the Web or print group and sent them intervention materials. One hundred and six students completed the posttest survey. The intervention consisted of a series of 4 weekly "newsletters" in electronic or print format. The authors collected data using a standardized online 42-item survey. They found that an Internet-based binge drinking prevention intervention for college students was feasible. Results supported the efficacy of this intervention for those students already binge drinking, regardless of delivery mode. The authors found no significant differences on outcome measures when delivered via the Internet or postal mail. Results lend support to the use of the Internet as a viable alternative to more traditional health intervention delivery methods.     

COMBAT EXPOSURE,CIGARETTE CONSUMPTION,AND SUBSTANCE USE

This study estimates the relationship between combat exposure and several risky health behaviors: cigarette consumption, binge drinking, and drug use. We find that the U.S. active duty military personnel deployed to combat zones with enemy firefight are more likely to subsequently smoke cigarettes, consume alcohol, and use illicit drugs than their counterparts deployed to noncombat operations. Our results suggest that the mental health effects of combat can explain up to two‐thirds of the estimated association between combat exposure and risky health behaviors. (JEL H56, I12)     

Psychosocial correlates of recreational ecstasy use among college students

College students' ecstasy (MDMA) use increased significantly in recent years, yet little is known about these students. In this study, the authors used the Center for Alcohol and Other Drug Studies (CORE) survey to compare 29 college students who had used ecstasy and other illicit drugs with 90 students who had used marijuana and no other illicit drugs. They noted differences in age, frequency of alcohol and marijuana use, average age of onset of marijuana use, frequency of negative consequences associated with substance use, perceptions of peer norms' drug use, perceived peer acceptance of substance use, and risk perception of substance use. When they entered polysubstance use as a covariate, many of these correlates became nonsignificant. The authors suggest that college ecstasy initiators may be a cohort of marijuana users who tend to engage in multiple risk-taking behaviors. This study serves as a preliminary effort to better understand college students who use ecstasy recreationally.     

Gambling on the Lottery: Sociodemographic Correlates Across the Lifespan

Two representative U.S. telephone surveys of gambling were conducted—an adult survey of adults aged 18 years and older (n = 2,631) and a youth survey of young people aged 14–21 years old (n = 2,274). Because the questions and methods were the same or similar in both surveys, the data from these two surveys were combined into a single dataset to examine the prevalence and sociodemographic correlates of gambling and problem gambling across the lifespan. The present work focused specifically on gambling on the lottery which is the most prevalent form of gambling in the U.S. The frequency of gambling on the lottery increased sharply from mid adolescence to age 18 which is the legal age to purchase lottery tickets in most states; lottery play continued to increase into the thirties when it leveled off and remained high through the sixties and then decreased among those 70 years and older. Considering multiple sociodemographic factors together in a negative binomial regression, the average number of days of lottery gambling was significantly predicted by male gender, age, neighborhood disadvantage and whether or not lottery was legal in the state where the respondent lived. These findings can be used to inform policies regarding lotteries in the U.S.     

Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey

Declining contact and cooperation rates in random digit dial(RDD) national telephone surveys raise serious concerns aboutthe validity of estimates drawn from such research. While researchin the 1990s indicated that nonresponse bias was relativelysmall, response rates have continued to fall since then. Thecurrent study replicates a 1997 methodological experiment thatcompared results from a "Standard" 5-day survey employing thePew Research Center’s usual methodology with results froma "Rigorous" survey conducted over a much longer field periodand achieving a significantly higher response rate. As withthe 1997 study, there is little to suggest that unit nonresponsewithin the range of response rates obtained seriously threatensthe quality of survey estimates. In 77 out of 84 comparableitems, the two surveys yielded results that were statisticallyindistinguishable. While the "Rigorous" study respondents tendedto be somewhat less politically engaged, they did not reportconsistently different behaviors or attitudes on other kindsof questions. With respect to sample composition, the Standardsurvey was closely aligned with estimates from the U.S. Censusand other large government surveys on most variables. We extendour analysis of nonresponse to include comparisons with thehardest-to-reach respondents and with respondents who terminatedthe interview prior to completion.     

Prevalence and correlates of self-injury among university students

OBJECTIVE: The authors' purpose in this research was to establish estimates of the prevalence and correlates of nonsuicidal self-injury among university students. PARTICIPANTS: The authors recruited participants (N = 2,843) from a random sample of 5,021 undergraduate and graduate students attending a large midwestern public university. METHODS: Using an Internet-based survey, the authors measured the prevalence of self-injury and potential risk factors, including depression, anxiety, eating disorders, suicidal thoughts, and negative health behaviors. RESULTS: Seven percent of students reported any self-injury over the previous 4 weeks. Factors associated with a significantly higher likelihood (p <.05) of self-injury included cigarette smoking, concurrent depressive and anxiety disorders, and for men, growing up in a family of low socioeconomic status and having symptoms of eating disorders. Only 26% of those who reported self-injury received mental health therapy or medication in the previous year. CONCLUSIONS: Students who harm themselves experience high anxiety and distress, yet are unlikely to seek help.     

The prevalence of evidence-based substance use prevention curricula in the nation's elementary schools

Current guidelines for school-based substance use prevention suggest that prevention efforts should begin in elementary grades, before students begin using substances. Previous research suggests, however, that the use of evidence-based curricula in these grades may be low. Using a 2005 survey of public school districts in the United States that include elementary grades (n = 1563), we assessed the prevalence of elementary curricula use, particularly those designated as evidence-based. We found that although 72% of districts administer a substance use prevention curriculum to their elementary students, only about 35% are using one that is evidence-based and only about 14% are using an evidence-based curriculum more so than any other prevention curriculum. We present prevalence estimates for specific evidence-based curricula and conclude by discussing possible reasons for and implications of our findings.