The Association of Survey Setting and Mode with Self-Reported Health Risk Behaviors among High School Students

This study examined whether the prevalence of self-reportedhealth risk behaviors among high school students varied by surveysetting (school versus home) and mode of administration (paperand pencil versus computer). Students in grades 9 and 11 wereassigned randomly to one of four conditions—school paper-and-pencilinstrument (PAPI), school computer-assisted self-interview (CASI),home PAPI, and home CASI. During the spring of 2004, 4,506 studentscompleted identically worded questionnaires based on the YouthRisk Behavior Survey questionnaire. Logistic regression analysescontrolling for sex, grade, and race/ethnicity revealed thatsetting was associated significantly with the reporting of 30of the 55 risk behaviors examined, and mode was associated significantlywith the reporting of 7 of the 55 behaviors. For all behaviorswith a significant setting main effect, the odds of reportingthe behavior were greater among students who completed questionnairesat school than among students who completed questionnaires athome. For all behaviors with a significant mode main effect,PAPI mode students had lower odds of reporting the behaviorthan CASI mode students. Because social measurement researchassumes that higher prevalence estimates are more valid thanlower estimates, methodological factors shown to increase estimates,such as setting and mode, should be considered when planningsurveys.