USING DUAL FRAME DESIGNS TO REDUCE NONRESPONSE IN TELEPHONE SURVEYS

This article reports on the results of a series of experimentsdesigned to improve response rates for telephone surveys. Inthree surveys telephone households were selected using bothstandard random digit dialing (RDD) techniques and lists oftelephone numbers purchased from a commercial firm. In the RDDportions of the samples "cold contact" interviewing methodswere used; in the list frame portions advance letters were mailed,and the listed household name was used in the introduction.Experiments were designed to test the effects on response ratesof the advance letters and use of the listed household nameas a means of establishing rapport. The advance letters increasedresponse rates, but no difference could be attributed to theuse of names. The mixture of RDD and list sampling techniquesis also used to evaluate the effects of relative response rateson substantive findings. The cost consequences of these dualframe designs are assessed along a number of dimensions, andthe cost and error components of these designs are discussed.     

Methodologic challenges of e-health research

In this article, research-based strategies used in a web-based study to assess the impact of participation in cancer-related mailing lists on cancer survivors and caregivers are highlighted. The paper presents alternative methods of measuring response rates in Internet surveys. Response rate estimation, based on American Association for Public Opinion Research guidelines, ranged between 15% and 24.9% for the study. Several strategies were implemented to increase survey participation and reduce item nonresponse. Few participants opted for a telephone survey as an alternative to a web-administered design (mixed-mode administration). Using time-stamp data to diagnose places in the questionnaire where respondents prematurely exited or broke off survey participation, we were able to decrease premature break offs. A lottery was also implemented to increase response rates. The experience of obtaining institutional review board approval for the lottery is also described. Preliminary data indicate slight increases in response rates subsequent to implementing the lottery.     

Effects of Anonymity and Social Setting on Survey Responses

Anonymity was tested by placing an identifying number on halfof the questionnaires on a mail survey designed to elicit reactionsfrom teachers concerning teacher unions. Bias due to socialsetting was tested by mailing half the questionnaires to teachersat their home addresses, the other half to teachers at theirschool addresses. In a two-by-two factorial design, anonymityand social setting had no appreciable effect on response orspeed of return, although social setting did have an effecton return rate. Respondents receiving the questionnaire at theirschool address had a higher return rate than those receivingit at home     

Breaking ground on the virtual frontier: Surveying civic life on the internet

The Internet provides a virtual frontier to expand our access to information and to increase our knowledge and understanding of public opinion, political behavior, social trends and lifestyles through survey research. Comparable to other technological advancements, such as the telephone and the computer, the Internet presents opportunities that will impact significantly on the process and quality of survey research now and in the twenty-first century. Cyberspace permits us to move beyond traditional face-to-face, mail and telephone surveys, yet still to examine basic issues regarding the quality of data collection: sampling, questionnaire design, survey distribution, means of response, and database creation. This surveys include those posted on LISTERV mailing lists, USENET newsgroups, and the World Wide Web. A survey on politics and civic life, conducted by the authors, is used as a case study. She is currently pursuing interests in methodological issues concerning surveying using the Internet, and in policy issues concerning student victimization on college and university campuses. His publications includeViable Democracy (1979);Manipulating Public Opinion (1989);Free Expression, Public Support and Censorship: Examining Government’s Role in the Arts in Canada and the United States (1994); and numerous articles in scholarly and popular journals. His current research interests are contemporary democratic theory and political participation, as well as the political thought of John Locke.     

Can Registration-Based Sampling Improve the Accuracy of Midterm Election Forecasts?

We compare the predictive accuracy of preelection polls usingtwo types of sampling frames, random digit dialing (RDD) andregistration-based sampling (RBS). The latter involves stratifiedrandom sampling from voter registration lists. In order to assessthe accuracy with which RDD and RBS predict election outcomes,we collaborated with the Washington Post, Quinnipiac, and CBSNews polls, which conducted parallel RDD and RBS surveys inMaryland, New York, Pennsylvania, and South Dakota prior tothe November 5, 2002, elections. The results suggest that inthe gubernatorial and congressional elections studied, RBS performedas well, if not better, than RDD, both in terms of forecastingaccuracy and cost.     

A Comparison of Address-Based Sampling (ABS) Versus Random-Digit Dialing (RDD) for General Population Surveys

Valid and reliable public health data are becoming more difficultto obtain through random-digit dial (RDD) telephone surveys.As a result, researchers are evaluating different survey designs(i.e., sampling frame and survey mode combinations) as complementsor alternatives to RDD. Traditionally, mail surveys of the generalpublic have been limited due to a lack of a complete samplingframe of households. Recent advances in electronic record keeping,however, have allowed researchers to develop a sample from aframe of addresses (e.g., the U.S. Postal Service Delivery SequenceFile, which appears to provide coverage which rivals or possiblyexceeds that obtained through RDD sampling methods). To testthe use of this frame for surveying adults aged 18 years andolder across a wide geographic area, a pilot study was conductedas part of the 2005 Behavioral Risk Factor Surveillance System(BRFSS). The pilot compared use of a traditional, RDD telephonesurvey methodology to an approach using a mail version of thequestionnaire completed by a random sample of households drawnfrom an address-based frame. The findings indicate that themail survey approach can achieve higher response rates in low-response-ratestates (<40%) than RDD (particularly when two mailings aresent). Additionally, the address frame with mail survey designprovides access to cell phone only households and offers costsavings over the telephone approach. The resulting sample, however,significantly overrepresents non-Hispanic whites and peoplewith higher levels of education.     

Stimulant Medication Use,Misuse, and Abuse in an Undergraduate and Graduate Student Sample

In this study, the authors investigated the characteristics of use, misuse, and abuse of stimulant medication (primarily methylphenidate and variants) among students at a northeastern US university. Researchers sent an invitation to take an Internet survey to student e-mail addresses and passed 150 paper surveys in undergraduate classes, analyzing 1,025 (975 electronically) returned surveys. Sixteen percent of respondents reported abusing or misusing stimulant medication. Ninety-six percent of respondents who specified a medication preferred to abuse or misuse Ritalin. Men and women reported similar use patterns. Most respondents who abused or misused stimulant medication swallowed pills; 40% used intranasally. Reasons for abusing or misusing stimulant medication included improving attention, partying, reducing hyperactivity, and improving grades. Consistent with previous studies, results suggest that abuse of stimulant medication is a concern on college campuses. The results point to various reasons for and methods of abusing and misusing stimulant medication that may direct future research, prevention, and intervention.     

Stimulant medication use, misuse, and abuse in an undergraduate and graduate student sample

In this study, the authors investigated the characteristics of use, misuse, and abuse of stimulant medication (primarily methylphenidate and variants) among students at a northeastern US university. Researchers sent an invitation to take an Internet survey to student e-mail addresses and passed 150 paper surveys in undergraduate classes, analyzing 1,025 (975 electronically) returned surveys. Sixteen percent of respondents reported abusing or misusing stimulant medication. Ninety-six percent of respondents who specified a medication preferred to abuse or misuse Ritalin. Men and women reported similar use patterns. Most respondents who abused or misused stimulant medication swallowed pills; 40% used intranasally. Reasons for abusing or misusing stimulant medication included improving attention, partying, reducing hyperactivity, and improving grades. Consistent with previous studies, results suggest that abuse of stimulant medication is a concern on college campuses. The results point to various reasons for and methods of abusing and misusing stimulant medication that may direct future research, prevention, and intervention.     

College Counselors’ Perceptions and Practices Regarding Anticipatory Guidance on Firearms

Abstract

Objectives: This study assessed college counselors’ anticipatory guidance on firearms for student clients. Participants: The membership of the Association for University and College Counseling Center Directors was used to identify a national random sample of counseling centers (n = 361). One counselor from each center was selected to survey. Methods: In the winter of 2008, a 3-wave mailing procedure was used to maximize the response rate. Completed surveys served as consent (as approved by the University Human Subjects Committee). Results: A total of 213 counselors (59%) responded. They were unlikely to provide anticipatory guidance (6%), chart/keep records on client ownership/access to firearms (17%), or to counsel the majority of clients from various diagnostic categories on firearms. Conclusions: University personnel are likely to refer students with suspected mental health problems to university counseling centers. The findings indicate that few counseling centers will address firearm issues with students.     

SOFTWARE DEFAULTS AS DE FACTO REGULATION The case of the wireless internet

Today's internet presumes that individuals are capable of configuring software to address issues such as spam, security, indecent content, and privacy. This assumption is worrying - common sense and empirical evidence state that not everyone is so interested or so skilled. When regulatory decisions are left to individuals, for the unskilled the default settings are the law. This article relies on evidence from the deployment of wireless routers and finds that defaults act as de facto regulation for the poor and poorly educated. This paper presents a large sample behavioral study of how people modify their 802.11 ('Wi-Fi') wireless access points from two distinct sources. The first is a secondary analysis of WifiMaps.com, one of the largest online databases of wireless router information. The second is an original wireless survey of portions of three census tracts in Chicago, selected as a diversity sample for contrast in education and income. By constructing lists of known default settings for specific brands and models, we were then able to identify how people changed their default settings. Our results show that the default settings for wireless access points are powerful. Media reports and instruction manuals have increasingly urged users to change defaults - especially passwords, network names, and encryption settings. Despite this, only half of all users change any defaults at all on the most popular brand of router. Moreover, we find that when a manufacturer sets a default 96-99 percent of users follow the suggested behavior, while only 28-57 percent of users acted to change these same default settings when exhorted to do so by expert sources. Finally, there is also a suggestion that those living in areas with lower incomes and levels of education are less likely to change defaults, although these data are not conclusive. These results show how the authority of software trumps that of advice. Consequently, policy-makers must acknowledge and address the power of software to act as de facto regulation.     

Watershed-scale analysis of pollutant distributions in stormwater management ponds

Stormwater management ponds have become a common Best Management Practice in urban and suburban landscapes. Stormwater management ponds are designed to hold runoff from impervious surfaces and allow the settling of sediments and associated pollutants. Various semi-aquatic and aquatic wildlife species have been documented using stormwater management ponds as habitat, but these wetland-like systems are not managed to adhere to freshwater habitat pollutant guidelines. To address the potential for pollutant exposure for wildlife, we used a random sample of 68 stormwater ponds and estimated the proportion of ponds in a third-order watershed that exceed toxicity guidelines for trace metals and polycyclic aromatic hydrocarbons in sediments and chloride in surface waters. Ninety-six percent of ponds exceeded consensus-based threshold effect concentrations for at least one trace metal. Concentrations of at least one of the PAHs measured exceeded the threshold effects concentration in 63% of the ponds. Nine percent of ponds exceeded chronic toxicity levels of chloride on all sampling dates, and 21% exceeded acute toxicity concentrations on at least one sampling date. More studies are needed to evaluate toxic effects of pollutants in stormwater management ponds and the potential for interactive effects of pollutants on wildlife.     

The Yellow Pages as a sampling frame for farm surveys: Assessing potential bias in agri-environmental research

The Yellow Pages business directory has often been used as a sampling frame to select respondents for farm surveys. Studies in the UK have suggested that the directory both provides a sufficiently accurate estimate of population parameters for most purposes and offers the best alternative when the comprehensive MAFF lists are not available. However, two recent studies of farmers in the Marston Value Community Forest and the Cambrian Mountains ESA scheme demonstrate that drawing samples from the Yellow Pages may exclude less-commercial or ‘life-style’ farmers. These farmers, although still deriving much of their income from farming (unlike ‘hobby’ farmers), are generally more conservation-oriented in their environmental management approach and farm on a lower profit margin. Consequently, it is strongly recommended that caution be exercised when using the Yellow Pages as a sampling frame for environmental management research.     

Investigation of alternative interface designs for long-list questions–the case of a computer-assisted survey in Germany

ABSTRACT

This study aims to address the questionnaire design challenges in cases wherein questions involve a large number of response options. Traditionally, these long-list questions are asked in open-ended or closed-ended formats. However, alternative interface design options are emerging in computer-assisted surveys that combine both interface designs. To investigate trade-offs of these alternative designs, a split-ballot experiment was conducted with a) a long list of radio buttons, b) a search tree (nested list of response options), and c) a combo box (combination of a text box and a drop-down box). Based on the question on the highest educational qualification attained from the Innovation Sample of the German Socio-Economic Panel, we investigated the interface design that facilitates respondents optimally and enhances the measurement quality. The findings indicate that combo boxes reduce the response burden and increase measurement details, whereas search trees and long lists reduce post-coding efforts.     

STABILITY AND CHANGE IN THE U.S. PUBLIC'S KNOWLEDGE OF POLITICS

The U.S. public's current knowledge about politics is comparedwith levels of knowlege in the 1940s and 1950s. Fourteen questionsasked by Gallup on various surveys from 1945 to 1957 were includedon a larger survey of political knowledge conducted by telephonein 1989 with a randomly selected sample of 610 adult U.S. residents.On 8 of the 14 items, the percentage answering correctly in1989 was higher than in the earlier surveys (by 4–15 points).One item showed an increase of 1 percent, two were down 1 percent,and three others declined by 5 percent, 9 percent, and 10 percent.When level of education is controlled, however, levels of knowledgeappear to have declined for most of the items. A reanalysisof some of the original Gallup data is used to estimate theeffectiveness of schools in transmitting political informationin 1989 compared with the earlier years.     

The Influence of Advance Letters on Response in Telephone Surveys: A Meta-Analysis

Recently, the leading position of telephone surveys as the majormode of data collection has been challenged. Telephone surveyssuffer from a growing nonresponse, partly due to the generalnonresponse trend for all surveys and partly due to changesin society and technology influencing contactability and willingnessto answer. One way to counteract the increasing nonresponseis the use of an advance letter. In mail and face-to-face surveys,advance letters have been proven effective. Based on the proveneffectiveness in face-to-face and mail surveys, survey handbooksadvise the use of advance letters in telephone surveys. Thisstudy reviews the evidence for this advice and presents a quantitativesummary of empirical studies on the effectiveness of advanceletters in raising the response rate for telephone surveys.The major conclusion is that advance letters are also an effectivetool in telephone surveys, with an average increase in responserate (RR1) from 58 percent (no letter) to 66 percent (advanceletter), and an average increase in cooperation rate (COOP1)from 64 percent (no letter) to 75 percent (advance letter).     

The Content of Survey Introductions and the Provision of Informed Consent

Information disclosed to potential respondents in survey introductionswas examined in a sample of 78 introductions obtained by mailfrom AAPOR members. The following information was disclosed:research organization, in 86 percent of the introductions; interviewer,82 percent; research topic, 81 percent; sponsor, 45 percent;confidentiality, 42 percent; survey purpose, 26 percent; futuredata use, 24 percent; anonymity, 24 percent; sampling technique,21 percent; survey length, 13 percent; statement that participationwas voluntary, 10 percent; sample size, 4 percent; and consentsignature requirement, 4 percent. Mail surveys (and to a lesserextent those by academic institutions and on sensitive topics)provided more introductory information. For ethical reasons,such as providing informed consent, as well as methodologicalreasons, professional norms about providing information in surveyintroductions need to be examined.     

PRESIDENTIAL SPEECHES AND TEACHING SOCIOLOGY (2009 MSSA PRESIDENTIAL ADDRESS)

In this address, I review available published presidential addresses written by presidents of various sociological organizations as a way of thinking about sociology and what sociologists may find important. Using Eller's categorizations, I divide the articles into three types including (1) query of the profession in which the author discussed the history of sociology or its future; (2) a call for new directions in methodologies or theories within sociology; and (3) a focus on the author/president's research. Then, I focus on what is missing in most presidential addresses given by sociologists: sociologists' role as educators and the impact we have upon students. I find that most presidential addresses do not include any or only passing nods to our responsibilities as teachers. I end the address with a call to consider our responsibilities and impact as teachers.     

Sampling procedures and survey methodologies for the 1996 survey with comparisons to earlier national roadside surveys.

This article describes the multistage sampling system employed in the 1996 national roadside survey and compares it to the sampling methods employed in the two prior surveys in 1973 and 1986. Also described are the data collection procedures at the selected sites, the breath-test devices used to collect blood alcohol concentration (BAC) data, and the methods used to impute BAC values where breath-test measures were not obtained. Overall, almost twice as many (6,298 in 1996 compared to 3,698 in 1973 and 3,043 in 1986) drivers were interviewed in the most recent national survey as in the previous efforts. The procedures implemented in the three surveys are sufficiently similar to permit comparison of these surveys conducted at 10-year intervals.     

Matching anonymous participants in longitudinal research on sensitive topics: Challenges and recommendations

The purpose of this study was to examine the final analytic sample of a longitudinal randomized control trial (RCT) evaluation of a sexual violence prevention program at a university after facing challenges with the implementation of a self-generated identification code. The matched and unmatched samples (e.g., all unique surveys across all time periods) included 10,135 surveys. Eighty-eight percent of these surveys were matched into the final longitudinal dataset. Findings suggest that students with certain characteristics were more likely to be matched over time (i.e., students who participated in student government, Latino/a students, and Asian students). In addition, students who did not comply with RCT protocol were less likely to be matched. Student history of victimization or perpetration of sexual violence was not associated with being matched over time. This study provides recommendations for preventing matching problems in longitudinal studies, a process for rectifying matching issues and a critique of studies that do not address issues of matching-related sample bias in their final analytic sample.     

Peeking into the past to plan the future: Assessing bird species richness in a neotropical city

Urbanization has been considered as a major threat to biodiversity, making its ecology of increasing interest. Many urban ecology studies have been developed in a short time-scale, measuring real-time patterns. However, long-term studies are imperative to understand the responses of some species to the urbanization process. In this study, we aimed to assess the information provided by a recent one-year citywide bird survey when compared to a published ‘historical’ bird list of a neotropical city (Xalapa, Mexico) that compiles information of the past three decades, mainly from urban greenspaces. Specifically, we contrasted species richness values and assessed differences in species composition between both lists. We recorded 51 species in the one-year citywide survey, representing ~15 % of those reported in the historical list. Nonetheless, the upper-bound confidence interval of the citywide survey richness prediction represented ~66 %. Most of the species recorded in the one-year citywide survey are insectivores and granivores, a pattern that agrees with previous findings that underline the importance of insectivores as part of urban bird communities in the Neotropics. Although we used robust methods to compare our one-year citywide bird list and the historical list for the city of Xalapa, we acknowledge the limitations of comparing them. However, our results shed some light on the kind and type of information that one-year citywide surveys can provide and the importance of long-term studies for comprehending the processes involved in biodiversity changes within urban areas over time. Undoubtedly, establishing long-term citywide surveys sampling birds and other biodiversity groups will allow us to better understand the response of biodiversity to urbanization over time.