The Growth of Internet Research Methods and the Reluctant Sociologist*

Between 1999 and 2004 only one article appeared in the American Sociological Review, the American Journal of Sociology, or Social Forces using primary data collected with Web‐based research techniques. Since then there have been only a handful of studies published in these core sociology journals drawing on Web‐based surveys or other forms of Web‐based data. The use of Internet‐based data has become widespread in many academic fields, especially health research and education; Web‐based techniques are becoming routine in the practice and study of politics; and online commercial and market research has become a billion dollar industry. At the same time, the utility of random digit dialing surveys has eroded considerably owing to declining contact rates, increased use of technologies to screen unwanted telephone calls, and the replacement of landline telephones with cell phones. There is increasing evidence that Internet research can produce representative data. Although Web‐based surveys may overrepresent some populations, Internet usage in the general population is now well over 75 per cent and is especially strong among some hard to reach populations. Internet surveys have the potential to reduce measurement error, missing data, and respondent attrition. Sociologists must overcome their fear of participation in stigmatized Internet research and actively engage in the development of techniques and refinements that will increase the utility and validity of Internet‐based data collection.     

ASA certification as cooptation

We provide a brief overview of the American Sociological Association’s Ph.D. Certification Program and question the need for, and justification of, certifying sociologists. Essentially, the ASA certification mechanism, as implemented, is nonsociological, emphasizing presumed defects in the individual to the neglect of wider, systemic forces impinging on our discipline. If certification of sociologists is warranted, a view difficult to support given the small number of applicants for certification since 1986, we suggest departmental accreditation—a more sociological approach that emphasizes the value of the discipline, in and of itself. His research interests include political sociology, stratification and contemporary issues affecting the discipline. His research foci include rural and agricultural issues and the sociological employment market and profession.     

The political use of the internet: Some insights from two surveys of Italian students

Interest in the Internet's impact on political participation has grown over the last five years. The main claim of most social scientists is to consider the Internet as a new resource for political engagement. However, this claim has not always been backed up by empirical analysis. The aim of this article is to provide empirical evidence on a subject that previous surveys on the Internet have generally ignored: the influence of individual political characteristics on Internet use. The authors compare data from two distinct surveys, carried out in two different periods but which contain some common batteries of questions referring to political participation and Internet use for political purposes. One survey was carried out in 2001 and focused on students at the University of Florence. The second was carried out in 2002 and focused on the participants in the European Social Forum in Florence. The empirical results and interpretations offered are based on a sample of 397 students, extracted from the two databases. The focus of the research is on exploring whether and how the political use of the Internet is shaped by the political characteristics of users, in this case students. The findings of the two studies suggest that, firstly, the more students are engaged in different social and political organizations, the more they use the Internet to achieve political purposes; and, secondly, that different styles of Internet use (to retrieve alternative information, to discuss and to perform political actions) are associated with the political characteristics of users. In particular, the characteristics of offline participation are reproduced online: the Internet is appropriated and shaped by political practices of users.     

Mitofsky Waksberg: Learning From The Past

Warren Mitofsky and Joseph Waksberg were two of the most influentialresearchers in telephone surveys and survey research methods.Their development of the Mitofsky–Waksberg method forrandom digit dialing sampling revolutionized telephone samplingand surveys. Jointly and separately, Waksberg and Mitofsky wereinstrumental in the development of many innovative methods andapplications. This article reviews some of their contributionsand discusses how their approaches to these problems may bea model for addressing issues that are being encountered currentlyin the United States in cell phone research.     

Toward an Open-Source Methodology: What We Can Learn from the Blogosphere

During the 2004 election campaign, millions of political enthusiastsdownloaded poll data on the Internet, while "Weblogs" provideda new forum for commentary on survey methodology. At the sametime, traditional public opinion surveys came under pressurefrom declining cooperation, contact, and coverage rates, andmany automated and Internet surveys began to proliferate. Thisarticle provides some examples of "blog" commentary on automatedand Internet polls and then explores the lessons to be learnedfrom the spirit of innovation and openness of the Internet inevaluating new survey methods such as automated polls and thoseconducted over the Internet.     

Methodologic challenges of e-health research

In this article, research-based strategies used in a web-based study to assess the impact of participation in cancer-related mailing lists on cancer survivors and caregivers are highlighted. The paper presents alternative methods of measuring response rates in Internet surveys. Response rate estimation, based on American Association for Public Opinion Research guidelines, ranged between 15% and 24.9% for the study. Several strategies were implemented to increase survey participation and reduce item nonresponse. Few participants opted for a telephone survey as an alternative to a web-administered design (mixed-mode administration). Using time-stamp data to diagnose places in the questionnaire where respondents prematurely exited or broke off survey participation, we were able to decrease premature break offs. A lottery was also implemented to increase response rates. The experience of obtaining institutional review board approval for the lottery is also described. Preliminary data indicate slight increases in response rates subsequent to implementing the lottery.     

Presentation matters: how mode effects in item non-response depend on the presentation of response options

Comparability of data across modes is an important issue in survey research. In this paper we discuss item non-response to attitudinal questions in telephone and web surveys. We present results from a survey experiment conducted in Italy and in Spain that compares different presentations of response options in an online setting with a benchmark telephone survey. In line with earlier studies we find that (A), the share of non substantial answers in the online survey depends on how the response option is presented. Comparing different presentations in an online survey to the standard approach of telephone surveys using propensity score matching, we find that (B), the share and pattern of non substantial answers, is most similar across the two modes in the online survey when the it is captured in an instruction on each screen for the online survey. Our findings are of particular relevance for the design of multiple mode or mix-mode surveys of attitudinal questions using online and telephone modes.     

Political extremism — left, center, and right

This paper formalizes Lipset’s theory of political extremism and applies its axioms and derivations to guide empirical research. A latent structure analysis of measures of the issues from a survey of the 1992 U.S. electorate produced a three-class Left-Center-Right classification of voters. Given that ideological consistency may indicate a propensity toward political extremism, this study finds that this propensity now is strongest in the Right class and not in the Left and Center classes. He taught political sociology and search methodology at the University of Calfornia, Santa Barbara. His publications include theoretical and emjpirical analysis of political and social process and he has edited A Handbook of Social Science Methods.     

Public relations telephone surveys: Avoiding methodological debacles

Public relations practitioners rely on staff-produced telephone surveys for a variety of research projects. This study reports on one such project that revealed a serious methodological flaw in interviewer bias. Most surveys, using standard detection procedures, would not find the defect. Yet the outcomes were so misleading that any campaign using the results would be doomed. This study sounds an alarm for practitioner telephone surveys and suggests special precautions if in-house staff serve as interviewers.     

Internet and the Political Public Sphere

The article addresses the main theory of the political public sphere generally, and the role of the Internet and Internet‐based media in the theory specifically. It first reviews briefly the initial social research on the Internet in the 1990s concerning political participation. After a presentation of Jürgen Habermas' theory of the contemporary public sphere, it proceeds to discuss the main problems concerning the Internet as a platform or infrastructure for public debate: segmentation and concentration. It argues that a general conclusion is that the public sphere differentiates and become more complex. A key task for future research, it argues, is to investigate the complex connections between Internet publics and mass media publics.     

Fulfilling the dialogic promise: A ten-year reflective survey on dialogic Internet principles

A decade ago, using the dialogic theory of public relations as the theoretical framework, Kent and Taylor [Kent, M. L., & Taylor, M. (1998). Building a dialogic relationship through the World Wide Web. Public Relations Review, 24, 321–340; Kent, M. L., & Taylor, M. (2002). Toward a dialogic theory of public relations. Public Relations Review, 28, 21–37] provided a strategic framework to facilitate relationships with publics though the World Wide Web. Based on a review of research exploring Web-based public relations practices drawing on Kent and Taylor's theoretical framework, this essay offers a ten-year reflective survey on past, current, and future directions of Kent and Taylor's Internet principles, as they relate to the dialogic theory of public relations.     

Gender still at work: Interrogating identity in discourses and practices of masculinity

Apart from a few paragraphs reminiscing on how, in response to a publisher contacting us, Jill, Marilyn and I founded Gender, Work and Organization combined with a few comments on its evolution as a leading journal in our field, this article largely summarizes and seeks to develop my lifelong interests in discourses and practices of masculinity. It pays tribute to my doctoral students and/or research colleagues with whom many of these ideas concerning masculinities were shaped. The article then surveys the literature on discourses and practices of masculinities through the three waves: the unitarist, the pluralist and, finally, the performativist approach to discourses and practices of masculinity. A central argument of the article is that although each wave has contributed something of importance to the critical examination of masculinities, none of them fully interrogate identity to theorize how our attachment to the security that it promises is illusory. Posthumanist feminists come closest to realizing this and seeking an alternative embodied and ethical engagement with, rather than a competitive elevation of self over, the other. In the conclusion, there is a brief comment on how the global backlash from the political right has made struggles against dominant masculinities all the more urgent.     

Reaching the U.S. Cell Phone Generation: Comparison of Cell Phone Survey Results with an Ongoing Landline Telephone Survey

Noncoverage rates in U.S. landline-based telephone samples dueto cell phone only households (i.e., households with no landlinebut accessible by cell phone) and the corresponding potentialfor bias in estimates from surveys that sample only from landlineframes are growing issues. Building on some of the few publishedstudies that focus on this problem, a study was conducted inthree states (Georgia, New Mexico, and Pennsylvania) as partof the Behavioral Risk Factor Surveillance System (BRFSS), theworld's largest ongoing public health telephone survey, to evaluatethe effectiveness of conducting the BRFSS interview with a sampledrawn from dedicated cell phone telephone exchanges and mixed-use(landline and cell phone) exchanges. Approximately 600 interviewswere conducted in each of two groups: cell phone only adults(n = 572) and adults with both a landline and a cell phone (n= 592). Making comparisons with data from the ongoing, landline-basedBRFSS survey, we report on response rates, demographic characteristicsof respondents, key survey estimates of health conditions andrisk behaviors, and survey costs. The methods used in this studyhave wide application for other U.S. telephone surveys.     

A Study on Technical and Cultural Differences in Survey Methodology Between Japan and the United States

Abstract: At present, Japanese researchers conducting social surveys encounter several difficulties such as restricted access to official registers and a decrease in current response rates. These researchers may expect these difficulties to be solved by the survey techniques or methods developed outside Japan, such as computer-assisted interviews (CAI) and Internet surveys. It is unclear whether the numerous technical differences between survey methodologies developed in Japan and elsewhere imply the backward-ness of Japan or cultural differences. This paper discusses the potential of various recent survey methods, focusing on the culture and paradigms in Japan and the UnitedStates. First, this paper presents an overview of survey techniques, such as computer-assisted personal interviewing, Internet surveys, and mixed modes. Second, it points out the fact that the existence of the registers and different survey concepts might have created the different survey paradigms. In addition, reference is made to the linguisticdifferences between the US and Japan. The results indicate that survey research is more dispersed in Japan than in the US and that survey research adapted to the uniqueness of Japanese culture is not accumulated sufficiently, although such an accumulation is required. Finally, it is stated that not only surveys, but also the concept of methodology, is not very popular in Japan. Furthermore, the development of survey research in the US is likely to be related to pragmatism.     

The pursuit of political will: decision makers’ incentives and gender policy implementation in the Western Balkans

In the Western Balkans, just as in newly democratized countries in other regions, failures in gender policy implementation are often attributed to lack of “political will.” There is however a surprising lack of specificity concerning what is meant by it and how to measure its influence on the observed implementation gaps. To help to begin filling this research gap this article examines the extent to which Western Balkans countries might be failing in the implementation of their adopted gender policies and the reasons why decision makers seem to lack the political will to implement them. To allow for a more in-depth perspective, the analysis will concentrate on the case of the implementation of Gender Responsive Budgeting (GRB) on the municipal level in the three countries in its focus: Bosnia and Hercegovina; Macedonia; and Serbia. The empirical material used for it consists of primary data from telephone surveys, in-depth interviews with actors involved in GRB policy processes and official documents.     

Where Is Gender in Agenda Setting?

Abstract

Why do some issues surge to the forefront of our attention while others languish in obscurity? Feminist scholars have explored the emergence of issues such as rape, battering, no-fault divorce, pay equity, and other women's issues on the public agenda. Despite a burgeoning body of literature on feminist social movements within history, political science, and sociology over the last twenty-five years, scholars of agenda setting, public policy, and American politics more generally have largely ignored this work. Not surprisingly, this research cannot be simply added in to the dominant agenda setting theoretical paradigm; rather, the findings disrupt conventional understandings. This essay critiques two canonical works, Kingdon's Agendas, Alternatives and Public Policies(1995) and Baumgartner and Jones's Agendas and Instability in American Politics(1993), and discusses exemplary feminist research. It argues that if we want to know how norms change we need to broaden our scope beyond political elites and interest groups to include social movements and newly politicized grassroots activists. We must see change as produced by networks of insiders and outsiders rather than exclusively caused by elites in formal positions. Feminist scholarship also takes seriously the discursive and emotional aspects of politics rather than utilizing a narrow pluralist framework. Moreover, it recognizes the important yet neglected role of law as both an arena and a discourse.     

Australian public relations: status at the turn of the 21st century

Since its inception, public relations in Australia has grown in professional stature, status, education, research, and practice. As these trends progress, visibility of the profession is becoming steadily more pronounced in the industry, education, and public domain. Over the last two decades the Public Relations Institute of Australia together with its strategic alliances have made many changes, structurally, strategically, and academically towards the professional growth of public relations. This article briefly discusses the views of the Public Relations Institute of Australia and offers a snapshot of two surveys[1] on professional practice and related issues. Although direct comparisons are not meant to be made from these studies, both surveys offer insights into aspects of Australian public relations. Whereas mixed findings and scenarios are evident, and the surveys highlight areas for further development, the profession, with close attention to existing threats, is poised to grow in Australia.Raveena Singh is program director and senior lecturer at the University of Canberra (Australian Capital Territory) and Rosaleen Smyth is senior lecturer and public relations coordinator at Deakin University (Victoria). Both authors are coeditors of the Asia Pacific Public Relations Journal.     

Möglichkeiten und Probleme des Einsatzes postalischer Befragungen

The research focuses on the strategies in mail surveys that lead to high response rates and on the social characteristics of the respondents that are recruited into the survey through reminders. Empirical basis are surveys in the East German cities of Chemnitz, Dresden and Leipzig with an original sample size of ca 2000 persons per city and up to three reminders. The response rate varies between 68 and 70 percent and surpasses the usual response rates in face to face and telephone surveys done in German cities. In contrast to common assumptions in the literature it has no effect on the response rate whether stamps are used on the address and return envelope, neither do original versus scanned signatures make a difference and whether financial incentives are used in the late reminders. Through the reminders especially respondents with low education and of little political interest are recruited into the survey.     

Risk Factors for Problem Gambling in California: Demographics,Comorbidities and Gambling Participation

While population surveys have been carried out in numerous jurisdictions internationally, little has been done to assess the relative strength of different risk factors that may contribute to the development of problem gambling. This is an important preparatory step for future research on the etiology of problem gambling. Using data from the 2006 California Problem Gambling Prevalence Survey, a telephone survey of adult California residents that used the NODS to assess respondents for gambling problems, binary logistic regression analysis was used to identify demographic characteristics, health-related behaviors, and gambling participation variables that statistically predicted the odds of being a problem or pathological gambler. In a separate approach, linear regression analysis was used to assess the impact of changes in these variables on the severity of the disorder. In both of the final models, the greatest statistical predictor of problem gambling status was past year Internet gambling. Furthermore, the unique finding of a significant interaction between physical or mental disability, Internet gambling, and problem gambling highlights the importance of exploring the interactions between different forms of gambling, the experience of mental and physical health issues, and the development of problem gambling using a longitudinal lens.     

Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey

Declining contact and cooperation rates in random digit dial(RDD) national telephone surveys raise serious concerns aboutthe validity of estimates drawn from such research. While researchin the 1990s indicated that nonresponse bias was relativelysmall, response rates have continued to fall since then. Thecurrent study replicates a 1997 methodological experiment thatcompared results from a "Standard" 5-day survey employing thePew Research Center’s usual methodology with results froma "Rigorous" survey conducted over a much longer field periodand achieving a significantly higher response rate. As withthe 1997 study, there is little to suggest that unit nonresponsewithin the range of response rates obtained seriously threatensthe quality of survey estimates. In 77 out of 84 comparableitems, the two surveys yielded results that were statisticallyindistinguishable. While the "Rigorous" study respondents tendedto be somewhat less politically engaged, they did not reportconsistently different behaviors or attitudes on other kindsof questions. With respect to sample composition, the Standardsurvey was closely aligned with estimates from the U.S. Censusand other large government surveys on most variables. We extendour analysis of nonresponse to include comparisons with thehardest-to-reach respondents and with respondents who terminatedthe interview prior to completion.