The effect of interviewer evaluation of respondents’ attitudes and understanding on future survey participation in a panel study

This study explored whether the interviewers’ judgments of respondents’ performances in an initial survey can predict survey participation for a second survey among the same group of respondents in a panel study. Specifically, this study examined two interviewer variables: the interviewers’ judgments of (1) the respondents’ understanding of survey questions and (2) the respondents’ attitudes toward the survey. The analyses revealed that respondents who were rated to have an excellent understanding of the survey questions and friendly attitudes were more likely to respond to the second interview request than those with a poor understanding and unfriendly attitudes, after controlling for the characteristics of the respondents. Of these two, the judgment of the respondents’ attitudes was a stronger predictor. However, interviewer’s judgments are not correlated with the primary survey outcome or the data quality. This suggests limited value of the interviewer observation.     

The influence of interviewer characteristics on support for democracy and political engagement in Sub-Saharan Africa*

This study investigates how an interviewer’s characteristics affect how respondents answer survey questions about democracy and political engagement. I analyze data from the 2008 Afrobarometer surveys, in which 810 interviewers surveyed 27,713 respondents across 20 countries in sub-Saharan Africa. Using these data, I study how interviewer education, age, and gender affect two outcomes: (1) response distributions to attitudinal and behavioral survey questions and (2) the likelihood of respondents saying ‘don’t know’ to a survey question. The analysis also investigates how the respondent’s perception of who sponsored the survey (NGO, private sector, government) affects attitudes. The results show that these interviewer characteristics affect the quality of survey data on political attitudes and behaviors. In the discussion, I consider the implications for research based on public opinion data about democracy and political engagement.     

Measuring ego-centered social networks on the web: Questionnaire design issues

Collecting survey data on ego-centered social networks is a difficult task, owing to the complex questionnaire format. Usually, the interviewer handles the dynamics of the question–answer exchange, motivates the respondent and ensures the proper recording of the data. Self-administered modes of data collection, especially web data collection, are more problematic, as the respondents are left alone with a complex and burdensome questionnaire. Therefore, questionnaire layout is crucial for ensuring cooperation and data quality. In this paper we examined three key components of the corresponding web questionnaire: the number of name boxes using a single name generator, question format for assessing alter characteristics (i.e. alter-wise vs. question-wise) and number of name interpreters (i.e. alter characteristics). The number of name boxes was found to be essential for the reported size of social networks and also for some aspects of data quality. Specific data quality effects were also found with respect to variations in question format, where question-wise format performed better than alter-wise. The number of name interpreters had a relatively minor effect. Suggestions for possible standardization of the web interface layout are also given, so that equivalence with other data collection modes can be established.     

Women's Hair Color and Survey Response Rate: A Field Experiment

Previous research found that survey response rates were influenced by physical characteristics of the interviewer. However, the effect of hair color on compliance to a survey request has never been studied. Female confederates wearing blond, brown, black, or red wigs solicited 1,200 male and female pedestrians for a survey. It was found those male passersby, but not the female, agreed more frequently to the confederates wearing blond wigs whereas they agreed less to the same confederates wearing red wigs. Greater youth and healthiness associated with blond hair in women is used to explain these results. The practical interest in face-to-face surveys is addressed.     

INTERVIEWER GENDER AND GENDER ATTITUDES

This research addresses the effects of interviewer gender onresponses to a broad array of gender-related survey questions,using data from a probability sample of adults in the UnitedStates. We focus on whether gender-of-interviewer effects areevident, whether they vary by respondent gender, and whetherthey vary across several attitudinal domains relevant to genderinequality. While many items do not show statistically significantgender-of-interviewer effects, we document significant effectsacross a variety of items. When such effects are evident, theytend to involve both male and female respondents expressingmore egalitarian gender-related attitudes or greater criticismof existing gender inequalities to female interviewers. Malerespondents offer significantly different responses to maleand female interviewers on questions dealing with gender inequalityin employment. For female respondents, interviewer-gender effectsare evident for items addressing gender-related collective action,policy, and group interests. Using multivariate models thatallow us to represent both respondent-level and interviewer-levelvariables, we find that interviewer-gender effects are statisticallysignificant in most attitudinal domains but that the interactionbetween interviewer gender and respondent gender does not tendto be statistically significant. We consider the implicationsof these findings both for understanding the survey processand for understanding gender relations more generally.     

Effect of Interviewer Experience on Interview Pace and Interviewer Attitudes

Traditional statistical analyses of interviewer effects on surveydata do not examine whether these effects change over a fieldperiod. However, the nature of the survey interview is dynamic.Interviewers’ behaviors and perceptions may evolve asthey gain experience, thus potentially affecting data quality.This paper looks at how interview length and interviewer evaluationsof respondents change over interviewers’ workloads. Multilevelmodels with random interviewer effects are used to account forthe clustering of cases within interviewers and individual interviewercharacteristics in the 1984, 1988, and 2000 National ElectionStudies. The 1984 and 1988 NES released sample in four replicates,minimizing the confound between order in an interviewers’workload and sample composition. We find that over the courseof the studies, both measures change significantly. Interviewerprior survey experience also was significantly negatively relatedto the length of the interview. These findings have implicationsfor interviewer training prior to and during studies, as wellas suggesting future research to reveal why these behaviorsand perceptions change.     

What to do with “I Don't Know:” Elicitation in Ethnographic & Survey Interviews

When a researcher enters an interview, she has already construed it as being a standard type of communicative event. This article considers how a researcher's construal of a communicative event as either an ethnographic or survey interview shapes the production of information. Interview standards entail epistemological assumptions that directly inform the type of information sought and produced. I consider this process through a comparison of the elicitation techniques I employed in survey and ethnographic interviews conducted during research in Mexico. I draw on theory in linguistic anthropology on the nature of meaning in language, examining how dialogicality and interaction are essential to understanding the construal of communicative events.     

Variation within households in consent to link survey data to administrative records: evidence from the UK Millennium Cohort Study

This study expands our knowledge of consent in linking survey and administrative data by studying respondents’ behaviour when consenting to link their own records and when consenting to link those of their children. It develops and tests a number of hypothesised mechanisms of consent, some of which were not explored in the past. The hypotheses cover: parental pride, privacy concerns, loyalty to the survey, pre-existing relations with the agency holding the data, and interviewer effects. The study uses data from the longitudinal Millennium Cohort Study to analyse the correlates of consent in multiple domains (i.e. linkage of education, health and economic records). The findings show that respondent’s behaviour vary depending on the consent domain and on the person within the household for whom consent is sought. In particular, the cohort member’s cognitive skills and the main respondent’s privacy concerns have differential effects on consent. On the other hand, loyalty to the survey proxied by the longitudinal response history has a significant and strong impact on consent irrespective of the outcome. The findings also show that interviewers account for a large proportion of variations in consent even after controlling for the characteristics of the interviewer’s assignment area. In total, it is possible to conclude that the significant impact of some of the correlates will lead to sample bias which needs to be accounted for when working with linked survey and administrative data.     

Social Survey Research1 in Japanese Sociology

Abstract: In this paper, we look at the history of social survey development in Japanese sociology. First, the history of social research in Japan before World War II is explored. Second, the introduction of survey research to Japan during the American occupation after World War II is examined, and third, the present state and roles of social survey research in Japanese sociology is discussed. Social research was introduced as an administrative tool for the government. Sociology and social research were developed under British empiricism and American pragmatism, but Japanese academia has been based on a metaphysical approach. Social research introduced as a practical tool long had difficulty in being accepted by Japanese academia. For this reason, most sociologists in universities did not use social survey research for practical purposes, but pursued qualitative methodologies for analyzing data to gain academic prestige even after Social Stratification and Mobility (SSM) and Sabro Yasuda's research projects spread social survey methods in the field of Japanese sociology. Such academics did not think that findings acquired through qualitative case studies had to be confirmed through quantitative data to serve a practical purpose, nor did they believe that quantitative data could be better understood when examined along side qualitative data. Social survey methods have been opposed by those who have favored case‐study analysis methods in Japanese sociology. Needless to say, this opposition is fruitless. I propose that professional sociologists in Japanese universities should use social survey research for practical problems more frequently. This is the best way to establish sociology and social research as a science in Japanese society.     

EVALUATION OF A COMPUTER-ASSISTED SELF-INTERVIEW COMPONENT IN A COMPUTER-ASSISTED PERSONAL INTERVIEW SURVEY

This article examines respondent reactions to and performanceon a self-administered component of a computer-assisted personalinterview survey on self-images, conducted in the Detroit areain 1992. Although respondents were encouraged to complete thecomputer-assisted self-interview items them selves, only 79percent of those interviewed actually did so, while for 14 percentthe interviewer completed the items and for the remaining 7percent the interviewer read the questions while the respondententered the responses. We find that the decision to self-completethe computer-assisted self-interview items is re lated to factorssuch as respondents' age, education and com puter experience.This suggests that both capacity (literacy and vision) and motivationaffect the choice of completion. We also find differences insubstantive responses and data quality be tween self-completersand those who use interviewer assistance. These findings haveimplications for nonresponse error and data quality for self-administeredcomponents of interviews, particu larly those using computer-administration.     

Good girls don't comment on politics? Gendered character of online political participation in the Czech Republic

The article aims to contribute to the still relatively unexplored area of the relationship between gender and online political participation. Using two complementary methods – a representative, post-election survey of the adult Czech population and a content analysis of communication on the selected Czech political parties’ Facebook profiles during the campaign for the 2013 Parliamentary Elections – we attempt to challenge some established assumptions regarding the allegedly equalizing effect of the Internet and social media on participatory behaviour of men and women. While survey data discovered subtle yet statistically significant differences between men and women in some online expressive activities on Facebook, mainly commenting on other users’ statuses, content analysis further revealed that there are not only notable gender gaps among the Facebook users who commented on the campaign, but also differences in the tone of communication produced by the respective gender groups, with men posting more negative comments addressed to parties as well as to other Facebook users. We suggest that these results question the prevailing perception about the narrowing of the ‘gender gap’ in the online environment and call for a more nuanced methodological approach to different forms of online political expression.     

Gender attitudes in the Arab region – The role of framing and priming effects

Most evidence on survey response effects is based in the Western world. We use data from two randomized experiments built into a nation-wide representative household survey in Tunisia to analyze the effects of framing and priming on responses to gender attitudes in the Arab context. Our first experiment shows that questions on attitudes towards decision-making power when framed in an equality frame reduce responses in favor of gender inequality. In our second experiment we find that responses to attitudes towards domestic violence are susceptible to an audio primer. Oral statistical information about the incidence of domestic violence in Tunisia increases disapproval of domestic violence among the male subsample further, but does not affect women. In terms of impact heterogeneity, we find mixed results for treatment interventions interacting with the gender of the interviewer and the interviewer’s perceived religiosity.     

LG(BT) Families and Counting

Counting and understanding lesbian and gay families have gained attention over the last decade in popular culture, policy, and academic research. Contentious debates on family values and same‐sex marriage, increasing rates of social tolerance for homosexuality, and a greater general academic attention on issues of sexual orientation have partially spurred this attention in demographic analysis of lesbian and gay families. It is becoming increasingly clear that sexual orientation and gender identity have an effect on demographic processes and life outcomes. Although not perfect, practically speaking, drawing on nationally representative survey data has allowed us to illuminate the presence of same‐sex families and their children. These findings have an iterative relationship with social change, public policy, and increasing tolerance for diversity. This article reviews the recent demographic contributions related to lesbian, gay, bisexual, and transgender (LGBT) families. Due to research concentrations, the content of this article not only mostly addresses what is known about gay and lesbian families but also offers future directions to fill research voids including a call for greater attention to and visibility for families with bisexual and transgender members.     

Using cognitive interviews to refine translated survey questions: an example from a cross-national crime survey

Lately, social researchers have become increasingly interested and involved in comparative and cross-national research. In part this reflects a growing realisation that key social, economic and political processes are not merely ‘domestic’ but are common across countries and cultures. Although numerous good quality data sets now exist (e.g. the European Social Survey or International Social Survey Programme), in many instances researchers need to design their own bespoke comparative surveys. Such surveys require careful design if they are to produce meaningful data. Herein we introduce, outline and report on one technique which may usefully be employed in order to design better survey items for use in cross-national surveys.     

Exploring rural community agency differences in Ireland and Pennsylvania

The role of community agency in the rural community and economic development processes needs to be better understood in America and other advanced, industrialized nations. Community agency is vital to protecting, retaining, and maintaining rural communities. A comparative study was designed to explore the role of community agency in contributing to local well-being in Ireland and America. This role was evaluated through the use of a multiple method framework based on extensive key informant interviews, focus groups, and analysis of household survey data.     

The impact of touch-tone data entry on reports of HIV and STD risk behaviors in telephone interviews

Respondents concerns about privacy can decrease reporting of HIV and STD risk behaviors in general population telephone surveys. The purpose of this paper is to describe the results of an experimental study evaluating whether one method for increasing privacy, touch-tone data entry (TTDE), is effective in increasing estimates of sexual behaviors from a population-based survey. We conducted a random-digit-dial telephone survey of adults in New Jersey (n = 405), with half the respondents using TTDE for answering sexual behavior questions. TTDE led to increased reports of same-sex sexual behavior, certain HIV and STD risk factors, and concern about one s risk for HIV and STD transmission. TTDE also narrowed the difference between men s and women s reports of the number of different sexual partners over the past 10 years. The feasibility and limitations of TTDE are discussed, as well as possible alternative interpretations that consider the impact of TTDE on the dynamics of the interaction between the respondent and the interviewer.     

Giving the community a voice: Lessons learned from a comprehensive survey in an urban neighborhood

Weinland Park, an urban neighborhood adjacent to The Ohio State University, has been targeted for revitalization following several decades of disinvestment. The goal of these efforts is to develop holistic solutions that break the cycle of poverty. Such an undertaking requires collecting baseline data to understand community needs, inform programming, and guide revitalization efforts. This paper describes the development and implementation of the Weinland Park Evaluation Project (WPEP) – a collaborative and comprehensive neighborhood survey and needs assessment. Using the RE-AIM framework as a conceptual model, the paper describes how the WPEP was designed to meet short-, medium-, and long-term community needs. In addition, it offers lessons learned as a guide for researchers designing neighborhood surveys and conducting community assessments. An Appendix A includes indicators measured via the survey tool.     

OPTIMAL CALL SCHEDULING FOR A TELEPHONE SURVEY

Contacting a suitable respondent at home and securing the interviewis a significant component of the typical household telephonesurvey. An optimal calling schedule minimizes the number ofcallbacks required and thus conserves resources. This articlepresents an analysis of time-of-day and day-of-week effectson the probabilities of obtaining an answered outcome and aninterviewed outcome in a large national telephone survey ofadult males. The data presented indicate that, at least forthe survey population included in this study, the chances ofobtaining an answer and conducting an interview on the firstcall are much better on weekday evenings and on weekends thanthey are during weekday daytime hours. Moreover, there is someevidence to indicate that this finding also applies to secondcalls made to first-call no-answers, at least with regard tocontacting efforts. Time-of-day and/or day-of-week effects onfirst call outcomes appear to be generally consistent with respectto both contacting and interviewing, although Sunday has a decidedlyhigher interview response rate for answered calls than do theother calling periods analyzed.     

The impact of touch‐tone data entry on reports of HIV and STD risk behaviors in telephone interviews

Respondents’ concerns about privacy can decrease reporting of HIV and STD risk behaviors in general population telephone surveys. The purpose of this paper is to describe the results of an experimental study evaluating whether one method for increasing privacy, touch‐tone data entry (TTDE), is effective in increasing estimates of sexual behaviors from a population‐based survey. We conducted a random‐digit‐dial telephone survey of adults in New Jersey (n = 405), with half the respondents using TTDE for answering sexual behavior questions. TTDE led to increased reports of same‐sex sexual behavior, certain HIV and STD risk factors, and concern about one's risk for HIV and STD transmission. TTDE also narrowed the difference between men's and women's reports of the number of different sexual partners over the past 10 years. The feasibility and limitations of TTDE are discussed, along with possible alternative interpretations that consider the impact of TTDE on the dynamics of the interaction between the respondent and the interviewer.     

Lay people’s models of the economy: A study based on surveys of consumer sentiments

The purpose of this paper is to use a large data set comprising individual’s responses to survey questions about future economic conditions, unemployment and prices to explore lay people’s models of the economy and specifically their understanding of the relationship between unemployment and economic activity and also between unemployment and prices. The data is taken from the questionnaires used to form monthly indexes of consumer sentiments in Australia. We ask if the implied bivariate relationships are rational in the sense used by Muth (1961) and if they are consistent with the good-begets-good heuristic proposed by Leiser and Aroch (2009). We also ask if they are consistent with the actual operation of economic – and especially monetary – policy in Australia. We find that the data does provide some support for these hypotheses and for recent work in behavioural macroeconomics utilising the good-begets-good heuristic.