What influences respondents to behave consistently when asked to consent to health record linkage on repeat occasions?

This study constitutes the first longitudinal exploration of consent to link survey and administrative data. It examines variations in consent over time and explores the influence of the respondents’ characteristics (both observed and latent) and the impact of the interviewers on consent co-operation. Respondent inclination to consent is modelled as a latent construct. Most respondents behave consistently over time. However, this consistency is not driven by a strong inclination to consent but rather by the circumstances of the respondents at the time of the interview and by the impact of the interviewers themselves. The findings also show that the change in consent behaviour over time is a clear indication that consent should be treated as a dynamic phenomenon at the individual level.     

Variation within households in consent to link survey data to administrative records: evidence from the UK Millennium Cohort Study

This study expands our knowledge of consent in linking survey and administrative data by studying respondents’ behaviour when consenting to link their own records and when consenting to link those of their children. It develops and tests a number of hypothesised mechanisms of consent, some of which were not explored in the past. The hypotheses cover: parental pride, privacy concerns, loyalty to the survey, pre-existing relations with the agency holding the data, and interviewer effects. The study uses data from the longitudinal Millennium Cohort Study to analyse the correlates of consent in multiple domains (i.e. linkage of education, health and economic records). The findings show that respondent’s behaviour vary depending on the consent domain and on the person within the household for whom consent is sought. In particular, the cohort member’s cognitive skills and the main respondent’s privacy concerns have differential effects on consent. On the other hand, loyalty to the survey proxied by the longitudinal response history has a significant and strong impact on consent irrespective of the outcome. The findings also show that interviewers account for a large proportion of variations in consent even after controlling for the characteristics of the interviewer’s assignment area. In total, it is possible to conclude that the significant impact of some of the correlates will lead to sample bias which needs to be accounted for when working with linked survey and administrative data.     

Obtaining data linkage consent for children: factors influencing outcomes and potential biases

Understanding factors associated with consent for data linkage has largely focussed on adults, but parents or guardians can also be asked to consent on behalf of children for whom they are responsible. A framework for consent decision is presented, and is tested using a large nationally representative survey asking mothers to consent for both themselves and their children for two sets of records. Nearly all mothers give the same consent outcome for all their children. Consent rates are higher for education records than for health records and higher for mothers than children. Multivariate analyses suggest that minorities are generally less likely to consent, while more trust increases chances of consent. Several survey environment factors are important, with harder-to-contact respondents less likely to consent, while the presence of others and higher interviewer-respondent rapport lead to a higher chance of consent. These findings suggest potential methodologies to improve consent rates and possibly minimise bias. This is important given significant demographic differences between children across consent outcomes. However, data from a survey of 10–15 year olds in the study shows fewer differences for several important behaviours and attitudes across consent outcomes.     

The Impact of "No Opinion" Response Options on Data Quality: Non-Attitude Reduction or an Invitation to Satisfice?

According to many seasoned survey researchers, offering a no-opinionoption should reduce the pressure to give substantive responsesfelt by respondents who have no true opinions. By contrast,the survey satisficing perspective suggests that no-opinionoptions may discourage some respondents from doing the cognitivework necessary to report the true opinions they do have. Weaddress these arguments using data from nine experiments carriedout in three household surveys. Attraction to no-opinion optionswas found to be greatest among respondents lowest in cognitiveskills (as measured by educational attainment), among respondentsanswering secretly instead of orally, for questions asked laterin a survey, and among respondents who devoted little effortto the reporting process. The quality of attitude reports obtained(as measured by over-time consistency and responsiveness toa question manipulation) was not compromised by the omissionof no-opinion options. These results suggest that inclusionof no-opinion options in attitude measures may not enhance dataquality and instead may preclude measurement of some meaningfulopinions.     

The influence of interviewer characteristics on support for democracy and political engagement in Sub-Saharan Africa*

This study investigates how an interviewer’s characteristics affect how respondents answer survey questions about democracy and political engagement. I analyze data from the 2008 Afrobarometer surveys, in which 810 interviewers surveyed 27,713 respondents across 20 countries in sub-Saharan Africa. Using these data, I study how interviewer education, age, and gender affect two outcomes: (1) response distributions to attitudinal and behavioral survey questions and (2) the likelihood of respondents saying ‘don’t know’ to a survey question. The analysis also investigates how the respondent’s perception of who sponsored the survey (NGO, private sector, government) affects attitudes. The results show that these interviewer characteristics affect the quality of survey data on political attitudes and behaviors. In the discussion, I consider the implications for research based on public opinion data about democracy and political engagement.     

What was I thinking? A theoretical framework for analysing panel conditioning in attitudes and (response) behaviour

Though panel data are increasingly used in the social sciences, the question whether repeatedly participating in a panel survey affects respondents’ attitudes and (response) behaviour is still largely unsolved. Drawing on a model of associative networks that is extended by assumptions on survey satisficing, we present a theoretical framework that emphasizes the role of strength-related attributes of attitudes (accessibility, internal consistency, extremity) and motivation in respondents’ information processing. In particular, we argue that – depending on respondents’ predispositions – occupation with survey questions enhances attitude strength, which results in increasing attitude stability and influence on thoughts and behaviours. Against this background, we bring together hitherto unconnected results from previous research and thus contribute to a more thorough understanding of both the mechanisms and the multifaceted outcomes of panel conditioning.     

Measuring Perceived Mistreatment: Potential Problems in Asking About “Discrimination”

Many studies have used survey data on perceived everyday mistreatment to assess the extent and health impact of racial discrimination and of discrimination based on weight, sexual orientation, and other reasons. Some surveys use the word “discrimination” in the initial question put to respondents, while other surveys do not use this word. This research note argues that including “discrimination” in the initial question may depress reports of perceived mistreatment, particularly among whites. It tests this possibility with data from the 1995–1996 National Survey of Midlife Development in the United States, which used “discrimination” in the initial question, and the 2001–2003 National Survey of American Life, which did not use this word. Findings suggest that using “discrimination” in the initial question considerably depresses whites’ reports of everyday mistreatment.     

Toward a social psychology of survey methodology: An application of the approach and directions for the future

Survey methodology is a relatively new academic discipline focused on understanding sources of survey errors. As an interdisciplinary field, survey methodology borrows theoretical approaches from other disciplines and applies them to understand how survey respondents answer questions. One field in particular, cognitive psychology, has played a central role in the development of survey methodology. The cognitive approach has focused researchers' attentions on the sources of error at each stage of the cognitive process respondents use to answer a survey question: comprehension of the question, recollection of relevant information, estimation and judgment, and reporting an answer. Although this focus on the cognitive response process has been positive and fruitful, potentially strong social and interactional influences on the response process have been underinvestigated and undertheorized. Thus, this essay argues for a revitalized research program in the sociological social psychology of survey methodology, given its rich body of theory and research. The current strengths of social psychological and interactional approaches are highlighted, focusing primarily on recent work using identity theory to understand social desirability biases. Finally, potentially fruitful future directions for research are proposed, matching sociological social psychological theories to the survey errors upon which they may shed light.     

Outsiders in the union: organizing,consent, and union recognition campaigns

Although outsiders have played an important role in social protest in the U.S., outsiders’ role in the U.S. labor movement has been the focus of spirited debate. Debate about outsider organizers, in particular, reached a fevered pitch in the late 1990s, and continues today. This paper scrutinizes two of the core assumptions of this debate: that insider and outsider organizers operate differently on union recognition campaigns, and that workers respond to them differently in these settings. We analyzed 153 in-depth interviews with workers and organizers conducted at the height of the debate, in order to answer two questions: What is the role of outsider organizers during private sector union recognition campaigns, and how do outsider organizers secure workers’ consent in these settings? All of the organizers in our data-set were graduates of the AFL-CIO’s Organizing Institute, and 64 of them were outsiders. The outsider organizers in our data-set confronted barriers that insider organizers did not, including workers’ concerns about their youth, inexperience and lack of professionalism, and their own inability to relate to workers. While many critics of outsider organizers claim that these barriers are insurmountable, we found the opposite to be true. The vast majority of outsider organizers in our data-set successfully secured workers’ consent by demonstrating commitment, building relationships, and being honest and forthright. After proposing changes in organizer training and leadership development in response to these findings, we conclude with a brief discussion of the enduring debate about outsiders’ role in social protest in the U.S.     

The effect of interviewer evaluation of respondents’ attitudes and understanding on future survey participation in a panel study

This study explored whether the interviewers’ judgments of respondents’ performances in an initial survey can predict survey participation for a second survey among the same group of respondents in a panel study. Specifically, this study examined two interviewer variables: the interviewers’ judgments of (1) the respondents’ understanding of survey questions and (2) the respondents’ attitudes toward the survey. The analyses revealed that respondents who were rated to have an excellent understanding of the survey questions and friendly attitudes were more likely to respond to the second interview request than those with a poor understanding and unfriendly attitudes, after controlling for the characteristics of the respondents. Of these two, the judgment of the respondents’ attitudes was a stronger predictor. However, interviewer’s judgments are not correlated with the primary survey outcome or the data quality. This suggests limited value of the interviewer observation.     

Documenting Pornography Use in America: A Comparative Analysis of Methodological Approaches

Estimates of pornography use in the United States range widely. We explore the reasons for the variation in such estimates among U.S. adults using data from four different recent nationally representative samples—each of which asked a different type of question about pornography use. We attribute the notable variation in estimates to differences in question wording and answer options, and assert that a survey question asking respondents about their most recent use of pornography minimizes recall bias and is better poised to assess the overall prevalence of pornography in a population than is the more common approach of asking respondents about their historical general-use pattern. When we privileged the most-recent-use approach, survey data from 2014 reveal that 46% of men and 16% of women between the ages of 18 and 39 intentionally viewed pornography in a given week. These numbers are notably higher than most previous population estimates employing different types of questions. The results have ramifications for methods of surveying sensitive self-reported behaviors and for contextualizing scholars’ claims as well as popular conversations about the reach and implications of pornography use in the United States.     

Web survey design and administration.

Many claims are being made about the advantages of conducting surveys on the Web. However, there has been little research on the effects of format or design on the levels of unit and item response or on data quality. In a study conducted at the University of Michigan, a number of experiments were added to a survey of the student population to assess the impact of design features on resulting data quality. A sample of 1,602 students was sent an e-mail invitation to participate in a Web survey on attitudes toward affirmative action. Three experiments on design approaches were added to the survey application. One experiment varied whether respondents were reminded of their progress through the instrument. In a second experiment, one version presented several related items on one screen, while the other version presented one question per screen. In a third experiment, for one series of questions a random half of the sample clicked radio buttons to indicate their answers, while the other half entered a numeric response in a box. This article discusses the overall implementation and outcome of the survey, and it describes the results of the imbedded design experiments.     

EFFECTS OF QUESTIONNAIRE DESIGN ON THE QUALITY OF SURVEY DATA

The importance of format, graphic layout, and question routinginstructions on the quality of survey data has been acknowledgedfor self-administered survey instruments, but the significanceof these factors for questionnaires administered by interviewershas not been recognized equally. This paper examines two studiesin which interviewers used different questionnaire designs toadminister the same set of survey questions to randomly selectedadult respondents in housing units that made up area probabilitysamples of the Detroit metropolitan area. The paper presentsempirical evidence of specific effects (questions skipped inerror, unprobed answers) directly attributable to the choiceof questionnaire design. The analysis shows that question nairedesign choices can either help or hurt the quality of data collectedby interviewers. Furthermore, the behaviors of experienced andinexperienced interviewers are affected in similar ways. Inother words, interviewing experience does not compensate forformat deficits in the design of survey instruments.     

An evaluation of transit procurement training

We evaluated a training course called “Orientation to Transit Procurement”, designed and conducted by the National Transit Institute. This course is designed to provide Federal Transit Administration (FTA) grantees an overview of regulations and best practices related to the procurement process. Our objective in conducting the evaluation was to understand how transit agency staff made changes in procurement practices in response to the course training. The evaluation was mixed mode: an Internet survey followed by in-depth interviews with a small group of respondents. Survey respondents were also provided with an open-ended question providing us with additional context for our evaluation. Results show that the training is substantially successful at meeting the goal of improving procurement practices at transit agencies; indeed, most respondents report making changes at their agencies as the proximate result of the training. This was at odds with our exploration of knowledge of procurement topics, as most respondents gave inaccurate answers on multiple-choice “knowledge questions”. This may have been due to question structure or, more likely, the nature of online surveys. Suitable training on the procurement of information technology was also a main concern. The lack of training in this area is indicative of the broader challenge facing public transit agencies in how to incorporate new forms of technology into their existing practices and bureaucratic structures.     

Differential attrition rates and active parental consent.

Active parental consent in survey research poses ethical and practical concerns. One common argument against the requirement of active consent procedures is its effect on participation rates. There is additional concern that higher risk groups may be underrepresented in the final sample. Empirical support of differential attrition, however, is lacking. In the current multisite longitudinal study, passive consent procedures were approved for the collection of pretest data. For subsequent years of data collection, active parental consent procedures were required. In this article, we use the pretest data to examine demographic, attitudinal, and behavioral differences between those students for whom active consent was provided and those for whom active consent was either denied or for whom no response was received. The results indicate that active consent procedures produce deleterious effects on participation rates and lead to an underrepresentation of at-risk youth in the sample.     

THE ANSWERING MACHINE POSES MANY QUESTIONS FOR TELEPHONE SURVEY RESEARCHERS

The proliferation of the telephone answering machine raisesa number of questions about the continued efficiency of thetelephone as a data-gathering mechanism. The most critical ofthese is what effect the use of these machines might have onestablishing contact with potential respondents. If individualsroutinely use these machines to screen calls, then their accessibilityto telephone survey researchers will be restricted. A secondquestion is the degree to which respondents who own answeringmachines and are reachable are likely to participate in a survey.A third question is the extent to which the incidence of theanswering machine as a response disposition might vary by thetime of calling and the respondent's place of residence. Thefindings of this study, based on a nationwide survey, pointto a significant proportion of answering machine owners beingreachable and willing to participate. Furthermore, the answeringmachine appears to be in use more on weekends than on weekdayevenings and in more urbanized areas than in areas with fewerinhabitants.     

Pseudo-Opinions on Public Affairs

This article reports on the often suspected but rarely researchedtendency of survey respondents to give opinions on topics towhich they have given little or no thought. The findings, basedon a question about a fictitious public affairs issue, do showthat the magnitude of the problem is substantial. But the dataalso demonstrate that this phenomenon does not represent simplerandom error, reflecting instead basic social-psychologicaldispositions which can be elicited, unwittingly, in the contextof the interview.     

Does "Yes or No" on the Telephone Mean the Same as "Check-All-That-Apply" on the Web?

Recent experimental research has shown that respondents to forced-choicequestions endorse significantly more options than respondentsto check-all questions. This research has challenged the commonassumption that these two question formats can be used interchangeablybut has been limited to comparisons within a single survey mode.In this paper we use data from a 2004 random sample survey ofuniversity students to compare the forced-choice and check-allquestion formats across web self-administered and telephoneinterviewer-administered surveys as they are commonly used insurvey practice. We find that the within-mode question formateffects revealed by previous research and reaffirmed in thecurrent study appear to persist across modes as well; the telephoneforced-choice format produces higher endorsement than the webcheck-all format. These results provide further support forthe argument that the check-all and forced-choice question formatsdo not produce comparable results and are not interchangeableformats. Additional comparisons show that the forced-choiceformat performs similarly across telephone and web modes.     

Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding

Survey researchers since Cannell have worried that respondents may take various shortcuts to reduce the effort needed to complete a survey. The evidence for such shortcuts is often indirect. For instance, preferences for earlier versus later response options have been interpreted as evidence that respondents do not read beyond the first few options. This is really only a hypothesis, however, that is not supported by direct evidence regarding the allocation of respondent attention. In the current study, we used a new method to more directly observe what respondents do and do not look at by recording their eye movements while they answered questions in a Web survey. The eye-tracking data indicate that respondents do in fact spend more time looking at the first few options in a list of response options than those at the end of the list; this helps explain their tendency to select the options presented first regardless of their content. In addition, the eye-tracking data reveal that respondents are reluctant to invest effort in reading definitions of survey concepts that are only a mouse click away or paying attention to initially hidden response options. It is clear from the eye-tracking data that some respondents are more prone to these and other cognitive shortcuts than others, providing relatively direct evidence for what had been suspected based on more conventional measures.     

The content of the General Social Survey discussion networks: an exploration of General Social Survey discussion name generator in a Chinese context

This study focuses on the discussion network name generator used in the 1985 General Social Survey (GSS). Based on the data from a Chinese survey, it explores the content of the discussion networks by examining the overlapping of names generated by the GSS discussion name generator and the exchange name generators. It finds that the GSS discussion question has generated a range of social ties, which accounts for an important part of a Chinese personal network. Specifically, the people with whom the Chinese respondents discussed important matters are also likely to spend leisure time with the respondents and to be the confidants for personal matters. Some of them are expected to offer substantial help or to possess important social resources; however, they are least involved in what are considered family affairs.