Effects of Interview Mode on Assessments of Erectile and Ejaculatory Dysfunction among Men with Benign Prostatic Hyperplasia (BPH)

In a randomized experiment (N = 249; age 50 + years), this study examined if self-reports of erectile dysfunction (ED) and ejaculatory dysfunction (EjD) symptomatology were influenced by the mode of interview administration (computer-assisted self-interview [CASI], audio computer-assisted self-interview [ACASI], or computer-assisted personal interview [CAPI; involving an interviewer]). This study also examined if mode moderated person variables hypothesized to impact self-reports (social desirability, age, or depressive mood). No main or moderating effects of mode were found for self-reports of EjD symptoms. However, mode effects on reports of ED symptoms were observed, and these moderated age and social desirability effects on self-reports. Significantly more older (relative to younger) men reported high levels of ED symptoms when interview administration was by a live interviewer (CAPI) than with self-administration. Alternatively, significantly more younger men reported high levels of ED symptoms when administration was by an interviewer (CAPI) or by ACASI (vs. CASI). The Mode × Social Desirability effects were complex (see the Discussion section), showing hypothesized effects under ACASI and CAPI conditions, but an opposite effect under the CASI condition. The stability of self-reported ED symptoms did not vary by mode (based on test–retest comparisons); test–retest was significantly higher for EjD symptoms within the ACASI condition. The impact of mode of administration on self-reports of ED/EjD symptoms is less predictable and dramatic than one might conclude from prior research with other types of self-report outcomes. The findings are consistent with a small, but growing, body of studies that illustrate highly situational effects of interviewing, which may depend on a complex interplay between modes, person variables, and the interview topic/target items. Self-administered methods, in particular, may not be a universal solution to response bias.     

INTERVIEWER GENDER AND GENDER ATTITUDES

This research addresses the effects of interviewer gender onresponses to a broad array of gender-related survey questions,using data from a probability sample of adults in the UnitedStates. We focus on whether gender-of-interviewer effects areevident, whether they vary by respondent gender, and whetherthey vary across several attitudinal domains relevant to genderinequality. While many items do not show statistically significantgender-of-interviewer effects, we document significant effectsacross a variety of items. When such effects are evident, theytend to involve both male and female respondents expressingmore egalitarian gender-related attitudes or greater criticismof existing gender inequalities to female interviewers. Malerespondents offer significantly different responses to maleand female interviewers on questions dealing with gender inequalityin employment. For female respondents, interviewer-gender effectsare evident for items addressing gender-related collective action,policy, and group interests. Using multivariate models thatallow us to represent both respondent-level and interviewer-levelvariables, we find that interviewer-gender effects are statisticallysignificant in most attitudinal domains but that the interactionbetween interviewer gender and respondent gender does not tendto be statistically significant. We consider the implicationsof these findings both for understanding the survey processand for understanding gender relations more generally.     

Consequences of reducing nonresponse in a national telephone survey

Critics of public opinion polls often claim that methodological shortcuts taken to collect timely data produce biased results. This study compares two random digit dial national telephone surveys that used identical questionnaires but very different levels of effort: a "Standard" survey conducted over a 5-day period that used a sample of adults who were home when the interviewer called, and a "Rigorous" survey conducted over an 8-week period that used random selection from among all adult household members. Response rates, computed according to AAPOR guidelines, were 60.6 percent for the Rigorous and 36.0 percent for the Standard study. Nonetheless, the two surveys produced similar results. Across 91 comparisons, no difference exceeded 9 percentage points, and the average difference was about 2 percentage points. Most of the statistically significant differences were among demographic items. Very few significant differences were found on attention to media and engagement in politics, social trust and connectedness, and most social and political attitudes, including even those toward surveys.     

Effect of Interviewer Experience on Interview Pace and Interviewer Attitudes

Traditional statistical analyses of interviewer effects on surveydata do not examine whether these effects change over a fieldperiod. However, the nature of the survey interview is dynamic.Interviewers’ behaviors and perceptions may evolve asthey gain experience, thus potentially affecting data quality.This paper looks at how interview length and interviewer evaluationsof respondents change over interviewers’ workloads. Multilevelmodels with random interviewer effects are used to account forthe clustering of cases within interviewers and individual interviewercharacteristics in the 1984, 1988, and 2000 National ElectionStudies. The 1984 and 1988 NES released sample in four replicates,minimizing the confound between order in an interviewers’workload and sample composition. We find that over the courseof the studies, both measures change significantly. Interviewerprior survey experience also was significantly negatively relatedto the length of the interview. These findings have implicationsfor interviewer training prior to and during studies, as wellas suggesting future research to reveal why these behaviorsand perceptions change.     

ADOLESCENTS' INCONSISTENCY IN SELF-REPORTED SMOKING: A COMPARISON OF REPORTS IN SCHOOL AND IN HOUSEHOLD SETTINGS

Extent and sources of inconsistency in self-reported cigarette smoking between self-administered school surveys and household interviews was examined in two longitudinal multiethnic adolescent samples, the urban Transition to Nicotine Dependence in Adolescence (TND) (N = 832) and the National Longitudinal Study of Adolescent Health (Add Health) (N = 4,414). Inconsistency was defined as a positive report of smoking in school followed by a negative report in the household. Smoking questions were ascertained with paper-and-pencil instruments (PAPI-SAQ) in school in both studies, and computer-assisted personal interviewing (CAPI) in TND but audio computer-assisted self-interviewing (ACASI) in Add Health in the household. In TND, 23.5 percent of youths who reported smoking lifetime and 20.4 percent of those who reported smoking the last 12 months in the school survey reported in the household never having smoked; in Add Health, the latter was 8.6 percent. Logistic regressions identified five common correlates of inconsistency across the two studies: younger age, ethnic minority status, lesser involvement in deviant activities, having nonsmoking parents and friends. In TND, interviewing of youth and parent by the same interviewer increased inconsistent reporting. Matching the definition of inconsistent reporting and the age, gender and race/ethnic distributions of TND on an urban Add Health subsample reduced the predicted rate of inconsistency in TND. The estimated bias attributable to CAPI compared with ACASI methodology did not reach significance in the aggregated matched samples suggesting that irrespective of administration mode, household interviews decrease reporting of smoking, especially among younger, minority and more conventional youths embedded in a social network of nonsmokers.     

The self-interview: a new method in social science research

This article presents the new method of self-interviewing as an empirical tool specifically for use in memory studies research. The article traces some of the empirical limitations specific to the field of memory studies and reviews the existing tools used in this area. It particularly focuses on some of the limitations of qualitative interviewing, the memory work method and diary methods in generating data on the processes of vernacular remembering at the same time as making visible the meaning that remembering has for participants in their everyday lives. We propose the self-interview as a method which addresses some of these limitations. In elaborating the value of the self-interview, we draw extensively on fieldwork that we have conducted using this method. Although the self-interview does not divest memory studies of the need for a range of other methods, the self-interview is an important addition to its currently rather sparse methodological tool kit.     

The effect of interviewer evaluation of respondents’ attitudes and understanding on future survey participation in a panel study

This study explored whether the interviewers’ judgments of respondents’ performances in an initial survey can predict survey participation for a second survey among the same group of respondents in a panel study. Specifically, this study examined two interviewer variables: the interviewers’ judgments of (1) the respondents’ understanding of survey questions and (2) the respondents’ attitudes toward the survey. The analyses revealed that respondents who were rated to have an excellent understanding of the survey questions and friendly attitudes were more likely to respond to the second interview request than those with a poor understanding and unfriendly attitudes, after controlling for the characteristics of the respondents. Of these two, the judgment of the respondents’ attitudes was a stronger predictor. However, interviewer’s judgments are not correlated with the primary survey outcome or the data quality. This suggests limited value of the interviewer observation.     

Interview as a Social Event: Cultural Influences Experienced While Interviewing Older Adults in India

This article examines the methodological challenges encountered while interviewing older adults in India for the purpose of understanding the effect of adult child emigration on the older family members left behind. This article explores the impact of cultural influences on the interview process. Twenty‐nine older parental units were interviewed. The presence of extended family, social desirability, the older adult's familiarity with questionnaire items and interviewer effects are explored. Strategies used to overcome methods bias are presented. Understanding cultural elements allowed for adaptation of interviewing techniques in the field and produced interviews that yielded reliable and valid data.     

Beyond interviewer effects in the standardized measurement of ego-centric networks

The effects which interviewers exert on the collection of ego-centric networks have recently come into the focus of methodological considerations. Studies consistently show that the size of networks varies depending on the interviewer. We would like to expand on this research strand by pointing to different aspects which have so far gone unremarked in the discussion. First, size is mainly analysed as a network measure which is influenced during data collection, while other common measures such as network density or composition have not received sufficient consideration. Second, large-scale surveys using face-to-face interviews usually allocate interviewers to a single sampling point. Differences between sampling points (locality effects) are attributed to interviewer effects. Hence, we disentangle the effects of the locality and interviewer. Third, the discussion on interviewer effects often follows an “actor-oriented” consideration of how data collection situations are structured by interviewers. Expanding this approach from a relational perspective, we consider the relationship between the interviewers and respondents and whether this relationship influences the collection of network data. To test our hypotheses about the influence of interviewers, the locality and the interviewer-respondent relationship on different network measures, we use data from the 2010 German General Social Survey (n = 2827 respondents, n = 220 interviewers). The multilevel analyses show that the relationship between the interviewer and the respondent is not very relevant. Furthermore, the analyses show that interviewers have an influence on the network size but not on measures of their composition. However, evidence on the prevalence of locality or interviewer effects is mixed. Finally, homophilous interviewer-respondent relationships have very little effect on network characteristics. We find evidence of training and fatigue effects on network size. However, much of the variation in network size caused by the interviewer still remains unexplained. We draw conclusions on how to organize interview situations in surveys.     

UNDERREPORTING OF SUBSTANCE USE IN A NATIONAL LONGITUDINAL YOUTH COHORT: INDIVIDUAL AND INTERVIEWER EFFECTS

The quality of drug data in the 1984 wave of the National LongitudinalSurvey of Youth is explored. Comparisons with other nationalsurveys indicate that underreporting of use of illicit drugsother than marijuana appears to have taken place, and that lightusers of these drugs are underrepresented among the self-acknowledgedusers. Comparison with marijuana use reported four years earlierindicates that experimental marijuana users are much less likelythan extensive users to acknowledge involvement. Even aftercontrolling for frequency of use, underreporting is more commonamong terminal high school dropouts and minorities. Not onlyindividual characteristics but field conditions also contributeto underreporting. Familiarity with the interviewer, as measuredby number of prior interviewing contacts, depresses drug usereporting. We speculate that interviewer familiarity increasessalience of normative standards and that participants respondnot only in terms of their past familiarity but also in termsof their subjective expectations regarding the probability ofa future encounter with the interviewer.     

EFFECTS OF INTERVIEWER GENDER, INTERVIEWER CHOICE, AND ITEM WORDING ON RESPONSES TO QUESTIONS CONCERNING SEXUAL BEHAVIOR

We examined factors influencing responses to questions on sexualbehavior among adult respondents 18–49 years old (unweightedN = 2,030) obtained through a random-digit dialing survey. Basedon self-disclosure and perceived control the ory, we hypothesizedthat giving people a choice in selecting the gender of theirinterviewer rather than being assigned an inter viewer, andusing questions that are "supportive" of what may be perceivedof as nonnormative behavior (enhanced items), would increasedata quality relative to, respectively, matched-or opposite-genderinterviewer conditions and standard worded items. The enhanceditems facilitated responding to a number of sensitive topics.However, the effects of item wording on item response are oftenmediated by interviewer conditions. The "choice" results suggestthat giving respondents greater control decreases question threat.However, the overall findings argue for matching respondentsand interviewers on gender over opposite-gender interviewersor allowing respondents to select their interviewer's gender.Wording and interviewer manipulations reduced the discrepanciesbetween men's and women's self-reports of sexual behavior, butthey did not eliminate them, and in some cases they had no effect.The present findings suggest that males tend to be influencedby variations in item wording, interviewer gender, and respondentcontrol across a somewhat wider range of sexual topics. In general,the findings recommend matching respondents and interviewerson gender and the use of more supportive wording in sexual behaviorquestions. However, for assessment of some topics (e.g., sexualviolence) in particular segments of the population (e.g., men),other procedures, such as increasing respondent control, maybe a better choice. Overall, the data support the view thatin terms of preferred procedures, not all sexual topics arecreated equal.     

DIRECT SUPERVISION: ADDING COMPUTER-ASSISTED FEEDBACK AND DATA CAPTURE TO LIVE SUPERVISION

This is a critical review of live supervision with emphasis on technical innovations such as earphones or bug-in-the-ear, Teleprompters, and computers. A computer-assisted approach is described that overcomes many criticisms of live supervision. Direct supervision uses a computer monitor to unobtrusively provide information to the therapist about the supervisor's perceptions of the clients' and therapist's behavior, the expected therapeutic behaviors, and the therapist's "on target" behavior. Direct supervision has the advantage over other forms of supervision by providing an immediate, continuous, and permanent record for postsession supervision and for research into the supervisor-therapist-client process. The paper provides several suggestions for research.     

Assessment of Cigarette Smoking and Smoking Susceptibility among Youth: Telephone Computer-Assisted Self-Interviews versus Computer-Assisted Telephone Interviews

This experimental study assesses the effect of two survey methods,telephone audio computer-assisted self-interviewing (T-ACASI)and computer-assisted telephone interviewing (CATI), on self-reportsof smoking behavior and smoking susceptibility among adolescents12–17 years of age in California. In T-ACASI, participantslisten to prerecorded, computer-controlled questions and respondby pressing the keypad on a touch-tone telephone. In CATI, interviewersadminister the questions and enter responses into a computer.Prior research suggests that youth may be more likely to reportsensitive behaviors in a self-administered survey like T-ACASIcompared to an interviewer-administered survey like CATI, dueto greater perceived confidentiality. Logistic regression analyseswere conducted on unweighted data, controlling for demographicdifferences. Adjusted estimates of current smoking (past 30days) were significantly greater in T-ACASI (8.3 percent) thanCATI (4.5 percent). Smoking susceptibility (i.e., lack of afirm commitment not to smoke among those who have never smoked)was also greater in T-ACASI (45.0 percent) than CATI (34.9 percent).In both surveys, social desirability response bias was negativelyassociated with smoking, which suggests that response bias wasproblematic for both modes. Many respondents reported that aparent was present during the interview (59.4 percent in CATI;42.0 percent in T-ACASI). In both surveys, parental presencewas negatively associated with smoking, which suggests thatthis factor could also contribute to underreporting. Applicationof sample weights to the data eliminated the survey mode effects;however, the CATI current smoking estimate (9.3 percent) fromthis study was significantly less than an estimate (14.2 percent)obtained from a self-administered, school-based survey conductedthe same year on California adolescents.     

Gender attitudes in the Arab region – The role of framing and priming effects

Most evidence on survey response effects is based in the Western world. We use data from two randomized experiments built into a nation-wide representative household survey in Tunisia to analyze the effects of framing and priming on responses to gender attitudes in the Arab context. Our first experiment shows that questions on attitudes towards decision-making power when framed in an equality frame reduce responses in favor of gender inequality. In our second experiment we find that responses to attitudes towards domestic violence are susceptible to an audio primer. Oral statistical information about the incidence of domestic violence in Tunisia increases disapproval of domestic violence among the male subsample further, but does not affect women. In terms of impact heterogeneity, we find mixed results for treatment interventions interacting with the gender of the interviewer and the interviewer’s perceived religiosity.     

Human Sexual Development is Subject to Critical-Period Learning: Paradigm-Shifting Implications for Sexual Therapy and for Child-Rearing

ABSTRACT. Objectives: Our study was designed to study the origins of the variation in sexual interest in normal adult human beings. Methods: Retrospective data were entered anonymously by 2,201 female participants and 1,242 male participants using computer-assisted self-interview. Results: In both sexes, participants who began sexual behaviors before age 13 had the highest interest in sex as adults as measured by frequencies of masturbation and partner sex. Our findings were consistent with learning to function sexually being subject to critical-period learning. Conclusions: Critical-period learning provided a theoretical basis for understanding variation in interest in sex among adult individuals of both sexes. These results have implications for understanding the origins of hypoactive sexual desire, and they also have implications for child-rearing practices.     

Race-of-Interviewer Effects Among Southern Adolescents

Bias arising from the race-of-interviewer effect was found tooccur among both black and white high school seniors livingin the South. The magnitude of the effect was comparable tothat observed among non-Southern adults. Such bias was limitedto items mentioning the race of the interviewer, and the directionof bias was always toward deference to the interviewer's race.Low status respondents showed a sporadic tendency toward increaseddeference. The magnitude of the effect of the interviewer'srace rarely exceeded 3 percent of variance explained.     

The influence of interviewer characteristics on support for democracy and political engagement in Sub-Saharan Africa*

This study investigates how an interviewer’s characteristics affect how respondents answer survey questions about democracy and political engagement. I analyze data from the 2008 Afrobarometer surveys, in which 810 interviewers surveyed 27,713 respondents across 20 countries in sub-Saharan Africa. Using these data, I study how interviewer education, age, and gender affect two outcomes: (1) response distributions to attitudinal and behavioral survey questions and (2) the likelihood of respondents saying ‘don’t know’ to a survey question. The analysis also investigates how the respondent’s perception of who sponsored the survey (NGO, private sector, government) affects attitudes. The results show that these interviewer characteristics affect the quality of survey data on political attitudes and behaviors. In the discussion, I consider the implications for research based on public opinion data about democracy and political engagement.     

Painful Passages: Traumatic Experiences and Post‐Traumatic Stress among U.S. Immigrant Latino Adolescents and their Primary Caregivers

Using data from a stratified random sample of 281 foreign‐born adolescents and their parents in the United States, this study provides data on migration‐related trauma exposures and examines how the migration process influences the risk of experiencing trauma and developing posttraumatic stress disorder (PTSD). We find that 29 percent of foreign‐born adolescents and 34 percent of foreign‐born parents experienced trauma during the migration process. Among those that experienced trauma, 9 percent of adolescents and 21 percent of their parents were at risk for PTSD. Pre‐migration poverty combined with clandestine entry into the U.S. increased the risk of trauma and the subsequent development of PTSD symptoms. Post‐migration experiences of discrimination and neighborhood disorder further exacerbated this risk, while social support and familism mitigated it. Our results emphasize the importance of understanding how factors prior to, during, and after migration combine to influence the health of immigrants.     

No booze? You may lose: Why drinkers earn more money than nondrinkers

A number of theorists assume that drinking has harmful economic effects, but data show that drinking and earnings are positively correlated. We hypothesize that drinking leads to higher earnings by increasing social capital. If drinkers have larger social networks, their earnings should increase. Examining the Gen-eral Social Survey, we find that selfreported drinkers earn 1014 percent more than abstainers, which replicates results from other data sets. We then attempt to differentiate between social and nonsocial drinking by comparing the earn-ings of those who frequent bars at least once per month and those who do not. We find that males who frequent bars at least once per month earn an addi-tional 7 percent on top of the 10 percent drinkers’ premium. These results sug-gest that social drinking leads to increased social capital. We thank Daniel Arce, Phil Cook, Rodolfo Gonzalez, Teresa Beckham Gramm, Nick McKinney, Tom Means, Jake Vigdor, and participants in the Faculty Development Endowment seminar at Rhodes College for helpful comments and suggestions. We gratefully acknowledge Rhodes College for supporting this research through a Faculty Development Endowment grant.