Is the web a promising tool for data collection in developing countries? An analysis of the sample bias of 10 web and face-to-face surveys from Africa,Asia, and South America

Whereas the sample composition biases of web surveys have been discussed extensively for developed countries, studies for developing countries are scarce. This article helps to fill that gap by comparing similar non-probability-based web surveys (WEB) and probability-based face-to-face (F2F) surveys both to each other and to the labor force. An analysis of WageIndicator data on work and wages derived from surveys held in 2009–2013 in 10 developing countries (WEB-sample N = 9135; F2F-sample N = 14,659), shows that F2F samples resemble the labor force to a larger extent than web samples do. In both cases, individuals in their 20s and early 30s are overrepresented, and younger and older respondents are underrepresented. This trend is more pronounced in WEB than in F2F samples. However, the differences converge in countries with higher Internet usage. A comparison of the WEB and F2F samples shows that compositions differ greatly, with web respondents being younger, more often male, more often living alone, and higher educated, although these differences are smaller in countries with higher Internet usage. Given the cost differences between the two survey modes, one should nevertheless consider the potential of web surveys as an instrument to gain explorative insights, specifically when searching for individuals with particular characteristics.     

Email subject lines and response rates to invitations to participate in a web survey and a face-to-face interview: the sound of silence

This paper investigates the relationship between blank and non-blank email subject lines on levels of response to a solicitation to participate in an interview, and on participation in a web survey. Email use has grown substantially in recent years, presenting significant opportunity to the empiricist seeking research respondents. However, response to emails may be low because growth in the sheer volume of messages that individuals receive per day has led to a sense of ‘email overload’, and faced with the challenge of personal email management, many recipients choose to ignore some messages, or do not read them all fully. Drawing on information gap theory, we expected that sending an invitation with a blank subject line would induce a sense of curiosity in recipients that would improve email response and willingness to participate in research studies. However, findings from research with two samples with different propensities to participate in research (academics and business owners) revealed that an email invitation with a blank subject line does not increase overall response rates to a web survey and a face-to-face interview over either an informative subject line or a provocative subject line, but that it does prompt a greater number of active refusals. Based on this finding, recommendations for researchers are outlined.     

Presentation matters: how mode effects in item non-response depend on the presentation of response options

Comparability of data across modes is an important issue in survey research. In this paper we discuss item non-response to attitudinal questions in telephone and web surveys. We present results from a survey experiment conducted in Italy and in Spain that compares different presentations of response options in an online setting with a benchmark telephone survey. In line with earlier studies we find that (A), the share of non substantial answers in the online survey depends on how the response option is presented. Comparing different presentations in an online survey to the standard approach of telephone surveys using propensity score matching, we find that (B), the share and pattern of non substantial answers, is most similar across the two modes in the online survey when the it is captured in an instruction on each screen for the online survey. Our findings are of particular relevance for the design of multiple mode or mix-mode surveys of attitudinal questions using online and telephone modes.     

Gender attitudes,sexual meanings,and interactional patterns in heterosexual encounters among college students in the Netherlands

This study examines the utility of internet banner ads for recruiting rural MSM and identifies correlates of internet HIV risk survey initiation and completion. Banner ads were shown on a popular internet dating site for one month and resulted in 1,045 rural MSM, from 49 States, Canada, Australia/New Zealand, and 5 from other countries initiating the questionnaire. Logistic regression indicated that progression beyond screening questions was negatively related to “expecting pay, but not being paid” and positively related to “using chat rooms to find friends” and identifying as gay. Linear regression indicated that the absolute number of responses by consenting participants was positively correlated with reimbursement, number of sexual partners, motivated by money, and having been HIV tested. Overall, this sample represents one of the largest rural MSM samples; survey completion was high and strengthened by reimbursement and possibly by awareness of HIV risk. Generalizability was limited by low participation of minority and non‐gay identified MSM.     

Influence of door handles design in effort perception: accessibility and usability

The application of ergonomics in product design is essential to its accessibility and usability. The development of manual devices should be based on ergonomic principles. Effort perception analysis is an essential approach to understand the physical and subjective aspects of the interface. The objective of the present study was to analyze the effort perception during a simulated task with different door handles by Portuguese subjects of both genders and different ages. This transversal study agreed with ethical aspects. 180 subjects of both genders pertaining to three age groups have participated. Five door handles with different shapes were evaluated. A subjective numeric rating scale of 5 levels was used to evaluate the effort. For statistical analysis it was applied the Friedman non-parametric test. The results have showed no significant differences of effort perception in door handles "A" and "B"; "A" and "D"; and "D" and "C". Door handle "E" presented the lowest values of all. In general, there's an inverse relationship between the results of biomechanical studies and the effort perception of the same task activity. This shows that door handles design influence directly these two variables and can interfere in the accessibility and usability of these kinds of products.     

Mixed-Mode Contacts In Web Surveys: Paper is Not Necessarily Better

This paper investigates the impact of paper and email contactson web survey response rates. We use six combinations of paperand email prenotifications and reminders to test the impactof mixed-mode contacts. In addition, we use two survey samplesthat differ in their relationship with the sponsoring institutionto test if the impact of contact mode is conditional on relationshipbetween respondents and the survey researchers. Contrary toprevious research, we find little differences in response ratesacross experimental groups.     

Change resistance moderates existence and longevity biases

Evidence has been found for existence and longevity biases—inferences of goodness from prevalence or longevity. We argue these biases actually emerge among change-resisting individuals. Our evidence suggests change-accepting individuals can even demonstrate a reversal of these biases. In two studies, change-resisting individuals’ attitudes were suggestive of existence and longevity biases while change-accepting individuals significantly reversed this pattern by evaluating long-standing or prevalent objects less favorably. Finally, we reanalyzed data from the existence and longevity biases literature previously reported in Social Influence. We found Americans identifying as more Republican—thus theorized as more change-resisting—were those who favored a long-standing practice. Altogether, we argue that existence and longevity biases emerge depending on individuals’ change resistance, indicating an important theoretical expansion.     

Investigating the impact of inquiry mode on self-reported sexual behavior: theoretical considerations and review of the literature

Measurement of sexual behaviors is typically reliant on retrospective self-reports of behaviors. Historically, self-reported sexual behavior data were primarily collected through face-to-face interviews or paper-and-pencil questionnaires, as these were the only modes of inquiry available. In recent decades, technological innovations such as telephones, computers, and the Internet have expanded the self-report inquiry modes available. The addition of these new inquiry modes further complicates the ability of sex researchers to evaluate the quality of research results and compare findings across studies. Self-report sexual behavior data are vulnerable to participation biases, as well as to sources of bias in individual responses, such as recollection and social desirability bias. This is true regardless of the inquiry mode being used, but some modes may be more vulnerable to bias than others. This review examines the available research regarding self-report sexual behavior research, inquiry mode, and relative bias across modes. The review also provides recommendations for advancing the current understanding of inquiry mode effects within sexual behavior research. Specifically, by shifting the focus away from evaluating specific modes of inquiry toward examination of factors common across all modes, researchers will be better able to interpret existing research and improve the designs of future studies as well.     

Measuring expectations of inflation: Effects of survey mode,wording, and opportunities to revise

Several national surveys aim to elicit consumers’ inflation expectations. Median expectations tend to track objective inflation estimates over time, although responses display large dispersion. Medians also tend to differ between surveys, possibly reflecting survey design differences. Using a nationally representative Dutch sample, we evaluate the importance of three survey design features in explaining observed differences: mode (face-to-face vs. web), question wording (‘prices in general’ vs. ‘inflation’), and the explicit opportunity to revise responses. We examine effects on item non-responses, revisions, reported inflation expectations and their deviation from the CPI inflation rate. We discuss implications of our findings for survey design.     

The effect of personalization on response rates and data quality in web surveys

Personalizing correspondence has often shown to significantly increase survey response rates in mail surveys. This study experimentally tests whether personalization of email invitations acts correspondingly to web survey response rates. Also, it is investigated whether personalization influences data quality. The results of the study, using a large student sample, show that personalization significantly increases the web survey response rate by 8.6 percentage points. The data quality does not appear to be affected in any major way by personalizing the email invitations. However, the analyses do show that respondents of the personalization condition tend to respond with more social desirability bias to sensitive questions. Therefore, it is concluded that personalization has positive effects on the survey response rate, but one should carefully consider whether or not to personalize when a survey on sensitive topics is conducted.     

The interplay of public and private spaces in internet access

The creation of public internet access facilities is one of the principal policy instruments adopted by governments in addressing 'digital divide' issues. The lack of plans for ongoing funding, in North America at least, suggests that this mode is regarded mainly as transitional, with private, home-based access being perceived as superior. The assumption apparently is that as domestic internet penetration rates rise, public access facilities will no longer be needed. Central to this issue are the varied characteristics of publicly provided and privately owned access sites and their implications for non-employment internet activities. What are the relative advantages and disadvantages of these two access modes? More fundamentally, how do people conceptualize public and private spaces and how does this perception influence their online activities? Finally, why do people choose one over the other, and how do they navigate between the two? This article attempts to answer these questions by drawing on data generated within the Everyday Internet Project, a 'neighborhood ethnography' of internet usage. It argues that the conventional view of private and public access facilities as immiscible, fixed alternatives is inadequate. Rather than 'pure' types, they are better understood as offering hybrid spaces whose identity and character are fluid, perceived differently by individuals in light of the activities being performed, life experiences, infrastructure and architecture. The picture emerging from our study is one where public and private access modes intertwine with each other in a variety of ways, their combination offering significant additional value for many users. From a public policy perspective, these findings suggest that if universal access is to be achieved, there is a continuing need for publicly supported broad-spectrum facilities with integrated technical support and learning opportunities, even if domestic penetration rates approach that of the telephone.     

Countertransference Bias: Self-Examination,Not Cross-Examination

ABSTRACT

In reply to T. Tippins (2007, this issue), we take issue with his claim that recognition of the biasing impact of custody evaluators' countertransference opens the door to “evidentially legitimate” fishing expeditions through evaluators' private lives on cross-examination. We clarify the distinction between self-examination for counter-transference bias as a heuristic for improving the sensitivity and objectivity of expert testimony and its use as substantive evidence. We argue that countertransference bias is a highly personal, emotionally charged kind of bias, unlike the cognitive biases more frequently discussed in the child custody literature. We conclude that recognition of the insidious emotional influences that threaten our objectivity in working with families in high conflict divorce is an important ethical responsibility.     

气密性生物安全实验室应对开关门的压差控制策略研究

目的研究气密性生物安全实验室（BSL）应对开关门的压差控制策略。方法理论分析开关门对实验室风量及压差的影响,并进行对比实验研究气密性实验室分别在有无人为附加漏风两种情况下开关门对实验室压差的影响。结果提出了实验室核心工作间与缓冲间分别采用变风量（VAV）、定风量（CAV）的压差控制与人为附加漏风相结合的综合控制策略。结论该控制策略可有效应对开关门对实验室压差稳定的干扰,并保证实验室的定向流。     

The effects of propensity score weighting on attrition biases in attitudinal,behavioral, and socio-demographic variables in a short-term web-based panel survey

Propensity score weighting often is used to correct for attrition biases in panel surveys. While methodological literature exists on the logic of propensity score weighting and its practical applications, an in-depth discussion is lacking on the effects of using this weighting to correct for attrition biases in attitudinal, behavioral, and socio-demographic variables. By applying a split panel design, we assessed the effects of weighting on attrition biases in 48 attitudinal, 38 behavioral, and 27 socio-demographic variables. Our findings suggest – while acknowledging the estimate-specific nature of bias – first, that biases vary across these types of variables and second, that the effects of propensity score weighting are not homogeneous across the types. Accordingly, a sole reliance on socio-demographics to evaluate attrition in the present panel survey would have resulted in an underestimation of the biases of attitudinal variables and an overestimation of the ability of weighting to cure the negative effects of attrition in behavioral variables.     

Integrating psychometric and cultural theory approaches to formulate an alternative measure of risk perception

Psychometric and cultural theory are key approaches used to explain risk perceptions. However, both approaches explain only 20 and 5–10% of the variance of risk perceptions, respectively. Through advances in social psychology, terror management theory revealed that certain survey questions used in the psychometric approach primed thoughts of death. Such unintentional priming evoked defense mechanisms that would subconsciously activate participants’ cultural biases and values when answering some questions but not others. There are two implications: one, psychometric theorists need to modify their questionnaires to reduce the incidence of priming thoughts of death; and two, integrating the psychometric and cultural theory approaches may potentially explain a higher amount of variance in risk perceptions. Specifically, attitudes (psychometric approach), demographics, affect and past behavior collectively influence cultural biases, which in turn exert an effect on risk perception. However, such a model calls for an appropriate measure of the dynamic nature of cultural biases that current attitudinal measures fall short of. Drawing from methodology within industrial/organizational psychology, the Situational Judgment Test (SJT) is proposed as an alternative measure for risk perception. Steps to designing an SJT are outlined and followed through to culminate in a 10-item SJT that measures cultural biases.     

Factors affecting the organizational responses of employers to workers with injuries

The organizational responses of employers to work-related injuries is one of several significant influences on return-to-work outcomes. Thus, understanding the factors that lead to better or worse organizational responses to work injuries may ultimately help to improve success in this area. The purpose of this study was to systematically explore factors that might influence the organizational responses of employers to injured workers, based on employee perceptions. Cross-sectional survey data were collected from 2,943 subjects with work-related injuries which had occurred less than eight weeks prior to survey completion. Measured variables included pre-injury demographic and job factors, injury circumstances, and a measure of post-injury events that comprised the organizational response. Multivariate linear regression results show that age, gender, job dissatisfaction before injury, prior difficulty performing job tasks, injury severity, back injury and lost time were all associated with negative organizational responses, suggesting potential opportunities for intervention.     

An experiment to test the feasibility and quality of a web-based questionnaire of teachers

The use of web-based surveys to gather information from teachers has become increasingly common primarily based on the premise that they can reduce costs. Yet, relatively, little is known about the quality or cost effectiveness of web-based versus mail surveys for teachers. To study the efficacy of web-based teacher surveys, the author randomly assigned a nationally representative sample of 877 elementary school teachers to a paper or web survey mode. The cost savings from the web administration were not enough to offset the loss of sample due to missing/inaccurate email addresses and the lower response rates that resulted from the web survey.     

Cultural Capital of Recruitment Decision‐Makers and its Influence on their Perception of Person‐Organisation Fit of Skilled Migrants

This article examines how recruitment decision‐makers’ cultural capital can influence their concerns about the organizational fit of skilled migrants (SM). We used survey data and interviews with Information Technology organizations in Australia. The study highlights the decision‐makers’ relatively poor understanding of non‐western cultures and how it negatively influences their perception of candidates from non‐western backgrounds. Furthermore, this study also notes how organisational cultural values and decision‐makers’ exposure to diverse cultures can influence their assumptions about the value of international qualifications and work experiences. Similarly, it can also influence how they assess the perception of fit based on a candidate's appearance and communication style. Consequently, the cognitive biases and judgements of resource acquisition managers can act as gatekeepers who keep non‐western SM out of the organizational resource pool. The article concludes by noting the importance of human resource practices that seek to develop cultural capital of decision‐makers.     

RESPONSE RATES AND RESPONSE CONTENT IN MAIL VERSUS FACE-TO-FACE SURVEYS

Two surveys were administered based on the same area probabilitysampling frame and with some of the same questions: one samplewas used for hour-long face-to-face interviewing in the 1992Detroit Area Study; the other sample received a much shorterquestionnaire in the mail for sell-administration. The samplesegments had previously been stratified in terms of the percentagethat was black. For the predominantly white stratum, there wasonly a small difference in response rates due to mode of administration.For the predominantly black stratum, the mail survey obtaineda considerably lower response rate then the face-to-face survey.Within the predominantly white stratum, there were no cleardifferences between results for the two modes of administrationin demographic variables or in gross housing characteristics.However, the mail survey respondents expressed more negativeattitudes toward racial integration and affirmative action thandid the face-to-face respondents. Because the mail sample ofthe predominantly black stratum was small, it was not possibleto carry out similar analyses of demographic or attitudinaldifferences, or to determine whether its lower response ratewas due mainly to race, to correlates of race such as incomeor education, or even to problems with mail delivery in centralcities.