The accuracy and biases of diary communication data

A study to determine the accuracy and reliability of telephone communications data obtained via self-recording diaries was undertaken. The methodology involved comparing data obtained from the diaries to the more objective data provided by the recording capabilities of a PBX (Private branch Exchange). Two questions formed the basis for the analysis. First, what is the level of accuracy of diary data, and, second what biases are inherent in data obtained from self-recorded diaries. The findings indicate that diary data significantly understate the actual frequency of communications. There were also several biases inherent in the diary data. One involved a significant understatement of very short communications (i.e. those lasting less than 90 seconds). The others showed an under-recording of received calls and a likelihood to record internal rather than external cals. The conclusion drawn is that in the absence of objective data (i.e. data obtained from machine recording) diaries can provide usable data as long as one pays attention to the biases inherent in their use.     

Capturing daily family dynamics via text messages: development of the mobile diary

In this paper we introduce a new tool, the mobile phone, for use in diary research. We demonstrate, with reference to two family studies conducted in Finland, how daily family dynamics can be captured by using the mobile diary. In both studies family members sent text messages (SMSs) in answer to structured diary questions three times a day over a one-week period. The participants kept also paper-and-pencil diaries. Two mobile diary items measuring mood (stressfulness and feelings of competence) both at home and at work are reported here as examples. For both items we found statistically significant daily and weekly variation as well as individual fluctuation. The data gathered by the mobile diary were congruent but not identical with the data gathered by the paper-and-pencil diary. The mobile phone method of data collection facilitated participants’ answers at the agreed times and the participants reported that answering was easy and did not take too much time. The main limitation is the lack of space for answers; therefore, the few questions that are used have to be reliable and valid.     

An evaluation of the use of diaries in a study of medication in later life

This paper is based upon our experience of commissioning diaries to be kept by research subjects. First the paper reviews some previous research based on diaries, then it outlines the aims of our research and the method of data collection. Then the paper goes on to evaluate the design and use of a diary that participants in our research completed. In particular we consider the ways in which the diary may have biased our sample, caused the participants difficulties and generated poor data. There is also a discussion on how it may have affected behaviour and on the ethical issues that are raised by commissioned diaries. In conclusion, observations are made about the strengths and weaknesses of diaries as an investigative tool with a wider applicability. The diary proved particularly revealing and we recommend that other researchers consider diaries as a method of investigating everyday life.     

Sexual Assault Risks Among Gay and Bisexual Men

The goal of this study was to examine lifetime patterns of sexual assault and associated risks among a purposive sample of gay and bisexual men (N = 183; 18 to 35 years old, M = 24.3). Cross-sectional data were collected via written, self-administered questionnaires and face-to-face, event-based qualitative interviews. Alcohol severity scores indicated high rates of hazardous drinking (53.0%) and possible dependence (14.2%) among participants. One-half of men (50.8%) reported childhood sexual abuse (CSA), and 67.2% reported adult sexual assault (ASA). Average age at most recent ASA was 21 years. Most perpetrators (83.9%) of recent ASA incidents were male; 67.0% of participants reported consuming alcohol and/or drugs prior to the most recent incident. Regression findings indicated more severe CSA experiences and past alcohol-related problems predicted recent severe ASA. Although we found similarities between gay and bisexual men in lifetime sexual assault history, we found some distinct differences in ASA risk factors. Bisexual men reported higher alcohol severity scores, more female ASA perpetrators, higher internalized homophobia scores, and fewer male sexual partners than gay men. Findings suggest the need for interventions that reduce ASA risk among sexual minority men—and the potential benefits of focusing on alcohol consumption in risk reduction efforts.     

Using smartphones to collect daily sexual behavior data from college students

ABSTRACT

Objective: Our objectives were to measure reporting differences between sexual behavior data from daily diary and retrospective estimates and to assess the utility of using smartphones to collect sexual behavior data from a college student population. Participants: Eighty-six participants (68 women, 18 men) completed the study. Methods: For 30 days during the Spring 2017 semester, participants received prompts to participate in daily diaries about their previous day's sexual behavior on their smartphones. Participants then retrospectively reported their past 30 days of sexual behavior and provided feedback on the process of receiving daily diaries on their smartphones. Results: We found that college students overreported their sexual behavior on the retrospective survey compared to their daily diary reports (ps < .001; Cohen's ds ≥ 1.51). Participants provided positive and constructive feedback. Conclusions: Using smartphones to administer daily diaries is a promising technique for obtaining reliable sexual behavior data from college students.     

Effects of method on participants and disclosure rates in research on sensitive topics

This study replicates and extends the research of Rosenbaum, Rabenhorst, Reddy, Fleming, and Howells, which also appears in this special issue. Responses from 398 randomly assigned participants regarding differentially sensitive topics were collected via four methods of data collection: written questionnaires, face-to-face interviews, telephone interviews, and an automated telephonic data collection system (ATDC). Several significant differences in data collection methodology and topic area were found, including greater disclosure of sensitive information via the ATDC system than via face-to-face and paper-and-pencil conditions. Participants who were assigned to the ATDC condition felt significantly more comfortable answering questions compared to those in the face-to-face interview condition. Participants in the telephone interview condition reported answering significantly more carefully than participants answering via written questionnaire. Taken together, the results of this study and the previous one it replicates suggest that the ATDC produces disclosure rates that are at least equivalent to, if not greater than, those generated using traditional methods for collecting sensitive data.     

Effects and Costs of Tracing Strategies on Nonresponse Bias in a Survey of Workers with Low-Back Injury

Declining rates of participation are an increasing challengefor studies that involve telephone surveys. This study examinedthe costs of a telephone survey methodology that used increasinglyintensive tracing methods to track a pool of claimants who hadsustained occupational back injuries. It also compared the respondentsample to people who refused the survey and/or were not locatedor contacted. 3,181 claimants were drawn from a database maintainedby the Missouri Division of Workers’ Compensation (DWC)and 1,475 completed a telephone interview. The DWC databaseprovided data reflecting monetary and disability outcomes forall potential participants; telephone interviews provided additionalself-reported data. More intensive tracing strategies improvedthe representativeness of the sample, yielding more women andminority participants. Relative to less intensive techniques,advanced tracing efforts located people whose DWC records weremore similar to claimants not located. While the hands-on tracingefforts reduced the apparent bias of the respondent sample,costs increased as tracing strategies intensified – over$98,000 was spent to trace 1,027 claimants who were never locatedor contacted. The results suggest some guidelines that may facilitatedecision-making for researchers and funders who must balancethe trade-off between costs and nonresponse bias when planningsurveys.     

A comparison of the reliability of questionnaire versus diary data

The crucial role that communication plays in organizations has led to the development of various methodologies to collect communications data. Two of the more common techniques are one-shot questionnaires and self-recording diaries completed at the time of the interaction. Questionnaires are often viewed as unreliable since they are based on the memory and perceptions of the participants. Diaries, on the other hand, are considered to be more reliable since they are completed immediately following an interaction when the event is still fresh in the individual's mind. This paper compares the cross-recorder reliability of these two data collection instruments. A reliability measure which indicates the degree to which an individual concurs as to the occurrence of interactions across all individuals is introduced. The results, based on studies in three organizations involving 49, 61 and 110 participants respectively, indicate that diary data are significantly more reliable than data obtained from questionnaires.     

Peer connections as an intervention with children of families where a parent has a mental illness: Moving towards an understanding of the processes of change

Prevention and early intervention programmes have been found to impede the transmission of mental illness from parents to children. However, the extant processes of change in such programmes are less clear. This study focuses on the impact of a peer support programme developed for children and adolescents who have a parent with a mental illness and examines the processes of change which might promote positive outcomes for youth. A mixed methods research approach was employed with participants aged between 8 and 12 years old; 69 completed pre- and post-questionnaires and 18 of these same participants engaged in telephone interviews post programme. Results demonstrate improved mental health knowledge and children reported that they were more likely to use an anonymous telephone helpline after attending the programme. Children indicated that the programme provided a place of respite from caring for their parent with a mental illness, an opportunity to connect with peers, and a positive change in perception of their parent's mental illness. The reported findings are moving towards an understanding of the process of change in programmes.     

Drinking Game Participation Among Undergraduate Students Attending National Alcohol Screening Day

Abstract

Objectives, Participants, Methods: Drinking game participation has increased in popularity among college students and is associated with increased alcohol consumption and alcohol-related problems. The current study investigated drinking game participation among 133 undergraduates attending National Alcohol Screening Day (NASD) in April of 2007. Results: A large percentage of the sample reported lifetime (77%) and recent (52%) drinking game participation. Males were more likely to report recent participation and reported higher levels of consumption while playing drinking games. Drinking game participants were more likely to experience a range of alcohol-related problems, and the relationship between drinking game participation and alcohol-related problems was mediated by weekly alcohol consumption. Conclusions: These results suggest that drinking game participation is a risk factor for elevated levels of alcohol consumption and alcohol-related problems. Programs should be developed to educate students about the risks of drinking game participation, and prevention programs like NASD should address drinking games.     

Monitoring youth behavior in response to structural changes. Alternative approaches for measuring adolescent drinking

Random digit dial (RDD) telephone and self-administered school-based surveys of drinking and drinking and driving were compared for adolescents from two Northern California communities. The RDD and school-based surveys resulted in very different samples. The telephone sample contained a greater proportion of European Americans and a smaller proportion of Asian Americans and "other" ethnicities. Respondents to the telephone sample also tended to be older and of higher socioeconomic status (SES). The telephone survey captured very few school dropouts. Moreover, it resulted in lower self-reports of drinking and drinking and driving. Survey mode appeared to influence respondents equally, regardless of their gender, age, ethnicity, or SES.     

EFFECTS OF INTERVIEW MODE ON SELF-REPORTED DRUG USE

The effects of interview mode on 18- to 34-year-olds' self-reportedtobacco, alcohol, marijuna, and cocaine use were investigated.RDD telephone and personal drug use surveys of the state ofNew Jersey were conducted in 1986–87. In the personalinterview, respondents recorded their drug use on self-administratedanswer sheets. Compared to the area probability sample in thepersonal interview, RDD yielded a sample of blacks higher inincome and education, and more likely to be married and currentlyemployed; white SES was also higher in the telephone sample,but to a lesser degree than for blacks. Controlling for demographiccharacteristics and RDD's exclusion of non-telephone households,the telephone survey yielded significantly lower estimates ofblacks' alcohol consumption, and lifetime and recent marijuanause. Whites' alcohol consumption was slightly lower by telephone;otherwise, estimates of whites' use of the four substances werenearly identical in the two modes. Sample coverage, respondentdemographic characteristics, and racial matching of interviewerand respondent did not account for the significant mode differences.Characteristics of the interview situation itself, such as provisionof privacy in the self-administered format, may have influencedtendencies toward socially desirable responding to a threateningtopic such as drug use.     

Managing chronic conditions in college: Findings from prompted health incidents diaries

Objective: This pilot study assessed an electronic health diary method designed to collect data about critical health incidents experienced by college students who have chronic health conditions. Participants: Nine university students with chronic medical conditions were recruited to complete a series of e-mail–based surveys, sent once every 3 days across the fall 2014 semester. Methods: In each survey, participants described a health-related incident that occurred within the past day and cited resources that helped or could have helped in that situation. They completed follow-up interviews and ranked the importance of cited resources. Results: The diary completion rate was 78.3% (141/180). Most frequently affected management areas were activities (61.3%), monitoring (34.9%), and problem-solving (34.3%). Resources considered helpful included situational knowledge, campus health professionals, peer support, and relaxation opportunities. Conclusions: Prompted health incidents diary method achieved a high completion rate and provided data that could be useful for college health researchers and practitioners.     

Associations Between Physical Activity and Health-Related Factors in a National Sample of College Students

Abstract

Objective: To examine associations between meeting the current moderate to vigorous physical activity (MVPA) recommendation and health-related factors in a national sample of college students. Participants: Participants (N = 67,861) completed the National College Health Assessment II during the Fall 2008/Spring 2009 academic year. Methods: Hierarchical binary logistic regression was used to examine the contribution of 19 variables in explaining whether or not participants met the MVPA recommendation. Results: Meeting the MVPA recommendation was associated with several protective factors among college students, including adequate daily fruit and vegetable consumption, positive perception of general health, healthy body mass index, consistent seatbelt use, not smoking cigarettes, less perceived depression, and adequate sleep. In addition, meeting the MVPA recommendation was also significantly associated with a few risky behaviors including binge drinking, physical fighting, and multiple sexual partners. Conclusions: College student PA interventions should consider also addressing fruit/vegetable consumption and binge drinking.     

Assessment of Cigarette Smoking and Smoking Susceptibility among Youth: Telephone Computer-Assisted Self-Interviews versus Computer-Assisted Telephone Interviews

This experimental study assesses the effect of two survey methods,telephone audio computer-assisted self-interviewing (T-ACASI)and computer-assisted telephone interviewing (CATI), on self-reportsof smoking behavior and smoking susceptibility among adolescents12–17 years of age in California. In T-ACASI, participantslisten to prerecorded, computer-controlled questions and respondby pressing the keypad on a touch-tone telephone. In CATI, interviewersadminister the questions and enter responses into a computer.Prior research suggests that youth may be more likely to reportsensitive behaviors in a self-administered survey like T-ACASIcompared to an interviewer-administered survey like CATI, dueto greater perceived confidentiality. Logistic regression analyseswere conducted on unweighted data, controlling for demographicdifferences. Adjusted estimates of current smoking (past 30days) were significantly greater in T-ACASI (8.3 percent) thanCATI (4.5 percent). Smoking susceptibility (i.e., lack of afirm commitment not to smoke among those who have never smoked)was also greater in T-ACASI (45.0 percent) than CATI (34.9 percent).In both surveys, social desirability response bias was negativelyassociated with smoking, which suggests that response bias wasproblematic for both modes. Many respondents reported that aparent was present during the interview (59.4 percent in CATI;42.0 percent in T-ACASI). In both surveys, parental presencewas negatively associated with smoking, which suggests thatthis factor could also contribute to underreporting. Applicationof sample weights to the data eliminated the survey mode effects;however, the CATI current smoking estimate (9.3 percent) fromthis study was significantly less than an estimate (14.2 percent)obtained from a self-administered, school-based survey conductedthe same year on California adolescents.     

Unhealthy behavior clustering and mental health status in United States college students

Abstract

Objective: Examine the association of health risk behavior clusters with mental health status among US college students. Participants: 105,781?US college students who completed the Spring 2011 National College Health Assessment. Methods: We utilized the latent class analysis to determine clustering of health risk behaviors (alcohol binge drinking, cigarette/marijuana use, insufficient physical activity, and fruit/vegetable consumption), and chi-square and ANOVA analyses to examine associations between the class membership and mental health (mental health diagnoses, psychological symptoms, and self-injurious thoughts/behaviors). Results: Three classes were identified with differing rates of binge drinking, substance use, and insufficient physical activity but similar rates of insufficient fruit/vegetable consumption. Students classified with the highest rates of binge drinking and cigarette/marijuana use had the highest rates across all mental health variables compared to other classes. Conclusions: Students who reported engaging in multiple health risk behaviors, especially high alcohol and cigarette/marijuana use, were also more likely to report poorer mental health.     

Upward contacts in everyday life: Benefits of reaching hierarchical relations in ego-centered networks

Recent studies have inspired inquiries about what circumstances allow people to gain from interactions with those who rank higher than themselves in the social hierarchy. We examine how self-reported benefits of such upward contacts vary by tie strength and network structures in everyday life. Data were drawn from contact diaries that 137 individuals recorded over seven months in 2014; these diaries captured unique features of 94,353 one-on-one contacts that 137 diary keepers made, along with the estimated tie strength and the extent of embeddedness among network members. Multilevel models with interaction terms show that diary keepers benefit from contacts with people who play higher hierarchical roles and that the benefits become more substantial when the higher-ranked others are weakly tied to the diary keepers and connected with fewer fellow network members. The paper extends contact diary studies to estimate alter-alter ties that help construct comprehensive structures in egocentric networks.     

Institutional child protection: issues in program development and implementation

As part of a comprehensive inventory of state institutional child protection programs, state protective services offices were surveyed by telephone, self-administered questionnaire, and site interviews regarding the policies, procedures, and protocols of each for handling complaints of abuse and neglect in children's institutions.     

Weak ties and contact initiation in everyday life: Exploring contextual variations from contact diaries

This study examines how the significance of weak ties varies by contact initiation and purposes of contact in everyday life. Based on data from 55 contact diaries, we analyze the extent to which diary keepers judge each of 104,361 specific contacts as beneficial after they occur, by how well they knew the target person beforehand. Our hypothesis testing and bootstrap resampling show that when a diary keeper initiates a contact, weak ties result in more gains. In contrast, when the other party starts the contact, it is strong rather than weak ties that turn out to be more beneficial to the diary keeper. Such effects vary by other contextual factors, however, particularly the purposes of contacts.