Time matters: the potential and pitfalls of using mixed methods approaches in longitudinal program evaluation

While social programs are often assessed using short-term impact studies, longitudinal designs allow evaluators to capture change over time, identify longer-term outcomes, adapt instruments, and better understand participants in transition. A mixed methods design can be critical in understanding these dynamics; yet there is a lack of literature exploring the practical considerations of planning and conducting qualitative and quantitative data collection and analysis within longitudinal studies. This paper examines two different mixed methods frameworks used in a 5-year evaluation of three youth entrepreneurship programs in East Africa. We show how the evaluation team dealt with unique challenges across methods and over time, and how the design ultimately facilitated a richer understanding of program impacts and processes. Considerations for conducting this type of study are explored, related to the impact of longevity on analysis and research staff. Successfully using a longitudinal mixed methods approach requires researchers to be strategic and reflexive, and work in close collaboration.     

Examining the Student's Decision to Pursue a Joint Graduate Degree Program in Social Work and the Law

In response to economic and educational trends, an increasing number of American universities are offering joint graduate degree programs in social work and the law. However, little is known about what drives a student to pursue study in these programs. This research study involved qualitative interviews with nine students in the United States either currently enrolled in a joint degree program in social work and law or who considered the joint degree program, but chose a single degree program instead. Interviews focused on what factors drew students to, or deterred students from, dual matriculation. Grounded theory analysis was used to identify themes across interviews. The findings can inform development of new joint degree programs in social work and law, as well as guide improvement of recruitment and retention practices for existing programs.     

Investigating the impact of inquiry mode on self-reported sexual behavior: theoretical considerations and review of the literature

Measurement of sexual behaviors is typically reliant on retrospective self-reports of behaviors. Historically, self-reported sexual behavior data were primarily collected through face-to-face interviews or paper-and-pencil questionnaires, as these were the only modes of inquiry available. In recent decades, technological innovations such as telephones, computers, and the Internet have expanded the self-report inquiry modes available. The addition of these new inquiry modes further complicates the ability of sex researchers to evaluate the quality of research results and compare findings across studies. Self-report sexual behavior data are vulnerable to participation biases, as well as to sources of bias in individual responses, such as recollection and social desirability bias. This is true regardless of the inquiry mode being used, but some modes may be more vulnerable to bias than others. This review examines the available research regarding self-report sexual behavior research, inquiry mode, and relative bias across modes. The review also provides recommendations for advancing the current understanding of inquiry mode effects within sexual behavior research. Specifically, by shifting the focus away from evaluating specific modes of inquiry toward examination of factors common across all modes, researchers will be better able to interpret existing research and improve the designs of future studies as well.     

Making choices in my life: Listening to the ideas and experiences of young people in the UK who communicate non-verbally

Service user participation and making choices are frequently advocated, however, they are complex concepts and how they are translated and/or experienced in everyday life can vary amongst different groups of service users. Recognising the importance of participation in current international guidance and UK government policy this paper seeks to explore how research can include a frequently marginalised group of disabled young people, in particular young people with learning disabilities and/or who communicate non-verbally. The paper discusses the use of non-traditional research methods, especially symbol based interviews developed in an ongoing English longitudinal study exploring choices and decision-making processes for young people with life-limiting conditions. The paper then presents some research findings and concludes by discussing their implications. In particular, it demonstrates how the use of symbol based interviews can inform policy makers about how these young people can be included in research and that listening to them can inform our understanding of decision-making processes.     

Social support networks,instant messaging,and gender equity in refugee education

ABSTRACT

This paper addresses the role of instant messaging chat groups to support teacher training and gender equity initiatives in Kenyan refugee camps. Our findings are based on survey data with refugee teachers in Dadaab and Kakuma refugee camps (n?=?203), group interviews with refugee teachers in Kakuma (n?=?21), and interviews with international instructors of teacher training programs in Nairobi, Toronto, and Vancouver (n?=?14). In our analysis, we apply amplification theory, feminist science and technology studies paradigms, and considerations of transnational approaches to understand the use of instant messaging among refugee teacher communities. Our framework explores how social and cultural norms are amplified through transnational text and instant messaging related to teacher training and in support of gender equity. Peer-to-peer group chats draw on transnational learning opportunities and expand these engagements through group chats between men and women refugee teachers across camps as well as through community engagement about gender equity initiatives in education. International instructors identify both value and hesitation in navigating the quantity and content of these communications, such as learning more about refugee teachers’ daily lives in the camps and concern about following and managing the amount of communication that can ensue over chat groups. Our work has practical implications for transnational teacher training programs in refugee camps, illuminates how mobile technology and chat groups allow women and men in the community to engage and support girls’ education, and questions how text messaging affects the lived and day-to-day experiences of women refugee teachers.     

Faith-Based Programs and the Role of Empirical Research

Abstract

After some decades of being subject to neglect or contempt, faith-based social care programs are receiving increased attention and resources enabling them to undertake a greater role in the national network of human services. Faith-based programs receiving public support can expect to be rightly scrutinized by the public, in terms of their ability to attain professed program goals. The tools of conventional empirically-oriented program evaluation research have tremendous potential to help demonstrate the effectiveness of faith-based programs, which will justify their receipt of ongoing support from public funds. Negative research findings can be properly scrutinized by the faith-based community of service providers to help make tough, data-based, decisions on funding priorities. Several examples are described, illustrating how various types of faith-based programs have profitably participated in program evaluation studies.     

Hidden boundaries and shared meanings: the roles of researcher characteristics and cultural norms in shaping understandings of sexuality in the unstructured interview setting

This paper examines the role of the research process in shaping the construction of knowledge about sensitive topics in in-depth interviews particularly with regard to researcher identity and cultural influences or norms. We argue that these influences shape all aspects of the research process and that researchers will benefit from reflecting upon them when planning, undertaking and interpreting qualitative studies. Drawing on an empirical study interviewing Australian women aged 55 years and older about sexuality we address differences and similarities between researchers and participants; cultural constructions of sexuality and ageing, and generational influences. Using examples from our interview data we interrogate the contribution of each of these aspects to the interview dynamic and the co-production of meaning. Our analysis draws attention to the fluidity of insider and outsider status and to the existence of hidden boundaries that impact on how certain topics can be discussed in interviews. The paper argues that knowledge about sensitive topics such as older people’s sexuality must be viewed as a situated occurrence shaped by the particularities of the interview and the cultural context. Finally, we discuss the implications of these findings for qualitative inquiries into sensitive topics.     

Environmental stewardship footprint research: linking human agency and ecosystem health in the Puget Sound region

Urbanization processes challenge ecosystem health in many metropolitan areas. New policy and program approaches are needed to restore and sustain natural systems as public agencies and organizations face greater demands and declining budgets. Environmental stewardship is an often overlooked intervention strategy, and the full potential of civic engagement by citizens on behalf of ecosystem health is little understood. Using a coupled systems approach, integrated analysis of social and ecological footprints can lead to greater theoretical understanding and more effective programs at the landscape scale. Here we outline two pilot studies as part of an emergent research program that is investigating the extent and impact of environmental stewardship. Qualitative interviews of stewardship managers revealed multiple dimensions of motivations and purposes for stewardship, ranging from the practical to the conceptual. A regional organization census yielded a surprisingly large number of organizations that conduct stewardship, with social and ecological values being of comparable emphasis. The initial research is based in the Puget Sound area of Washington State, U.S., but results have relevance to other urban areas. Pilot study findings now guide additional research effort about motivations, organizational networks, and theory of integrated socio-ecological systems to be derived from comprehensive footprint analysis of stewardship activity.     

The importance of volitional narrative in treatment: An ethnographic case study in a work progran

The revised theory of the model of human occupation expands the concept of volition to include volitional narrative. This paper focuses on the application of this theory of volition to a client's experience in a work program. This ethnographic case study describes the volitional narrative and life world of one client who attended the occupational therapy work based program. For fifteen months the client was the subject of narrative interviews, participant observation, videotapes and telephone contacts. The findings will illustrate how knowledge of a client's volitional narrative and life world can shed critical light on understanding treatment conflicts. Finally, the discussion will underscore how important it is for work based programs to be designed to encourage therapists to adapt their treatment approaches to maximize the opportunities to seek out the client's volitional narratives and to create meaningful experiences that are consistent with the client's life world.     

The Five Cs of Positive Youth Development: Configurations of Thriving in Four U.S. Adolescent Samples

Positive youth development (PYD) models are widespread, but the empirical evidence for them is primarily nomothetic (i.e., investigations of universal patterns). Contemporary developmental theory suggests that concepts and processes within PYD models should also be explored with respect to specificity. This study demonstrates how the Five Cs Model, a predominant PYD model, can be advanced using group-differential methods. Secondary data from four studies of adolescents were used to test: (1) Whether there were subgroups who varied in their patterns of scores across the Five Cs, and (2) Whether subgroups also varied in Contribution behaviors. Unexpectedly, the four data sets used could not be combined, yielding an opportunity to discuss consistencies and inconsistencies in findings across the four data sets through contextual and sample differences. Findings demonstrate how understanding specificity in theorized concepts and processes in PYD models can complement studies of universal patterns, which are both necessary to advance PYD research and practice.     

EMPLOYERS' USE OF JOB HISTORY DATA FOR MAKING HIRING DECISIONS:

Most research on occupational assignment has concentrated on characteristics of job seekers that presumable signal positive labor market information to employers. Foremost among these have been educational credentials and years and type of work experience. In many cases, though, employers seek indicators that can provide them with negative information about a candidate's prospects for successful job performance; they frequently construct screens that enable them to easily disqualify candidates. Case studies of six Chicago organizations identified six components of "job history data' used by many employers to screen out otherwise acceptable candidates: job hopping, absences from work, latenesses to work, periods of unfilled time, reasons for leaving past employers, and past wage rates. One or more of these items are often consequential in employer hiring decisions. The implications of these findings for a more detailed understanding of status attainment and job assignment are discussed, as well as how research in this area might proceed.     

Teaching, research, and service: Expectations of assistant professors

In this article, we critically evaluate the expectations of assistant professors as perceived by junior and senior faculty (n=22) across seven disciplines at two universities. Our research shows that there are similarities and differences within Sociology departments, across disciplines, and across the teaching and research schools where we collected our data. In one respect, Sociology is no different than the other departments where we interviewed faculty members—ambiguity abounds in terms of expectations for junior faculty. Scholarship expectations for tenure and promotion to associate professor vary much more greatly across rank, discipline, and institution than do those for teaching or service. Based on our findings, we offer several suggestions for improving the transition to the role of Assistant Professor in Sociology. Our suggestions focus on change within graduate programs, hiring institutions, and Sociology as a discipline. While our results are consistent with prior research in many cases, we note that the generalizability of our findings is limited given the number of interviews conducted and the purposive sampling design utilized. However, we hope that our results will provide additional information that may help others as they prepare to begin their roles as assistant professors.     

Single Mothers with Custody Following Divorce

The experience of being a single mother with custody following divorce is influenced by many variables across several levels of interaction, such as age of mother and child, potential for remarriage, coping skills, social networks and income changes. Cross-sectional studies have examined additional variables such as time since divorce and level of family religiosity and subsequent impact on individual well-being. Whereas most studies took a cate- gorical approach to examining the experience of divorce, a few refreshing studies were based on an ecological systems model. As divorce also involves building a new life, longitudinal research pro- vides the best picture of how divorced women accomplish this task. Long-term research clearly points to the fact that divorce is an event whose impact is individual and very often life long. Researchers have provided valuable information to build meaningful programs of intervention for divorced mothers. Perhaps the biggest challenge is to design flexible programs which can grow and change with the needs of the divorced mother. Future research will be most beneficial when it addresses the divorced mother family as a healthy family unit.     

Megachurch involvement at the local level: Examining conditions for church action in economic development

The roles of small congregations and their social impacts are well known, but few theoretical studies investigate megachurch congregations. These mammoth organizations have the potential for advancing social good, but minimal research specifically focuses on the activities of these congregations in economic development (ED). This study addresses this dearth of information by answering the following research questions: (a) In what ways are megachurches involved in ED activities? (b) Who benefits from these programs and how are the programs offered? and (c) What factors influence megachurches to offer ED activities? We frame our investigation using both demand‐ and supply‐side arguments from Frumkin's (2002) model of nonprofit and voluntary action. Online survey data and follow‐up interviews with 42 megachurch leaders in the Dallas/Fort Worth and greater Houston areas show that megachurches are implementing ED activities in alignment with demand‐side explanations, especially when advancing opportunities for the unemployed and underemployed. However, supply‐side arguments provide more explanatory power, indicating that volunteer engagement with ED activities plays a significant role in the provision of ED services through megachurches. Our study offers a better understanding of why megachurches carry out ED activities with considerable attention devoted to how megachurches partner with other congregations, nonprofits, and government entities to encourage economic growth and improve the economic well‐being of community members.     

Friendships with benefits? Examining the role of friendship in semi-structured interviews within music research

This article explores the ‘methodology of friendship’ and its wider potential within music research. Drawing on two research examples that made use of ‘friendship’ in distinct fashions – one that explores music listening practices in everyday life and the other, music as a site for racialisation – the article discusses how friendship can be incorporated within semi-structured interviews. The case studies act as examples of how to negotiate alterity in music research and how friendship represents a potential for gathering more detailed data. The notion of ‘alterity’, at the core of research relationships is critical to shift the conversation to an informal tone and improve the depth of the discourses gathered from informants. Consequently, this article addresses debates within qualitative (music) sociology by reconsidering friendship as an axis of power and examines the nature of the data gathered in semi-structured interviews through the methodology of friendship.     

Great walls over African rivers: Chinese engagement in African hydropower projects

Recent acceleration of Chinese engagement in African hydropower is attracting increasing attention and concern. Yet there is scant research and little reliable data on this engagement. This article analyses Chinese hydropower engagement based on a new, verified dataset. We examined over 100 projects reported by the media and lists compiled by other organizations, amassing case studies for each project using desk research, interviews and field visits. We demonstrate that Chinese engagement in African hydropower is often overestimated in both numbers and value. Further, misunderstanding and myths abound regarding Chinese financing and construction practices. This evidence‐based understanding provides a firmer foundation for advocacy, research and efforts by other companies and funding agencies to co‐operate with Chinese actors in this controversial sector.     

Exploring the Development of Professional Identity with Newly Qualified Social Workers

This paper discusses the experiences of newly qualified social workers as part of a research project exploring professional identity. Drawing on literature in this area and a subset of data from a larger study involving Australian practitioners, it is argued that while several studies explore experiences of identity, the phenomenon remains under-researched, especially in Australia. Seventeen people participated in three in-depth, semistructured interviews across a 12-month period. A subset of the data explores how participants were actively motivated and benefitted from reflecting on their identities through the research process. Findings indicate newly qualified social workers appreciate meaningful opportunities to critically reflect upon their social work identities. It is concluded that further research is needed, to understand the identities and needs of newly qualified social workers in Australia.     

Growing with youth: A lifewide and lifelong perspective on youth-adult partnership in youth programs

Youth-adult partnership (Y-AP) shows promise for positive youth development, yet research seldom examines how youth programs employ Y-AP as a developmental practice. This paper provides a developmental ecological perspective on Y-AP in programs and communities with data collected across a mid-sized city. In Study 1, interview data suggest adult practitioners hold three distinct goals for Y-AP: voice, decisionmaking, and leadership. We identify program practices for carrying out YAP including building positive adult-youth relationships, engaging youth in first-hand learning, and addressing developmental progression; i.e., gradually increasing opportunities and responsibilities as youth age. In Study 2 we investigate this practice of supporting developmental progression with a case study focused on adolescent opportunities and supports in a multi-age program. Study 2 findings present a picture of YAP opportunities highly integrated into program operations; in particular, integrated into the multiage context. These studies offer insight into strengthening program and community capacity for Y-AP.     

“I didn’t raise a d#@k!” How parents perceive and address gendered bullying with children

This is an exploratory study that uses a critical feminist approach to examine how parents perceive and respond to gendered bullying with children. Past research conceptualizes bullying from a feminist perspective and previous studies examine how parents perceive bullying. This study moves beyond earlier investigations by integrating these sites of inquiry. The author engages five fathers and eight mothers to participate in this study (n = 13). Data collection includes semi-structured individual interviews and the data analysis is based on a critical feminist approach to phenomenological inquiry. The data analysis shows how the majority of parents, in this study, do perceive and address bullying from a critical feminist perspective, in particular, according to three categories: (a) challenging binary thinking b) understanding identities/positionalities and c) perceiving/addressing gendered power relations. The results lay the foundation for practice and policy implications aimed at bullying prevention and future research to further examine social phenomenon related to gendered bullying.     

Reformulation as a strategy for managing ‘understanding uncertainty’ in office hour interactions between international teaching assistants and American college students

This article provides a discourse analysis of problematic communication in office hour interactions between international teaching assistants and American college students. The goal of the article is to explicate what is termed here as ‘understanding uncertainty’, something which has received little attention in existing studies. The data under consideration consist of a number of dyadic interactions that naturally occurred during office hours. The data analyses revealed that the type of understanding uncertainty as defined here was displayed and managed in six types of reformulations. The findings suggest that reformulation may be used as an interactive strategy to achieve mutual understanding across linguistic and sociocultural boundaries in educational contexts.