Teaching Note—A Call for Including Theories of Evaluation in Program Evaluation Courses Taught in Schools of Social Work

ABSTRACT

Many schools of social work offer courses on program evaluation. However, one component of program evaluation—theories of evaluation—may all too often be left out of the curriculum. This Teaching Note defines and describes evaluation theory and the benefits of including it in a program evaluation curriculum in schools of social work. Specific ideas for incorporating this content into MSW and doctoral courses in schools of social work are provided.     

Work–Family Conflict and Couple Relationship Quality: A Meta-analytic Study

This study examined the association between work–family conflict and couple relationship quality. We conducted a meta-analytic review of 49 samples from 33 papers published between 1986 and 2014. The results indicated that there was a significant negative relationship between work–family conflict and couple relationship quality (r = ?.19, k = 49). Several moderators were included in this analysis: gender, region, parental status, dual-earner status, and the measures used for work–family conflict and marital quality variables. The strength of the relationship varied based on the region of the sample—samples from Europe and Asia had a significantly weaker relationship between work–family conflict and relationship quality than those from North America. In addition, the relationship was significantly weaker in samples of dual-earner couples and when non-standardized scales were used. Implications of the results and directions for future research are suggested.     

Research Note—Program Evaluation: Enhancing Academic Quality and Program Integrity During Rapid Off-Campus Growth

By creating a program evaluation model that assesses multiple components from several perspectives, a social work division is able to determine the quality, effectiveness, and integrity of its offerings and support its mission to develop social work students for practice. This task is critical in supporting an off-campus program’s ability to navigate change and uncertainty in higher education. This research note discusses how a small, bachelor of social work program with a dual-delivery system (traditional and community-site) used the Council on Social Work Education reaccreditation process to adapt its program evaluation to ensure academic quality and program integrity during a period of rapid growth.     

Improving Social Work Education in Vietnam Through International Cooperation: The ‘Social Work Education Enhancement Program’

This paper describes an initiative to improve social work education in Vietnam through a three-year international collaborative, including US Aid for International Development, San José State University, eight universities in Vietnam, Vietnam's government ministries, and Cisco Systems, Inc. The social work profession was officially recognized by the Vietnamese government in 2010. Despite the rapid expansion of social work education programs, there are significant limitations in the universities' ability to provide social work education. The goal of the Social Work Education Enhancement Program (SWEEP) is to strengthen the capacity of Vietnam's undergraduate social work programs to deliver quality education and prepare trained, job-ready social workers. The SWEEP project aims to improve the administration of social work education, the professional capacity of faculty, social work curriculum, and networking technology to enable centers for excellence in learning and scholarship. To ensure that the SWEEP team targeted training and technical assistance activities that were culturally congruent, a comprehensive needs assessment and frequent mid-course evaluations were conducted, showing many shared and unique contextual issues facing universities. The collaborative process of developing social work education which fits the local context can be replicated in other countries that are in the early stages of social work development.     

Research Note—A Pilot Cyber Counseling Course in a Graduate Social Work Program

Cyber counseling is a new and growing medium for offering mental health services to children and youth. However, there is a lack of identification of the core competencies required to provide effective online counseling. A school of social work, in partnership with a national service agency providing online counseling to children and youth, developed and offered a 13-week course to participating MSW social work students and agency staff. The development of online counseling competencies was assessed through individual interviews with participants and a content analysis of online posts. Participants scored well in areas of assessment and intervention. Challenges were identified in relationship building within an online environment.     

Accountability in Action?: Program Evaluation in Nonprofit Human Service Agencies

Program evaluation can be used as an excellent tool to promote nonprofit human service organizations' accountability. This article lays out several conditions that need to be met before evaluation achieves its potential. Application of this framework to nonprofits in Dallas, Texas, indicates the usefulness of the approach. Results show that considerable numbers of evaluation are being conducted but that the quality of the research methods and measures is low. This indicates that evaluation cannot currently be said to be providing the level of accountability possible. Additional efforts by all stakeholders to promote the use of evaluation to hold agencies accountable for efforts and results are necessary.     

Research Articles in Australian Social Work from 1998–2007: A Content Analysis

Abstract

With the rise of evidence-based practice, there have been calls in social work for practice research that examines the efficacy of its interventions. For the present paper, the authors conducted a content analysis of all articles published in Australian Social Work in the period from 1998 to 2007 to examine the nature of published research and evaluation. Of the 313 articles, 138 (45%) reported on research findings. Of these, only six articles involved practice evaluation or testing of an instrument, but there were positive signs of a developing empirical research culture primarily utilising a qualitative approach or mixed methods studies. The authors suggest that there is a need for more research on social work interventions, a more conscious decision by the profession about its attitude to evidence-based practice (EBP), specific directions for research education, and greater rigour in reporting all types of research studies, but particularly qualitative studies.     

Fathers’ Perspectives on Strengthening Military Families: A Mixed Method Evaluation of a 10-Week Resiliency Building Program

A recent Institute of Medicine report on “The Assessment or Readjustment Needs of Veterans, Service Members, and Their Families” http://nationalacademies.org/hmd/Reports/2013/Returning-Home-from-Iraq-and-Afghanistan.aspx, (2013) underscored the need for effective support for military families with young children, and that effective engagement into existing services remains a challenge. This mixed-method study involved 14 fathers (previously deployed military) who engaged in the Strong Military Families Program, a resiliency-building group for families with young children. The purpose of this paper was twofold: first, to identify the efficacy of this brief intervention for reducing mental health symptomatology among previously deployed military fathers who completed the group, and second to better understand the perceptions and reflections of fathers who completed an effective symptom management program in order to fill the literature gap around this issue and guide future efforts at increasing engagement of this population. Pre- and post-group assessments were administered including depression and posttraumatic stress symptom ratings. Assessments also included interviews designed to elicit fathers’ expectations before the program and to capture their reflections after completion. Quantitative analyses examined changes in symptoms pre- to post-group, and qualitative analyses aimed to better understand fathers’ experiences and help guide future efforts to increase engagement of this population. A grounded theory approach was employed to analyze interview content, and two themes were identified reflecting a desire for (1) connection and (2) learning. The prominence of these themes both before and after group underscored the value of connection to others who shared experience and opportunity for learning effective parenting strategies. Corresponding quantitative analyses indicated a significant decrease in self-reported posttraumatic stress (p?<?.05) and trend level reduction in depression (p?<?.10), suggesting participation may contribute to more effective symptom management. Subgroup analyses contrasting the pre-group interviews of fathers who endorsed higher (n?=?9) versus lower (n?=?5) levels of symptoms revealed that those with greater symptomatology expressed more themes related to fear of committing to the program. Discussion will focus on effective outreach and engagement, and the need to align programs to the interests of previously deployed fathers of young children.     

Reconfiguring Social Work Education to Fight HIV–AIDS: A Model for Developmental Contexts

This article charts the response of social work educators in addressing HIV–AIDS. Based at the University of the West Indies in the Republic of Trinidad and Tobago, the faculty within the Social Work Unit developed a model of teaching, research and practice that was innovative and transcended cultural, geographical and professional boundaries. The model has contributed a lasting legacy of knowledge and culturally relevant practices to enhance the capacity and effectiveness of social workers working with people living with HIV–AIDS (PLWHIV). Inherent in the propositions that underpinned the model was a belief in the role of education in alleviating psychosocial and other impacts of social problems. This article describes this unique initiative and discusses its relevance to current social work practice and the implications for contemporary social work education. The authors argue that while social work draws on a common body of knowledge, an established set of professional skills and a universal code of values, these central tenets of the profession should not be regarded as concrete and fixed but must be figured and reconfigured as needed to address emerging contemporary problems and their specific sociocultural manifestations.     

Couples’ Sexual Communication and Dimensions of Sexual Function: A Meta-Analysis

Research and clinical data have shown that couples with sexual problems report a lack of sexual communication. However, no published meta-analyses have evaluated the relationship between sexual communication and sexual function. This meta-analysis examines the correlation between couples’ sexual communication and dimension of sexual function across 48 studies. Sexual communication was positively associated with sexual desire (r = .16), sexual arousal (r = .21), lubrication (r = .17), orgasm (r = .23), erectile function (r = .19), less pain (r = .12), and overall sexual function (r = .35). The effect sizes for sexual desire (r = .21; r = .12) and orgasm (r = .26; r = .16) were higher for women than for men. For overall sexual function, studies with married participants (r = .47) had a larger effect size than studies with participants with multiple relationship types (r = .31) or than studies with dating participants (r = .11). Effect sizes were larger for studies conducted outside of the United States (r = .39) compared to studies conducted in the United States (r = .12). We discuss the importance of addressing the relationship between sexual communication and sexual function, as well as future directions for research in this area.     

“Work as unto the Lord”: Enhancing Employability in an Evangelical Job-Readiness Program

The 1996 passage of welfare reform radically reshaped the principles and practices of poverty management in the U.S. On the one hand, it brought about an end to welfare as an entitlement and imposed rigid time limits, work requirements, and a programmatic supply-sided focus on “job-readiness.” On the other hand, it permitted and promoted the expansion of faith-based organizations in the provision of social services. This ethnographic case study of a prominent faith-based job-readiness program--Jobs for Life--is situated at the underexplored nexus of these two trends. Drawing upon participant observation in a Jobs for Life class, in-depth interviews with class instructors and participants, and content analysis of organizational materials, this article documents the program’s use of biblical principles and teachings to expound on the moral irreproachability of work and to fabricate “employable” subjects who submit themselves to both God and the employer. At play is a project that we call the “righteous responsibilization” of the poor, a responsibilization achieved through religious salvation. The case of Jobs for Life, we argue, not only extends our understanding of “religious neoliberalism” (Hackworth 2012), revealing how it shapes the process of subjectification and practices of poverty management. It also remediates a tension at the heart of neoliberal ideology between its emphasis on individualistic entrepreneurialism and its demand for submission to the abstract, alien decrees of the market. In the religious neoliberal framework exemplified by Jobs for Life, deference to capital is recast as the first step toward the entrepreneurial achievement of individual salvation.     

Development,Implementation, and Evaluation of a Comprehensive Course on Suicide in a Master’s of Social Work Program

ABSTRACT

Most master of social work (MSW) programs provide minimal education or training on suicide prevention, intervention, and postvention despite that the majority of social workers encounter suicidal clients during their professional careers. This study describes the development, implementation, and evaluation of a course on suicide in an MSW program. Changes in student suicide-related knowledge, confidence, and preparedness were evaluated using a pre/post design. We found statistically significant increases in knowledge (t [df = 21] = 4.79; p < .001), confidence (t [df = 17] = 8.55; p < .001), and preparedness (t [df = 20] = 7.28; p < .001) from pretest to posttest. Knowledge, confidence, and preparedness were significantly positively correlated, indicating that confidence and preparedness did not increase without a corresponding increase in knowledge. Given the prevalence of suicide and the frequency with which social workers serve populations affected by suicide, it is critical that MSW programs provide effective training on understanding suicide.     

Examining Foundations of Qualitative Research: A Review of Social Work Dissertations, 2008–2010

This study examined the treatment of epistemology and methodological rigor in qualitative social work dissertations. Template-based review was conducted on a random sample of 75 dissertations completed between 2008 and 2010. For each dissertation, we noted the presence or absence of four markers of epistemology: theory, paradigm, reflexivity, and power. We also examined methods choices and the strategies used for ensuring rigor. Results suggested that most (96%) doctoral students completing qualitative dissertations address theory, but fewer refer to reflexivity (45%), paradigm (13%), or power dynamics (8%). Students typically used multiple strategies for ensuring rigor. Grounded theory and phenomenology were the most popular methods choices, followed by case studies, ethnography, or narrative methods. Implications for doctoral education are offered.     

Social Work Supervision of Staff: A Primer and Scoping Review (2013–2017)

Supervision of staff has a rich history within the social work profession, and is widely valued internationally for the support, knowledge, and skill it is perceived to provide. Moreover, quality supervision is championed for ensuring good client care. However, supervisors practicing within the social work profession have not typically had access to best practice information, nor accessed the parallel research related to the supervision of staff. A supervision primer provides an orientation to the supervision literature, including definitions and disciplinary perspectives. This sets the stage for a scoping review of social work supervision articles for the purpose of supporting supervisors in keeping current, locating, understanding, and applying literature to their practice. Seventy-nine conceptual and empirical articles first-authored by social workers were published in 36 journals between 2013 and 2017. The volume, location, context and nature of these articles are presented, pointing to an increased social work presence in the literature. Implications for supervisory practice, scholarship, and research are discussed.     

A Psychometric Analysis of Field Evaluation Instruments Designed to Measure Students’ Generalist-Level Social Work Competencies

ABSTRACT

There is a dearth of research on the evaluation of the psychometric performance of instruments designed to measure students’ generalist-level social work competencies. There is also uncertainty on the performance of various response option formats used to measure students’ competencies in assessment instruments. Using a sample of 198 master of social work students and 198 field instructors, the current study employs confirmatory factor analysis to assess the psychometric performance of a field evaluation instrument designed to measure students’ generalist-level social work competencies. The results provide evidence to support the validity and reliability of the instrument. The results also highlight nuances associated with a 5-point response option format for items used to measure competency indicators. Implications, limitations, and directions for future research are discussed.     

Teaching Note—Keeping It Real: Program Evaluation Projects for an Undergraduate Research Class

ABSTRACT

This article describes a teaching innovation that focused on the redesign of an undergraduate social work research class. Students enrolled in the redesigned class had an opportunity to conduct program evaluation projects in community agencies. The projects included (a) pretest and posttest evaluation of reminiscence approach in improving the well-being of older adults in a long-term care facility, (b) evaluation of family support services at a Head Start center, and (c) pretest and posttest evaluation of an awareness program to promote community inclusion of individuals with an intellectual disability. Steps in course development, implementation, and evaluation as well as the positive student learning outcomes are discussed. The article concludes with limitations and potential areas for further improvement.     

Business in Social Work Education: A Historically Black University’s Social Work Entrepreneurship Project

The destabilization of the current economy has sparked increased interest in entrepreneurship, especially for underrepresented minority social work students. The entrepreneurial thinking of these social work students entering social work programs at historically Black colleges and universities needs to be fostered in a learning environment. This article describes a historically Black university’s creative social entrepreneurship venture in response to the Social Work Congress’s 2010 imperative “Business of Social Work—Infuse models of sustainable business and management practice in social work education and practice.” The social entrepreneurship project uses the interprofessional collaborative educational model and attempts to provide meaningful and relevant education to social work students interested in social entrepreneurship through the collaborative efforts of the university’s School of Social Work and the School of Business and Management.