Research Note—Program Evaluation: Enhancing Academic Quality and Program Integrity During Rapid Off-Campus Growth

By creating a program evaluation model that assesses multiple components from several perspectives, a social work division is able to determine the quality, effectiveness, and integrity of its offerings and support its mission to develop social work students for practice. This task is critical in supporting an off-campus program’s ability to navigate change and uncertainty in higher education. This research note discusses how a small, bachelor of social work program with a dual-delivery system (traditional and community-site) used the Council on Social Work Education reaccreditation process to adapt its program evaluation to ensure academic quality and program integrity during a period of rapid growth.     

A Model for Developing and Managing Distance Education Programs Using Interactive Video Technology

Based on two years of experience with a distance MSW program, the authors present an evolving model for the development, management, and evaluation of distance education graduate programs that use interactive video technology. The model includes five core components: (a) accreditation standards compliance, (b) resource requirements, (c) curriculum adaptation, (d) faculty development, and (e) program evaluation. While not an exhaustive listing, these components are advanced as central to the effective planning and administration of distance education programs in social work.     

Teaching Successful Community Practice in Social Work

ABSTRACT

This article identifies and addresses a severe problem in the management of community practice projects of students in their second and third year in the Undergraduate Social Work program at the University of Haifa School of Social Work; namely, the current binary evaluation method based on total success or failure of the project.

Using a systems approach, this study creates a framework by which to ensure effective and positive outcomes for community practice projects carried out by undergraduate social work students (Freund, Arkin & Saltman, 1999). This framework is unique in that it draws on knowledge gained from organizational and community theories, as well as instructional theories for teaching social work practice.

The proposed framework includes three components that describe the factors necessary to help transform the student's learning experience: the organization's characteristics, the student's resources, and the evaluative measures.

This inter-conceptual approach enhances the ability of the instructor, the student, and the organization to build an appropriate organizational foundation for students operating communal programs. The underlying assumption is that an integrative approach promotes a better understanding of the components essential for building and evaluating social plans conducted by social work students.     

Teaching Note—A Call for Including Theories of Evaluation in Program Evaluation Courses Taught in Schools of Social Work

ABSTRACT

Many schools of social work offer courses on program evaluation. However, one component of program evaluation—theories of evaluation—may all too often be left out of the curriculum. This Teaching Note defines and describes evaluation theory and the benefits of including it in a program evaluation curriculum in schools of social work. Specific ideas for incorporating this content into MSW and doctoral courses in schools of social work are provided.     

Field Note—Developing Suicide Risk Assessment Training for Hospital Social Workers: An Academic–Community Partnership

This article describes 1 large urban pediatric hospital's partnership with a university to provide suicide assessment and management training within its social work department. Social work administrators conducted a department-wide needs assessment and implemented a 2-session suicide assessment training program and evaluation. Respondents (97.8%) indicated that the training was either helpful or very helpful in 8 suicide assessment skill-based domains. All attendees reported positive changes in perceived competence in 6 of 8 skill-based domains. A brief and time-efficient in-service training can be instrumental in augmenting hospital social worker competence in suicide risk assessment practice. This model of training program development, implementation, and evaluation is feasible, evidence-informed, and may be replicated.     

Educating Social Workers for Practice in Integrated Health Care: A Model Implemented in a Graduate Social Work Program

ABSTRACT

This article introduces a curricular innovation, the Integrated Health Scholars Program (IHSP), developed to prepare master's-level social work students for practice in integrated health care settings, and presents preliminary findings related to students’ self-reported program competencies and perceptions. IHSP, implemented in a research-intensive school of social work in a large midwestern public university, includes specialized course work, interprofessional education across health science disciplines, and field practicum in integrated health care settings. Curricular components support stepwise learning and follows the British Columbia model of interprofessional education learning tiers: exposure, immersion, and skill mastery. Despite IHSPs successful development in a well-resourced, supportive environment, challenges facing our profession's ability to develop and sustain training of MSW students in integrated health care are discussed.     

Addiction Social Work Fellowship Program in Canada

Substance use disorders (SUD) disproportionally contribute to the global social and economic cost of disease; however, their treatment has been inadequate in large part due to an enduring research to practice gap in which competencies for treating and preventing SUDs are often lacking from social work education curricula. Training social workers in managing SUDs has been separated from nurse and physician training, partly due to the long-standing divide between the behavioral health and medical care system. Recently, a new interdisciplinary fellowship in addiction social work, nursing and medicine has been established in Vancouver, Canada. We describe the novel fellowship program and outline initial impact of the training on knowledge and skills in addiction social work from our qualitative evaluation of the fellowship. We conclude that training social workers, and other allied health professionals alongside physicians and nurses may extend the reach of this type of training program even further.     

An organizational model to distinguish between and integrate research and evaluation activities in a theory based evaluation

Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.     

An organizational model to distinguish between and integrate research and evaluation activities in a theory based evaluation

Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.     

“Compassion,pleasantry, and hope”: A process evaluation of a volunteer-based nonprofit

As funders continue to emphasize the importance of documented results, nonprofit organizations must work to complete program evaluations that are both valuable and feasible. The purpose of this paper is to document a practical process evaluation of a southeastern nonprofit, a local Meals on Wheels. Using a mixed methods approach, we sought to answer four evaluation questions: (1) What are the essential program components, as identified by key stakeholders; (2) To what extent are volunteers implementing the identified essential components as intended; (3) What is the level of volunteer satisfaction with the program; and (4) What suggestions do stakeholders have for improving the program? Our findings indicate that most aspects of the program were implemented as intended, but inconsistencies occurred when volunteers were unsure of their assigned duties. In addition, volunteers had high levels of satisfaction and specific suggestions for improvement. From these results, we developed a conceptual model of factors contributing to quality of implementation and volunteer satisfaction that may be generalizable to other volunteer-based nonprofits. Specifically, we identified three factors that helped to facilitate satisfaction and performance: leadership, social contact, and fulfillment. Finally, this process evaluation demonstrates the feasibility of developing and implementing evaluation tools in similar organizations.     

Leadership in Social Work Education and the Social Change Model of Leadership

Leadership is a topic of international debate in both social work education and practice. Questions remain, however, regarding what specific models of leadership should be emphasized and how leadership content should be infused within the social work curriculum. This paper seeks to contribute to the ongoing discussion about the infusion of leadership within social work education. Specifically, this paper shares the design and development of a graduate-level social work course in program evaluation that infused education around the social change model of leadership (SCM) and then explores qualitatively how 39 graduate students interpreted and applied this model of leadership through an experiential community-based evaluation project. Findings of this study suggest that students utilized the values identified in the SCM in a range of ways to understand and interpret their leadership experience both in their collaborative groups and in their partnerships with community-based organizations. Community organizations also reported benefiting from the experience in partnership with the students. Implications are discussed in relation to the potential value and impact of this model for social work education.     

A formative assessment of gender awareness and ability of staff based on the service programs of the All-China Women's Federation: The case of the “3861 My Home” program

In order to achieve “gender mainstreaming” which is a global strategy to promote the development of women, it has in recent years been a major task for the All-China Women's Federation (ACWF) to improve the gender awareness and ability of policy makers and implementers. Thus, researchers should constantly propose and evaluate various possible attempts to improve gender awareness and the ability of individuals. There are few empirical studies on the assessment of gender awareness and the improvement of the ability of staff who have been trained and educated. Research studies focusing on the promotion of gender-sensitive awareness and ability of staff by participating in programs are even rarer.This study presents a specific case, namely the evaluation of promoting social service workers’ gender awareness and ability within the implementation of the “3861 My Home” program. Based on this case, this study examines how to promote gender awareness and ability of social service workers through the implementation of the service program of Women's Federation, and also assesses the quality of the results of this implementation. Moreover, this study also contributes to the literature pertaining to assessing the development of social service workers’ gender awareness and ability. In addition, the study provides an option for enhancing the gender awareness and ability of social service workers in addition to training: The participatory learning or action pertaining to gender awareness and ability based on the Women's Federation programs are able to effectively improve the gender awareness and ability of staff.     

How can We Enhance Productivity in Social Work? Dynamically Reflective Structures,Dialogic Leadership and the Development of Transformative Expertise

This article examines how to enhance the ability of managers to promote productivity through reflective structures and appreciatively evaluative dialogues based on front-line expertise and knowledge in social work practice. In order to discuss these ideas, we review the ideas of dialogical leadership and reflective structures, and the concept of productivity in relation to reassessing social work core tasks and the work-related well-being of social workers. We will present and reflect on our experiences and ideas generated from research that developed reflective tools, known as the Mirror method, for peer evaluation and practice development in social work. The Mirror method is designed as a tool for leaders and managers to enhance, through trialogic processes and structures, both the well-being of employees at the individual level and the productivity of social work and learning for transformation at the organizational level.     

Principles of Survey Analysis

Abstract

The National Association of Social Workers developed a methodology for conducting systematic content analysis of social work jobs and the curriculum of a social work program. Although the methodology was created so employers could respond to the declassification phenomenon, potentially it is quite valuable as a curriculum development tool in social work education. A social work program in New Zealand illustrates the usefulness of this approach in curriculum development.     

Teaching Note—Keeping It Real: Program Evaluation Projects for an Undergraduate Research Class

ABSTRACT

This article describes a teaching innovation that focused on the redesign of an undergraduate social work research class. Students enrolled in the redesigned class had an opportunity to conduct program evaluation projects in community agencies. The projects included (a) pretest and posttest evaluation of reminiscence approach in improving the well-being of older adults in a long-term care facility, (b) evaluation of family support services at a Head Start center, and (c) pretest and posttest evaluation of an awareness program to promote community inclusion of individuals with an intellectual disability. Steps in course development, implementation, and evaluation as well as the positive student learning outcomes are discussed. The article concludes with limitations and potential areas for further improvement.