Competency-based program evaluation: A contingency approach

What types and levels of professional competency should an evaluator have? Should requisite competencies differ depending on the nature of an evaluation? Can a practical competency assessment approach be developed for use in educating highly qualified evaluation professionals? This article addresses these concerns by presenting a contingency model of evaluation competencies. Four broad categories of competency — policy analysis, administrative, interpersonal /personal, and technical — are identified along with three different levels or criteria of acceptable performance. Then several features of the evaluation context, including the evaluation type, the phase and the evaluator role, are individually analyzed to determine the required competencies implied by each. Based on this, a contingency model is developed that postulates requisite competency types and levels depending on a combination of contextual features. The article concludes that the model can usefully serve as a heuristic or organizing mechanism for assessing evaluation contexts and orienting the education of professional evaluators.     

Unresolved struggles: Educating social workers in Aotearoa New Zealand

This article introduces key themes that arise throughout the history of social work education and are central to the education of social workers today. Curriculum and the goodness of fit between agency demands and professional standards, accreditation, provision of social work courses, and more recently, the competency movement, have constantly been significant, albeit in changing forms. In New Zealand, cultural awareness and knowledge of indigenous models for practice together with re-organisation of social service delivery systems have implications for social work education. Managerial devices such as the purchaser/provider split and risk/case management approaches to social work and their impact on social work education and practice are discussed. The role of the national accrediting body and the ensuing tensions around accreditation are discussed. A discussion of opportunities and concerns for the future considers relationships between those who teach social work, those who practice it, their employers and the role of Industry Training Organisations.     

A model of cultural competency in social work as seen through the lens of self-awareness

Providing effective cultural competency training to social work students is a social work education struggle. This qualitative study, conducted in the United States, addresses this challenge by examining social work educators’ teaching methods for cultural competency by focusing on the self as a part of culture and racism as a part of dominant culture. The findings reveal that the social work educators emphasize the role of self-awareness and cultural awareness in teaching cultural competency. However, they prefer to use multiculturalism, a 1960s ideology, to teach cultural competency and do not invest in teaching anti-racism. These findings shed light on teaching cultural competency and have practical implications in social work education.     

A Psychometric Analysis of Field Evaluation Instruments Designed to Measure Students’ Generalist-Level Social Work Competencies

ABSTRACT

There is a dearth of research on the evaluation of the psychometric performance of instruments designed to measure students’ generalist-level social work competencies. There is also uncertainty on the performance of various response option formats used to measure students’ competencies in assessment instruments. Using a sample of 198 master of social work students and 198 field instructors, the current study employs confirmatory factor analysis to assess the psychometric performance of a field evaluation instrument designed to measure students’ generalist-level social work competencies. The results provide evidence to support the validity and reliability of the instrument. The results also highlight nuances associated with a 5-point response option format for items used to measure competency indicators. Implications, limitations, and directions for future research are discussed.     

Culturally sensitive social work: promoting cultural competence

In current times of great conflict and clashes between different cultures and worldviews, cultural competencies should be a well embedded feature of social work education. This is a fundamental and cross-cutting issue; however, we question whether it is an obvious concern in social work education in European countries, specifically in Portugal, and if the curriculum of social work courses covers this topic. This article is based on research that seeks to find out if there are mandatory curricular units of the disciplinary field of social work that explicitly address culturally sensitive social work and cultural competencies. Thus, this article presents a study that focuses on educational institutions that provide social work courses in Portugal, and has the potential to be extended to other countries. An online survey and a document analysis of the curriculum programmes of all Portuguese courses in social work were conducted. The study results revealed the lack of curricular units with clear terms relating to the topic of culturally sensitive social work. The implications for practice and educational policy are also discussed, which lead to a reflection and analysis of the evaluation and accreditation process of social work education in Portugal, with a conclusion that it is incomplete and faces major challenges in curriculum development and course accreditation. Challenges and opportunities in developing social work curricula, as well the debate around a generic or specialist social work education are also discussed. Finally, the authors suggest an opportunity to develop cultural competencies through continuing and lifelong learning for social workers.     

Emerging Social Work Field Education Trends in China

MSW field education in China has been adopting Western models. However, this adaptation cannot address all educational and professional training needs in China. This study used an exploratory qualitative study design and interviewed 54 MSW students regarding their field experiences at a university in Shanghai. Results revealed six key themes: field education curriculum design’s influence on student field experiences, faculty advisers’ influence on student field experiences, field agencies’ expectations toward MSW intern performance, field agencies’ capacity to host MSW interns, student perceptions of their professional competencies, and students’ coping strategies to manage challenges in field practicum. Competency-based social work field education is a potential solution to address the current social work field education challenges in China.     

Making Changes to Assessment Methods in Social Work Education: Focusing on Process and Outcome

Moving towards delivering the new social work qualification led to many social work programmes considering the ‘fitness for purpose’ of assessment methods being used to assess the competence of social work students. This article highlights how changes in assessment methods were considered on one particular social work programme. The advantages and disadvantages of three particular assessment methods in relation to professional practice are debated here. Discussions emanating from these considerations and subsequent changes made to the programme are highlighted. The specific focus is on the experience of one particular social work programme which is used as a case study to illustrate issues of general relevance in social work education. It is intended that the reflections presented in this article will contribute to this broader arena of learning and teaching for professional practice taking place and continuing beyond the introduction of the new qualification.     

Developing social work students’ professional identity: the role of England’s Professional Capabilities Framework

ABSTRACT

Developing professional identity is a key aim of social work education. This paper argues that the Professional Capabilities Framework (PCF) – a holistic, capability approach to student assessment used in England’s social work education programmes – is ideally placed to promote the development of students’ professional identities. The paper discusses two research studies, each of which was stimulated by significant policy changes in England’s social work profession. The author draws out the implications of both studies for supporting social work students to develop their professional identities. It is concluded that the PCF is valued by practice educators as an assessment and teaching tool, while acknowledging that its future is uncertain due to the lack of continuity impacting on England’s social work profession. This paper is equally of relevance for social work educators outside the UK who may be developing and evaluating their assessment approaches and also for those experiencing the impact of rapid policy changes in their own countries.     

Social Work Student Learning Experiences of Family Therapy: Improving Competency in Pedagogy Through Qualitative Research

The purpose of this qualitative study is to evaluate graduate social work student experiences of pedagogy intended to improve competency in family therapy practice. Students from two classes (N = 37) completed open‐ended surveys assessing: perceptions of most helpful pedagogical practices; understanding of needed competencies; and perceived opportunities offered to them during their graduate training for learning about work with couples and families. Results, analysed using grounded theory methodology, revealed that students: (1) believed that experiential activities were especially critical for learning how to do clinical practice with couples and families; (2) understood important competencies related to professional development, therapeutic engagement with the family, and how to approach family practice; and (3) believed they were ‘somewhat prepared’ for practice. Implications include improving understanding of abstract skills in practice with couples and families, and emphasising relationship dynamics more in graduate social work education and training.     

Teaching Note—Time for a Teach-In? Addressing Racist Incidents on College Campuses

ABSTRACT

This teaching note discusses a teach-in organized in response to a racist incident on a college campus. An examination of the history of teach-ins demonstrates that social work educators have been involved with them since the beginning of the profession, and the method is a natural fit for social work given its historic role. Social work educators have unique professional and ethical responsibilities to respond to hate crimes and other racist incidents on campus and to develop the competencies of social work students to do the same. Teach-ins are a model for doing so in ways that demonstrate the profession’s commitments to social justice advocacy, social justice education, and a robust implicit curriculum.     

Joint Assessment in Inter‐professional Education: A Consideration of Some of the Difficulties

This paper examines one effort to jointly assess nurses and social workers where professional as well as academic qualifications were at stake. It chronicles an attempt in a Scottish university to integrate assessment of a multi‐disciplinary academic course with assessment within the existing post qualifying framework for social work. In setting up a new course the assessment strategy was designed to meet both the course learning outcomes and the requirements of the Post Qualifying Award for social work. In looking at the tensions between different academic disciplines it is, perhaps, not surprising that this attempt at assessment across professional boundaries ran into difficulties. The context of the assessment issue and the different mechanisms used in repeated attempts to resolve the problems are examined. The tentative conclusion is that, while the inter‐professional education process is highly valued by students, there are tensions between the academic and practice assessment requirements, between different academic traditions and between understandings of reflection and how it is assessed. Mutual trust and understanding are essential to the development of inter‐professional education, including an accreditation system which is flexible enough to meet a range of needs.     

NCWWI Traineeships: A National Cross-Site Evaluation of Child Welfare Stipend Programs for Ethnically Diverse Students

The task of recruiting and retaining ethnically diverse, qualified, and committed social workers in child welfare is challenging. Federal funding supporting BSW and MSW education has been a catalyst for university–agency partnerships across the country. An important goal of these partnerships is to prepare social work students with the knowledge, skills, and competencies for effective child welfare practice. The National Child Welfare Workforce Institute’s innovative child welfare traineeships program prepares students from 12 social work programs around the country. This study focused on diversity, competency attainment, and readiness for the job. Results showed that programs recruited ethnically diverse students, and after receiving child welfare–specific content and hands-on experiences in the field, students felt competent and prepared for child welfare work.     

Critical social work and competency practice: a proposal to bridge theory and practice in the classroom

Social work education in North America is increasingly focused on competency criteria and micro skills training for future practitioners. Market forces are transforming the nature of social work practice in Canada, and social work regulators are concerned about the lack of evidence-based competencies in social work education. Since the Controlled Act of Psychotherapy was proclaimed in 2017, social work practitioners are in a position to offer psychotherapy services; as a result, universities are under greater pressure to shift to competency-based learning that meets the requirements of a regulated profession. This has raised concerns about the narrowing focus on critical social work theory in preparing students for practice. The divergence between anti-oppressive and direct practice schools is widening with the result that many students have difficulty bridging the gap between critical theory and competency-based practice. This paper attempts to integrate both traditions by offering students a course that directly links critical analysis of structural barriers and client centered interventions. The course is part of a developing critical competency curriculum that focuses on methods of facilitating empowerment and change in the helping process by articulating key relational components between service user and practitioner from a critical-competency perspective.     

Achieving Collaborative Competence through Interprofessional Education. Lessons Learned from Joint Training in Learning Disability Nursing and Social Work

The ability to work interprofessionally is widely regarded as essential to professional education and training for social work. The changing contexts of social work practice and the requirement for integrated working are regular reminders of the need for social work students to develop collaborative competence. Guidance preceding the development of the social work degree emphasised that social work students should undertake specific learning and assessment in partnership working and information sharing. This suggests that aspects of interprofessional education are relevant to the teaching and development of social work students if graduates are to successfully engage in complex practice.

This paper seeks to identify the competencies needed for successful collaboration. It then draws on evaluative research of joint training programmes in learning disability nursing and social work in England to discuss the unique experiences and perspectives of graduates whose social work training was exceptionally interprofessional. The paper will discuss how some of the findings from this research can indicate lessons for promoting collaborative competence in singly trained social work students. It will argue that interprofessional learning opportunities are one of the key ingredients for the development of critical practice.     

Does accreditation really matter in public relations practice? How age and experience compare to accreditation

Many scholars and practitioners have suggested accreditation as one way to enhance the professionalism of public relations practice. But, others have questioned whether accreditation really makes a difference and whether experience is a sufficient substitute for accreditation. This study found that, although accredited practitioners were significantly older and had significantly more years of experience compared to their non-accredited counterparts, differences between the groups with respect to seven work categories and five professional competencies remained even when age and years of experience were controlled. The affected work categories were account/client management, strategic planning, public relations program planning, project management, stakeholder relations, issues management, and crisis management. The affected professional competencies were the four-step strategic planning process; ethics and legal issues; communication theory; business literacy; and advanced communication skills. In short, this study refutes the argument that age and professional experience are sufficient substitutes for accreditation in public relations. In fact, they are not.     

Social Work Admissions and Academic Accommodations for Students with Disabilities

ABSTRACT

The Americans With Disabilities Act of 1990 (ADA) protects students wth disabilities from discrimination by academic and professional programs in higher education. A student with a disability cannot be denied admission to an educational program because of his or her disability if the student is otherwise qualified. This means that a student with a disability who is qualified for an academic or professional educational program cannot be denied admission to a program based solely on the student&s disability. This educational requirement mandated by the ADA applies to all educational fields including social work education. The purpose of this study was to explore how social work programs are dealing with these requirements in their admission and academic accommodation procedures. Twelve social work programs located in the mid-western United States participated in the study. Representatives of each of these programs were given an in-depth interview focusing on their admissions process, academic accommodations, and general topics related to social work education and disabilities. All programs taking part in the research were accredited by the Council on Social Work Education (CSWE). The CSWE is the national accreditation body for social work education within the United States.     

Nicholas II — 1868-1918

Recent changes in accreditation standards now require professors to systematically assess whether a teacher candidate actually possesses a “disposition” appropriate to the profession. This new mandate from accreditation bodies is controversial on a number of fronts. As social studies educators in particular, we like to think of ourselves as especially attentive to issues such as individual differences and rights, indoctrination, prejudice, intolerance, freedom of expression, maturation, and the worth of the individual—all of which are potentially raised by the NCATE and NCSS mandates. And as a practical matter, it places new stresses on the role of professors as both mentors and gatekeepers. In this article, two social studies teacher educators provide an overview of current theory and debate regarding dispositions, an assessment of practical problems associated with the accreditation accountability mandates, and—in spite of the persistent problems associated with defining and assessing dispositions—offer one successful model for evaluating teacher candidates’ professional dispositions that has been implemented in a social studies education program.     

An Integrative Framework for Developing Comprehensive Examinations to Measure Student Social Work Competencies

ABSTRACT

Social work and other professions are endeavoring to promote student proficiency with respect to core competencies of the discipline, and the attainment of these competencies must be demonstrated objectively in some way. This article provides an illustrative guide for social work educators seeking to develop comprehensive examinations to assess students’ acquisition of professional competencies, particularly at the master’s level and across generalist and specialization levels of practice. An integrative framework is presented, highlighting 5 central stages of examination development: planning, creating and implementing, evaluating, revising, and perpetuating. These stages are illustrated with a case example, followed by key conclusions, methodological considerations, and other implications for moving forward on efforts to effectively develop examinations to measure student social work competencies.     

Professional competencies in social work education for the third sector in southern Spain

The education of social workers in the Spanish university is structured around the professional competencies that will subsequently be applied in the labour market. As social work is a profession focused on the provision of social welfare and the prevention of social exclusion, it is expected of social workers that they become analytical, thoughtful professionals within their environment and that they play an active role in preventing social exclusion and inequality. However, there are important splits and contradictions between the official recognition of such competencies by universities and their effective implementation in the labour market. In this paper we analyse the main constraints and contradictions involved in the acquisition of the professional skills of social workers in their transition to the labour market. To do this, we focus on the specific case competencies in professional field of the third sector in Andalusia     

Assessing Cultural Competence in a BSW Student Population

Bachelor’s level social workers serve a population that is becoming more diverse. Social work educators must respond with adapted teaching methods, theories, and exercises to reflect the growing need for cultural competence in our practitioners. The 2015 Educational Policy and Accreditation Standards (EPAS) outline the knowledge, value, and skills competencies central to social work education. These competencies include thorough integration of cultural competence in social work education; the ways in which this content is taught likely vary greatly between programs. This study assessed whether students gained competence as a result of taking a bachelor’s level social work (BSW) course in cultural diversity at a mid-sized public university. Furthermore, the study assessed whether their level of competence was related to student demographics, such as being from an urban or rural community. One hundred twenty-three students completed the California Brief Multicultural Competence Scale (CBMCS) at the beginning and end of a course specifically dedicated to cultural competence. Results indicate that the course itself is effective in increasing significantly student’s self-reported cultural competence. Study results lay the foundation for future research that will (1) assess more broadly the implications of a specific cultural competence course and (2) aid in the development of a social work-specific measure of cultural competence.