Evaluating child welfare training in public agencies: status and prospects

Although staff training in public child welfare agencies is thought to be a critical component of effective practice, little is known about the delivery and effectiveness of training interventions. Few evaluations are published in the literature and it is uncertain how much evaluation activity is being conducted and utilized. This study collected data from 48 public child welfare agencies in the United States regarding the conduct of training evaluation and the utilization of training data. The data are discussed within the context of planning the next steps for public agencies’ efforts in training evaluation.     

Evaluating multidisciplinary child abuse and neglect teams: a research agenda

A review of child welfare research literature reveals used to investigate and intervene in child abuse and neglect cases, the field does not know enough about their structural variations, implementation processes, or effectiveness. Moreover, although articles advocating multidisciplinary teams enumerate their apparent strengths, they lack attention to the teams' possible weaknesses. The article discusses implications for future evaluation studies.     

Training child welfare citizen review panel members: A promising approach?

Citizen Review Panels (CRPS) are groups of volunteers mandated by United States federal law to examine policies, procedures, and practices of public (e.g., state) child welfare agencies, and make recommendations for systemic improvements. To date, several researchers have made clarion calls for training frameworks and approaches for CRP members. Despite the federal mandate, millions of dollars in resources allocated to these panels, and the potential to positively impact the child welfare system, no published training frameworks exist. This brief documents the evaluation of an online training for CRP members (N = 21) in one southeastern state. The training was developed based on needs identified in existing CRP literature, and delivered via an online learning platform. A pre-experimental (pre/post) approach was used to evaluate the training. Results indicate a significant improvement in knowledge associated with serving on the CRP, and overall, participants viewed the training as being positively impactful to their work as a CRP member. The brief will provide an overview of the training, evaluation approach, and briefly discuss salient implications derived from the results.     

Lessons from the courtroom: Perspectives from child welfare attorneys and supervisors

Despite a history of child welfare worker performance difficulty in the courtroom, there has been little documentation regarding specific training needs for worker courtroom practice skills. This study expands the literature on child welfare courtroom practice skills by documenting child welfare worker conduct via perspectives from courtroom attorneys and child welfare supervisors. Separate focus groups with child welfare attorneys and supervisors were held to ascertain best and concerning practices for child welfare workers in the courtroom. Focus group participants identified themes related to preparation, adversarial nature of court proceedings, testimony, reasonable efforts, appearance and mannerisms, esteem of workers, duality of worker roles, and support. Study results have implications for focusing and improving training and supervision.     

Washington State's adoption of a child welfare practice model: An illustration of the Getting To Outcomes implementation framework

Despite a great need for evidence-informed practices in child welfare, very few child welfare systems have implemented evidence-based case management models state-wide. While the literature on implementation from the perspective of model developers and researchers is steadily increasing, there has been little attention to the process of implementation originating from the reverse direction, by community organizations themselves, or with regard to going-to-scale implementation in child welfare. The Getting to Outcomes (GTO) model, which was originally created to help organizations choose and implement prevention programs, is a promising guide for child welfare systems seeking to initiate system-wide implementation of evidence-based practices. The GTO framework provides a step-by-step guide for surveying a system, building motivation, training, and evaluation. This article will illustrate the state-wide implementation of Solution-Based Casework (SBC), an evidence-based model of case management, by Washington State's Children's Administration, following the GTO framework. Despite some barriers and obstacles, the GTO model proved to be feasible and to aide in the implementation of SBC. Implications for the GTO model as a framework for empowering community organizations to choose and implement relevant evidence-based practices will be discussed.     

Training as a factor in policy implementation: Lessons from a National Evaluation of Child Welfare Training

Federal, state, and local governments spend substantial resources on training child welfare staff. Moreover, enhanced training is often proposed as a core solution to many problems facing public child welfare and other human service agencies. In this paper we conceptualize training as an element of the policy implementation process. We use data from a multiple case study evaluation of nine federally-funded training projects to examine training activity within a policy implementation framework. Findings indicate federal, state, county and organizational contexts were important in successful implementation; the projects were, for the most part, successfully implemented; training projects lacked explicit causal theory to link training activities to training outcomes; and elements of both top-down and bottom-up implementation frameworks were identified. Conclusions focus on the utility of training for enhancing policy implementation, as well as the need for greater theory development in this area.     

“Like a marriage”: Partnering with peer mentors in child welfare

A growing number of child welfare programs have incorporated peer mentors – individuals in long-term recovery from substance use disorders – into their service delivery models. Whereas existing literature suggests the collaboration between peer mentors and child protective service workers brings both opportunities and challenges, few studies have described these experiences from the perspectives of mentors, caseworkers, and supervisors. Understanding how these team members experience partnership is critical for the further evaluation and development of mentor models in child welfare. The purpose of this study was to understand the experiences of mentors, caseworkers, and supervisors working through an integrated team model in Kentucky. A qualitative approach was used, combining a phenomenological lens with constructivist grounded theory analysis techniques. Our results indicate that successful partnerships between mentors, caseworkers, and supervisors involve four processes: sharing a common vision, developing working relationships, learning with open-mindedness, and identifying the benefits of partnership. These findings have implications for practitioners in a variety of child welfare settings, particularly those interested in developing and training teams for peer mentor integration.     

Use of evidence-based interventions in child welfare: Do attitudes matter?

Implementation of evidence-based programs in child welfare has progressed slowly, with the majority of services in child welfare settings lacking empirical evidence for effectiveness. In other settings, research has identified providers' attitudes about evidence-based practices (EBPs) as a potential barrier to adoption of EBPs. As little research has focused on the role of attitudes in influencing use after training in an EBP in child welfare, the potential for attitudes to impede implementation efforts in child welfare is unclear. This study addressed this question in a sample of 55 caseworkers and therapists randomly assigned to enhanced support to use an EBP following training or a training-only condition. Information on providers' use of the intervention after training and their attitudes about EBPs were measured for up to five time points. Results indicate that attitudes did not predict providers' use of the EBP, and attitudes did not change overall or in the enhanced condition that provided greater exposure to the intervention. Providers perceived of requirements to use a practice as more influential in their use than their openness to EBPs. However, those who were more open to EBPs were more likely to participate in implementation support after the training, suggesting that openness facilitates participation in activities that support use of a new intervention.     

Use of data to assess performance and promote outcome achievement by public and private child welfare agency staff

Despite the emphasis on evidence-based practice in the literature, little is known about the extent to which child welfare workers routinely use data to assess the effectiveness of their practice, or consider an array of evidence informed practices such as peer record review, supervisory sessions or program evaluation as useful in improving their performance. This study, conducted as a part of the planning phase for a larger research and demonstration project measured frontline staff perceptions in both the public and private sectors in one state regarding these and other outcome-focused activities. Statistically significant differences were noted between public and private agency staff. In addition, the relationship between staff's use of data and their assessment of their own skill and the support provided by their agency for an array of out-of-home care practice activities are described. Implications for building the use of evidence-informed practice in child welfare are discussed.     

Interventions for youth aging out of care: A scoping review

Youth aging out the child welfare system are being transitioned out of the child welfare system with few interventions in place to support their move to independence. In developed countries, compared to their peers, youth aging out of care face poorer outcomes when it comes to education, employment, and housing. A better understanding of the effectiveness of the existing interventions that support youth in care is warranted. This paper presents a critical scoping review of the available evidence on interventions available to youth who are aging out of the child welfare system and identifies gaps for future research. Arksey and O'Malley's framework for scoping reviews shaped the process of this review. A total of thirteen databases were searched resulting in the retrieval of 1978 articles. Of the 1978 retrieved, only 68 met the review's criteria. Studies included were in English, described an intervention that was implemented and evaluated in developed countries, and published within the last 20 years. Interventions were categorized as: housing, employment, education, mentorship, independent living, and health. The majority of studies fell under the independent living category which provide cohesive resources to improve education, housing, and employment. Studies evaluating these programs generally reported positive outcomes on youth's ability to complete their education and attain part- or full-time employment. Methods of evaluations were found to be methodologically weak with respect to determining the effectiveness of interventions in ensuring youth's successful transitions to independence. Future research should look at longitudinal outcomes of youth and cost-benefit analysis of supporting youth transitioning out of the child welfare system. Recommendations also include policy changes extending the age of eligibility for youth transitioning out of the child welfare system.     

Forgotten children: A critical review of the reunification of American Indian children in the child welfare system

Reunification is the preferred permanency path experienced by children following out-of-home placement (Child Welfare Information Gateway, 2011, 2012). Emerging literature suggests a number of child, parent, family, and child welfare case characteristics predict the likelihood of reunification. However, research on the reunification of American Indians in child welfare system is limited. Given the unique historical and cultural context of American Indian families, a need exists to better understand what contributes to achieving permanency through reunification for these families. To develop a better understanding of reunification research, this article provides a critical review of the literature on predictors of reunification that is inclusive of American Indians. A search of the literature resulted in the inclusion of 17 articles. Findings suggest that although awareness of the factors associated with reunification for American Indian families is helpful, without consistent inclusion of child, parent, family, and case-related variables across statistical analyses, limited conclusions can be drawn. It is significant to note that a level that is not currently considered in literature is the tribe or band and what is done to assist the child in reunification from the tribal level.     

A confirmatory factor analysis of the evidence-based practice attitudes scale in child welfare

Despite the emphasis on evidence-based practice (EBP) in child welfare services (CWS) as an emerging and inevitable trend, implementation factors such as child welfare worker attitudes towards implementing EBP have received little attention in CWS. Aaron's (2004) Evidence Based Practice Attitudes Scale (EBPAS) has been used in multiple studies across mental health and healthcare settings. However, it has rarely been used in CWS. A-Mid Atlantic State implemented the EBPAS in all child welfare jurisdictions to measure workers' performance. The purpose of this study is to examine the EBPAS applied in a large urban child welfare services setting using a confirmatory factor analysis. Based on prior literature, three models were tested: a four factor model, a five factor model, and a second order four factor model. The second order model provided the best fit to the data, suggesting the EBPAS can measure workers' global attitudes, as well as four attitude types, towards EBP in a CWS setting. This study validates the use of the EBPAS with child welfare workers. Implications for effective evidence based practice in child welfare are discussed.     

Entering into a Collaborative Search for Meaning with Gay and Lesbian Youth in Out-of-Home Care: An Empowerment-Based Model for Training Child Welfare Professionals

Utilizing an empowerment-based approach, which incorporates self-identified gay and lesbian youths and openly gay and lesbian child welfare professionals as collaborative partners in the process, this article offers a model for training child welfare professionals to work more effectively with gay and lesbian youth in out-of-home care. This three hour training model empowers the gay and lesbian youth, whose voices have been subjugated, to emerge as the experts in training child welfare professionals to more competently and responsively address and meet their needs.     

Developing and validating measures for child welfare agencies to self-monitor fidelity to a child safety intervention

Building evidence of effective practice in child welfare requires practitioners and researchers to know the extent to which programs are implemented in order to understand evaluation results. Fidelity monitoring is a critical strategy for ensuring that evidence-based and promising practices are implemented as intended and can be studied in real-world contexts. This paper addresses challenges to measuring fidelity in child welfare systems and presents an approach taken with one state to define fidelity criteria and measure fidelity to a child safety intervention. Measurement challenges were addressed by using existing documents and case review mechanisms to assess fidelity, and measuring the quality of practitioner judgment using expert reviewers. Validity of fidelity criteria and fidelity review instruments was established through consensus with model developers and local purveyors. Twelve cases were reviewed by a panel of raters to assess inter-rater reliability and discrepancy between local purveyors and model developers. This participatory and capacity-building method can be replicated and used to develop and embed valid and reliable fidelity monitoring systems in public child welfare to continue to build evidence about what works in child welfare services.     

Exploring the self-care practices of child welfare workers: A research brief

Child welfare workers experience higher rates of vicarious trauma, workplace stress, and compassion fatigue, when compared to other social service workers. Increasingly, social service agencies, in general, and child welfare agencies, specifically, recognize the importance of self-care in assuaging these problematic employee outcomes. However, research that explicitly examines the self-care practices of child welfare workers in nominal. This study brief explores the self-care practices of child welfare workers (N = 222) in one southeastern state. Results reveal that child welfare workers only engage in self-care at moderate levels. Additionally, data suggests that variables such as health status, current financial status, and relationship status significantly impact personal and professional self-care practices, respectively. After a terse review of relevant literature, this brief will explicate findings associated with this study, and identify salient discussion points and implications for child welfare training, practice, and research.     

Placement Discontinuity for Older Children and Adolescents Who Exit Foster Care Through Adoption Or Guardianship: A Systematic Review

For over two decades, practitioners, advocates, and scholars involved with the U.S. child welfare system have engaged in coordinated efforts to increase the number of foster youth who find stable, permanent homes through adoption or guardianship, and these efforts have been shaped and guided by federal policies and directives. As a result, the number of children adopted or placed into guardianship out of foster care has increased significantly. This trend has significant implications for child welfare research, policy, and practice. However, the risk and protective factors for post-permanency discontinuity, or placement changes that occur after legal finalization of an adoption or guardianship, have received little attention in the literature. Also, many previous studies that investigated post-permanency adjustment for former foster youth have been limited by serious design and/or conceptual flaws. The purpose of this study is to investigate the peer-reviewed literature that examines risk or protective factors for discontinuity, or outcomes proximal to discontinuity, for older foster youth. A systematic search located 18 quantitative, quasi-experimental studies published in peer-reviewed journals that implemented multivariable methods. This review finds that the quality of the research evidence is generally weak, but previous studies do suggest several risk and protective factors for post-permanency discontinuity, including child, family, and service characteristics.     

Supporting child welfare supervisors to improve worker retention

Recent child welfare research has identified supervisors as key to retaining qualified and committed workers. This paper describes implementation of a federally funded child welfare training initiative designed to improve worker retention largely through developing, implementing, and evaluating a statewide supervisor training program in a Midwestern state. Unique to this collaborative effort was involving all child welfare supervisors in identifying needed content components, developing competencies, and conducting self-assessments.     

Every Child Matters? A critical review of child welfare reforms in the context of minority ethnic children and families

This paper critically reviews some key government papers that together largely provide the foundation for the relevant child welfare reforms in England and Wales. The context of this review was to evaluate whether these papers and documents made sufficient reference to improving policies and practices for minority ethnic children and families involved in child welfare matters, given the research evidence from the early 1990s suggesting that such families may experience particular disadvantages or discriminations within the UK child welfare system. The research evidence cited draws upon studies that have considered the experiences of different minority ethnic groups from the point of referrals through to long term services, including those children who have been looked after in local authority care and those families that have been subject to care proceedings. This paper concludes that more is needed under the Every Child Matters agenda to both acknowledge and address the specific needs of minority ethnic children and their families, as identified in the range of studies published post Children Act 1989. Copyright © 2008 John Wiley & Sons, Ltd.     

WHAT FAMILY THERAPISTS MIGHT LEARN FROM CHILD PSYCHIATRY

Recent articles in child psychiatry in America are reviewed, with emphasis on those studies ofinterest to family therapists. Major areas covered include: normal development, deviant development, and the impact of trauma. Differences from the "family therapy" literature include: multi-causal explanations, respect for scientific studies, reviews of progress in knowledge, and a deep-rooted ethical commitment to the welfare of children.