A novel approach for evaluating programs designed to serve military veterans: Using an adapted common components analysis

Evaluators are challenged to keep pace with the vast array of Veteran support programs operating in the United States, resulting in a situation in which many programs lack any evidence of impact. Due to this lack of evidence, there is no efficient way to suggest which programs are most effective in helping Veterans in need of support. One potential solution to this dilemma is to reconceptualize program evaluation, by moving away from evaluating programs individually to evaluating what is common across programs. The Common Components Analysis (CCA) is one such technique that aggregates findings from programs that have undergone rigorous evaluation at the level of program components (e.g., content, process, barrier reduction). Given that many Veteran programs lack outcome evidence from rigorous studies, an adaptation to CCA is needed. This report examines cross-sectional data from a pilot study using an adapted CCA across five domains of well-being (i.e., employment, education, legal/financial/housing, mental/physical health, and social/personal relationships). The purpose of this preliminary study is to determine the feasibility of eliciting program nominations and program components from Veterans via an online survey. When coupled with a longitudinal research design, this adaptation to CCA will allow for stronger causal claims about the expected impact of different program components within and across a variety of domains.     

Managing physical and mental health conditions: Consumer perspectives on integrated care

Despite the growing trend of integrating primary care and mental health services, little research has documented how consumers with severe mental illnesses (SMI) manage comorbid conditions or view integrated services. We sought to better understand how consumers perceive and manage both mental and physical health conditions and their views of integrated services. We conducted semi-structured interviews with consumers receiving primary care services integrated in a community mental health setting. Consumers described a range of strategies to deal with physical health conditions and generally viewed mental and physical health conditions as impacting one another. Consumers viewed integration of primary care and mental health services favorably, specifically its convenience, friendliness, and knowledge of providers, and collaboration between providers. Although integration was viewed positively, consumers with SMI may need a myriad of strategies and supports to both initiate and sustain lifestyle changes that address common physical health problems.     

CQI approaches for evaluating management development programs: A case study with health service managers from geographically remote settings

Health systems are known for being complex. Yet, there is a paucity of evidence about programs that successfully develop competent frontline managers to navigate these complex systems. There is even less evidence about developing frontline managers in areas of contextual complexity such as geographically remote and isolated health services. This study used a customised management development program containing continuous quality improvement (CQI) approaches to determine whether additional levels of evaluation could provide evidence for program impact. Generalisability is limited by the small sample size; however, the findings suggest that continuous improvement approaches, such as action learning workplace-based CQI projects not only provide for real-world application of the manager’s learning; they can potentially produce the type of data needed to conduct evaluations for organisational impact and cost-benefits. The case study contributes to the literature in an area where there is a scarcity of empirical research. Further, this study proposes a pragmatic method for using CQI approaches with existing management development programs to generate the type of data needed for multi-level evaluation.     

Explanatory models for disability: perspectives of health providers working in Malawi

Health providers’ understanding of disability determines how disabled people are treated, and hence it is imperative to address conceptualisations of disability, as this will contribute to better opportunities and realisation of human rights for disabled people. This article will use data from a qualitative study exploring conceptualisations of disability by 22 health service providers from the total health care system in Malawi, including the professional sector (e.g. medical doctors and nurses) and the folk sector (healers and indigenous practices). We will discuss how these perceptions influence the lives of disabled people, using the case of a health service user with physical and speech impairment as an example. Our data show that health providers largely conceptualise disability according to the medical model for disability, contributing to the exclusion of disabled people. The bio-psycho-social model for disability, largely absent as an explanatory model for disability among our informants, is the most inclusive and rights based.     

Providing context to the implementation of health promoting schools: A case study

PurposeIssues related to program context are important components of population health interventions and particularly among complex, adaptive initiatives in schools. Health Promoting Schools (HPS) is a global approach to support early development of healthy behaviors among children and youth. The purpose of this study was to explicate the practical and contextual processes that influenced implementation of HPS in schools in Nova Scotia (Canada).MethodsUsing a case-study approach, data was collected using interviews (n = 14) with principals, teachers and parents, observations collected during school visits and document review in five diverse schools.ResultsCase study schools reported a variety of HPS practices and three key themes emerged that provided context to the processes that facilitated their implementation. The results suggest that although school characteristics (theme 1), like staff allocation, physical location and resources, are important, these barriers can be mitigated by building organizational capacity (theme 2) and establishing a supportive school community culture (theme 3).ConclusionsThe study provided insight to the variability in implementation by describing how contextual barriers were experienced and mitigated by schools. Establishing a broad system to support HPS, with collaboration across health and education sectors, could help to progress adoption, implementation and sustainability of HPS.     

Unpacking intergenerational (IG) programs for policy implications: A systematic review of the literature

Intergenerational care is a program where both the younger and older generations are receiving programmed care in an environment where activities and resources are shared between them. Anecdotally, an intergenerational care program takes on many forms. This paper presents a systematic literature review of intergenerational care models. Our findings are relevant to policy makers as the paper highlights the opportunities to create an age-friendly environment by introducing intergenerational models in Australia, where intergenerational care development is in its infancy. Future research will help articulate the personal, social, and economic value of intergenerational care.     

The development of anti-cancer programs in Canada for the geriatric population: an integrated nursing and medical approach

Cancer control in Canada refers to the development of comprehensive programs utilising modern techniques, tools and approaches that actively prevent, cure or manage cancer. The scope of such programs is quite vast. They range from prevention, early detection and screening, comprehensive treatment both curative and palliative to comprehensive palliative care. Cancer is a disease associated with the aging population, and as the population ages the incidence of cancer would be expected to rise as well. This in itself poses a great challenge. In addition, the aging population demographics with the projected rise in the numbers of senior citizens, especially the over 80 group in the next decade, poses its own creative challenges to health planners. In Canada, health care is centrally administered, and controlled by the provincial governments of Canada, under the Canada Health Act. The challenge of developing comprehensive programs for the geriatric population requires changes in the care models and care pathways. The patient-centred models that have been adapted require a multidisciplinary approach to the clientele and their families that integrates cancer therapy and geriatric care and realities. This requires changes in the nursing and medical approach, as well as education in the subtleties of the two intersecting medical realities.     

Dialogic communication in the health care context: A case study of Kaiser Permanente's social media practices

This case study examines how one of the largest not-for-profit health care organizations in the US, Kaiser Permanente, uses social media to communicate with its stakeholders. Through content analysis and interviews, this study identifies the communication models reflected in a sample of social media posts and examines the organization's approach to using social media. The study finds evidence of both one-way and two-way communication models, as well as principles of dialogic communication. The implications of these findings are discussed.     

Independent living programs for young people leaving the care system: The state of the evidence

A substantial body of evidence suggests that young people leaving public care systems are at increased risk for low educational attainment, unemployment, homelessness, physical and mental health difficulties, dependency on public assistance, and involvement with the criminal justice system. Independent living programs (ILPs), which incorporate life skills and personal development, are one strategy frequently used to improve outcomes for young people leaving care. However, the effectiveness of ILPs remains unknown. This paper systematically reviews the current evidence for ILPs, summarizing all controlled comparisons designed to evaluate their effectiveness. Reviewers were unable to find any randomized controlled trial evaluating ILPs, but the results of eight non-randomized controlled studies suggest that some ILPs may have protective effects for youth leaving the public care system. These trends were observed for outcomes related to educational attainment, employment, housing, health, and other life skills; nevertheless, the weak methodological quality of the evidence tempers the validity and generalizability of these conclusions. Further research utilizing random assignment of participants is imperative in order to draw reliable conclusions for policy and practice.     

Application of theory-based evaluation for the critical analysis of national biofuel policy: A case study in Malaysia

Theory-based evaluation (TBE) is an effectiveness assessment technique that critically analyses the theory underlying an intervention. Whilst its use has been widely reported in the area of social programmes, it is less applied in the field of energy and climate change policy evaluations. This paper reports a recent study that has evaluated the effectiveness of the national biofuel policy (NBP) for the transport sector in Malaysia by adapting a TBE approach. Three evaluation criteria were derived from the official goals of the NBP, those are (i) improve sustainability and environmental friendliness, (ii) reduce fossil fuel dependency, and (iii) enhance stakeholders’ welfare. The policy theory underlying the NBP has been reconstructed through critical examination of the policy and regulatory documents followed by a rigorous appraisal of the causal link within the policy theory through the application of scientific knowledge. This study has identified several weaknesses in the policy framework that may engender the policy to be ineffective. Experiences with the use of a TBE approach for policy evaluations are also shared in this report.     

Constructing the digital patient: Patient organizations and the development of health websites

In order to understand the constraints and challenges of realizing the democratic potentials of the Internet, this paper focuses on the attempts of three Dutch patient organizations to develop health websites. The authors describe how these patient organizations had to overcome specific barriers to develop their digital services. All three organizations faced certain constraints that had negative consequences for the plans they wanted to realize. Lack of financial resources and manpower were the main reasons why these patient organizations could not develop interactive parts of their website or provide personal advice services. Other barriers the patient organizations had to overcome were getting access to digital expertise to build the websites. The paper shows that the development of a website is a very demanding task, even for patient organizations that have in-house expertise with computers and Internet. Moreover, the paper shows that patient organizations do not consider the involvement of patients as crucial for the design of health websites. This research thus confirms previous research findings that users, in this case patients, are largely absent from the design process of information and communication technologies Finally, the paper shows how patient organizations' websites contribute to a redefinition of the patient from being a passive actor towards one who is an active participant in his or her care.     

Design of an educational strategy based on Intervention Mapping for nutritional health promotion in Child Care Centers

Early childhood is a critical period for instilling healthy habits to prevent overweight and obesity. This paper describes the development of an educational intervention for the promotion of healthy eating and physical activity among two-to-four-year-old children in public child care centers (CCCs) in Mexico City. Following the Intervention Mapping (IM) protocol, we developed the Bright Futures multidisciplinary intervention. First, a formative research process to identify the personal and environmental determinants of childhood overweight and obesity, behavioral outcomes and performance objectives was conducted. Then, a matrix of change objectives by intersecting the performance objectives with the determinants was integrated. Bright Futures lasted six months and included 24 weekly sessions, each composed of five phases: warm-up, theory, active movements, relaxation, and hydration. Ad hoc interactive teaching materials focused on recreational activities, and formulated plans for the adoption, implementation and process/impact evaluation of the intervention was developed. IM successfully guided the design of a theory-driven and evidence-based intervention for children in CCCs within a socio-ecological and participatory planning framework. This is one of the first studies in Mexico to use IM in the context of CCCs.     

In sickness and in health: A qualitative study of elderly men who care for wives with dementia

It is estimated that approximately 1,000,000 elderly men care for spouses with Alzheimer's disease or other forms of cognitive impairment, yet we have only a limited understanding of their work, and central questions arise. What do men caregivers do, and what meanings do they ascribe to their work? What are their distinctive strengths and vulnerabilities, and what can we learn about men and caregiving from their stories? This qualitative study was based on in-depth, open-ended interviews with 14 elderly men who are primary caregivers to wives with dementia. All interviews were taped, transcribed, and manually coded. The resulting information then underwent analysis from which three major themes emerged: feelings of isolation and invisibility of their care work, a style of caregiving that jointly utilizes management and nurturing, and feelings of commitment, responsibility, and devotion.     

A model for a comparative cost-effectiveness evaluation of two mental health partial care programs.

This study provides a model for comparing the cost-effectiveness of two mental health programs. The example cited examines the cost-effectiveness of a hospital-based and a community-based partial care program. Using each group as its own control, the authors compare patients' use of inpatient hospitalisation and emergency room services during one year prior to and one year subsequent to first admission in day care. In both day care programs, patients substantially reduced their number of inpatient admissions and days. Neither program, however, showed a significant decrease in patients' use of the emergency room. Reflecting the substantially lower costs of the community-based program, the benefit-cost and cost-effectiveness ratios were significantly better in the community-based program than in the hospital-based program. Based on this evidence the authors conclude that the lower-cost, equally effective community-based program should be carefully considered as an alternative for more partial care patients.     

A mixed-methods evaluation using effectiveness perception surveys,social network analysis,and county-level health statistics: A pilot study of eight rural Indiana community health coalitions

Community health coalitions (CHCs) are a promising approach for addressing disparities in rural health statistics. However, their effectiveness has been variable, and evaluation methods have been insufficient and inconsistent. Thus, we propose a mixed-methods evaluation framework and discuss pilot study findings. CHCs in our pilot study partnered with Purdue Extension. Extension links communities and land grant universities, providing programming and support for community-engaged research. We conducted social network analysis and effectiveness perception surveys in CHCs in 8 rural Indiana counties during summer 2017 and accessed county-level health statistics from 2015-16. We compared calculated variables (i.e., effectiveness survey k-means clusters, network measures, health status/outcomes) using Pearson’s correlations. CHC members’ positive perceptions of their leadership and functioning correlated with interconnectedness in their partnership networks, while more centralized partnership networks correlated with CHC members reporting problems in their coalitions. CHCs with highly rated leadership and functioning developed in counties with poor infant/maternal health and opioid outcomes. Likewise, CHCs reporting fewer problems for participation developed in counties with poor infant/maternal health, poor opioid outcomes, and more people without healthcare coverage. This pilot study provides a framework for iterative CHC evaluation. As the evidence grows, we will make recommendations for best practices that optimize CHC partnerships to improve local health in rural areas.     

Parenting adolescents from ethno-cultural backgrounds: A scan of community-based programs in Canada for the promotion of adolescent mental health

ObjectivesTo i) describe current community-based programs across Canada to support parents for the promotion of adolescent mental health, with special attention to ethno-cultural populations; and ii) identify needs, gaps, and opportunities for the development of a framework to support parents for the promotion of adolescent mental health.MethodsWe conducted an internet-based cross Canada scan of community-based parenting programs that promote adolescent mental health in ethno-culturally diverse populations, followed by structured phone interviews with program staff. Findings were categorized according to audience (ethnicity/culture and age group), geographical distribution and coverage, and program type. Barriers to access and outreach mentioned by interviewees were documented.ResultsWe found a total of 47 programs that met our search criteria. The greatest numbers were found in the provinces of Ontario, British Columbia and Alberta, particularly in the Greater Toronto and Vancouver Areas. Most programs consisted of psycho-educational, information-based workshops, support groups, or used innovative approaches (e.g., arts, alternative medicine, mentorship, and skillsdevelopment courses). Five programs (11%) had parent and youth components. From the perspective of service providers, cultural distrust, stigma, financial constraints and language barriers pose challenges to outreach. Program evaluations are limited and often not publicly available.ConclusionThere are gaps in geographic coverage and types of programs available to parents for the promotion of adolescent mental health in ethno-cultural communities. Inconsistent and insufficient funding [and other forms of institutional support] detract from the capacity of community-based organizations to adequately support families and conduct, publicize, and evaluate their programs.     

Collaborative care for individuals with bipolar disorder or schizophrenia and co-occurring physical health conditions: A systematic review

While rates of chronic physical health conditions are increasing for the general population, individuals with severe mental illness are at greater risk. Co-occurring mental and physical health conditions are associated with poor health care utilization, socioeconomic, and patient-reported health status outcomes. This study used systematic review procedures to investigate the effectiveness of collaborative care models for improving the health of adults with bipolar disorder or schizophrenia and co-occurring chronic physical health conditions. Six studies met inclusion criteria, and included outcomes related to quality of life, physical health, and mental health. Collective and study-level results are reported and discussed, including implications for social work practice and research.     

Achieving Permanence in Foster Care for Young Children: A Comparison of Kinship and Non-Kinship Placements

ABSTRACT

A number of child welfare policies have reinforced the use of kinship care as the most preferred placement for foster children, reflecting the philosophy that maintaining children within their own extended family system contributes to their stability and well-being. Given the growing utilization and legislative emphasis on kinship care along with the push for an immediate implementation of permanency plans for children in foster care, this study examines how the permanency goal under the 1997 Adoption and Safe Families Act (ASFA) is being implemented and achieved. The reunification and permanency placement (adoption or legal guardianship) outcomes of children in relative and non-relative care are analyzed, focusing on the experiences of young children. Based on public child welfare agency data from 2000 to 2003, child, case, and placement variables are explored to identify which set of factors best explains case outcomes. The present study identifies the total length of foster placement (kinship and non-kinship), the length of family maintenance services, and the number of placement changes as the most important variables in determining family reunification and permanent placement (legal guardianship and adoption) outcomes for young children.     

Implementation of evidence-based interventions: analyzing critical components for sustainability in community mental health services

This study analyses the implementation and sustainability of evidence-based community mental health services in the form of publicly financed Individual Placement and Support programs. Critical implementation components and program fidelity were assessed after one year. After two years, program fidelity was assessed once again. After three years, the programs’ sustainability was assessed and semi-structured interviews performed, in order to deepen the understanding of implementation. Interviews and documents provided the quantitative and qualitative data, which were analyzed by the use of the Supported Employment Fidelity Scale, the Sustainable Implementation Scale (which was developed in a connecting study), and qualitative content analysis. Despite promising fidelity results after one year, eight out of 14 programs were terminated within three years. Implementation of integrated evidence-based programs in community-based settings is a delicate undertaking. Implementing agencies can benefit from rigorous preparation before program start, especially concerning the circumstances at the organizational level, such as making plans for collaboration, financing and assessments of program fidelity.