UPSTREAM! Together evaluation results from community efforts to prevent mental,emotional, and behavioral health problems

Mental, emotional, and behavioral (MEB) health problems are prevalent globally. Despite effective programs that can prevent MEB problems and promote mental health, there has not been widespread adoption. UPSTREAM! Together was a planning project in three Colorado communities. Communities partnered with academic and policy entities to 1) translate evidence about MEB problem prevention into locally-relevant messages and materials and 2) develop long-term plans for broad implementation of interventions to prevent high-priority MEB problems. Community members recognized the need to talk about MEB problems to prevent them. The UPSTREAM! communities localized messages designed to start conversations and sustain attention on preventing MEB problems. The communities understood that prevention takes sustained community attention and advocacy, knowing that important outcomes may be years away. Long-term implementation plans aimed to strengthen families and enhance social connections among youth. Despite community readiness and capacity to implement evidence-based programs, there were few funding opportunities, delaying program implementation and revealing gaps between funding policies and community readiness. This community-engaged experience suggests an achievable approach, acceptable to communities, and worthy of further development and testing. Policies that cultivate and support local expertise may help to increase wider community adoption of evidence-based programs that promote mental health among youth.     

Personality and community prevention teams: Dimensions of team leader and member personality predicting team functioning

The predictors and correlates of positive functioning among community prevention teams have been examined in a number of research studies; however, the role of personality has been neglected. In this study, we examined whether team member and leader personality dimensions assessed at the time of team formation predicted local prevention team functioning 2.5–3.5 years later. Participants were 159 prevention team members in 14 communities participating in the PROSPER study of prevention program dissemination. Three aspects of personality, aggregated at the team level, were examined as predictors: Openness to Experience, Conscientiousness, and Agreeableness. A series of multivariate regression analyses were performed that accounted for the interdependency of five categories of team functioning. Results showed that average team member Openness was negatively, and Conscientiousness was positively linked to team functioning. The findings have implications for decisions about the level and nature of technical assistance support provided to community prevention teams.     

A gender-informed model to train community health workers in maternal mental health

The New Haven Mental Health Outreach for MotherS (MOMS) Partnership is a community-academic partnership that works to develop public health approaches to ensure that pregnant and parenting women living in the City of New Haven achieve the highest possible level of mental health. The MOMS Partnership developed a training model for community health workers specializing in maternal mental health. Six community health workers (termed Community Mental Health Ambassadors or CMHAs) were trained on key topics in this gender-informed maternal mental health curriculum. Pre- and post-test questionnaires assessed changes in attitudes, perceived self-efficacy and control using standardized scales. The results indicated preliminary acceptability of the training curriculum in transforming knowledge and attitudes about maternal mental health among community health workers.     

A flexible framework for planning and evaluating early-stage health interventions: FRAME-IT

Health interventions exhibit three stages of maturity: early-, mid-, and late-stages. Early-stage interventions have innovative content necessitating evaluation; however existing evaluation frameworks omit constructs and guidelines relevant to this evaluation. Early-stage interventions require planning and evaluation that supports creating, testing, and exploring content to establish general feasibility and enable refinement for further testing, prior to randomised controlled trialling and wider dissemination. Feasibility, Reach-out, Acceptability, Maintenance, Efficacy, Implementation, Tailorability (FRAME-IT) was developed for a mixed methods feasibility study of a novel well-being intervention. FRAME-IT was conceived as a complementary framework to Reach, Efficacy, Adoption, Implementation, Maintenance (RE-AIM; Glasgow et al., 1999) which is better suited for mid- and late- stage interventions. FRAME-IT is proposed to support: (1) early-stage intervention planning and design, by guiding research focus and data sourcing strategy with relevant constructs; (2) comprehensive evaluation, by including constructs appropriate for early-stage interventions, i.e. feasibility, acceptability, and tailorability; (3) future intervention scalability, by including and adapting some of RE-AIM’s constructs to encourage a smoother translation of research into practice as interventions are scaled-up.     

Implementation of evidence-based interventions: analyzing critical components for sustainability in community mental health services

This study analyses the implementation and sustainability of evidence-based community mental health services in the form of publicly financed Individual Placement and Support programs. Critical implementation components and program fidelity were assessed after one year. After two years, program fidelity was assessed once again. After three years, the programs’ sustainability was assessed and semi-structured interviews performed, in order to deepen the understanding of implementation. Interviews and documents provided the quantitative and qualitative data, which were analyzed by the use of the Supported Employment Fidelity Scale, the Sustainable Implementation Scale (which was developed in a connecting study), and qualitative content analysis. Despite promising fidelity results after one year, eight out of 14 programs were terminated within three years. Implementation of integrated evidence-based programs in community-based settings is a delicate undertaking. Implementing agencies can benefit from rigorous preparation before program start, especially concerning the circumstances at the organizational level, such as making plans for collaboration, financing and assessments of program fidelity.     

Gender-based health interventions in the United States: An overview of the coalition for healthier community initiative

Health disparities by gender constitute an important yet often overlooked aspect of health around the globe. Within the United States, there is both a paucity of research as well as planned programs that take into account how socio-cultural roles and expectations for men and women may differentially affect symptoms, access to care, and treatment. Viewing women's health exclusively as a function of sex (i.e., biological) differences represents a narrow understanding that does not fully explain gaps in health disparities between men and women. In September 2010, the U.S. Department of Health and Human Services (DHHS) launched a national initiative entitled the Coalition for a Healthier Community (CHC) to employ a gender-based framework in several urban, suburban and rural communities across the nation. The Office on Women's Health (OWH) within the DHHS funded 10 coalitions to ultimately improve the health of women and girls utilizing a gender-based approach. This article provides an overview of the initiative and the focus of the special issue.     

Evaluating a community based mental health programme in West Bengal,India: Description of the methodology and lessons learned

Mental disorders impose an enormous burden on society. In developing countries like India, there is a lack of adequate number of trained mental health professionals to provide specialized care and 75–85 % of affected individuals do not have access to appropriate mental health services. The National Mental Health Programme (NMHP) is being implemented by the Government of India to support state governments in providing mental health services in the country. The Urban Mental Health Programme (UMHP) is a pilot initiative that has attempted the integration of mental health services in primary health care settings in two municipal wards in Kolkata, West Bengal, India. The overarching aim of this paper is to describe the methodology used for the evaluation of the community based mental health programme and to understand the processes of the programme in terms of barriers and facilitators. The current evaluation is based on a concurrent nested design, where qualitative and quantitative data are both collected at the same time but analysed separately and priority was given to qualitative data. This experience will contribute in helping other researchers to make some evaluations more effective, useful and manageable. Ethics approval was obtained from an institutional ethics committee of an organization (Ekjut) based in Ranchi, Jharkhand, India. The evaluation was undertaken by the George Institute for Global Health, New Delhi from February- June 2016.     

“We don't want to talk about that”: Overcoming barriers to rural aging research and interventions on sensitive topics

Geographical, economic, social and cultural barriers to accessing services in rural areas are widely reported. Less widely discussed are dilemmas posed by individual and community reluctance to address sensitive health issues. This article, focusing on the highly sensitive area of mental health, and employing a participatory action approach, describes the natural history of a project, the Mental Health and Aging Initiative (MHAI) to enhance awareness of mental health issues in rural Kentucky-Appalachian communities and overcome the reluctance of individuals in these communities to seek assistance. Funded by the United States Department of Agriculture (USDA), MHAI involved an educational intervention to improve knowledge about mental health and aging in rural Appalachian counties. The need to overcome significant community reluctance to engage in discussion of mental health resulted in significant modification of the protocol. The intervention was grounded in recognition of four key aspects of the local situation: (1) the need to understand the sensitivity of mental health as an element of rural culture; (2) the critical role of local community leaders as points of entry, acceptance, and action; (3) the need to overcome social stigma and reframe the topic of mental health in a more positive light; and (4) the need for methodological innovation in developing an empowering educational action plan oriented toward community-wide long-term impact. The intervention model that emerged from these considerations was based on engaging community leaders, providing educational and technical resources, and nurturing the acceptance by individual rural residents of responsibility for monitoring community mental health. This motif became a central theme in a strategy designed to facilitate culture change and acceptance of mental health as a community concern. It involved active engagement of community representatives in defining and implementing an intervention consistent with participatory action research as a means of empowering rural residents in monitoring and addressing sensitive health care issues. Given that many issues in rural health are difficult to address because of such sensitivity, the approach described is considered to have application in other contexts.     

Active transportation to support diabetes prevention: Expanding school health promotion programming in an Indigenous community

BackgroundSchool-based physical activity (PA) interventions, including school active transportation (AT), provide opportunities to increase daily PA levels, improves fitness, and reduces risk of diseases, such as type 2 diabetes. Based on a community-identified need, the Kahnawake Schools Diabetes Prevention Project, within an Indigenous community, undertook school travel planning to contribute to PA programming for two elementary schools.MethodsUsing community-based participatory research, the Active & Safe Routes to School’s School Travel Planning (STP) process was undertaken in two schools with an STP-Committee comprised of community stakeholders and researchers. STP activities were adapted for local context including: school profile form, family survey, in-class travel survey, pedestrian-traffic observations, walkability checklist, and student mapping.ResultsSTP data were jointly collected, analyzed and interpreted by researchers and community. Traffic-pedestrian observations, walkability and parent surveys identified key pedestrian-traffic locations, helped develop safe/direct routes, and traffic calming strategies. In-class travel and mapping surveys identified a need and student desire to increase school AT. The STP-Committee translated findings into STP-action plans for two schools, which were implemented in 2014–2015 school year.ConclusionsCombining CBPR with STP merges community and researcher expertise. This project offered evidence-informed practice for active living promotions. Experience and findings could benefit Indigenous and non-Indigenous communities.     

Aligning research and practice: The role of academic-community partnerships for improving measurement and process

ObjectiveCommunity programs addressing social determinants of health are growing in prominence and are increasingly expected to provide metrics of success. Our objective is to assess the role of an academic-community partnership for a community health worker program targeting social and medical needs, and determine factors impacting its effectiveness.MethodsWe draw on a 4.5-year partnership that includes both quantitative and qualitative data collection and analysis. Quantitative data collection mechanisms evolved as a result of the partnership. Qualitative interviews were conducted with community health workers and leadership.ResultsTo align medical and social support services in a sustainable and measurable manner, our academic-community partnership found that creating and maintaining a mutually beneficial space through small wins enabled us to then address larger problems and needs. Ongoing self-study and process evaluation allowed quick adjustments. Unique partnership elements such as having consistent funding and flexible timelines and objectives were essential.ConclusionsWhen integrating health and social services, academic-community partnerships create pathways for bidirectional learning than can quickly turn research into practice and support sustainability, especially when based on incrementally built trust and a history of small wins.     

Valuing and embracing complexity: How an understanding of complex interventions needs to shape our evaluation capacities building initiatives

This paper describes some of the main challenges of evaluating complex interventions, as well as the implications of such challenges for evaluation capacity building. It discusses lessons learned from a case study of an evaluation of Dancing with Parkinson’s, an organization that provides dance classes to people with Parkinson’s disease in Toronto, Canada. These implications are developed from a realist evaluation lens. Key lessons include the need to develop skills to understand program mechanisms and contexts, recognize multiple models of causality, apply mixed method designs, and ensure the successful scaling up and spread of an intervention.     

Beyond the state: Conceptualizing protection in community settings

In the last two decades, the child welfare system has undergone a series of dramatic changes. We have moved from a broad concern for the social welfare of children and families to a restricted focus on detecting, investigating and assessing instances of child physical and sexual abuse and neglect. Spiraling reports of suspected or actual abuse and neglect, higher caseloads, reduced resources and lack of support for both families and workers, have all contributed to narrowing the focus of contemporary child welfare to one more aptly characterized as child protection. Child protection discourse is concerned with the nature and extent of state intervention into family life for the purpose of protecting children at risk of harm. While much attention has been given to boundaries and procedures for state intervention, it is less common to critically examine the actual activities involved in protection of children. An exception to this is the feminist scholarship on the topic, illustrating that protection is very much a gendered activity entailing the scrutiny of women's mothering practices and often associated with mother-blame. In this paper, another dimension to protection activity is explicated, namely that which occurs in a community setting. Drawing on a qualitative case study of a community agency that serves young mothers, we document its implications in 'child protection' processes and its markedly different approach to protection from formal child welfare agencies. Given the community agency's emphasis on supportive services to mothers, we turn a critical eye on usual conceptions of protection, where it occurs, and how it is accomplished.     

Cognitive behavioral interventions for depression among Hispanic people: promising meta-analytic evidence for deep cultural adaptations

ABSTRACT

Depressive disorders are common among Hispanic people. Evidence-informed guidelines indicate cognitive behavioral interventions (CBI), but they were developed primarily with non-Hispanic White people. Narrative studies of clients and workers along systematic review evidence suggested that well-defines cultural adaptations of CBIs would likely improve outcomes among Hispanics people with diverse mental health problems. We advanced the meta-analytic hypothesis that CBIs incorporating so-called “deep structure” cultural adaptations will be more effective than otherwise similar, but more superficially, “surface structure” or non-adapted interventions with depressed Hispanic people. This meta-analysis synthesized evidence from nine typically randomized trials in the United States with one subsample from the Commonwealth of Puerto Rico. Most clients were young women, living in poverty and suffering a reactive depressive episode. We found statistical and practical support for our hypothesis. In most practice contexts, CBI success rates were between 15% and 30% better than those typically observed with other usual practices. Moreover, these effects were maintained at 6- to 12-month follow-up. Given the size and growth of the Hispanic American population, their prevalent experience of depression, and the size of the intervention effects, these synthesized findings seem of potentially great human, clinical, and policy significance.     

Diversity training for the community aged care workers: A conceptual framework for evaluation

Older Australians are an increasingly diverse population, with variable characteristics such as culture, sexual orientation, socioeconomic status, and physical capabilities potentially influencing their participation in healthcare. In response, community aged care workers may need to increase skills and uptake of knowledge into practice regarding diversity through appropriate training interventions. Diversity training (DT) programs have traditionally existed in the realm of business, with little research attention devoted to scientifically evaluating the outcomes of training directed at community aged care workers. A DT workshop has been developed for community aged care workers, and this paper focuses on the construction of a formative evaluative framework for the workshop. Key evaluation concepts and measures relating to DT have been identified in the literature and integrated into the framework, focusing on five categories: Training needs analysis; Reactions; Learning outcomes, Behavioural outcomes and Results The use of a mixed methods approach in the framework provides an additional strength, by evaluating long-term behavioural change and improvements in service delivery. As little is known about the effectiveness of DT programs for community aged care workers, the proposed framework will provide an empirical and consistent method of evaluation, to assess their impact on enhancing older people’s experience of healthcare.     

The unique effects of environmental strategies in health promotion campaigns: a review

Various strategies are used as tools in health promotion campaigns to increase health-related outcomes among target populations. Evaluations of these campaigns examine effects on changing people's knowledge, attitudes, and/or behaviors. Most evaluations examine the combined impact of multiple strategies. Less is known about the unique effects of particular strategies. To address this gap, we used highly systematic methods to identify and review scientifically rigorous evaluations of 18 campaigns that examined the unique effects of three sets of intervention strategies (entertainment education, law enforcement, and mass media) on changes in knowledge, attitudes, and practice with regard to various health behaviors. Results showed differences in evaluation processes based on the type of strategy used to promote campaign messages. For instance, evaluations of mass-media based campaigns were more likely to examine changes in knowledge, relative to evaluations of campaigns that used law enforcement strategies. In addition, campaign effects varied by particular strategies. Mass media-based campaigns were more likely to affect knowledge, relative to behaviors. Law enforcement and entertainment education-based campaigns showed positive effects on behaviors. The implications for planning and evaluating health promotion campaigns are described.     

The theory of change of the evaluation support program: Enhancing the role of community organizations in providing an ecology of care for neurological disorders

This paper discusses the Ontario Brain Institute’s theory of change for the Evaluation Support Program, a program designed to enhance the role of community organizations in providing care and services for people living with a brain disorder. This is done by helping community organizations build evaluation capacity and foster the use of evidence to inform their activities and services. Helping organizations to build capacities to track the ‘key ingredients’ of their successes will help ensure that successes are replicated and services can be improved to maximize the benefit that people receive from them. This paper describes the hypothesized outcomes and early impacts of the Evaluation Support Program, as well as how the program will contribute to the field of evaluation capacity building.     

Relative effectiveness of mindfulness and cognitive behavioral interventions for anxiety disorders: Meta-analytic review

ABSTRACT

Increasingly popular mindfulness intervention innovations seem demonstrably effective in alleviating anxiety among people with anxiety disorders. However, the basis of such primary and synthetic evidence has, for the most part, been comparisons with non-active comparison conditions such as waiting lists. The longest-standing and strongest evidence-informed practices in this field have been cognitive behavioral interventions (CBI). This meta-analysis synthesized evidence from nine randomized trials of the relative effectiveness of mindfulness interventions compared to CBIs (i.e., active control groups) in treating anxiety disorders. The sample-weighted synthesis found no statistically or practically significant differences between the two groups on anxiety alleviation: Cohen’s d = - 0.02 (95% confidence interval = - 0.16, 0.12). Both groups enjoyed large clinical benefits. However, because mindfulness methods may require less professional training and take less time for both workers and clients to master, they are probably less expensive to provide. As they are probably less expensive, but equally effective, it seems that, in a cost-beneficial sense, mindfulness interventions may be more practically effective. These review-generated meta-analytic findings and inferences may be best thought of as developed hypotheses for future research testing. These and other future research needs are discussed.     

A principles-focused evaluation of community mental health short-term case management

Principles-focused evaluations allow evaluators to appraise each principle that guides an organization or program. This study completed a principles-focused evaluation of a new community mental health intervention called Short Term Case Management (STCM) in Toronto, Canada. STCM is a time limited intervention for clients to address unmet needs and personalized goals over 3 months. Findings showcase that a principles-focused evaluation, assessing whether program principles are guiding, useful, inspiring, developmental and/or evaluable (GUIDE), is a practical formative evaluation approach. Specifically, offering an understanding of a novel intervention, including its key components of assessment and planning, support plan implementation and evaluation and care transitions. Findings also highlight that STCM may work best for those clients ready to participate in achieving their own goals. Future research should explore how best to apply the GUIDE framework to complex interventions, including multiple principles, to increase evaluation feasibility and focus.     

Impact of Psychological Disorders on Postpartum Mothers and Child: Current Issue in Remediation in India

ABSTRACT

India is a multicultural, multiethnic, pluralistic society with enormous socioeconomic disparities, and it is a formidable task to provide affordable and effective mental health care, especially to the remote rural corners of the country. The unfortunate aspect of the Indian mental health scenario is that there exists very poor awareness of the maternal health risks of the postpartum period. It is during this period that serious psychological disturbances can manifest and seriously jeopardize safe and normal motherhood. Currently, there is neither a national agenda for mental health care among pregnant and postnatal women nor a viable training program to equip health workers to recognize and manage postpartum psychological disorders. This article attempts to provide a viable module for training future health providers to gain an understanding of the illness pattern that constitutes postpartum disorders through experiential learning and problem solving.