Measurement and evaluation practices of factors that contribute to effective health promotion collaboration functioning: A scoping review

The purpose of this scoping review was to identify promising factors that underpin effective health promotion collaborations, measurement approaches, and evaluation practices. Measurement approaches and evaluation practices employed in 14 English-language articles published between January 2001 and October 2015 were considered. Data extraction included research design, health focus of the collaboration, factors being evaluated, how factors were conceptualized and measured, and outcome measures. Studies were methodologically diverse employing either quantitative methods (n = 9), mixed methods (n = 4), or qualitative methods (n = 1).In total, these 14 studies examined 113 factors, 88 of which were only measured once. Leadership was the most commonly studied factor but was conceptualized differently across studies. Six factors were significantly associated with outcome measures across studies; leadership (n = 3), gender (n = 2), trust (n = 2), length of the collaboration (n = 2), budget (n = 2) and changes in organizational model (n = 2). Since factors were often conceptualized differently, drawing conclusions about their impact on collaborative functioning remains difficult. The use of reliable and validated tools would strengthen evaluation of health promotion collaborations and would support and enhance the effectiveness of collaboration.     

Quality improvement learning collaborative to examine foster care guidelines

Learning collaboratives (LC) are an important method of implementing quality improvement by serving as laboratories to translate research into practice and sharing knowledge. We created a Foster Care Learning Collaborative (FCLC) of 11 foster care health sites to share best practices on providing health services for children in foster care. Using a collaborative approach involving monthly conference calls, we invited each health site to present specific health care delivery issues for the purpose of developing collaborative quality improvement projects regarding the delivery of healthcare to children placed into foster care. For health sites providing primary care (n = 8 of 11 sites), we examined adherence to two American Academy of Pediatrics (AAP) guidelines for children entering foster care: a) the initial health screen, and b) the comprehensive medical evaluations. At least four distinct types of health care models that provide either direct primary care or administrative oversight for children in foster care were identified: 1) medical home sites (n = 3); 2) foster care evaluation/intake sites (n = 2); 3) specialized primary care sites (n = 1); and, 4) state administrative programs (n = 2). Data from the six direct primary care sites (n = 586 children) and two state administrative models (n = 3855 children) was collected. The time-frame for the initial health screen was adjusted to 7 days after entry and adherence (31%) was comparable among primary care sites. Adherence to AAP guidelines regarding completion of a comprehensive medical evaluation within 30 days of intake varied among medical homes (30%–86%), intake models (23%–33%), specialized primary care site (43%), and state models (43%–73%). No site was fully compliant with the AAP guideline for universal comprehensive medical evaluation within 30 days, and there is variation within and among care models. A foster care learning collaborative identified significant variability in adherence to a commonly accepted guideline for timely access to healthcare for children placed into foster care. The LC c model offers the opportunity to evaluate best practices, identify barriers to care, and provide objective feedback for improvement.     

If you build it,will they come? A qualitative investigation into community barriers to accessing paediatric HIV services in Kenya

We present qualitative research investigating demand-side barriers to uptake of paediatric HIV services in Kenya. We explore community perceptions of services in 3 provinces where paediatric treatment is readily available but under-utilised, aiming to focus on demand-side obstacles and derive strategies for increasing uptake. We conducted focus-group discussions with openly HIV-positive parents and caregivers of children aged up to 15 years (n = 7 groups), and clinic- and community-based healthworkers (n = 13 groups); and individual in-depth interviews with managers and Ministry of Health representatives (n = 6 interviews). Results revealed low community awareness of medical indications for paediatric HIV testing, alongside widespread anxieties about potential infection routes. Care-seeking delays reflect strong perceived associations between antiretroviral treatment (ART) and mortality. Despite free drugs available from the Kenyan government, costs for laboratory services, medications for opportunistic infections, transportation and nutritional needs remain major obstacles. Attitudinal barriers include fatalistic beliefs about early death for infected children and reliance on traditional healers. Stigma reduces access, especially as paediatric testing represents a “window” into parental HIV status. Apprehensive caregivers fear the lifelong nature of ART and report adherence struggles. Even when paediatric ART is relatively accessible, demand-side barriers impede uptake and must be addressed at community and facility levels.     

The reasons why children work on the streets: A sample from Turkey

The phenomenon of children working on the streets is a societal issue in all underdeveloped or developing countries just as it is in Turkey. The purpose of this research was to examine the reasons that children work on the street by conducting individual in-depth interviews with working children and their mothers, choosing individuals from similar socioeconomic demographic backgrounds and making a comparison of their acceptance or rejection of working, the perception of social support received by the mothers, and their problem-solving skills. The research was a mixed study that used both qualitative and quantitative techniques. The research was conducted in two stages. In the first stage, quantitative comparisons were made of the problem-solving skills of and social support received by the mothers of children working on the streets (n = 37) and non-working children (n = 35) and of the parental acceptance or rejection/control status of working children (n = 41) and non-working children (n = 41). In the second stage, the reasons children were working on the streets were evaluated qualitatively with seven children who were working on the streets and nine mothers. The Child/Adolescent Parental Acceptance–Rejection/Control Questionnaire, the Multidimensional Scale of Perceived Social Support, the Problem-Solving Inventory, and individual interview questionnaires were used as data collection tools. The social support and problem solving skills of the mothers with children working on the streets were lower than those of the mothers whose children were not working. The main themes and sub-themes that stood out at the end of the research were socioeconomic and political factors, environmental factors, cultural factors and family factors.     

Results from a psychometric assessment of a new tool for measuring evidence-based decision making in public health organizations

BackgroundIn order to better understand how to improve evidence-based decision making (EBDM) in state health departments, measurement tools are needed to evaluate changes in EBDM. The purpose of this study was to test the psychometric properties of a new measurement tool to assess EBDM in public health practice settings.MethodsA questionnaire was developed, pilot-tested and refined in an iterative process with the input of public health practitioners with the aim of identifying a set of specific measures representing different components of EBDM. Data were collected in a national survey of state health department chronic disease practitioners. The final dataset (n = 879) for psychometric testing was comprised of 19 EBDM items that were first examined using exploratory factor analysis, and then confirmatory factor analysis.ResultsThe final model from confirmatory factor analysis includes five latent factors representing components of EBDM: capacity for evaluation, expectations and incentives for EBDM, access to evidence and resources for EBDM, participatory decision making, and leadership support and commitment.ConclusionsThis study addresses the need for empirically tested and theory-aligned measures that may be used to assess the extent to which EBDM is currently implemented, and further, to gauge the success of strategies to improve EBDM, in public health settings. This EBDM measurement tool may help identify needed supports for enhanced capacity and implementation of effective strategies.     

Factors affecting adoption in Wales: Predictors of variation in time between entry to care and adoptive placement

In the UK, there has been an increasing emphasis in recent years on reducing the delay in making permanent placements for children who cannot remain living with their birth parents. Adoption is one such plan for permanence. This study examined those factors that predicted a lengthier care episode for a national sample of children recently placed for adoption. The data was drawn from the Wales Adoption Study. This is a mixed methods study that analysed information from the adoption reports of all children placed for adoption over a 13 month period during 2014 and 2015 (n = 374). Children were aged between 0 months and 6 1/2 years on entry into care. On average, the time between entering care and moving into an adoptive placement was 528 days. The results of the regression analysis showed that four child-related factors were associated with a longer wait in care before being placed for adoption. These were developmental delay, externalizing behaviour, serious and enduring health problems/disability and exposure to domestic violence. The procedural factors examined showed no association with length of time to placement. The findings from this study make a substantial contribution to further developing what is known about the timeliness of adoption within the current UK context. The implications for policy and practice are discussed.     

Predicting illegal income generation among homeless male and female young adults: Understanding strains and responses to strains

This study examined gender differences among homeless young adults' engagement in illegal economic activity (i.e., panhandling, selling drugs, survival sex, gambling, theft). A purposive sample of 601 homeless young adults (ages 18–24) was recruited from three U.S. cities (Los Angeles, CA [n = 200], Austin, TX [n = 200], and Denver, CO [n = 201]) to participate in semi-structured interviews. General strain theory was used to identify predictors of illegal economic activity, including strains (childhood abuse, street victimization, length of homelessness, transience) and responses to strain (deviant peer associations, substance use, post-traumatic stress disorder, arrest history). The full hypothesized path models for males and females separately were tested using observed-variable path analysis. Among females, a greater variety of illegal income sources was reported by those who had experienced greater street victimization and who had used a greater number of substances in the past year. Among males, a greater variety of illegal income sources was reported by those who had more deviant peer associations, experienced greater street victimization, and used a greater number of substances in the past year. Findings have implications for research and preventive interventions to address engagement in illegal economic activity among male and female homeless young adults.     

Services use by children and parents in multiproblem families

BackgroundMultiproblem families are multi-users of psychosocial and health care services, but little is known about factors associated with their care utilization in the general population. The aim of this study was to assess which factors were associated with the overall and psychosocial care use of two members—i.e., child and parent—of each multiproblem family.MethodsDuring well-child visits or psychosocial care, we identified 354 children and their parents who had problems in several life domains (response 69.1%). We used multivariate stepwise backward logistic regression analyses to identify the factors related to their use of overall and psychosocial care.ResultsA child's overall care use was associated with greater social support from family and friends (odds ratio, OR, 95% confidence interval, CI; OR = 1.05, CI = 1.01–1.08) compared to less perceived social support; and with more psychosocial problems in the child (OR = 1.84, CI = 1.04–3.24). Child's psychosocial care use was more likely among older children (OR = 1.94, CI = 1.20–3.15); greater social support by family and friend (OR = 1.03, CI = 1.00–1.06); more psychosocial problems (OR = 1.75, CI = 1.04–2.97); and when there were more parenting concerns (OR = 1.19, CI = 1.06–1.33). Parental overall and psychosocial care use was more likely when the family experienced a higher number of life events (OR = 1.27, CI = 1.17–1.38, and OR = 1.39, CI = 1.25–1.55).ConclusionsCare use in multiproblem families is related to family factors as well as psychosocial problems. It may be possible to use these family risk factors to identify such families early, whose intensive care use is possibly explained by the relationship with inadequate use of social support.     

Physical activity and nutrition program for adults with metabolic syndrome: Process evaluation

IntroductionThe Vietnam Physical Activity and Nutrition (VPAN) program aimed to improve physical activity and nutrition for adults aged 50–65 years with Metabolic Syndrome in Vietnam. The VPAN program consisted of a range of resources and strategies, including an information booklet, resistance band, face-to-face education sessions, and walking groups. This process evaluation assessed the participation, fidelity, satisfaction, and reasons for completing and not-completing the VPAN.MethodsData were collected by mixed-methods from a sample of 214 intervention participants. Quantitative data were collected via surveys (n = 163); qualitative data via face-to-face exit interviews with intervention program completers (n = 10) and non-completers (n = 10), and brief post education session discussions.ResultsMost participants (87%–96%) reported the program resources and strategies useful, assisting them to increase their physical activity level and improving their diet. The education sessions were the most preferred strategy (97%) with high attendance (>78% of participants). The main reasons for withdrawal were work commitments and being too busy.ConclusionThe evaluation indicated that the program reached and engaged the majority of participants throughout the six-month intervention. The combination of printed resources and face-to-face intervention components was a suitable approach to support lifestyle behavioural change in the Vietnamese population.     

Using a community-based participatory research approach to evaluate resident predictors of involuntary exit from permanent supportive housing

ObjectiveThe aim of this study was to determine an association between resident characteristics at time of entry to permanent supportive housing and exit status.MethodsA community-based participatory research (CBPR) approach was the guiding framework for the design, implementation and evaluation of this project. This retrospective observational study used an administrative data source from a local permanent supportive housing provider to compare resident characteristics among those who left housing voluntarily or involuntarily.ResultsThe population based sample (n = 407) was comprised of 51% males and 47% African-Americans with a mean age of 40 years (SD = 11.8). Involuntary exits (IEs) occurred in 40% of the sample (n = 166). IE was less likely with receipt of mainstream benefits, compared to employment income (O.R. = .546, p = .032). IE was more likely for residents self-identifying as African-American (O.R. = 1.56, p = .037) and when children resided in the household (O.R. = 2.03, p = .013).ConclusionsDespite limitations of community-derived data, findings suggest that supportive housing providers consider income source and family status when designing interventions to decrease IEs. A CBPR approach is a promising framework to guide evaluation efforts for supportive housing programs.     

From foster care to juvenile justice: Exploring characteristics of youth in three cities

Children placed in foster care are at risk for becoming involved with the juvenile justice system. This study documents the rates at which children involved with foster care enter the juvenile justice system (crossover or dually involved), and the factors associated with this risk. We utilize multiple birth cohorts and prospective, longitudinal data from birth to maturity separately in three major American cities. Analyses consider integrated administrative records from multiple birth cohorts representing populations in Cook County (Chicago; N = 26,003), Cuyahoga County (Cleveland; N = 10,284), and New York City (N = 13,065). Crossover rates ranged from 7 to 24%. African American males, and children who experienced congregate care were at highest risk for juvenile justice involvement. Older age at first foster care placement signaled progressively greater risk, as did more foster care spells for those first placed as infants. We discuss findings in terms of developmental theory, and as actionable intelligence to inform prevention, practice, and policy.     

Diabetes education program for people with type 2 diabetes: An international perspective

BackgroundIn the Palestinian community, lifestyle changes, rapid urbanization and socioeconomic development, stress, smoking, and changes in food habits has increased the risk of non-communicable diseases especially diabetes mellitus. Diabetes complications can be prevented if the glycemic status of patients with diabetes is maintained within a nearly normal range. Therefore, patient education is critical in controlling blood glucose levels within the normal range.ObjectiveThis study aimed at measuring the effect of diabetes educational intervention program for patients suffering from type 2 diabetes attending the Diabetes Clinic in Tulkarim Directorate of Health.MethodsA short duration observational study involving pre- and post-test educational intervention program was carried out on a relatively small number of type 2 diabetes patients at the Diabetes Clinic in Tulkarim Directorate of Health. In total, 215 patients attended a group-based 4 h educational intervention session about diabetes. The program included explaining diabetes mellitus-symptoms, risk factors, types, treatment and complications and main aspects of self-care of the disease (foot care, eye care, and blood glucose monitoring), main aspects of dietary management, weight reduction, blood pressure, smoking cessation, periodic investigations, home monitoring and importance of physical activity. Knowledge evaluation questionnaire were evaluated pre- and post-study. Anthropometric measurements such as body weight (WT), body mass index (BMI) and laboratory tests such as fasting blood glucose (FBG), hemoglobin A1C (HbA1c), cholesterol (Chol), and triglycerides (TG) were measured both at the beginning and at the end of the study. Significance of the results was assessed by paired t-test at 95% confidence interval.ResultsThe participant’s mean age was 51.07 that ranged between 31 and 70 years. For a total of 215 participants, 41.4% were males and 58.6% were females. The mean weight before educational intervention was 80.81 ± 14.95 kg (82.6 kg for males and 79.5 kg for females) that decreased to 78.9 ± 14.33 kg (81.1 kg for males and 77.3 kg for females) after educational intervention program. The BMI also decreased significantly after educational intervention. The mean fasting blood sugar was 188.65 ± 71.45 mg/dL before educational intervention that decreased to 177.7 ± 66.11 mg/dL after the educational intervention (p = 0.049). The mean glycosylated hemoglobin was 8.57 ± 1.21 before educational intervention that decreased to 7.95 ± 1.42 after educational intervention. The mean value of cholesterol before educational intervention was 183.27 ± 37.74 mg/dL that decreased to 169.57 ± 34.23 mg/dL after educational intervention. The mean triglycerides value decreased after educational intervention from 209.85 ± 171.04 mg/dL to 183.28 ± 152.4 mg/dL (p = 0.025). The mean score of knowledge questionnaire before educational intervention was 60.6 ± 20.65 that increased to 78.1 ± 13.4 after conducting educational intervention.ConclusionsDiabetes education was found to be effective on BMI, FBG, HbA1c, Chol, TG, and knowledge.RecommendationsDiabetes education is a cornerstone in the management and care of diabetes and should be an integral part of health planning involving patient’s family, diabetes care team, community, and decision makers in the education process.     

A randomized controlled trial of the effectiveness of the youth crime prevention program ‘New Perspectives’ (NP): Post-treatment changes and moderator effects

ObjectivesNew Perspectives (NP) aims to prevent that youth at onset of a criminal career will develop a more persistent criminal behavior pattern. The study aim was to examine whether NP was effective relative to care as usual in preventing and reducing (persistent) delinquency. Moreover, we examined improvements in secondary outcomes (e.g., peer and parent relationships and cognitive distortions) and other outcomes (e.g., substance use and self-esteem).MethodsAt-risk youth (N = 101) aged 12 to 19 years were randomly assigned to the intervention group (NP, n = 47) or control group (‘care as usual’, n = 54). The effects of the NP intensive phase (3 months after program start) and aftercare phase (6 months after program start) were analyzed.ResultsNP and care as usual did not differ on any of the outcome measures at both post-test occasions. The effects of NP were the same for boys and girls, different age groups, and ethnic groups.ConclusionsThe overall null-effects are discussed, including implications for further research, policy, and practice.     

Factors that influence parent recruitment into prevention programs in early childhood: A concept map of parents', practitioners', and administrators' points of view

Given that parents are the main carriers of change in their child, their participation in programs for preventing behavior problems in early childhood represents a key element in ensuring the success of the intervention. That said, although at-risk families benefit the most from this type of program, they are identified as being hard to reach. This study aims at identifying the factors that influence parent recruitment based on the points of view of the actors concerned. To this end, a concept mapping operation was performed, which involved parents (n = 19), practitioners (n = 19), and administrators (n = 13) from community and public organizations. The participants generated 131 statements to complete the following sentence: In your opinion, parents would enroll more in prevention activities for their child if…. These 131 statements were classified into 12 groups representing the factors that influence parent recruitment, all of which were considered relatively important (between 3.51 and 4.42 on 5). The participants also agree on an understanding of recruitment that tends toward an ecological model. This study shows that parent recruitment into prevention programs targeting behavior problems in early childhood is complex and multifactorial (including factors that concern parents, practitioners, services, organizations, and policies). Because the map shows that the influencing factors in recruitment appear to be interrelated, they should all be considered to increase the chances of reaching at-risk families.     

A qualitative study of 369 child welfare professionals' perspectives about factors contributing to employee retention and turnover

A statewide qualitative study of personal and organizational factors contributing to employees' decisions to either remain or leave employment in child welfare is described. Of particular interest was identifying factors related to employee retention. Professional staff (n = 369) in a state public child welfare agency, representing all levels of the agency and regions of the state, participated in 58 focus group interviews comprising some 1200 person hours of data collection. Core findings of the results are presented and discussed in view of information from other recent child welfare workforce studies. Recommendations and implications of the results for policy and practice are described.     

‘Reach Out,Rise Up’: The efficacy of text messaging in an intervention package for anxiety and depression severity in young people

BackgroundDepression and anxiety are among the most commonly experienced mental health issues faced by young people in Aotearoa, New Zealand. Considerable barriers exist that prevent young people from engaging with face-to-face mental health services. Young people's preference for technology-based counselling mediums such as text messaging opens up new pathways for intervention.ObjectiveA pilot text message-based intervention package was trialled for use by young people to evaluate the potential efficacy of the text package as an intervention for depression and anxiety symptoms.MethodThe text package was piloted using a 10-week longitudinal cohort pilot with 21 young participants (12–24 years) who demonstrated mild to moderate anxiety and/or depression symptoms.ResultsParticipants' post-package scores were significantly lower than their pre-package scores for both anxiety (Z = − 2.83, p = .005, r = − 0.65) and depression (Z = − 2.49, p = .013, r = −.056). ‘Feeling encouraged and supported’ increased as a result of receiving support from a trained supporter (Z = − 2.06, p = .039, r = − 0.45), but not from friends/family (Z = − 1.72, p = .130, r = − 0.37). Anxiety and depression scores did not change as a result of support from either trained supporters or friends/family.ConclusionsFindings support the potential efficacy of the text package, justify wider trials of the text package, and support the use of text message-based interventions as potentially effective therapies for young people.     

Children's subjective well-being in rural communities of South Korea and the United States

The study examined subjective well-being of 10- to 12-year-old children from rural South Korea (n = 489) and rural United States (n = 1286) using the Children's Worlds Survey within the framework of the ecological, relationship-based model of children's subjective well-being. Applying Structural Equation Modeling to the analysis, a large proportion of the variance was explained and children's subjective well-being was predicted in both countries by microsystem factors of family relationships, parent involvement, and school quality, and individual factors of age (younger), and gender (male). Additional microsystem factors predicting subjective well-being were neighborhood quality in South Korea, and peer relationships in the United States, which may reflect contextual influences of collectivistic (South Korea) and individualistic (United States) macrosystems.     

From assessing needs to designing and evaluating programs: Case study of a family support program in Portugal

In the last years, researchers have been emphasizing the importance of promoting needs-led, context-specific, user-centered services in the context of child protection. However, policy-makers and service planners around the world largely depend on US-based research evidence of what is effective in the domain of family support. This work presents, in two studies, the process of design and evaluation of a targeted family support intervention that was developed and implemented in Portugal.Following the Common Language Approach to needs assessment (Dartington Social Research Unit, 2001), in study 1 we screened 100 children and their families attending a generalist child care service for risk and protective factors. Four different clusters of needs were identified. One cluster was selected as target-group for the design of a service to match their needs. Results indicated that families in this cluster had socioeconomical disadvantages, a challenging family environment and inadequate parenting practices. Children were showing signs of problematic social behaviors.In study 2 we describe the theoretical process model and the logic model for the intervention, and experimentally evaluate the program's efficacy. Results from pre–post assessments indicate improvements in the intervention group (N = 20) in several areas of parental empowerment and family relations, comparing with the control group (N = 20).This approach to need-service matching seems to be a viable pathway to design needs-led, context-specific, and user-centered services, and to assess their efficacy, thereby informing policy makers and service planners.     

Development of an innovative process evaluation approach for the Families Improving Together (FIT) for weight loss trial in African American adolescents

This study demonstrates how a multi-theoretical, multilevel process evaluation was used to assess implementation of the Families Improving Together (FIT) for weight loss intervention. FIT is a randomized controlled trial evaluating a culturally tailored, motivational plus family-based program on weight loss in African American adolescents and their parents. Social Cognitive, Self Determination, Family Systems theories and cultural tailoring principles guided the conceptualization of essential elements across individual/family, facilitator, and group levels. Data collection included an observational rating tool, attendance records, and a validated psychosocial measure.ResultsAttendance records (0 = absent, 1 = present, criteria = ≥70%) indicated that 71.5% of families attended each session. The survey (1 = false, 6 = true, criteria = ≥4.5) indicated that participants perceived a positive group climate (M = 5.16, SD = 0.69). A trained evaluator reported that facilitator dose delivered (0 = no, 1 = yes, criteria = ≥75%) was high (99.6%), and fidelity (1 = none to 4 = all, criteria = ≥3) was adequate at facilitator (M = 3.63, SD = 0.41) and group levels (M = 3.35, SD = 0.49). Five cultural topics were raised by participants related to eating (n = 3) and physical activity (n = 2) behaviors and were integrated as part of the final curriculum.DiscussionResults identify areas for program improvement related to delivery of multi-theoretical and cultural tailoring elements. Findings may inform future strategies for implementing effective weight loss programs for ethnic minority families.     

Differences between risk factors for truancy and delinquency in Dutch adolescents

The present study examined differences in risk factors for truancy and delinquency. Research questions were: (1) Which risk factors are significantly different between truants and delinquents? (2) Which risk factors make the strongest distinction between truancy and delinquency? Participants were Dutch adolescents (N = 365) who received a penal sanction in the Netherlands. 83% (n = 304) of them had violated the penal law, and 17% (n = 62) received the penalty for truancy. Differences in risk factors for truancy and delinquency were found for age and parental punishment. Binary logistic regression showed that only parental punishment retained its predictive effects when controlling for other differences. Truants experienced more parental punishment than delinquent adolescents. The present study shows that addressing dysfunctional home circumstances could be more important for truants, indicating that existing interventions do not differentiate enough between truants and delinquents.