Evolutionary Evaluation: Implications for evaluators,researchers, practitioners,funders and the evidence-based program mandate

Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of “evidence-based programs”. From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.     

A Review of Nonfamilial Intergenerational Programs on Changing Age Stereotypes and Well-Being in East Asia

This paper examines whether nonfamilial intergeneration programs reduce age stereotyping and increase the well-being of both youth and older adults in five East Asian communities. We used the systematic review method and screened 2,261 abstracts, selecting 14 publications for full review. Studies reported positive attitudinal changes among young and old participants. The intergeneration programs generally covered one of two themes: art activities or cultural heritage. Three best practices that can enhance intervention effectiveness were pre-intervention training, maintaining the intensity of the intervention on a weekly base, and pair-wise matching between the two stakeholders. More studies are recommended to test intergenerational programs with randomized designs and a wider age range of young participants. Culturally specific intergenerational contact theory is also in need of development, particularly “status concern” between the young and old generation.     

The Changing Institution of Marriage: Adolescents’ Expectations to Cohabit and to Marry

Cohabitation has become part of the pathway toward marriage. Prior work focuses on expectations to marry and has ignored cohabitation. Although most young adults are not replacing marriage with cohabitation, but instead cohabit and then marry, it is important to study adolescents’ joint expectations to cohabit as well as marry. Our analyses draw on recently collected data from the Toledo Adolescent Relationships Study (N = 1,293). We find that adolescents are less certain about their cohabitation than marriage expectations. Dating and sexual experience, traditional values, prosocial activities, and parents influence adolescents’ union formation expectations. The findings from this work suggest that adolescents are including cohabitation as part of their future life trajectories but rarely envision cohabitation as substituting for marriage.     

Engagement in Mental Health Treatment Among Adolescents and Young Adults: A Systematic Review

The purpose of the present study is to review empirical evidence of the effects of interventions designed to improve engagement in mental health services among adolescents, young adults and their families. Investigators searched relevant databases, prior reviews, and conducted hand searches for intervention studies that met the following criteria: (1) examined engagement in mental health services; (2) included a comparison condition; and (3) focused on adolescents and/or young adults. Effect sizes for all reported outcomes were calculated. Thirteen studies met inclusion criteria. Conceptualizations of engagement and measurement approaches varied throughout studies. Approaches to improving engagement varied in effectiveness based on level of intervention. Individual level approaches improved attendance during the initial stage of treatment. While family level engagement interventions increased initial attendance rates, the impact did not extend to the ongoing use of services, whereas service delivery level interventions were more effective at improving ongoing engagement. The review illuminated that engagement interventions framed in an ecological model may be most effective at facilitating engagement. Implications for future research and practice are discussed.     

Judgments about Risk and Perceived Invulnerability in Adolescents and Young Adults

This study examined age differences in risk judgments and perceptions of invulnerability, by surveying 577 adolescents (grades 5, 7, and 9) and young adults (ages 20 to 30 years) for their judgments concerning natural hazards and behavior–linked risks. Adolescents were less likely than were young adults to see themselves as invulnerable, and only a small minority of adolescents evidenced such perceptions. Moreover, individuals’ perceptions about the magnitude of their personal risk for experiencing negative outcomes showed an inverse relation to age. Most participants were inaccurate and significantly overestimated risks; this was especially true of adolescents. These patterns of age differences were consistent across different types of risks and sociodemographic configurations. The results pose a challenge to conventional wisdom concerning adolescents’ perceptions of risk and have important implications for theory, programs, and policies related to adolescents.     

Alcohol and Substance Use in Adolescence and Young Adulthood: The Role of Siblings

Interpersonal relationships within and outside the family have been a central part of alcohol and substance use research. Many studies have focused on the role of parents and peers; fewer studies have focused on siblings. This article examines siblings’ roles in alcohol, tobacco, and other drug (ATOD) use patterns and trajectories in the context of familial and nonfamilial factors across time. First, intraclass correlations were used to examine the degree to which older siblings’ ATOD use was associated with younger siblings’ ATOD use. Second, hierarchical regression analyses were conducted to examine the degree to which individual, parent, sibling, and peer factors over time were associated with adolescents’ and young adults’ ATOD use. It should be noted that developmentally proximal predictors were utilized in these models and within-family replication was also examined. Results demonstrate strong associations between older and younger siblings’ ATOD use. Moreover, the developmentally proximal sibling variables were predictive of younger sibling ATOD use in the context of other variables across all substances. Study findings are discussed in terms of identifying promising and potentially malleable points of intervention for future investigators.     

Adolescent Female Offenders’ Subjective Experiences of How Peers Influence Norm-Breaking Behavior

Delinquent peers have a strong influence on adolescent delinquent behavior. However, few studies have investigated adolescents’, and in particular young females’, own perspectives of the role of peers on their delinquent behavior. The purpose of the present study was to explore how young female offenders described their delinquent behavior and more specifically the role they assign to peer relations in committing or avoiding delinquent acts. Nine female adolescents, sentenced to youth service, were interviewed, and the data was analyzed using the Consensual Qualitative Research (CQR) method. The results showed that committing crimes and taking drugs with peers were portrayed as a way for the female delinquents to socialize. Delinquent and pro-social activities with peers appear to serve similar developmental functions in the sense that it is described to fulfill the same developmental needs. The young offenders also described collectively created pressures and norms in the peer group as the main contributing factor to their norm-breaking behavior, where they described being both recipients and producers of influence in the group. Another important finding was that the female offenders showed an awareness of the importance of pro-social peers and the need to eliminate delinquent friends from their peer network in order to help them refrain from deviant behavior. Implications for prevention and intervention are discussed.     

Systematic dissemination of a preschool physical activity intervention to the control preschools

For public health interventions to have a meaningful impact on public health, they must be disseminated to the wider population. Systematic planning and evaluation of dissemination efforts can aid translation from experimental trials to larger dissemination programs. The Study of Health and Activity in Preschool Environments (SHAPES) was a group-randomized intervention trial conducted in 16 preschools that successfully increased the physical activity of preschool age children. Following the completion of the research study protocol, the intervention was abbreviated, modified and implemented in four preschools that participated as control preschools in the original research study. The purposes of the current study were to describe the process of refining the intervention for dissemination to the control preschools, and to assess the acceptability of the resulting abbreviated intervention delivery. Five overarching behavioral objectives, informed by process evaluation, data from the original trial and collaboration with intervention teachers, were used to guide the implementation. Teachers in the dissemination classrooms reported high levels of acceptability, potential for sustainability of the program, and positive results in knowledge, skills, and child outcomes. Researchers can include a systematic approach to dissemination of effective intervention elements to the control participants in experimental studies to inform future dissemination efforts and begin to bridge the dissemination gap.     

Voice,authenticity and ethical challenges: the participatory dissemination of youth-generated visual data over social media

Using the theoretical frameworks of childhood studies and visual ethics, this article explores ethical ways of engaging children and young people in disseminating self-generated visual data (‘participatory dissemination’) over social media. The discussion draws on a research project carried out with a group of young people in an underserved community in South Africa. The project was an educational intervention that aimed to enable the participants to bring out their experiences with the HIV and AIDS pandemic in South Africa and to reflect on related issues through participatory video making. The methodological focus was on exploring visual ethics in the context of participatory dissemination. Despite a growing interest in social media, few studies have been conducted in relation to ethics in using social media as an outlet to disseminate visual data created by young people. This article contributes to addressing this knowledge gap. It is argued that (1) the process of remaking visual data can enhance the ethics of dissemination by offering young participants an opportunity to reflect on self-representation more carefully and (2) the verbal contextualisation of participant-generated visual data can contribute to a further clarification of young people’s ideas, thereby making dissemination more ethical. I am cautious, however, to overstate the significance of disseminating young people’s verbal and visual expressions without researchers’ discretion because such expressions may contribute to stigmatising the young people.     

Social identity and alcohol in young adolescence: the perceived difference between youthful and adult drinking

This paper examines the evolving social identities of young adolescents in regard to alcohol and drinking culture in Norway. Detailed analysis of 29 focus group interviews and 32 individual interviews with 12–13-year-olds reveal a thorough negative attitude towards alcohol, especially when enjoyed by young people. Young adolescents found young people to be too irresponsible and immature to drink, while adults were portrayed as capable of enjoying alcohol without losing control or experiencing other negative effects. Through symbolic boundary work, they distanced themselves from adolescents who drank. The young adolescents rejected the idea that drinking alcohol was a sign of maturity; instead, they exhibited maturity by distancing themselves from drunk adolescents. We discuss how these findings reflect the participants’ socio-cognitive development, and how symbolic boundaries are often drawn against those closest in social distance. We conclude that boundaries between ‘adolescents’ and ‘adults’ are fundamental when understanding emerging adolescent social identities, especially when it comes to drinking and drinking culture.     

Sexually Experienced Adolescents’ Thoughts About Sexual Pleasure

Little research on adolescents has examined developmentally normative facets of sexuality that are not obviously linked to physical health. The purpose of this secondary data analysis was to qualitatively analyze adolescents’ thoughts about and experiences with sexual pleasure. The study sample consisted of 56 sexually experienced, ethnically diverse, predominantly female adolescents who were participating in a Web-based intervention to promote healthy sexual decision making. Comments on one message board, “Sexual Pleasure: Does It Matter to You?,” provided an opportunity to examine adolescents’ thoughts about and experiences with sexual pleasure, as well as their communication with partners about that topic. Adolescents’ comments demonstrated that they experience difficulties with pleasure in their sexual relationships. Adolescents generally believed that men are more likely than women to feel pleasure due to differences that include biology, understanding of one’s body, and control over partnered sexual behavior. Adolescents defined inequality of received pleasure differently and discussed contexts in which inequality may be acceptable. Adolescents expressed motivation to communicate with partners about sexual pleasure. However, their statements suggested they often lack the skills to do so. Future prevention and intervention programs should equip adolescents with skills to communicate with partners about sexual pleasure.     

Loneliness,the search for meaning,and the psychological well-being of economically disadvantaged Chinese adolescents living in Hong Kong: Implications for life skills development programs

Assuming a relational basis of meaning-making, we examined ways in which the search for meaning and loneliness relate to the psychological well-being of economically disadvantaged adolescents. Using a survey with a sample of 366 economically disadvantaged adolescents and 304 non-economically disadvantaged adolescents recruited from 10 schools in Hong Kong, we observed that the search for meaning had a positive association with self-esteem, self-efficacy, and life satisfaction only among economically disadvantaged adolescents, whereas loneliness had a negative association with those indicators of psychological well-being in the entire sample. We also identified an interaction effect between the search for meaning and loneliness on life satisfaction among economically disadvantaged adolescents. Our results partially supported our hypotheses by showing that loneliness and the search for meaning jointly affected the development of economically disadvantaged adolescents, whereas loneliness was a more significant predictor than the search for meaning. Given such functions of the search for meaning and sense of belongingness in the development of young people amid economic hardship, practitioners and educators should initiate meaning- and relationship-oriented life skills programs in the formal and non-formal learning contexts, as well as facilitate young people's search for meaning in the informal learning context.     

Anthropology,Dance, and Education: Integrated Curriculum in Social Studies

The integration of dance into K–12 curriculum can help students to learn better, encouraging deeper exploration and active engagement with content knowledge. The purpose of this intervention study was to determine how the integration of dance and social studies with an anthropological framework affects student learning of content knowledge in social studies, as well as student attitude toward the topic. An anthropological framework was implemented to foster respectful investigation of culture. As a supplement to a sixth-grade unit on Ancient Egypt, the experimental group received four intervention lessons, incorporating creative dance. Results show that at posttest the intervention group had significantly higher content knowledge than the control group, and qualitative student responses from the intervention group suggest extremely positive feelings toward experiences in the program. This suggests that incorporating dance into sixth-grade social studies with an anthropological framework can encourage student exploration and increase understanding of content.     

How and why are Theory of Change and Realist Evaluation used in food security contexts? A scoping review

The complex ways in which food security actions lead to nutrition and other health outcomes make it important to clarify what programs work and how, with theory-driven evaluation emerging as a promising approach to evaluate complex programs. However, it is unclear how and why theory-driven evaluation is applied in food security contexts. Our objective is to examine the development and use of Theory of Change and Realist Evaluation to support food security programs globally. Using a systematic search and screening process, we included studies that described a food security program, used a Theory of Change or Realist Evaluation, and presented original research or evaluations. We found a total of 59 relevant Theory of Change studies and eight Realist Evaluation studies. Based on our analysis, Theories of Change arose in response to three main problems: 1) the need to evaluate under complexity; 2) challenges with evaluation; and, 3) information gaps surrounding a program. In contrast, Realist Evaluation was reported to be developed primarily to understand a program’s outcomes. Reflecting on the problem to be addressed in the evaluation would help improve understandings of the evaluation context, which would then inform the choice and design of an evaluation approach.     

Gambling among culturally diverse older adults: a systematic review of qualitative and quantitative data

Culturally diverse older gamblers may face multiple jeopardies and socially structured challenges. In this first systematic review of empirical evidence of gambling in this population, the authors examined both quantitative and qualitative studies published between 1996 and June 2016. A thorough search of 7 databases yielded 18 articles with a total sample of 11,296 culturally diverse older adults. The review revealed contrary findings on the correlation between gender, education, income and gambling behaviour. Early onset was more frequently found among older adults who belonged to a culture that promoted tolerance of gambling activities; however, some developed a gambling habit after they had moved to a western society. Using an analytical framework, the authors demonstrate interrelated factors: enabling factors (cultural acceptance of gambling, supportive social networks, accessibility to gambling facilities and venues, and external cues); motivational factors (desire for excitement and winning money, coping with boredom, and stress due to structural issues); and buffering factors for culturally diverse older gamblers . Both environmental and personal factors could be triggered as buffers between gambling and culturally diverse older adults. In light of the motivational and enabling factors, practitioners and policy makers may need to step beyond focusing on ‘correction’ during intervention.     

Adolescents Exhibit Late Maturation of Long‐Range Beta Coherences in Affective Processing

We investigated whether intra‐/interhemispheric long‐range beta coherences mirror developmental changes in affective functional integration during adolescence. Electroencephalogram data were gathered from 15 young adolescents, 16 old adolescents, and 16 young adults during viewing affective pictures. The results indicated that both positive and negative pictures induced greater intra‐ and interhemispheric long‐distance beta coherences than neutral pictures. However, opposite results were observed between young and old adolescents in terms of negative phase differences. Old adolescents exhibited greater beta coherences for positive and negative pictures than both young adolescents and young adults, but there was no difference between the groups for neutral pictures. These observations suggest that long‐range beta coherence might reflect the late maturation of affective functional integration in adolescents.     

The Farming Question: Intergenerational Linkages,Gender and Youth Aspirations in Rural Zambia☆

With agriculture considered key to generating jobs for Africa's growing population, several studies have explored youth aspirations toward farming. While many factors explaining aspirations have been well studied, little is known about the actors' shaping aspirations. We developed a novel framework that focuses on the factors and actors shaping the formation and actual aspirations of rural youth and applied a unique “whole-family” approach based on mixed-methods data collection from adolescents (boys and girls) and corresponding adults. We applied this approach in rural Zambia, collecting data from 348 adolescents and adults in 87 households. The study finds that parents strongly shape youth aspirations—they are much more influential than siblings, peers, church, and media. Male youth are more likely to envision farming (full or part-time) than female youth. The male preference for farming reflects their parent's aspirations and is reinforced by the patriarchal system of land inheritance. Parents' farm characteristics, such as degree of mechanization, are also associated with aspirations. We recommend a “whole-family” approach, which acknowledges the influential role of parents, for policies and programs for rural youth and a stronger focus on gender aspects.     

Adolescents’ perceptions of parental influences on commercial and simulated gambling activities

Parents can have a major influence on young people’s access to and participation in gambling activities. However, with the rise of digital online gambling, there is greater potential for young people to freely explore and engage in gambling activities without parental oversight. This study examined perceived parental influences on adolescents’ gambling activities, including differences in these influences across commercial and simulated types of activities, and the association between parental influences and problem gambling symptoms. A survey of 824 adolescents from 3 secondary schools was conducted. The results indicated that financial gambling was usually facilitated by a parent, particularly for scratch tickets and sports betting. Simulated gambling activities, such as social casino games, tended to be reported as being unsupervised by parents. Young people’s perceptions of parents’ measures to limit, restrict or oversee online and electronic activities were not significantly associated with youth simulated gambling. Their perceptions of parental influences were not significant predictors of problem gambling behaviours. This study underscores the need to examine potential differences in how adolescents develop an understanding of different gambling activities without parental influences, and adds to the continuing debate on the necessity of regulation and other countermeasures to limit young people’s access to simulated gambling activities.     

Treatment For Suicidal Thoughts and Behavior: A Review of Family‐Based Interventions

The purpose of this article is to review the scientific evidence on the effects of family based interventions for suicidal ideation and behavior. We conducted an extensive search of electronic databases using a comprehensive search strategy. This search resulted in 16 studies that tested 13 interventions for treating suicidal ideation and behavior using family based interventions. Of the interventions identified, three yielded an overall improvement in suicidal ideation and behavior while an additional three interventions produced partial improvement in mental health symptoms. These studies targeted suicidal ideation and behavior in youth or adolescents while no studies examined family interventions for adults with suicidal ideation and behavior. The limitations of these studies and the need for additional research are examined.