Collaborative evaluation of a high school prevention curriculum: How methods of collaborative evaluation enhanced a randomized control trial to inform program improvement

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome variables that can be used for program improvement. Throughout this project there were many examples of client learning from evaluator and evaluator learning from client. This article presents convincing evidence that collaborative evaluation can improve the design, implementation, and findings of the randomized control trial. Throughout this paper, we discuss many examples of good science, good evaluation, and other practical benefits of practicing collaborative evaluation. Ultimately, the authors created the term pre-formative evaluation to describe the period prior to data collection and before program implementation, when collaborative evaluation can inform program improvement.     

An approach to design long-term monitoring and evaluation frameworks in multi-actor systems--a case in water management

Learning-by-doing and adaptive management require careful monitoring and evaluation of the outcomes of environmental policies and programs under implementation. Selecting relevant indicators is difficult, especially when monitoring over a longer period of time. Further challenges arise when policies are developed as a collaborative effort among multiple actors. This paper discusses an approach to design frameworks for long-term monitoring and evaluation in multi-actor systems. It uses Dynamic Actor Network Analysis (DANA) as an actor-sensitive method to reconstruct program theories. This is combined with elements of assumption-based planning to identify critical assumptions and associated indicators to incorporate the dynamic aspects related to long-term monitoring. An application of this approach is described for a case of water management in the Netherlands. Here, mapping multiple perspectives and identifying critical assumptions helped to broaden the scope of monitoring in important ways. Identifying associated indicators and expectations on their development in response to policy implementation proved more difficult. From this case, it can be concluded that the approach is feasible, useful, but also demanding. However, with continuing trends of networked governance and adaptive management, additional efforts to reflect these trends in monitoring and evaluation, through this and similar approaches, are needed.     

The Efron dice voting system

About 50?years ago, Efron noted some counterintuitive properties of the long-term behavior of contests involving dice. For instance, consider the 6-sided dice whose sides are labeled (4,4,4,4,0,0), (3,3,3,3,3,3), (6,6,2,2,2,2), and (5,5,5,1,1,1). Each die has a 2/3 probability of rolling a higher number than the next one in the list and the last has the same 2/3 probability of rolling a higher number than the first. The non-transitivity of games involving non-identical dice was popularized by Gardner (Sci Am, 223:110–114, 1970). Although Gardner and other authors have observed that non-transitive dice serve to illustrate the complexities of the theory of voting, it does not seem that much attention has been paid to the corresponding voting system. Our purpose in this article is to present this voting system and compare its properties with those of other voting systems. One of the most interesting properties is the fact that cancellation with respect to the Efron dice voting system can replace cancellation with respect to pairwise preferences in Young’s characterization of the social choice function associated with the Borda Count.     

Caught Between Love and Money: The Experiences of Paid Family Caregivers

This paper considers the experiences of family home care providers, paid an hourly wage by California’s In Home Supportive Services program to care for disabled or elderly relatives. These caregivers are unique in that they provide care in what Arlie Hochschild calls the “third sector” of social life, where norms and responsibilities tied to work and family intersect. Drawing on in-depth interviews and ethnographic observations of family home care providers, we find that providers perceive their paid caregiving as deviant behavior that violates social norms surrounding family care, i.e. that people should not be paid for the care of kin. Family caregivers manage the norm violation associated with their carework by offering “accounts” that 1) emphasize the tasks and skill associated with caregiving and 2) by framing their carework as a public good that benefits the larger community. These accounts allow family providers to distance themselves from the norm violation of receiving a wage for care and to reconstruct their actions in a positive light.     

Predicting engagement in a transition to parenthood program for couples

Fostering participant engagement is a challenging but essential component of effective prevention programs. To better understand which factors influence engagement, this study examines several predictors of couple engagement in Family Foundations (FF), a preventive intervention for first-time parents shown to enhance parent mental health, couple relations, parenting quality, and child adjustment through age 3 years. FF consists of a series of classes delivered through childbirth education departments at local hospitals. Baseline data on socio-demographics, parent mental health, and couple relationship quality were examined as predictors of participants’ level of engagement in FF (n = 89 couples, 178 individuals). Sociodemographic variables such as parent gender, socioeconomic status, and age predicted program engagement to a limited extent. However, findings indicated that marital status was the best predictor of engagement. Discussion focuses on how findings can inform the development of practices that promote engagement, such as the use of targeted outreach efforts for individuals most at risk of disengagement.     

The effects of teenage fatherhood on young adult outcomes

This paper uses national longitudinal data and several new empirical strategies to examine the consequences of teenage fatherhood. The key contribution is to compare economic outcomes of young fathers to young men whose partners experienced a miscarriage rather than a live birth. The results suggest that teenage fatherhood decreases years of schooling and the likelihood of receiving a high school diploma and increases general educational development receipt. Teenage fatherhood also appears to increase early marriage and cohabitation, and has mixed short-term effects on several labor market outcomes.     

MORE INFORMATION IS NOT ALWAYS BETTER: THE CASE OF VOLUNTARY PROVISION OF ENVIRONMENTAL QUALITY

We use a new U.S. survey on pro‐environmental behaviors, attitudes, and knowledge and find that individuals engage in activities that they believe are more effective in reducing carbon emissions, regardless of whether or not these beliefs are accurate. We find that low provision of the public good is greater among people who believe they cannot do much for the environment and do not consider themselves environmentalists. A policy implication of our results is that the effect of more accurate information on the provision of the public good is ambiguous. (JEL Q50, Q54, C10)     

Family therapy for drug abuse: review and updates 2003-2010

Just 15 years ago, Liddle and Dakof (Journal of Marital and Family Therapy, 1995; 21, 511) concluded, based on the available evidence, that family therapy represented a "promising, but not definitive" approach for the treatment of drug problems among adolescents and adults. Seven years later, Rowe and Liddle (2003) review described considerable progress in this specialty with encouraging findings on adolescent-focused models based on rigorous methodology, as well as advances with adult-focused family-based treatments. The current review brings the field up to date with highlights from research conducted in the intervening 7 years, cross-cutting issues, recommendations for new research, and practice implications of these findings. Adolescent-focused family-based models that attend to the ecology of the teen and family show the most consistent and strongest findings in recent studies. Adult-focused models based on behavioral and systems theories of change also show strong effects with drug abusers and their families. The overarching conclusion is that family-based models are not only a viable treatment alternative for the treatment of drug abuse, but are now consistently recognized among the most effective approaches for treating both adults and adolescents with drug problems.     

Couple and family interventions in health problems

Intervention research for couples and families managing chronic health problems is in an early developmental stage. We reviewed randomized clinical trials of family interventions for common neurological diseases, cardiovascular diseases, cancer, and diabetes, which is similar to the content of previous reviews discussed later. One overriding theme of these studies is that patients with chronic illnesses and their families face a variety of challenges to which researchers have responded with an array of treatment modalities. Very few of the interventions reviewed, with the exception of treatment for adolescents with diabetes, tested family psychotherapy models. Most interventions were time-limited therapeutic interventions that trained families to improve their communication and problem-solving skills, individual and family coping skills, and medical management. Researchers more clearly described mechanisms of change in intervention studies with cancer and diabetes than with other diseases, and not surprisingly, they found greater empirical support for their interventions. Family interventions show promise to help patients and family members manage chronic illnesses. To develop an empirical base for family approaches to managing chronic illnesses, interventions must be based on theories that delineate mechanisms of change in family processes and skills in medical management necessary to maintain patients' and family members' health.