Causal inferences on the effectiveness of complex social programs: Navigating assumptions,sources of complexity and evaluation design challenges

This paper explores avenues for navigating evaluation design challenges posed by complex social programs (CSPs) and their environments when conducting studies that call for generalizable, causal inferences on the intervention’s effectiveness. A definition is provided of a CSP drawing on examples from different fields, and an evaluation case is analyzed in depth to derive seven (7) major sources of complexity that typify CSPs, threatening assumptions of textbook-recommended experimental designs for performing impact evaluations. Theoretically-supported, alternative methodological strategies are discussed to navigate assumptions and counter the design challenges posed by the complex configurations and ecology of CSPs. Specific recommendations include: sequential refinement of the evaluation design through systems thinking, systems-informed logic modeling; and use of extended term, mixed methods (ETMM) approaches with exploratory and confirmatory phases of the evaluation. In the proposed approach, logic models are refined through direct induction and interactions with stakeholders. To better guide assumption evaluation, question-framing, and selection of appropriate methodological strategies, a multiphase evaluation design is recommended.     

A novel approach for evaluating programs designed to serve military veterans: Using an adapted common components analysis

Evaluators are challenged to keep pace with the vast array of Veteran support programs operating in the United States, resulting in a situation in which many programs lack any evidence of impact. Due to this lack of evidence, there is no efficient way to suggest which programs are most effective in helping Veterans in need of support. One potential solution to this dilemma is to reconceptualize program evaluation, by moving away from evaluating programs individually to evaluating what is common across programs. The Common Components Analysis (CCA) is one such technique that aggregates findings from programs that have undergone rigorous evaluation at the level of program components (e.g., content, process, barrier reduction). Given that many Veteran programs lack outcome evidence from rigorous studies, an adaptation to CCA is needed. This report examines cross-sectional data from a pilot study using an adapted CCA across five domains of well-being (i.e., employment, education, legal/financial/housing, mental/physical health, and social/personal relationships). The purpose of this preliminary study is to determine the feasibility of eliciting program nominations and program components from Veterans via an online survey. When coupled with a longitudinal research design, this adaptation to CCA will allow for stronger causal claims about the expected impact of different program components within and across a variety of domains.     

Geriatric Hospitals in India,Today and in the Future

Summary

In a country that shuns hospitalization of the elderly, regarding it as disrespect of those who helped youngsters evolve, Heritage Hospital (HH)is a welcome change, a model and pioneer stand-alone geriatric hospital. With its non-ambulatory services looking after sick elderly, HH is like an extended family of seniors. HH's love and fresh air complement its Meals-on-Wheels program, guided by the nutritionist's healthy food. HH's Volunteer Guild; its Diabetes Club, ever growing with India's dramatic rise in the number of diabetics; its Senior Net Club's Click@50, making elders computer savvy; and Grandparent-Grandchild and Golden and Silver Couple contests celebrated on October 1st, are all widely appreciated, enforcing strong values Indians still share on marriage and family. Heritage brings together 10,000 seniors in Hyderabad, strengthening its motto of Eastern philosophy with its strong emphasis on care for the elderly.     

Therapeutic Responses to Domestic Violence in Australia: A History of Controversies

This paper reviews controversies about domestic violence occurring in heterosexual relationships discussed in the Australian context by practitioners and academics and published in the Australian & New Zealand Journal of Family Therapy over the past three decades. Controversies arose in relation to the provision of therapeutic interventions for domestic violence, primarily in individual and couple counselling and group programs. After a literature review, the following controversial issues are identified: (1) the role of patriarchy: Is a patriarchal culture the main cause of domestic violence? (2) Systemic family therapy and gendered violence: Does systemic family therapy hide men's responsibility for domestic violence? (3) Therapeutic and educational interventions for domestic violence: Does therapy turn a ‘crime’ into a ‘psychological problem’? (4) Men as victims: Do both men and women perpetrate domestic violence in equal measure? (5) It takes two to tango: What part do women play in eliciting men's violence?     

Pro-social behavior in the TV show “Come Dine With Me”: An empirical investigation

We investigate the influence of social approval, reputation, and individual characteristics on voting behavior in the German version of the TV show “Come Dine With Me”. Five contestants prepare a dinner for each other during the course of a week and evaluate each other’s performance. The winner receives a monetary prize. Evaluations remain concealed until the show is broadcast. Because actual voting behavior remains concealed during the show, a contestant could evaluate his/her opponents as zero in an effort to increase his/her own chances of winning, without risking later punishment in the form of low scores. However, this behavior is not observed in our dataset, which runs from 2006 to 2011. We find that all of the following have a significant influence on the evaluating behavior: the objective sophistication of a meal; the order of cooking; whether a person has already cooked; and the social similarity between contestant and evaluator. These findings help to improve understanding of the impact that reputation and social approval have on economic decision making.     

Training Students as Facilitators in the Youth Empowerment Strategies (YES!) Project

SUMMARY

This article describes the training of students as facilitators for the Youth Empowerment Strategies (YES!) project designed to promote problem-solving, social action and civic participation among underserved elementary school youth in West Contra Costa County, California. This project involved 160 fifth grade students in after-school activities which identified their capacities and strengths in ways which aimed to decrease rates of alcohol, tobacco and other drug use and other risky behaviors. The article describes the recruitment and training of high school students and their graduate student counterparts as facilitators in this university-community partnership, and discusses the implications for other youth-focused community-based projects.     

Community-Based Program Research

ABSTRACT

At first glance, the worlds of program professionals and evaluators may seem quite separate. However, there are common issues whose resolution will enhance both program development and research on programs. Program professionals and evaluators have a great deal to learn from each other. As that learning occurs, both program delivery and evaluation research will benefit. Both are concerned about matters of validity, whether it pertains to the nature of the program intervention itself or to the nature of the assessment of the program intervention. To reinforce the development of program evaluation in partnership, this paper discusses key points about evaluation research relevant to both program professionals and researchers. These include the contextual influences on a program, the “readiness” of a program for evaluation, and whether the evaluation research “works” for the program. Underlying our discussion is a call for the development of partnerships around research on programs. In that light, this article elaborates the process steps that should be taken to build program evaluation partnerships, including a discussion of what evaluators and program professionals need to know about each other, and their respective values, interests, and professional perspectives.     

The Community Development for Healthy Children Initiative

Abstract

An increasing interest in positive youth development has led to the creation and expansion of programs and initiatives related to youth involvement and engagement. This article focuses on the Community Development for Healthy Children initiative, which envisions making Kansas the best state in the nation in which to raise a child. The initiative includes three primary strategies: A multi-media campaign; technical assistance and support to local communities; and mini-grant opportunities. The paper provides examples of activities from across the state that promote youth involvement. Outcomes across four areas are examined, and the benefits and challenges of this initiative are also discussed.     

Ben's Grille

Summary

Advantages of computer-based alcohol education over traditional written materials in improving alcohol related behavior are presented in this article. The program, “Ben's Grille” was created to promote public awareness of issues relating to the use and abuse of alcohol The program is described in detail along with directions for use. One component of the program, an interactive drama, is the focus of this article. Characters from which a play can select to play are described. Methods used in obtaining feedback about the game are specified. The author concludes that both students and teachers have had positive reactions to the program.     

Social Work Admissions and Academic Accommodations for Students with Disabilities

ABSTRACT

The Americans With Disabilities Act of 1990 (ADA) protects students wth disabilities from discrimination by academic and professional programs in higher education. A student with a disability cannot be denied admission to an educational program because of his or her disability if the student is otherwise qualified. This means that a student with a disability who is qualified for an academic or professional educational program cannot be denied admission to a program based solely on the student&s disability. This educational requirement mandated by the ADA applies to all educational fields including social work education. The purpose of this study was to explore how social work programs are dealing with these requirements in their admission and academic accommodation procedures. Twelve social work programs located in the mid-western United States participated in the study. Representatives of each of these programs were given an in-depth interview focusing on their admissions process, academic accommodations, and general topics related to social work education and disabilities. All programs taking part in the research were accredited by the Council on Social Work Education (CSWE). The CSWE is the national accreditation body for social work education within the United States.