Economic evaluation of an agricultural sector investment program: A case study for Peru

An evaluation of a sector-wide investment program differs in important respects from an evaluation of an individual project. First, the program as a whole is likely to have more than a marginal effect on production and trade levels and other variables, and so the returns to any one project depend on which other projects are included in the program. Therefore the evaluation of all projects in the program must be carried out jointly. Second in many cases Policy makers may judge alternative program designs according to a multiplicity of criteria, explicitly or implicity. Hence the project identification stage of work is more useful if it takes into account the multiple criteria. This paper reports an experience in constructing and applying a model for the design and evaluation of a sector-wide agricultural investment program. Emphasis is placed on the ways in which such a model may be used. In the course of the applications discussed here, policy makers' preference weights among alternative goals were elicited, but even without such information a model-based exercise can be helpful in the design of a sector investment program.     

Practitioner Competence in Social Work

Practitioner competence is becoming an increasingly important priority within the social work profession. A skill training program designed to promote practice competence was developed to examine problematic situations for social workers. Previous training programs have emphasized basic skills but have not attempted to teach skills in specific problematic situations. This pilot training program was evaluated using a time-series design replicated across four subjects. Results show that students made gains on all measures after the introduction of the training. These results suggest that social work students can enhance their practice skills and competence through training of this nature.     

Data Evaluation for Intrasubject-Replication Research

The data from intrasubject-replication research usually are evaluated through visual inspection. When behavior shows little or no wend over time prior to treatment and day-to-day variability is slight, and when trearmenr effects are marked, visual criteria can be readily applied. In many situations where visual inspection may not detect changes, statistical analyses provide a useful tool for evaluating the effects of treatment. The statistical rests for single-case research depart from the more familiar analyses used in between-group research. Different analyses are needed in part because of the special characteristics of time-series data. The present paper discusses visual inspection and statistical analyses of intrasubject-replication reseorch. In addition, two statistical analyses, time-series analysis and a nonparametric ranking procedure, are described and illustrated with ABAB and multiple-baseline designs. Guidelines for using statistical tests and problems they may present for clinical research are discussed.     

“Keeping It Real”: An Evaluation Audit of Five Years of Youth-Led Program Evaluation

Youth are increasingly seen as competent in participating in research and program evaluation, two activities previously reserved for adults. This article is a report of the findings from an evaluation audit of Stand Up! Help Out!, a participatory action after-school youth leadership development program for disadvantaged urban youth that utilized youth evaluations to develop a best practices service model. The youths' feedback assisted providers in improving services so that youth engagement in the program was 99% (by comparison with national highs of 79%). Here, the authors describe an important aspect of the process of youth-led program evaluation leading to such high youth engagement: how youth interviewed each other so as to optimize the authenticity of their program evaluations and contributions to program design. Drawing from over 5 years of program evaluation data collected by youth, the authors report on the youths' experiences as informants and coresearchers, consider strategies used to help youth best describe their experiences in the program, and describe implications for other settings looking to incorporate youth-led program evaluation. Youth-led program evaluation has considerable promise for helping service providers make programs more meaningful for disadvantaged youth.     

How Do We Know What Works? A Review and Critique of Current Practices in Ethics Training Evaluation

Training is a costly investment. As such, it is of great interest to know the extent to which that investment is yielding a positive return. Recent meta-analytic efforts have observed that ethics training programs are, indeed, having a positive effect, leading to the conclusion that the programs are working. However, they have also uncovered considerable variability in the effectiveness of ethics training programs, which leads to the purpose of the present study—to review current practices in ethics training evaluation. Through this review of 243 studies, consisting of 380 ethics trainings, we identified major themes in evaluation practices and training design. The tradeoffs associated with these evaluation procedures and designs are discussed, along with directions for future research.     

‘WORK FOR THE DOLE’ – A CHEAP LABOUR MARKET PROGRAM? AN ECONOMIST'S PERSPECTIVE

From an economists perspective, this paper explores some of the issues associated with the design of an effective labour market program, and evaluation processes which are required to determine the merits of a scheme. This analysis comes at the time when pilot projects under the federal Government's ‘Work for the Dole’ scheme are being implemented. The paper concludes that if the ‘Work for the Dole’ scheme is to be viewed as a labour market program, then an evaluation mechanism should have been determined prior to the implementation of such a scheme.     

EVALUATING GROUP INTERVENTION

Five types of data for the evaluation of group intervention are described and discussed. A model for using them in various combinations to: (a) evaluate contemporary practice, and (b) develop social technology is proposed. Two conclusions are: (a) single-subject designs can be used with groups, but grouped data designs do not have all of the shortcomings in group evaluation that they have in case evaluation. and (b) member satisfaction should be wed as an independent, not a dependent variable.     

Why targeting matters: The apprenticeship program for youth in the Czech Republic

In this paper, we analyze the targeting and outcomes of the apprenticeship program implemented under the Youth Guarantee/YG scheme in the Czech Republic. We examine the outcomes and targeting using counterfactual impact evaluation (quasi-experimental design) of the apprenticeship program on the basis of administrative data from the Czech Employment Office. The implementation strategy is analyzed using various policy documents. The findings indicate that the program is apparently targeted at those groups of young people who are less disadvantaged as regards education level and previous unemployment experience. At the same time, paradoxically, the effects in terms of outflows from the unemployment register are weak for the short-term and medium-term unemployed, as well as for low-skilled and high-skilled youth, and stronger effects are evident in the case of long-term unemployed and medium-skilled youth. The failures in targeting and in adjusting the program to the needs of more vulnerable groups of youth are due to an inconsistent implementation strategy of Czech Public Employment Services.     

更富裕是否意味着更幸福?基于横截面时间序列数据的分析(2003-2013)

四十年前,经济学家伊斯特林提出了“幸福感悖论”:短时期内个人和国家的财富水平与幸福感都正向相关,而在长期背景下,经济增长并不会显著提高整体幸福感水平。本文使用横跨十年的全国代表性横截面时间序列数据直接检验了财富与幸福感的关系,结果证实了“幸福感悖论”。研究发现,虽然在短时期内,无论是家庭人均收入还是省份的人均生产总值都与幸福感有显著的正相关,但在经济高速发展的十年内(2003-2013),省份人均生产总值的变化与幸福感的变化之间并没有显著相关。     

Lessons Learned From the First-Year Evaluation of a Small-Scale Home Visitation Program

ABSTRACT

Home visitation programs to prevent child maltreatment are offered in many communities. Agencies in these communities want to help families in need while under increased pressure to provide effective services. Funding is limited and competitive; some agencies might choose to limit funds spent on supervision, training, and evaluation as a way to provide more direct service. In this article, we use an implementation science framework and the results of an evaluation of a small home visitation program to underscore the importance of ongoing training and supervision, attention to fidelity, and program evaluation. The evaluation included 17 families entering the program during 21 months. Evaluators visited families in their homes at the beginning of the program and again 10 months later. Like many other well-intended, small-scale programs, this one “borrowed” from evidence-based models and expanded enrollment criteria in an attempt to better serve families. Findings from the evaluation suggest that the program, as it was carried out, was not effective at reducing parenting behaviors known to be associated with child maltreatment. We offer advice to funding and community agencies based on these findings and implementation science. Future evaluation research must pay greater attention to fidelity and implementation.     

A Review of Effectiveness of Group Work with Children of Divorce

This article reviews the published studies of the effectiveness of major group work programs, mainly implemented in schools, which address the stressful impact of parental divorce on children. Focused short-term program group work has shown to be modestly effective in helping children of divorce. However, methodological issues exist in regard to the evaluation studies, related to research design, program fidelity, biased ratings, and the overreliance on measures that focus on psychopathology and ignore coping and adaptation.     

Modeling the rally event in presidential politics: Toward conceptual and methodological clarity

This research provides conceptual clarity both to the modeling of rally events in presidential politics by introducing the stimulus-cognitive response model and to the measurement of rally events by presenting the steps necessary for proper specification and empirical analysis using the time-series method. The utility of stimulus-cognitive response modeling in conjunction with time-series is demonstrated by an examination of the attempted assassination of President Ronald Reagan. Several of the specific findings are counterintuitive and have implications for the presidency-congress literature.     

A Qualitative Evaluation of a Conditional Cash Transfer Program in Turkey: The Beneficiaries’ and Key Informants’ Perspectives

ABSTRACT

Since the 2001 economic crisis, conditional cash transfers (CCTs) have been provided to poor families in Turkey to improve education and health outcomes of children. Under the framework of CCT programs, grants provide an incentive for poor households to use available basic social services. The aim of this study is to explore beneficiaries’ perspectives in relation to a CCT program in Turkey. The in-depth study design entailed semistructured qualitative interviews with beneficiary households and key informants. A total of 397 in-depth interviews were conducted. Analysis results suggest that the CCT program not only positively affected health and educational outcomes, but also contributed to the empowerment of women and improved the self-esteem and self-confidence of beneficiary children. Recommendations for future research are made including the need for an impact evaluation analysis that employs quantitative research methods designed to improve the provision and quality of the basic social services.     

Considerations in the Evaluation of the Short Term Program—The Barwon Experiment

Evaluation of welfare projects is a difficut and demanding process. There are particular difficulties and considerations associated with an evaluation of the short term program—which for the purpose of this article is defined as one established with an initially guaranteed life of up to twelve months. The author examines some of the issues and practical considerations which emerged during the evaluation of one such program, the Barwon Regional Family Aide Scheme, and presents the model which was developed.     

Applying Single-Case Evaluation in Social Work

Summary This article reports on a research project involving the useof single-case designs on an agency-wide basis within KirkleesMetropolitan Education Social Work Service. Following a programmeof training, 21 social workers (69 per cent of the service)applied the methodology in 83 cases. The extent of practitionerinvolvement in this project prompted Bruce Thyer (Professorat the University of Georgia, USA and editor of Research onSocial Work Practice and author of Thyer, 1993) to state ina letter to the authors, ‘Please allow me to offer mycongratulations on a most valuable project. To my knowledge,this is the largest agency-based study of this type which hasever been conducted. Your agency social workers are especiallyto be commended for their implementation of single-case designswith real life clients and families’ (6 May 1994). Theproject's strategy was to concentrate on the prerequisites ofsingle-case methodology which include specifying target problemsand selecting an appropriate measure to monitor progress. Thetype of single-case design used was determined by the courseof natural practice, hence indicating the flexible nature andviability of this methodology in the evaluation of social workpractice. The use of single-case designs encouraged a systematicapproach in the definition of target problems, identificationof goals, selection of intervention procedures and in monitoringoutcomes. The practitioners found that single-case designs enabledcontinuous assessment of outcome data by both the clients andthe practitioners, providing a model of accountability and collaborativeworking. A paper based on this article was presented by MansoorKazi at the ADSS Research Group Conference, Stafford, 17–18November 1994.     

Assessment of Task-Centered Interventions with Families in Israel

The study describes and evaluates the effectiveness of task-centered interventions performed with families in two new neighborhoods in Jerusalem, Israel. Thirty-five low-income nondelinquent families experiencing financial, personal and family problems were treated by 11 social work trainees. Each worker performed a single-case time-series design to evaluate 2 to 4 families, using the Clinical Rating Scale and a Goal Attainment Scale. The families were interviewed at termination of treatment. Both practitioners' and families' assessments indicated improvements in the majority of clients. Improvements were associated with young age of spouses and with the application of the techniques of task assignment, focusing and guidance. The validity, generalizability, and practical implications of the findings are discussed.     

Single-Case Evaluation Designs for Practitioners

ABSTRACT

This article examines single-case designs that omit baseline phases, contain shorter reversal phases, administer treatment across fewer baselines, or have other features that make them easier for practitioners to use in evaluating their own interventions. Particular attention is given to the Repeated Pretest-Posttest and the Periodic Treatments Designs, the Nonconcurrent Multiple-Baseline Design, the short reversal design, the short multiple-baseline design, and the short alternating treatments design. Also discussed and illustrated is how these streamlined designs can raise practitioners' sensitivity to intervention outcomes, assist practitioners in providing evidence-based services while adjusting for client diversity, and advance practitioners' knowledge.     

Men's Domestic Violence Treatment Groups

A survey of all 13 men's domestic violence treatment groups in North Carolina found that such programs were similar in program philosophy and goals but highly divergent in group struc- ture. All programs utilized a feminist orientation which viewed domestic violence as resulting from socio-cultural and social learn- ing factors. Groups generally focused on the development of anger control, problem solving, and communication skills. Groups dif- fered widely in their agency affiliation, relationship with the court as referral source, degree of structure, leadership patterns, number of members, number of sessions, degree of co-ordination between men's and women's programs; follow-up procedures; and sophisti- cation of program evaluation. The diversity of men's domestic violence group treatment models is a result of grassroots laissez faire program development. This diversity offers opportunities to test the effectiveness of various group approaches. Considerations for men's domestic violence treatment programs are outlined. In addition, the need for systematic program evaluation and a statewide co-ordinating mechanism is dis- cussed.     

DECRIMINALISATION OF PUBLIC DRUNKENNESS IN WESTERN AUSTRALIA: THE PROCESS EXPLAINED

Two alternative models of service provision are associated with decriminalisation of public drunkenness – the medical or sickness model and the social welfare model. In the development of alternative strategies to accompany decriminalisation, Australian jurisdictions have largely followed the latter welfare approach. In Western Australia, decriminalisation of public drunkenness was spurred by the recommendations of the Muirhead Interim Report on Aboriginal Deaths in Custody. A community development approach was used to establish local management structures for sobering-up programs in areas of greatest need. Three sobering-up centres are now operating in the State with a fourth centre due to open in mid 1993. Some preliminary evaluation of the Western Australian program has been carried out but a more comprehensive research and evaluation program is being conducted to assess the impact of decriminalisation and the development of alternative responses.