A vocational special college: preparing students for a participatory democracy?

This paper is based on an ethnographic type study of the say that young people have in the decisions which shape their education and their lives. Such student participation in decision-making is not only a challenge to an essentially authoritarian system in which education is controlled by teachers, politicians and others, it is the foundation of citizenship. The research was undertaken in a newly established, supposedly unique, vocational college for 14-18 year-olds. The analysis of data was structured in a framework of participative democracy: freedom, equality and fraternity. Using this framework, the paper examines the development of power structures, power relations and ideologies which maintain status quo, and define and determine the say young people have in decision-making. It addresses the denial of any foundation for active participatory citizenship in a segregated educational setting.     

Planning and implementation of a participatory evaluation strategy: A viable approach in the evaluation of community-based participatory programs addressing cancer disparities

Community-based participatory research (CBPR) has been posited as a promising methodology to address health concerns at the community level, including cancer disparities. However, the major criticism to this approach is the lack of scientific grounded evaluation methods to assess development and implementation of this type of research. This paper describes the process of development and implementation of a participatory evaluation framework within a CBPR program to reduce breast, cervical, and colorectal cancer disparities between African Americans and whites in Alabama and Mississippi as well as lessons learned. The participatory process involved community partners and academicians in a fluid process to identify common ground activities and outcomes. The logic model, a lay friendly approach, was used as the template and clearly outlined the steps to be taken in the evaluation process without sacrificing the rigorousness of the evaluation process. We have learned three major lessons in this process: (1) the importance of constant and open dialogue among partners; (2) flexibility to make changes in the evaluation plan and implementation; and (3) importance of evaluators playing the role of facilitators between the community and academicians. Despite the challenges, we offer a viable approach to evaluation of CBPR programs focusing on cancer disparities.     

Qualitative evaluation of family therapy programs: a participatory approach

In this article, we provide examples of participatory qualitative evaluation methods that can be used within family therapy training programs. These methods can elicit useful feedback to improve programs and, at the same time, empower trainees to become partners in the evaluation process.     

Development of a participatory monitoring and evaluation strategy

This paper describes the process of developing a participatory monitoring and evaluation strategy for a Kenyan youth-based NGO. The iterative nature of the study including the process of narrowing down indicators to measure and methods to monitor/evaluate these is well documented. A discussion on the extent to which the process achieved participation and was empowering for the participants reflects on existing power relationships and cultural context of Kenya and points to the need to create opportunities for youth where they engage with the broader community. Lessons that emerge out of the study focus on the importance of prioritizing monitoring and evaluation, the potential of youth to carry out effective monitoring and evaluation, and the need for researchers to engage respectfully with communities and participants.     

Seeking good governance in participatory-GIS: a review of processes and governance dimensions in applying GIS to participatory spatial planning

The adoption of participatory spatial planning (PSP) approaches has been partially supported by developments in participatory-GIS (P-GIS), as seen in applications both in local resource management in developing South countries, and in community neighbourhood planning in the urban North. Such applications provide a basis for examining the relationship between the use of geo-information and governance, as many P-GIS initiatives claim to foster accountability, transparency, legitimacy and other dimensions of governance. Examples from recent literature illustrate the strengths and weaknesses of utilising P-GIS, and in particular, the implications for greater participation, empowerment, and ownership of and access to spatial information, and for governance in general. Some new developments in GIS technology, like ‘mobile-GIS’, have the potential to strengthen these impacts. While P-GIS is not an essential component of PSP, if used with an adequate regard and sensitivity for issues of ownership, legitimacy and local knowledge, it can contribute to the empowerment of communities in solving spatial planning problems.     

Blazing an evaluation pathway: Lessons learned from applying utilization-focused evaluation to a conservation education program

In 2005, state fish and wildlife agency wanted to examine how one of its conservation education programs was providing science-based understanding and outdoor experiences by evaluating students’ knowledge, skills, attitudes and intended behavioral outcomes related to fish, fishing and aquatic habitats in Montana. A key factor in this study was the acceptance by program stakeholders to conduct the evaluation using a utilization-focused evaluation approach to promote usability and accuracy of evaluation results. Using a quasi-experimental non-equivalent group design, more than 2000 students in participating classrooms throughout Montana received a pre-survey, post-survey and an extended post-survey; 114 teachers participated in an Internet survey and 16 program instructors took part in a structured open-ended telephone interview. The participatory approach and mixed methods enhanced abilities to interpret results of student surveys in particular. The user-focused approach was discovered to be personal and situational, allowed the facilitation of the evaluation process with consideration for increased application of evaluation findings and implementation of recommendations from beginning to end. Further development of evaluation pathways is needed to more effectively evaluate outcomes and implement practical and transferable measures to determine if environmental education activities produce desired participant outcomes.     

Using developmental evaluation and community-based participatory research to develop a model of supportive housing

Community-based participatory research (CBPR) and developmental evaluation (DE) have emerged over recent decades as separate approaches for addressing complex social issues. Current literature offers little with respect to the use of CBPR and DE in combination, although the two approaches are complementary. Through the current paper, we outline how CBPR and DE were used to develop a model of supportive housing for teen families. More specifically, we describe the structures and processes that contributed to this development, including (1) our partnership approach, (2) pooled resources, (3) regular opportunities for collaboration and reflection, (4) integration of multiple data sources, (5) ongoing feedback and knowledge dissemination, and (6) adjustments to program practices. We end by providing insights into the lessons that we learned through this project. Through this paper, we describe how researchers and community partners can collaboratively use CBPR and DE to develop a program model in complex community settings. Insights are offered that will be important for researchers, evaluators, and practitioners seeking to develop programming in response to complex community issues.     

Collaborative research in child welfare: a rationale for rigorous participatory evaluation designs to promote sustained systems change

Expansion of the child welfare evidence base is a major challenge. The field must establish how organizational systems and practice techniques yield outcomes for children and families. Needed research must be grounded in practice and must engage practitioners and administrators via participatory evaluation. The extent to which successful practices are transferable is also challenged by the diversity of child welfare systems. The U.S. Department of Health and Human Services' Children's Bureau funded Quality Improvement Centers (QICs) that were designed to promote collaborative, multisite research that would address these evaluation needs. This article, based on the findings of a regional and a national QIC, describes the challenges facing research collaboration and the strategies for achieving success.     

Using participatory research in community consortia development and evaluation: Lessons from the beginning of a story

This article explores the first eighteen months of the development of a community-based consortium project that employs the methodology of participatory action research. Using the Community-Based Consortia Development (CBCD) framework to identify critical phase-specific issues, the author illustrates the applicability of lessons learned from the project to the utilization of the participatory philosophy and process for the empowerment of communities.     

Beyond resistance: exploring health managers' propensity for participatory evaluation in a developing country

The evaluation of interventions is becoming increasing common and now often seeks to involve managers in the process. Such practical participatory evaluation (PPE) aims to increase the use of evaluation results through the participation of stakeholders. This study focuses on the propensity of health managers for PPE, as measured through the components of learning, working in groups, use of judgment and use of systematic methods. We interviewed 16 health managers to determine the meaning they ascribe to these four components in their practice in a developing country, Haïti. We found that learning was often informal and that all managers attached a negative meaning to the use of judgment. Working in groups was favored by all managers, while the health managers viewed the use of systematic methods differently than do evaluators. The administrative health managers generally ranked lower in propensity for PPE than did their clinical colleagues. Implications for the practice of evaluation are discussed in relation to the work styles exhibited by managers in everyday practice, the proactive repetition of actions, the control exercised by formal procedures, and the collective versus “solitary” image of one's environment of action.     

Working on Womanhood (WOW): A participatory formative evaluation of a community-developed intervention

The well-documented disparities in availability, accessibility, and quality of behavioral health services suggest the need for innovative programs to address the needs of ethnic minority youth. The current study aimed to conduct a participatory, formative evaluation of “Working on Womanhood” (WOW), a community-developed, multifaceted, school-based intervention serving primarily ethnic minority girls living in underserved urban communities. Specifically, the current study aimed to examine the feasibility, acceptability, and initial promise of WOW using community-based participatory research (CBPR) and represented the third phase of a community-academic partnership. Qualitative and quantitative data were collected from 960 WOW participants in 21 urban public schools, as well as WOW counselors, parents, and school staff over the course of one academic year. Results demonstrated evidence of acceptability of WOW and noteworthy improvements for WOW participants in targeted outcomes, including mental health, emotion regulation, and academic engagement. Findings also indicated several challenges to implementation feasibility and acceptability, including screening and enrollment processes and curriculum length. Additionally, we discuss how, consistent with participatory and formative research, findings were used by program implementers to inform program improvements, including modifications to screening processes, timelines, curriculum, and trainings – all in preparation for a rigorous effectiveness evaluation.     

Problems and possibilities of development work among tribals: a participatory evaluation of a voluntary agency in India

Mandal, a church-related non-governmental voluntary agency operating in north-west India's Nasik district since 1966 was evaluated for performance in promoting self-sustaining economic growth and socio- political awareness in its beneficiaries. The research design incorporated 2 questions, the extent to which Mandal had used the integrated approach, and the extent to which it promoted structural change in the village. 2 levels of analysis were used: random samples of 315 individuals (163 beneficiaries and 152 non-beneficiaries) and data from the takatu's office for 20 involved villages and 8 control villages. Quantitative data were sought by examining files and doing closed interviews, and qualitative data were collected by observation and open-ended interviews. The variables used in the analysis were educational level, class category, caste, agricultural investment, family net income, individual consciousness and social participation. It was concluded that on the individual level some positive impact was discernible in terms of family income and agricultural investment. At the village level no quantitative improvement was measurable, but the effect of Mandal was symbolic in that it sets an example for social change. The Mandal has acquired a health, non-partisan secular image for social action.     

Beyond resistance: Exploring health managers’ propensity for participatory evaluation in a developing country

The evaluation of interventions is becoming increasing common and now often seeks to involve managers in the process. Such practical participatory evaluation (PPE) aims to increase the use of evaluation results through the participation of stakeholders. This study focuses on the propensity of health managers for PPE, as measured through the components of learning, working in groups, use of judgment and use of systematic methods. We interviewed 16 health managers to determine the meaning they ascribe to these four components in their practice in a developing country, Haïti. We found that learning was often informal and that all managers attached a negative meaning to the use of judgment. Working in groups was favored by all managers, while the health managers viewed the use of systematic methods differently than do evaluators. The administrative health managers generally ranked lower in propensity for PPE than did their clinical colleagues. Implications for the practice of evaluation are discussed in relation to the work styles exhibited by managers in everyday practice, the proactive repetition of actions, the control exercised by formal procedures, and the collective versus “solitary” image of one's environment of action.     

Using process evaluation to determine effectiveness of participatory ergonomics training interventions in construction

The construction industry continues to experience high rates of musculoskeletal injuries despite the widespread promotion of ergonomic solutions. Participatory ergonomics (PE) has been suggested as one approach to engage workers and employers for reducing physical exposures from work tasks but a systematic review of participatory ergonomics programs showed inconclusive results.. A process evaluation is used to monitor and document the implementation of a program and can aid in understanding the relationship between the program elements and the program outcomes. The purpose of this project is to describe a proposed process evaluation for use in a participatory ergonomic training program in construction workers and to evaluate its utility in a demonstration project among floor layers.     

Lapses,infidelities, and creative adaptations: Lessons from evaluation of a participatory market development approach in the Andes

Participatory approaches are frequently recommended for international development programs, but few have been evaluated. From 2007 to 2010 the Andean Change Alliance evaluated an agricultural research and development approach known as the “Participatory Market Chain Approach” (PMCA). Based on a study of four cases, this paper examines the fidelity of implementation, the factors that influenced implementation and results, and the PMCA change model. We identify three types of deviation from the intervention protocol (lapses, creative adaptations, and true infidelities) and five groups of variables that influenced PMCA implementation and results (attributes of the macro context, the market chain, the key actors, rules in use, and the capacity development strategy). There was insufficient information to test the validity of the PMCA change model, but results were greatest where the PMCA was implemented with highest fidelity. Our analysis suggests that the single most critical component of the PMCA is engagement of market agents – not just farmers – throughout the exercise. We present four lessons for planning and evaluating participatory approaches related to the use of action and change models, the importance of monitoring implementation fidelity, the limits of baseline survey data for outcome evaluation, and the importance of capacity development for implementers.