Development of a participatory monitoring and evaluation strategy

This paper describes the process of developing a participatory monitoring and evaluation strategy for a Kenyan youth-based NGO. The iterative nature of the study including the process of narrowing down indicators to measure and methods to monitor/evaluate these is well documented. A discussion on the extent to which the process achieved participation and was empowering for the participants reflects on existing power relationships and cultural context of Kenya and points to the need to create opportunities for youth where they engage with the broader community. Lessons that emerge out of the study focus on the importance of prioritizing monitoring and evaluation, the potential of youth to carry out effective monitoring and evaluation, and the need for researchers to engage respectfully with communities and participants.     

The participatory design of a performance oriented monitoring and evaluation system in an international development environment

This article illustrates the application of the impact monitoring and evaluation process for the design and development of a performance monitoring and evaluation framework in the context of human and institutional capacity development. This participative process facilitated stakeholder ownership in several areas including the design, development, and use of a new monitoring and evaluation system, as well their targeted results and accomplishments through the use of timely performance data gathered through ongoing monitoring and evaluation. The process produced a performance indicator map, a comprehensive monitoring and evaluation framework, and data collection templates to promote the development, implementation, and sustainability of the monitoring and evaluation system of a farmer's trade union in an African country.     

Power and perceptions in participatory monitoring and evaluation

This paper examines the assumptions that commonly underpin the design of participatory monitoring and evaluation (PM&E) within development programmes through the examination of a case study of a large rural development programme in Uganda. This case study reveals a mismatch between programme assumptions and participant perceptions, which stymied the implementation of PM&E. In this case, PM&E was based on the assumptions that programme and participant goals were compatible, participants were willing to volunteer and engage themselves for the greater good of their communities, and information sharing and communication was fairly free and open. However, farmers within the programme felt that the bureaucratic and accountability requirements of the programme were not their concern, and were acutely aware of power differences between farmers and programme officials, and between farmers of varying status. The key lesson to be drawn from this case is the need for a heightened awareness of power dynamics and political factors in the design of PM&E.     

An evaluation of donor agencies’ policies on participatory development: The case of Ghana

This article critically evaluates guidelines concerning participatory development by the World Bank and the United States Agency for International Development (USAID). It focuses on the different conceptual frameworks adopted in order to examine the different ways of incorporating participation in their development agenda. A literature‐based method was adopted and the analysis included evaluation of five documented experiences, including the Ghana Secondary Education Improvement Project and Ghana Water Sanitation and Hygiene Project from both the World Bank and USAID. Baum project cycle stages have been taken as activities for project participation. The findings show the need for better planning, ensuring sustainability and involving beneficiaries.     

Engaging children and youth in research and evaluation using group concept mapping

Group concept mapping is a systematic methodology that recognizes participants’ expertise in their own experiences. In this approach, participants share their diverse knowledge and interpret the data generated by all group members. This approach uniquely blends quantitative and qualitative techniques to create illustrative, structured conceptualizations. In this article, we describe the steps in group concept mapping and report feedback on this method from 37 children and youth who participated in group concept mapping studies. We recommend group concept mapping as an engaging way to involve children and youth in research and evaluation activities.     

Rethinking youth voice and institutional power: Reflections from inside a service learning partnership in a California juvenile hall

This article shares the dilemmas that emerge from a community service project that engages students in a systematic critique of the juvenile justice system from the inside. It explores how competing images of youth (as dangerous thugs, vulnerable children and kids who have made bad choices) coexist uneasily within the juvenile justice system and significantly shape and constrain this community service learning project. They influence how volunteers understand their experiences and relationships with students inside, and they shape how young people in the system speak about their own lives, the inequalities they see around them, and the juvenile justice system itself. By exploring these dynamics this article aims to develop a more nuanced understanding of youth voice.     

Mediating role of citizen empowerment in the relationship between participatory monitoring and evaluation and social sustainability

The paper explores the mediating influence of citizen empowerment on the relationship between participatory monitoring and evaluation (PM&E) and social sustainability as a contribution to the ongoing debate on sustainability. The empirical investigation took the form of mixed-methods approach with the objectives to determine the extent to which PM&E influences citizen empowerment; establish the extent to which citizen empowerment influences social sustainability; and establish the joint influence of PM&E and citizen empowerment on social sustainability. The study employed a concurrent parallel design, in which samples for quantitative and qualitative components were different but drawn from the same population, and data collected within the same timeframe. Quantitative data were analyzed through bivariate and multiple regression analyses. Conversely, the qualitative component utilized interpretive technique and recursive abstraction to organize, summarize and give impression on the causal mechanisms at play in the quantitative data. Evidence from the study revealed that citizen empowerment mediates the relationship between PM&E and social sustainability. The study also found that when PM&E and citizen empowerment are considered together, citizen empowerment seems to have a dominant influence on social sustainability than PM&E itself. Thus, the government and development practitioners should prioritize citizen empowerment as a precursor to the realization of social sustainability outcomes.     

Beyond resistance: Exploring health managers’ propensity for participatory evaluation in a developing country

The evaluation of interventions is becoming increasing common and now often seeks to involve managers in the process. Such practical participatory evaluation (PPE) aims to increase the use of evaluation results through the participation of stakeholders. This study focuses on the propensity of health managers for PPE, as measured through the components of learning, working in groups, use of judgment and use of systematic methods. We interviewed 16 health managers to determine the meaning they ascribe to these four components in their practice in a developing country, Haïti. We found that learning was often informal and that all managers attached a negative meaning to the use of judgment. Working in groups was favored by all managers, while the health managers viewed the use of systematic methods differently than do evaluators. The administrative health managers generally ranked lower in propensity for PPE than did their clinical colleagues. Implications for the practice of evaluation are discussed in relation to the work styles exhibited by managers in everyday practice, the proactive repetition of actions, the control exercised by formal procedures, and the collective versus “solitary” image of one's environment of action.     

Precarious leisure: (re)imagining youth,transitions and temporality

ABSTRACT

The precarity of young people’s transitions to work has been a longstanding focus in youth studies. As Furlong and others have demonstrated, processes of social, political and economic restructuring have led to a pronounced instability for young people entering the labour market. While the notion of labour market precarity has gained attention, the ‘contamination’ of precarity into other spheres of life such as leisure has been less developed. This article seeks to extend these debates through interrogation of the concept of ‘leisure precarity’. Drawing on a qualitative study of youth leisure in Glasgow, it argues that temporal anxieties have reframed young people’s experiences and understandings of leisure such that young people have come to fear ‘empty’ or unproductive time. The pressures of juggling work and study, or looking for work, meant that most participants in our research had limited time free for leisure, and temporal rhythms became fragmented between past, present and future. The paper argues that these multiple and contradictory leisure dispositions reveal new forms of individualisation and uncertainty, as well as traditional patterns of inequality, thereby bringing youth transitions into dialogue with the study of precarity in the twenty-first century.     

Working on Womanhood (WOW): A participatory formative evaluation of a community-developed intervention

The well-documented disparities in availability, accessibility, and quality of behavioral health services suggest the need for innovative programs to address the needs of ethnic minority youth. The current study aimed to conduct a participatory, formative evaluation of “Working on Womanhood” (WOW), a community-developed, multifaceted, school-based intervention serving primarily ethnic minority girls living in underserved urban communities. Specifically, the current study aimed to examine the feasibility, acceptability, and initial promise of WOW using community-based participatory research (CBPR) and represented the third phase of a community-academic partnership. Qualitative and quantitative data were collected from 960 WOW participants in 21 urban public schools, as well as WOW counselors, parents, and school staff over the course of one academic year. Results demonstrated evidence of acceptability of WOW and noteworthy improvements for WOW participants in targeted outcomes, including mental health, emotion regulation, and academic engagement. Findings also indicated several challenges to implementation feasibility and acceptability, including screening and enrollment processes and curriculum length. Additionally, we discuss how, consistent with participatory and formative research, findings were used by program implementers to inform program improvements, including modifications to screening processes, timelines, curriculum, and trainings – all in preparation for a rigorous effectiveness evaluation.     

Conducting evaluation in contested terrain: challenges, methodology and approach in an American context

Using case examples, the author describes circumstances under which violence and conflict, overt and covert, have impinged on his evaluation field work. When fear is pervasive, it constrains people's ability and willingness to participate in an evaluation and their candor if they do. It can also be dangerous. Safety and well-being of participants and researchers in his view take priority over the evaluation's goals. Evaluation involving people who are survivors of violence, torture and conflict requires special sensitivity and examples are offered of appropriate methodologies. Stakeholders in evaluations presumably have beneficent interest in a program's success. However in conflict situations ‘malevolent’ stakeholders, who standing to gain from a project's failure, will actively try to thwart it. Undermining the evaluation as well and impugning the evaluator's objectivity, skill, knowledge and credibility are among the tactics they employ. Evaluators are urged to stay attuned to field conditions, consider alternative methods and locations for collecting data and be self-conscious and deliberate about how their study and role are defined and understood by contending parties.     

Evaluation capacity building (ECB) interventions and the development of sustainable evaluation practice: An exploratory study

Evaluation capacity building (ECB) is a practice that can help organizations conduct and use evaluations; however, there is little research on the sustainable impact of ECB interventions. This study provides an empirical inquiry into how ECB develops sustained evaluation practice. Interviews were conducted with 15 organizational leaders from non-profits, higher education institutions, and foundations that “bought in” to ECB and were at least six months removed from an ECB contract. The result of this work highlights how sustained evaluation practice developed over time and what these practices looked like in real-world settings. A developmental, iterative cycle for how ECB led organizations to sustain evaluation practice emerged around key components to sustainability. First, leadership supported ECB work and resources were dedicated to evaluation. Staff began to conduct and use evaluation, which led to understanding the benefits of evaluation, and promoted value and buy-in to evaluation among staff. Common barriers and emerging sustainability supports not previously identified by ECB literature—the “personal” factor and ongoing ECB practitioner contact—are described. Practical tips for ECB practitioners to promote sustainability are also detailed.     

Exploring racial identities through participatory visual and ethnographic methods: (Re)presenting the identities of ethnic minority youth in Hong Kong

There is increasing research attention to the integration of ethnic minority youth in Hong Kong. Within this attention lies an interest in how these young people make sense of their identities in relation to their schooling experiences. From a qualitative methodological viewpoint, researchers’ positionalities, including their cultural background and scholarly motivations, have implications on the ways in which they (re)present their findings. Using the axes of insider and outsider, we reflect on and compare how we have approached two studies with ethnic minority youth in Hong Kong. We discuss the potential affordances and tensions of cultural insider and outsider roles in our research to highlight the cultural dynamics in our interactions with our participants. As we advance dialogue on how researchers approach their work through their own cultural positionalities, we offer a nuanced account of the complexities surrounding the ‘making’ of ethnic minority young people’s identities in Hong Kong.     

Understanding and (dis)trusting food assurance schemes: Consumer confidence and the ‘knowledge fix’

This paper uses evidence from focus groups with consumers in England to consider how consumers understand and evaluate a range of proxies or intermediary organisations that offer assurance about food and consumer products, particularly voluntary certification schemes. This addresses the current concern in developed economies about providing information in order to reconnect consumers with food producers and to support moves towards more local, fairly traded and sustainable production. However, we show that such a ‘knowledge fix’ approach of providing information may not reconnect consumers so easily. Participants found it particularly difficult to work out what certification involved and what kinds of organisations were providing assurance. They built vernacular typologies and comparative judgements that did not necessarily identify or prioritise ‘independent’ third-party certification as the gold standard, not least because of the practical difficulties of monitoring complex supply chains, and expressed confusion and scepticism about how well food assurance schemes could work in practice. Our results therefore problematise the knowledge fix urged in the literature and emphasise instead the need to better understand how consumers make sense of assurance information in different contexts.     

“We believe in you,like really believe in you”: Initiating a realist study of (re)engagement initiatives for youth not in employment,education or training with experiences from northern Sweden

Due to a scarcity of rigorous evaluations and to commence a realist study addressing the lack of knowledge about the workings of interventions directed towards "NEET" youth, this research aimed to understand how and under what circumstances (re)engagement initiatives are expected to facilitate the social integration of young people who are in a situation that prevents them from entering into studies or work. By conducting the first phase in realist evaluation, qualitative interviews with five managerial stakeholders from two northern Swedish initiatives and reviews of documents were carried out for data collection. Using thematic analysis and retroductive reasoning, an intervention-context-actors-mechanisms-outcomes configuration was developed to elicit an initial programme theory that explained how the initiatives were presumed to operate and under what contextual contingencies. The results indicate that the intervention is expected to improve the youths’ wellbeing and engage them in work or studies by strengthening their competence and confidence in a caring and collaborative context. To incorporate the diverse voices and heterogeneous experiences of youth themselves, and ascertain whether the intervention works as intended, for whom, in what conditions and why, the results now need to be tested in selected cases and refined in subsequent phases of evaluation research.     

Integrating the gender dimension in teaching,research content & knowledge and technology transfer: Validating the EFFORTI evaluation framework through three case studies in Europe

Gender equality and gender mainstreaming in research is one of the six European Research Area (ERA) priorities. Integrating the gender dimension in research content and teaching is one of its three objectives. It is arguably the objective where least progress has been made. In this article we contribute to the evidence base by applying the EFFORTI evaluation framework to three empirical case study interventions that aim to integrate the gender dimension in tertiary education and research content. Comparison is based on an evaluation of the design of the intervention, those factors that have enabled/ hindered its implementation as well as an assessment of outcomes and impacts. The findings of the case studies highlight the importance of design, specifically regarding resources, legal status and the definition and operationalisation of the gender concept. Implementation hinges on top-level institutional commitment and mainstreaming gender studies with support of a central unit and crucially gender competence. A lack of recognition and status of gender studies and subsequent innovations was seen to hamper implementation. Outcomes and impacts included an increased awareness and interest in gender, increased gender competence, a push towards gender equality regarding representation and organisational change as well as an improved accreditation process and more and better research.     

Opting Out (Without Kids): Understanding Non‐Mothers' Workplace Exit in Popular Autobiographies

Since the term appeared in 2003, popular media and academics have been interested in the phenomenon of ‘opting out’ — elite women choosing to leave their jobs to stay at home with their children. Although it is unclear whether the opt‐out revolution actually exists, this conversation has resulted in a wealth of scholarship on women leaving successful jobs to care for their children, particularly how maternity might be a graceful time to exit gendered organizations. However, there is not scholarship considering women without children who opt out of the dominant career model. In this study, I look at three popular autobiographies of women who left successful careers to pursue alternative work (farming, baking). I found that the women sought meaning in their work, control over their labour process, and a new definition of success. These narratives provide broader insight into the constraints of the dominant career model and gendered organizations as well as the particular difficulties for non‐mothers to opt out.     

Religion and bullying: Perspectives from sexual and gender minority youth (SGMY) in Michigan

Abstract

This paper explored whether SGM (sexual and gender minority) young adults in Michigan thought religion played a role in the bullying they had witnessed or experienced. Twenty-four self-identified SGM young adults ages 20–29 participated in this study. Semi-structured in-depth interviews were conducted with participants following protocols approved by an institutional review board. The majority of participants (23/24) stated that religion had played a role in the bullying they witnessed or experienced. Additionally, several participants noted that the worst bullying they experienced based upon religion came from their families.     

Women migrants in the global economy: a global overview (and regional perspectives)

ABSTRACT

Huge advances have been made in deepening and expanding our knowledge of gendered migration over the last decades in both theoretical and methodological terms. Empirically it is, however, still the case that North–South migration is at the basis of most theorisations, leaving the characteristics of South–South migration at the margins. In this paper we, therefore, shift the focus to intra- and trans-regional migration in a South–South context in exploring what this means for women migrants. While feminist scholars have highlighted care and the ways in which migration challenges social reproduction as an important issue, mainstream approaches continue to focus predominantly on the ‘productive’ lives of migrant workers. With migration theories still largely drawing on the experience of South–North migration, there continues to be relatively little understanding of South–South migration’s gender dynamics, despite the fact that many of the highly feminised, yet hyper-precarious, migration flows occur intra-regionally.