Critical indicators for assessing the contribution of infrastructure projects to coordinated urban-rural development in China

It is widely recognized that the coordinated development between urban and rural areas can not only narrow gaps in infrastructure between urban and rural areas, promote balanced development in rural areas in terms of society, economy and environment, but is also an effective way to address issues facing agriculture, rural areas and farmers. In line with this, development of infrastructure projects has been an important means for promoting coordinated urban-rural development in developing countries (such as China). However, there is a lack of indicators that can be used to assess the contribution of infrastructure projects to coordinated urban-rural development. This paper thus attempts to present a set of critical indicators for evaluating the contribution of infrastructure projects to coordinated urban-rural development in the particular context of Chongqing, Western China.First, a list of optional indicators that are with potential for assessing the contribution of infrastructure projects to coordinated urban-rural development is presented based on examination on related project feasibility reports, official reports and literature. Then 42 indicators are identified from the optional list through a questionnaire survey. By using the data collected, the relative level of significance of each indicator is derived. Finally, an indicator system consisting of 19 critical indicators is established based on results of principle component analysis. The applicability and significance of the identified indicators for assessing the contribution of infrastructure projects to coordinated urban-rural development are discussed as well.     

More than just trees: Assessing reforestation success in tropical developing countries

Rural communities in many parts of the tropics are dependent of forests for their livelihoods and for environmental services. Forest resources in the tropics have declined rapidly over the past century and therefore many developing countries in the tropics have reforestation programs. Although reforestation is a long-term process with long-term benefits, existing evaluations of the success of these programs tends to focus on short-term establishment success indicators. This paper presents a review of reforestation assessment that highlights the need to not only consider short-term establishment success, but also longer-term growth and maturation success, environmental success and socio-economic success. In addition, we argue that reforestation assessment should not be based on success indicators alone, but should incorporate the drivers of success, which encompasses an array of biophysical, socio-economic, institutional and project characteristics. This is needed in order to understand the reasons why reforestation projects succeed or fail and therefore to design more successful projects in future. The paper presents a conceptual model for reforestation success assessment that links key groups of success indicators and drivers. This conceptual model provides the basis for a more comprehensive evaluation of reforestation success and the basis for the development of predictive systems-based assessment models. These models will be needed to better guide reforestation project planning and policy design and therefore assist rural communities in tropical developing countries to alleviate poverty and achieve a better quality of life.     

The evaluation of healthy city projects in developing countries

In international public health and other disciplines there is a debate about the use of process versus impact (sometimes referred to as outcome) indicators in project evaluations. With growing international and national support for Healthy City Projects in developing countries it is timely to address the issue of how to evaluate such projects. This paper briefly describes process and impact indicators, considers the importance of process indicators given the role of institutional strengthening and capacity building in Healthy City Projects and discusses the balance between locally and internationally generated indicators. A case study of the first Healthy City Project in a developing country in Asia (Chittagong, Bangladesh) illustrates how the project is linked with urban management and can enhance co-operation, co-ordination, motivation, internal organisation, decentralisation and community participation. Finally, some institutional indicators for evaluation are suggested.     

A strategy for monitoring and evaluating massive open online courses

We argue that the complex, innovative and adaptive nature of Massive Open Online Course (MOOC) initiatives poses particular challenges to monitoring and evaluation, in that any evaluation strategy will need to follow a systems approach. This article aims to guide organizations implementing MOOCs through a series of steps to assist them in developing a strategy to monitor, improve, and judge the merit of their initiatives. We describe how we operationalise our strategy by first defining the different layers of interacting agents in a given MOOC system. We then tailor our approach to these different layers. Specifically, a two-pronged approach was developed, where we suggest that individual projects be assessed through performance monitoring; assessment criteria for which would be defined at the outset to include coverage, participation, quality and student achievement. In contrast, the success of an overall initiative should be considered within a more adaptive, emergent evaluation inquiry framework. We present the inquiry framework we developed for MOOC initiatives, and show how this framework might be used to develop evaluation questions and an assessment methodology. We also define the more fixed indicators and measures for project performance monitoring. Our strategy is described as it was developed to inform the evaluation of a MOOC initiative at the University of Cape Town (UCT), South Africa.     

Policies and strategies for integrating women in agriculture and rural development

Continued economic stagnation, civil unrest, rural-urban migration, and a series of natural disasters have impeded efforts in the Sudan to integrate women into the development process. Although the Four-Year (1988-1989 to 1991-92) Salvation, Recovery, and Development Programs Plan does not explicitly addresses women's issues, its emphasis on food security, appropriate technology for the agricultural sector, small-scale industries and handicrafts, balanced regional development, and the needs of the poorest 20% of the population guarantees that women will be major recipients. There remains a need, however, to increase women's participation in the development planning process and to base projects on reliable data on women's economic activities. More successful in defining women's needs have been community development projects--Western Savannah Development Corporation, Blue Nile Integrated Rural Development Project, Nuba Mountain Project, and Jebel Marra Rural Development Project--that combine income generation, social welfare, and agricultural research. It is recommended that all such large integrated rural development or agricultural projects allot funds specifically for women's activities and ensure coordination with women's organizations to avoid duplication and identify areas of greatest need. Also urged is the development of appropriate technologies that will alleviate women's double burden of poverty and household chores and address the inequitable distribution of income. Establishment of a women's bureau for women's affairs and development within the National Planning Department would facilitate project formulation and evaluation. In need of change if women in development projects in the Sudan are to be successful are laws that limit female land ownership and practices that deny women loans and credit.     

The unique character of involvement in multi-site evaluation settings

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site program evaluations, traditional notions of participatory evaluation do not apply. The purpose of this research is to determine the ways in which stakeholders are involved in large-scale, multi-site STEM evaluations. This article describes the findings from a survey of 313 program leaders and evaluators and from follow-up interviews with 12 of these individuals.Findings from this study indicate that attendance at meetings and conferences, planning discussions within the project related to use of the program evaluation, and participation in data collection should be added to the list of activities that foster feelings of evaluation involvement among stakeholders. In addition, perceptions of involvement may vary according to breadth or depth of evaluation activities, but not always both. Overall, this study suggests that despite the contextual challenges of large, multi-site evaluations, it is feasible to build feelings of involvement among stakeholders.     

Project beneficiary participation and behavioural intentions promoting project sustainability: The mediating role of psychological ownership

It is of great importance that development projects (especially those projects that target improving the livelihood of rural communities) continue to deliver their intended benefits over their intended economic life—we call this “project sustainability.” Applying an experimental design, our study reveals that active involvement of project beneficiaries during the needs assessment and planning stages has a significant positive influence on the behavioural intentions of the project beneficiaries toward project sustainability. Our study also finds that psychological ownership plays a mediating role in the relationship between project beneficiary participation and project sustainability. Implications for project sustainability and directions for future research are discussed.     

Integrating gender needs into drinking-water projects in Nepal

It is argued that projects and programs designed to meet the practical needs of men, women, and children in communities should also focus on meeting the strategic gender needs of women. This paper shows what project planners can do to ensure women?s participation in the design and maintenance of development projects without increasing their workloads, and with the goal of raising their status in the family and society, as well as challenging men's prejudice. It utilizes the framework of strategic and practical gender needs in the context of the drinking-water sector, to argue that understanding how these needs are linked is important to the sustainability of drinking-water projects. Overall, this paper pointed out the great need to involve women in the management of water projects in order for it to be effective in reducing the burdens of the people. Moreover, all development initiatives, including improvements in water supply, should have explicit focus on improving women status and increasing their confidence. Meeting such gender needs requires real commitment from concerned individuals on all levels as well as budgetary provision to enhance the capacity of the involved sector, and heighten their awareness. Fulfillment of their strategic gender needs, will in turn, contribute to the sustainability of water projects.     

Using a participatory evaluation design to create an online data collection and monitoring system for New Mexico's Community Health Councils

We present the collaborative development of a web-based data collection and monitoring plan for thirty-two county councils within New Mexico's health council system. The monitoring plan, a key component in our multiyear participatory statewide evaluation process, was co-developed with the end users: representatives of the health councils. Guided by the Institute of Medicine's Community, Health Improvement Process framework, we first developed a logic model that delineated processes and intermediate systems-level outcomes in council development, planning, and community action. Through the online system, health councils reported data on intermediate outcomes, including policy changes and funds leveraged. The system captured data that were common across the health council system, yet was also flexible so that councils could report their unique accomplishments at the county level. A main benefit of the online system was that it provided the ability to assess intermediate, outcomes across the health council system. Developing the system was not without challenges, including creating processes to ensure participation across a large rural state; creating shared understanding of intermediate outcomes and indicators; and overcoming technological issues. Even through the challenges, however, the benefits of committing to using participatory processes far outweighed the challenges.     

From plan to action: Adapting evaluation to serve the developmental needs of a newly-funded multidisciplinary research center

The Southeastern Coastal Center for Agricultural Health and Safety (SCCAHS) is one of many newly-funded federal research centers, housing five multidisciplinary research projects and seven pilot projects, and serving a multi-state region. In the early stages of such a complex project, with multiple teams separated by geography and disciplines, the evaluation program has been integral in connecting internal and external stakeholders at the center and project levels. We used a developmental evaluation (DE) framework to respond to the complex political environment surrounding agricultural health and safety in the southeast; to engage external stakeholders in guiding the center’s research and outreach trajectories; to support center research teams in a co-creation process to develop logic models and tailored indicators; and to provide timely and feedback within the center to address communications gaps identified by the evaluation program. By using DE principles to shape monitoring and evaluation approaches, our evaluation program has adapted to the dynamic circumstances presented as our center’s progress has been translated from a plan in a grant proposal to implementation.     

Building evaluation capacity: definitional and practical implications from an Australian case study

Internationally, evaluation capacity-building activities have mushroomed as demands have increased for government-funded programs to demonstrate that they are effective and efficient. Despite this, there is a lack of clarity in the way in which evaluation capacity-building is defined and conceptualized. The current paper presents a case study of a national evaluation capacity building exercise that we are in the midst of conducting in Australia, and discusses the findings in relation to definitional, conceptual and practical issues. Specifically, we describe an evaluation capacity building exercise involving over 100 mental health projects, detailing the methods that we employ, some of the challenges that we have faced, and the benefits we feel we are achieving. Our key message is that definitions of evaluation capacity-building should not only make reference to equipping organizations to routinely conduct evaluations, but should also stress the varied uses to which evaluation findings can be put. In addition, such definitions should acknowledge some of the valuable by-products of evaluation capacity building activities, such as the development of shared understandings of the program or project being evaluated.     

Development of a participatory monitoring and evaluation strategy

This paper describes the process of developing a participatory monitoring and evaluation strategy for a Kenyan youth-based NGO. The iterative nature of the study including the process of narrowing down indicators to measure and methods to monitor/evaluate these is well documented. A discussion on the extent to which the process achieved participation and was empowering for the participants reflects on existing power relationships and cultural context of Kenya and points to the need to create opportunities for youth where they engage with the broader community. Lessons that emerge out of the study focus on the importance of prioritizing monitoring and evaluation, the potential of youth to carry out effective monitoring and evaluation, and the need for researchers to engage respectfully with communities and participants.     

Income generation and Facts for Life communication in Vietnam

In1997, UNICEF Vietnam conducted a participatory evaluation, Pathways Forward, to assess the impact of the Income Generation and Facts for Life (FFL) Communication Project, which communicates basic health messages to women who are also participating in a revolving loan scheme. Twenty-five people from UNICEF and the Vietnam Womens Union participated in the month-long evaluation. They used a combination of case studies, interviews, surveys, and social indicators to determine the projects impact on women finishing their final loan cycle in two project communes. A second group studied the projects microcredit component in order to recommend a financial strategy for the future.Evaluators found that while the project had successfully met many of its objectives, the degree of its success varied dramatically between the two communes studied. Further, the evaluation found the projects operational capacity needed to be strengthened so as to support existing microcredit activities.Based on these findings, the Pathways evaluation recommended that UNICEF postpone any future loan disbursements and focus instead on building the projects capacity through increased staffing levels and additional training. It also recommended a number of measures be taken to strengthen FFL communication activities, including training for group leaders and simpler, locally-produced FFL materials.     

Social impacts evaluation and insider-outsider paradigm: Floodwater spreading project on the Gareh-Bygone plain as an illustrative case

Selection of the appropriate social impact evaluation approach has become an important issue in agricultural and rural development projects in developing countries. The aim of this research was to use the lens of insider-outsider or mutual social impact assessment approach to assess the social impacts of floodwater spreading project (FWSP) on the Gareh-Bygone plain, Iran. A survey methodology with systematic sampling techniques was used to select 138 households as insider group in four villages’ of the Gareh-Bygone plain which is covered by FWSP. Furthermore, key person interview was used to assess the viewpoints of experts (outsider group) who had close, ongoing involvement with the project. Result indicated that the experts’ viewpoints were more positive towards social impacts of the project. Whereas, the project had some negative and positive social impacts from the local people point of view.     

Evaluating a project on Roma education

This research note is based on the evaluation of the Comenius project Teacher‐IN‐SErvice‐Training‐for‐Roma‐inclusion (INSETRom). The project represented an international effort that was undertaken to bridge the gap between Roma and non‐Roma communities and to improve the educational attainment of Roma children in the mainstream educational system. The evaluation of the project showed that such projects can impact a teacher's confidence and attitudes, but that implementing new insights poses many challenges.     

Assessing project approval procedures as formalised forms of public participation

Formalised public participation in project approval procedures is rarely addressed in technology assessment. Empirical data about public participation processes are taken into account even more rarely. This article explores the practice of public participation in infrastructure projects in the Federal Republic of Germany on the basis of empirical data from the period of 1990 to 2010. The author compares the empirical data about participation processes with the targets of the public participation and asks for the reasons for the lack of participation in formalised approval procedures. Furthermore, the author contrasts participation formats used in technology assessment with formalised public participation. In his conclusions, he advocates for a stronger combination of formalised and informal public participation in technology assessment.     

Monitoring and evaluation design of Malawi’s Right Foods at the Right Time nutrition program

Child stunting is a public health problem in Malawi. In 2014, the Government of Malawi launched the Right Foods at the Right Time (RFRT) program in Ntchisi district delivering nutrition social and behavior change communication, a small-quantity lipid-based nutrient supplement to children 6–23 months, and nutrition sensitive activities. Monitoring and evaluation (M&E) systems are key aspects of successful program implementation. We describe these and the methodology for an impact evaluation that was conducted for this program. Two monitoring systems using traditional and electronic platforms were established to register and track program delivery and processes including number of eligible beneficiaries, worker performance, program participation, and to monitor input, output, and outcome indicators. The impact evaluation used comparative cross-sectional and longitudinal designs to assess impact on anthropometric and infant and young child feeding outcomes. Three cross-sectional surveys (base-, mid-, and end-line) and two longitudinal cohorts of children followed in 6-month intervals from 6 to 24 months of age, were conducted in sampled households in the program and a neighboring comparison district. Additional M&E included qualitative studies, a process evaluation, and a cost-effectiveness study. The current paper describes lessons from this program’s M&E, and demonstrates how multiple implementation research activities can inform course-correction and program scale-up.     

Conservation of Bangkok old town

Conservation of urban heritage contributes to the quality of life of people. Unfortunately, the urban heritage tends to be set aside from city development. The growing importance of locality in recent years invokes the public participation in planning and conservation processes. The paper aims to address the issue in urban conservation through the case of Bangkok old town. The site has been designated as a conservation area with the master plan and a specific advisory board for around three decades. Though a number of palaces and religious buildings have been protected, there is still a need for recognizing the local heritage and the enhancement of public participation. The issues regarding heritage identification, standard used in conservation practices and excessive tourism development in Bangkok old town would be resolved by revisiting the master plan and improving the cooperation among stakeholders. Moreover, urban heritage should be considered as a basis for urban planning and projects.     

Outcomes Assessment and the Paradox of Nonprofit Accountability

Leaders of nonprofit organizations face a particular bind in responding to the demands for results‐based accountability. If they focus only on the project‐level outcomes over which they have the most control or for which indicators are readily available, they risk default on the larger question of accountability to publicly valued goals. On the other hand, if they try to demonstrate the impact of their particular projects on communitywide outcomes, they risk taking credit inappropriately or shouldering the blame for indicators beyond their control. Here, I present findings from a research project, conducted in collaboration with economic development organizations on the north coast of California, that explored the practical demands and dynamics associated with this paradox. The key challenges are more civic and political than technical.     

Impact assessment of the EU structural funds to support regional economic development in rural areas of Germany

Rural areas in Germany have been subject to major structural changes in agriculture and other economic sectors due to the combined effects of CAP reform and socio-economic adjustments resulting from German reunification. By comparing the different approaches to assistance for rural economic development in the two groups of rural areas the paper will focus on the following topics: analysis of initial conditions with respect to agricultural, demographic and economic indicators; design of the delivery system for financial assistance with regard to strategic aims and the policy mix of the programmes; organizational and operational aspects of the required system for monitoring and evaluation of operations according to EU regulations; indication of intended and immediate impacts of some measures, e.g. changing conditions on the labour markets in different types of rural areas. Conclusions will be drawn from comparison of observable changes based on experiences with impact assessment and evaluation of support schemes in the two different types of rural areas during the current phase 1989–1993 with a view to the next phase of the reform of the EU structural funds 1994–1999.