Urban flooding,social equity,and “backyard” green infrastructure: An area for multidisciplinary practice

ABSTRACT

“Backyard” green infrastructure programs are an innovative way to manage urban stormwater, with many social and ecologic benefits. In many programs, however, residents with lower incomes are not reached, though they could benefit from participation, and though their participation could benefit the socioecological system. We examined awareness of and interest in backyard green infrastructure among lower- and moderate-income residents (N = 234). Awareness among our study population is low to moderate, but interest is moderate to high, with variability by some demographic and other characteristics. A spouse/partner, city agency, and/or neighbor may have influential roles in increasing participation in backyard green infrastructure.     

Expanding theory-based evaluation: Incorporating value creation in a theory of change

Evaluations of policies and programs often use a theory of change to articulate how the intervention is intended to function and the mechanisms by which it is supposed to generate outcomes. When an evaluation includes cost and efficiency considerations, economic and other concepts can be added to a theory of change to articulate a theory of value creation that articulates the mechanisms by which the intervention should use resources efficiently, effectively and create sufficient value to justify the resource use.This paper introduces some theories of value creation that are often implicit in program designs. Making these theories explicit can support clearer evaluative thinking about value for money - including specification of criteria and standards that are aligned with the theory, methods of inquiry that test the theory, and well-reasoned judgements that answer evaluative questions about value for money. Implications for evaluation practice will be discussed.     

Visionary evaluation: Approaching Aboriginal ontological equity in water management evaluation

The 2017 Traditional Owner evaluation of the implementation of the Murray-Darling Basin Plan developed an approach to evaluation that tested the use of Standpoint Theory in the field of natural resource management. This methodological choice was intended to enable First Nation approaches to data generation and use in equal measure to non-indigenous approaches. The method is implemented as a nested, up-hierarchy of scale, enabling a pan-optican dimension of vision from "below" and "above". The paper does not present the evaluative results regarding the implementation of the Plan because that information is co-owned by the participating Nations for their uses. Instead, and in respect of that arrangement, the paper presents the evaluation practices funded by the Murray-Darling Basin Authority. The methodology was negotiated and implemented with the Nations in the pilot study as a co-production across cultural boundaries. The approach was then evaluated by the participants, and these results are reported. All those reviewing the methodology were directly involved in some aspect of the evaluation, 64 % of whom identified as Traditional Owners, 67 % of whom were involved in high level decision-making about the evaluation approach. Traditional Owners rated cultural competence of the tested approach at 68 %, the benefits of the approach at 75 %, satisfaction with the standard of the evaluation at 72 %, and satisfaction with complying with the Basin Plan’s requirements for evaluation at 78 %. Recommendations for broader engagement and better science communication are made.     

Drug abuse prevention evaluation methodology: a bright future

Drug abuse prevention research findings have been inconsistent. These inconsistencies can be related to several issues including study design and methodology. This article presents consensus recommendations developed to enhance drug abuse prevention evaluation research by a group of prevention researchers and practitioners who met at the National Institute on Drug Abuse in Rockville, Maryland during May 1989. As noted by the number of consensus statements, there was a high level of agreement. After exploring various aspects of evaluating prevention interventions, that agreement was reflected in specific recommendations which are directed to modifying prevention approaches; integrating epidemiologic, etiologic and intervention research methods; and expanding prevention research utilization.     

The family's role in person-centered care: practice considerations

Effective implementation of person-centered care requires a shared understanding and commitment to make it a reality by administrative personnel, direct care providers, and residents and their family members. Long-term care facilities must seek ways to engage residents' families in person-centered care through its training, policies, care planning, and documentation. Doing so may require revisions to policies and work practices, and ongoing leadership efforts to maintain this care framework within the realities of staff turnover and regulatory requirements. Developing protocols and procedures that facilitate family members' communication with staff and build consensus and shared values will result in a system that represents and honors the unique perspectives, values, and needs of each resident receiving care. It is important for facility leadership to set the tone for acknowledging the importance of family involvement in person-centered care by modeling acceptance of concerns and criticisms as valid and by acknowledging that direct care providers, residents, and their family members have a voice in care decisions. Such an approach has the greatest chance of success in promoting person-centered care and the shared values necessary to ensure its successful implementation.     

The evaluation ranking scale: a new methodology for assessing satisfaction

Most patient satisfaction scales produce high, undifferentiated levels of reported satisfaction that fail to detect program areas that consumers do not like. Methodological problems apparently contribute to these results. An alternative procedure, the Evaluation Ranking Scale (ERS), was formulated and tested. A 2 X 3 design was employed with 246 public health center patients randomly assigned to one of two measurement techniques (ERS vs. a global measure) and one of three informational sets. A secondary group of subjects was a convenience sample of 26 staff members, which allowed comparisons of staff evaluations of the health center to patients' evaluations of the health center. Compared to the global measure, the ERS provided more specific information about particular program components, was more discriminating, and resulted in mean satisfaction scores that were significantly lower. This new approach may be a more effective technique for assessing the psychosocial effectiveness of human service programs.     

Mediators and moderators in the evaluation of programs for children. Current practice and agenda for improvement

The author examines the role of mediators and moderators in the evaluation of programs for children. The terms are defined and examples of each are presented. Using bibliometric analysis, the author examines how evaluators use mediators and moderators in treatment studies in education, juvenile justice, health care, child protection, and mental health. The use of mediators and moderators is sporadic and vague at best. An agenda for improvement is outlined that includes greater use of program theory and intensive case studies to find out why researchers in prevention and health promotion incorporate mediators and moderators more effectively in their evaluations.     

Labour provisions in preferential trade agreements: Current practice and outlook

While the WTO and Doha Development Round do not deal with labour issues – they leave this to the ILO – the main countries that conclude free trade agreements incorporate labour provisions, which vary in terms of stringency. Sanctions are rarely used, and fears that “social clauses” would serve protectionist purposes have proved to be unfounded. Labour provisions are designed to meet a variety of sometimes conflicting goals, by means of different mechanisms aimed at improving labour practices and promoting Decent Work; the author makes a number of suggestions in this regard.     

Deaf and hard of hearing faculty in higher education: enhancing access,equity, policy,and practice

Higher education institutions are often well prepared in terms of accommodation policies and practices for disabled students. Ironically, campuses are often not prepared once disabled academics return as faculty. Most are particularly unfamiliar with the unique access needs of deaf or hard of hearing academics. This can result in career hindrances to employment and tenure, as well as potential losses to campuses in terms of diversity. Background and substantiation on this access issue is provided along with recommendations for policy-making and practices for campuses that are geared to ensuring career success for deaf and hard of hearing faculty.     

The development of evaluation as a profession: Current status and some predictions

Sociological models of professionalization are applied to recent events in program evaluation in order to understand the development of the field and to predict future events. The focus is on problems that might arise and on the necessity of ameliorating them. The possibility of eliminating such problems is discounted since they appear to be integral elements of the process of professionalization. Major elements of the analysis include discussions of the consequences of the development of a specialized body of evaluation knowledge, the definition of evaluation tasks, exclusivity in the performance of those tasks, the development of professional associations, and problems in the training of evaluators. The reasons for problems in these areas are presented and the importance of being aware of the origin of the problems is discussed.     

Practical considerations in the interview and evaluation of sexual offenders

The evaluation and assessment of sexual offenders is different than any other type of evaluation, and most clinicians are not properly trained to interview this population. This article addresses the clinical and ethical issues particular to the interview, assessment, and evaluation of these types of offenders. It offers both practical information regarding the interview itself, along with an overview of classification systems, paraphilias, and assessment techniques used with this population. In addition, issues related to risk assessment and risk management are also addressed, and an introduction to the use of actuarial risk assessment instruments is provided.     

Conducting evaluation in contested terrain: challenges, methodology and approach in an American context

Using case examples, the author describes circumstances under which violence and conflict, overt and covert, have impinged on his evaluation field work. When fear is pervasive, it constrains people's ability and willingness to participate in an evaluation and their candor if they do. It can also be dangerous. Safety and well-being of participants and researchers in his view take priority over the evaluation's goals. Evaluation involving people who are survivors of violence, torture and conflict requires special sensitivity and examples are offered of appropriate methodologies. Stakeholders in evaluations presumably have beneficent interest in a program's success. However in conflict situations ‘malevolent’ stakeholders, who standing to gain from a project's failure, will actively try to thwart it. Undermining the evaluation as well and impugning the evaluator's objectivity, skill, knowledge and credibility are among the tactics they employ. Evaluators are urged to stay attuned to field conditions, consider alternative methods and locations for collecting data and be self-conscious and deliberate about how their study and role are defined and understood by contending parties.     

The private practice of social work: Current trends and projected scenarios in a managed care environment

This article reviews the status of the social work labor force engaged in the private practice of social work based on data drawn from the full membership of the National Association of Social Workers. The demographics, areas of practice, income, and career development patterns of this sub-set of social workers are explored. These trends and issues are then discussed within the context of the realities of actual and potential changes in the mental health system of care in this society and their implications for private practice. Despite clear patterns which show a consistent upward trend in the proportion of social workers engaged in the private practice of social work, the current political and economic environment raises substantial questions about the nature and breadth of this component of social work practice in the future.     

Lessons learned using a values-engaged approach to attend to culture,diversity, and equity in a STEM program evaluation

Evaluation must attend meaningfully and respectfully to issues of culture, race, diversity, power, and equity. This attention is especially critical within the evaluation of science, technology, engineering, and mathematics (STEM) educational programming, which has an explicit agenda of broadening participation. The purpose of this article is to report lessons learned from the implementation of a values-engaged, educative (Greene et al., 2006) evaluation within a multi-year STEM education program setting. This meta-evaluation employed a case study design using data from evaluator weekly systematic reflections, review of evaluation and program artifacts, stakeholder interviews, and peer review and assessment. The main findings from this study are (a) explicit attention to culture, diversity, and equity was initially challenged by organizational culture and under-developed evaluator–stakeholder professional relationship and (b) evidence of successful engagement of culture, diversity, and equity emerged in formal evaluation criteria and documents, and informal dialogue and discussion with stakeholders. The paper concludes with lessons learned and implications for practice.     

Economic evaluation of drug court: methodology, results, and policy implications

The purpose of this study was to conduct a cost-benefit analysis of three Drug Court programs in Kentucky for two groups of Drug Court participants: program graduates and program terminators. The economic benefits of the Drug Court programs were estimated relative to a comparison group of individuals who were assessed for the Drug Court programs, but did not enter the programs. This study highlights important factors in estimating the costs and the economic benefits of a Drug Court program. Results indicated that, particularly for graduates, Drug Court involvement was associated with reductions in incarceration, mental health services, and legal costs, as well as increases in earnings and child support payments. Net benefits and benefit–cost ratios for each program are presented and policy implications are discussed.     

Examination of the empirical research environment of program evaluation: methodology and application

The study dealt with a research environment in which the treatment effect is heterogeneous, and in which individuals use their assessments of the treatment effect to decide whether or not to enroll in an intervention program. In this article, a new methodology is proposed for examining the validity of the specified research environment in a given intervention program and database. The methodology is based on direct examination of the assumptions underlying that research environment. Comparison of the commonly used verification method with the one proposed here revealed that these methods are complementary rather than substitutional.     

Ratings checklist for warnings: a prototype tool to aid experts in the adequacy evaluation of proposed or existing warnings

In the field of forensic human factors, experts are often called upon to assess and evaluate the adequacy of new or existing products' warnings or warnings systems. The usual goal of this evaluation is to arrive at a simple binary decision regarding the warning in question (i.e., does it "pass/fail", or is it "adequate/inadequate"). However, such a warning assessment process may in fact be quite complex and multidimensional in its execution. The existing warnings research literature has identified a fairly large number of warnings features or factors likely to have an impact on a given warning's effectiveness or adequacy. The tool addressed in this article is intended for use by a warnings expert (as opposed to one less knowledgeable and informed about complex warnings issues), and can serve as a reminder checklist to help ensure that the expert has taken into consideration the most relevant features or factors during such a warnings adequacy assessment.     

Trustworthiness in evaluation practice: an emphasis on the relational

As canons for trustworthiness developed explicitly in the discourse of qualitative inquiry, the emphasis was on procedural matters rather than fundamentally relational ones. A nod was made to the relational in such strategies as “member checks” but the issues of how the evaluator actually relates to participants and to the larger communities of practice and discourse—matters subsumed under moral principles and ethical standards—were often marginalized. This chapter posits that the first consideration in designing and conducting rigorous evaluation inquiry, and in critiquing the results of any research, should be the study's trustworthiness. Judging a study's trustworthiness, however, should focus on much more than procedural matters; it should also rely on moral principles and ethical standards which specifically address how we relate to an evaluation's participants. Central to these considerations are cross-cultural sensibilities about the nuanced meanings associated with any principles and standards. The chapter provides a theoretical framework for this position and offers two illustrative examples in the form of dialogues.