State “Technical Assistance Programs” for Nursing Home Quality Improvement: Variations and Potential Implications

To improve nursing home quality, many states have developed “technical assistance programs” that provide on-site consultation and training for nursing facility staff. We conducted a national survey on these state programs to collect data on program design, operations, financing, and perceived effectiveness. As of 2010, 17 states had developed such programs. Compared to existing state nursing home quality regulations, these programs represent a collaborative, rather than enforcement-oriented, approach to quality. However, existing programs vary substantially in key structural features such as staffing patterns, funding levels, and relationship with state survey and certification agencies. Perceived effectiveness by program officials on quality was high, although few states have performed formal evaluations. Perceived barriers to program effectiveness included lack of appropriate staff and funding, among others. In conclusion, state technical assistance programs for nursing homes vary in program design and perceived effectiveness. Future comparative evaluations are needed to inform evidence-based quality initiatives.     

Designing and managing public housing self-sufficiency programs: the Youngs Lake Commons Program

This article evaluates an experimental public housing self-sufficiency program that encourages home ownership among low-income families. A quasi-experimental design, in combination with focus groups, records review, and key informant interviews, provides data to focus on four questions: (a) Do these programs simply accelerate move-outs for those who would have left without intervention? (b) Are program elements replicable given the importance of the local context in public housing move-outs? (c) How do housing authorities resolve tensions that arise between housing management and social service delivery? (d) What should housing authority response be to those who fail?     

Resident Perspectives on Life in a Transitional Living Program for Homeless Young Adults

Safe and affordable housing is critical for any young person’s well-being, and yet many youth are without a reliable place to live. Knowledge of the perceptions of housing programs and shelter among homeless young adults ages 18–24 is very limited. Using qualitative methodology, the present study explores the perceptions of homeless young adults on their experiences as residents of a transitional living program (TLP) by asking the following research questions: (1) What are TLP residents’ expectations of themselves and others in the program? and (2) How do residents perceive the rules and structure of the TLP? Sixteen interviews were conducted with residents at a TLP for homeless young adults, with participants ranging in age from 18 to 22. Findings illuminated residents’ strong emphasis on the values of hard work, self-discipline and a good attitude. Results revealed that residents felt that they are overly monitored within the program, particularly around daily living in the residence and felt a lack of flexibility in the rules and regulations. It is important that the structure of a TLP housing program so that rules are not disruptive to healthy development and successful transition from adolescence to adulthood. Further implications for practice are discussed.     

“Compassion,pleasantry, and hope”: A process evaluation of a volunteer-based nonprofit

As funders continue to emphasize the importance of documented results, nonprofit organizations must work to complete program evaluations that are both valuable and feasible. The purpose of this paper is to document a practical process evaluation of a southeastern nonprofit, a local Meals on Wheels. Using a mixed methods approach, we sought to answer four evaluation questions: (1) What are the essential program components, as identified by key stakeholders; (2) To what extent are volunteers implementing the identified essential components as intended; (3) What is the level of volunteer satisfaction with the program; and (4) What suggestions do stakeholders have for improving the program? Our findings indicate that most aspects of the program were implemented as intended, but inconsistencies occurred when volunteers were unsure of their assigned duties. In addition, volunteers had high levels of satisfaction and specific suggestions for improvement. From these results, we developed a conceptual model of factors contributing to quality of implementation and volunteer satisfaction that may be generalizable to other volunteer-based nonprofits. Specifically, we identified three factors that helped to facilitate satisfaction and performance: leadership, social contact, and fulfillment. Finally, this process evaluation demonstrates the feasibility of developing and implementing evaluation tools in similar organizations.     

Consumer perceptions and preferences for public expenditure

This study deals with consumer evaluations of public spending. Ideological and self-interest factors are analysed to determine how these factors are related to consumer perceptions and preferences for public expenditure on legal advice, public transport and hospital services. Involvement in socio-economic issues, voting behavior and public spending preferences are discussed in relation with each other. The ‘fiscal connection’ between taxes and public expenditure is interpreted.     

Program Evaluation Practice in the Nonprofit Sector

Nonprofit organizations are increasingly being asked to demonstrate the effectiveness of their programs and services. Faced with this challenge, agencies that decide to engage in program evaluation must choose among various approaches and methods. This article provides a window into why and how nonprofit organizations are conducting program evaluations, and it reveals the factors nonprofit agencies identify as contributing to a useful and credible evaluation. In addition, the article addresses the role of stakeholder participation in program evaluation.     

Faith-based evaluation: accountable to whom, for what?

Findings, issues, and lessons learned about program evaluation are examined from a national qualitative study of 15 faith-based human service programs targeting those in need in urban areas. Using a grounded theory design, five properties emerge as part of the evaluation network: (1) philosophy of accountability, (2) legitimacy, (3) evaluation design, (4) feedback loop, and (5) barriers to evaluation. While funders expect measurable outcomes to evaluate service effectiveness, respondents acknowledge other competing expectations of multiple constituents in religious and secular communities. What emerges is an excellent example of managing multiple program evaluation demands in programs that are particularly facile at process evaluation in the interest of quality service and relationship building. The article concludes with important lessons learned about the process of program evaluation.     

The problem of replicability in program evaluation. The component solution using the example of case management

Specificity and replicability of a program are crucial in order to rigorously evaluate the program's effectiveness. However, the traditional approaches to evaluation have ignored the problem that most social and mental health programs consist of vaguely specified interventions and cannot meet minimal standards of replicability. Consequently, the results of effectiveness evaluations of poorly defined programs have little general generalizability. Nevertheless, effectiveness information concerning su ch programs is much needed. One solution to this problem is to focus on program components, examining interventions at a level where operational definitions can be employed and replicability is possible. In this paper, this approach is expanded using the example of case management programs. A component-oriented approach ensures a systematic evaluation of program effectiveness for which the first question for evaluators is whether a program consists of interventions that reliably produce specific immediate outcomes. Then, and only then, is it possible to address questions concerning whether a program will reliably produce those outcomes that are the overall objectives of the program.     

Research in the Undergraduate Curriculum: A Survey

Directors of and faculty teaching research/statistics in undergraduate social work programs were surveyed to (1) determine research requirement for undergraduates; (2) characterize those faculty teaching research; and (3) ascertain directors' and faculty perceptions of student attitudes toward research. Results revealed that most undergraduate programs required from 3 to 6 semester hours in research; course objectives varied widely from program to program; sociology faculty taught most of the research courses; and students were perceived as being negative toward research. Findings generally were consistent with prior surveys of MSW programs and practitioners. Dilemmas in teaching research are discussed.     

Controversies in Implicit Race Bias Research

Advances in measurement have allowed researchers to empirically distinguish between explicit attitudes, which are conscious and controllable, and implicit attitudes, which are activated automatically without cognitive effort or even awareness. Researchers using these methods have shown that although survey data reveal unprecedented declines in Americans’ expressions of overtly racist attitudes, most Americans continue to harbor an implicit pro‐White bias relative to other racial minority groups. This research has generated a great deal of controversy. The primary focus of the controversy has been on the findings that have come out of studies using the Implicit Association Test or IAT – a response‐time computer software program that records the speed with which positive and negative evaluations of different racial groups come to mind. This paper addresses the following questions that continue to divide researchers: (1) What does the IAT measure? (2) How do implicit attitudes as measured by the IAT relate to people’s race‐related judgments and behaviors? (3) What are the political and legal implications of being able to measure implicit racial bias?     

The unique character of involvement in multi-site evaluation settings

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site program evaluations, traditional notions of participatory evaluation do not apply. The purpose of this research is to determine the ways in which stakeholders are involved in large-scale, multi-site STEM evaluations. This article describes the findings from a survey of 313 program leaders and evaluators and from follow-up interviews with 12 of these individuals.Findings from this study indicate that attendance at meetings and conferences, planning discussions within the project related to use of the program evaluation, and participation in data collection should be added to the list of activities that foster feelings of evaluation involvement among stakeholders. In addition, perceptions of involvement may vary according to breadth or depth of evaluation activities, but not always both. Overall, this study suggests that despite the contextual challenges of large, multi-site evaluations, it is feasible to build feelings of involvement among stakeholders.     

Are cost-inclusive evaluations worth the effort?

Relative costs are as important as relative effectiveness when choosing between program alternatives or among a set of programs competing for scarce funds. Nevertheless, the number of cost-inclusive evaluations remains comparatively small. This article presents the results of three first-time cost-inclusive evaluations each performed by an experienced evaluator. Each evaluator performed a different type of cost-inclusive evaluation using different tobacco control programs as examples: "standard" cost-effectiveness analysis, threshold or break-even analysis, and a simulation model. Results are presented in terms of the challenges faced, and informational and insight benefits gained, as well as in terms of program cost-effectiveness. All three evaluators agreed that the benefits from performing cost-inclusive evaluations are well worth time and effort involved. They also found that this type of evaluation provides abundant information that can be used to improve program effectiveness and cost-effectiveness.     

The evaluation ranking scale: a new methodology for assessing satisfaction

Most patient satisfaction scales produce high, undifferentiated levels of reported satisfaction that fail to detect program areas that consumers do not like. Methodological problems apparently contribute to these results. An alternative procedure, the Evaluation Ranking Scale (ERS), was formulated and tested. A 2 X 3 design was employed with 246 public health center patients randomly assigned to one of two measurement techniques (ERS vs. a global measure) and one of three informational sets. A secondary group of subjects was a convenience sample of 26 staff members, which allowed comparisons of staff evaluations of the health center to patients' evaluations of the health center. Compared to the global measure, the ERS provided more specific information about particular program components, was more discriminating, and resulted in mean satisfaction scores that were significantly lower. This new approach may be a more effective technique for assessing the psychosocial effectiveness of human service programs.     

Low-Income Children's Participation in a Public Health Insurance Program in Georgia

To expand health care coverage to uninsured, low-income children, the Congress created the State Children's Health Insurance Program (SCHIP) in 1997. Given ample evidence that state Medicaid programs have failed to enroll many eligible children, experts questioned whether SCHIP could successfully enroll low-income children. Using Georgia state SCHIP data, we analyzed enrollment patterns and identified factors contributing to program enrollment. This study found that the children's enrollment is explained by perceived costs and benefits of joining the program as well as the underlying family structure, demographic factors, and health status. We discuss implications of these findings on the participation of low-income families in public sector programs.     

A two-path model of the impact of LGBTQ+ diversity CSR levels on public response

Since conflicting opinions and expectations of stakeholders about LGBTQ+ diversity coexist, companies contemplate how far to draw the line of CSR involvement in relation to LGBTQ+ diversity. This study examines how different levels of LGBTQ+ diversity CSR (i.e., proactive, passive, refusal) affect public responses. The proposed model investigates how public perceptions of corporate support for LGBTQ+ diversity (PCSL), influenced by CSR level, affects two dimensions of corporate associations differently (corporate ability and CSR association), and consequently CSR responses (supportive communication intent, purchase intent, and corporate evaluation in this study). The role of perceived value-driven motivation as a mediator was also examined. An online experiment was conducted with two Fortune 500 companies (Dell and Kellogg's). Overall, the results suggest that proactive CSR leads to higher PCS-L and better CSR outcomes among the general public than a passive or refusal approach. PCS-L, directly and indirectly, affects individuals’ CSR associations, which are mediated by value-driven motives. In turn, CSR associations positively influence publics’ supportive communication intent, purchase intent and corporate evaluations. As for CA associations, we found that they had a rather complicated relationship with PCS-L. Specifically, PCS-L had a direct negative effect on CA associations (Dell) or no effect (Kellogg), indicating possible backlash effects. However, higher PSC-L resulted in more favorable perceived motives of the CSR program, driven by the company's moral grounds and corporate values, consequently resulting in greater CA associations (positive indirect impact). Thus, perceived value-driven motives can offset potential backlash effects related to CA associations and corresponding CSR outcomes.     

Deterrence and Knowledge of Statutory Penalties*

This study examines deterrence theory in light of three questions. First, is there an inverse relation between crime rates and maximum statutory penalties? Second, is there an inverse relation between crime rates and maximum penalties as perceived by potential offenders? Third, what is the accuracy of those perceptions? Classical versions of deterrence theory seemingly assume that the perceptions of potential offenders are substantially accurate, but the present findings (based on a survey of adult Tucson residents) show only a positive correlation (not absolute agreement) between statutory and perceived maximums. Yet there is a substantial inverse relation among types of crimes between statutory maximums (actual or perceived) and crime rates. However, that relation becomes problematic when public disapproval of criminality is controlled because of the collinearity between that aspect of social condemnation and the statutory maximums.     

Television and Violence in the Economy of Memory

The present paper aims to consider the cultural function of television as a technology for the creation of a public memory. The television system records past images, preserves them, and broadcasts various historical programs. A viewer owns the public memory jointly, through watching/consuming programs. However, the process of production and consumption of programs is linked with the exclusion of other historical memories from the public space. After all, the creation of public memories in depth is related to social power. Through the analysis in concrete terms of a series of programs of Project X and the second episode of the Nippon Hoso Kyokai (NHK; Japan Broadcasting Corporation) series, Special Edition: Judging War, the relationship between the organization of public memories and social power is explored. Project X depicts the challenges of engineers of middle standing who initiated new industrial and technological developments in the 1960s and 1970s. Special Edition: Judging War is based on coverage of the Women's International War Crimes Tribunal on Japan's Military Sexual Slavery. This program was subjected to revision on the eve of its broadcast. What forms of expression were eliminated? These two programs should help us define more clearly what the Japanese media selects for incorporation into the public memory.     

The context of program implementation and evaluation: A pilot study of interorganizational differences to improve child welfare reform efforts

This article contributes to the growing literature on evaluation and implementation science by examining the interaction between staff perceptions of organizational strength with perceptions and indicators of program fidelity. As part of a pilot project related to the evaluation of the Family to Family initiative, a survey was distributed to employees within two urban child welfare agencies with a total of 410 respondents across both sites, for a combined response rate of 72.2%. Survey results were analyzed both in terms or respondents' perception of their agency as well as in relation to measures of program performance and workload. Multivariate models show that organizational indicators are the most significant and positive predictors of perceived program implementation. Specifically, staff who positively perceived the availability of information within their agency also believed that the programs were well implemented in their agency. These findings suggest that as the value of program changes are articulated within an organization, the implementation of the initiative is perceived to improve.     

The Father Friendly Initiative within Families: Using a logic model to develop program theory for a father support program

The transition to fatherhood, with its numerous challenges, has been well documented. Likewise, fathers’ relationships with health and social services have also begun to be explored. Yet despite the problems fathers experience in interactions with healthcare services, few programs have been developed for them. To explain this, some authors point to the difficulty practitioners encounter in developing and structuring the theory of programs they are trying to create to promote and support father involvement (Savaya, R., & Waysman, M. (2005). Administration in Social Work, 29(2), 85), even when such theory is key to a program's effectiveness (Chen, H.-T. (2005). Practical program evaluation. Thousand Oaks, CA: Sage Publications). The objective of the present paper is to present a tool, the logic model, to bridge this gap and to equip practitioners for structuring program theory. This paper addresses two questions: (1) What would be a useful instrument for structuring the development of program theory in interventions for fathers? (2) How would the concepts of a father involvement program best be organized? The case of the Father Friendly Initiative within Families (FFIF) program is used to present and illustrate six simple steps for developing a logic model that are based on program theory and demonstrate its relevance.