Using macro variables in program evaluation

This paper discusses the importance of using macro-level variables for program analysis. It is argued that three types of macro variables--cultural, economic, and demographic--provide a context for evaluation, and offer alternative explanations for the success or failure of a program. The problems of causality and availability of data are discussed. Macro variables are seen to be especially useful in "meta evaluation," and in integrating the results of specific program evaluations into general conclusions.     

The utilization of prevailing evaluation policy in the selection of performance measures

This study considers the problem of inferring a functional evaluation criterion from existing performance measure policies. The objective is to develop a rational basis by which to adaptively evaluate a current best set of performance measures from alternative sets. The analysis is based on a matrix approach for relating system characteristics to performance measures across a set of activities. A procedure for ranking measure combinations which are candidate implementation alternatives is devised using this matrix representation and cost information. An example illustrating the procedure is presented.     

Behavioral evaluation of a state program of deinstitutionalization of the developmentally disabled

The purpose of this study was to evaluate one phase of a statewide program of deinstitutionalizing developmentally disabled individuals. Forty adults who had spent a minimum of six months in community placements were evaluated with respect to changes in behavior associated with movement out of state institutions and into community settings such as group homes and day activity centers. Pre- and post-deinstitutionalization measures were taken with the Behavior Development Survey. Post-deinstitutionalization measures on Cataldo and Risley's Resident Activity Manifest were compared to the same measures obtained on 159 developmentally disabled individuals scheduled for deinstitutionalization. A consistent pattern of positive changes on both instruments favored deinstitutionalization, but changes could not be unequivocally attributed to movement out of the institutions per se.     

Pragmatic decisions in the evaluation of consumer satisfaction with mental health treatment

This article examines pragmatic choices which must be made in conducting consumer satisfaction assessment of mental health treatment. It is argued that choices involving sample, format, and procedure for examining satisfaction may influence the results of such research, and must be considered when creating or evaluating these efforts. These choices are examined in detail.     

Evaluating employee assistance programs. A review of methods, outcomes, and future directions

Renewed interest in assisting troubled employees has led to an upsurge in the development of employee assistance programs, coupled with demands for demonstrable effectiveness. This review examines the nature and scope of these programs, their administrative and methodological context, and the types and outcomes of evaluation studies conducted thus far. Proposals for improving future investigations through a number of different approaches and strategies are then made.     

On the limiting properties of social indicators

Characteristics of the population and economic measures that constitute traditional social indicators are compared with more recent “quality of life” measures to demonstrate that social indicators are always value statements at the policy level. The possibility of alternative perspectives is illustrated. It is suggested that an awareness of the assumptions implicit in any given indicator is as important as the data they provide.     

Culture, Cosmopolitanism, and Risk Management

Most cultural approaches to risk management deal with the connections between the forms of social relations within groups and the risk concerns of those groups. According to these theories, a certain limited set of different relational forms (usually three, four, or five) lead to specific, different and conflicting, risk concerns. In contrast to these theories, cosmopolitanism is an approach to culture that focuses, not on forms of sociality, but on changes among forms—expansions and contractions in the inclusivity of forms and movement by persons from one form of sociality to another. Relative to other cultural theories, cosmopolitanism thus is much more concerned with the solution of risk management problems than with their origins. Cosmopolitanism can be thought of as a cultural continuum, with cosmopolitanism at one end and pluralism at the other. Cosmopolitan persons are more open to cultural change—and thus the solution of risk management problems. In this article, we outline our new theory of cosmopolitanism, describe a method for measuring it and present an experimental study that tests some implications of the theory. Results from the study support the theory by showing that, compared to pluralistic respondents, cosmopolitan respondents are more inclusive in their risk management judgments—that is, they express equal concern for a local and a national issue, whereas the pluralistic respondents express greater concern in the local case. We discuss the risk management implications of a cosmopolitan approach to culture.     

Perception of Ecological Risk to Water Environments

This paper examines lay and expert perceptions of the ecological risks associated with a range of human activities that could adversely affect water resource environments. It employs the psychometric paradigm pioneered in characterizing perceptions of human health risks, which involves surveys to obtain judgments from subjects about risk items in terms of several important characteristics of the risks. The paper builds on a previous study that introduced ecological risk perception. This second study employs a larger, more diverse sample, a more focused topic area, and comparisons between lay and expert judgments. The results confirm that a small set of underlying factors explain a great deal of variability in lay judgments about ecological risks. These have been termed Ecological Impact, Human Benefits, Controllability , and Knowledge. The results are useful in explaining subjects' judgments of the general riskiness of, and need for regulation of, various risk items. The results also indicate several differences and areas of agreement among the lay and expert samples that point to potential key issues in future ecological risk management efforts for water resources.