The goal-oriented approach to evaluation: Critique and case study from drug abuse treatment

The specification and measurement of program goals remains central to most evaluation research strategies, yet procedures for implementing this approach are not well-articulated. It is the purpose of this discussion to describe a stepwise procedure for programmatic goal setting and monitoring used in a demonstration drug treatment program for women. Three implementation steps are described: (a) goal setting, (b) checking for consistency, (c) monitoring and feedback. The advantages and limitations of this approach are discussed and useful complementary measurement strategies are suggested.     

WOLVES, CHIMPS AND DEMSETZ

Harold Demsetz has argued that when an externality can be internalized through the existence of property rights such that societal benefits exceed costs, property rights will emerge. This paper shows that property rights exist in some animal systems with respect to specific pieces of property and for reasons similar to those postulated by Demsetz. Two cases are considered: wolves, where the property right is in land; and chimpanzees, where the property right exists for meat. The external costs or benefits that produce the property rights are examined and comparisons are drawn with situations in which no externalities exist and no property rights emerge.     

Evaluating the administrative efficiency of courts

In addition to being held accountable for judicial decision, courts, like other public agencies, can and should be evaluated in terms of their administrative efficiency. This paper illustrates how courts can be evaluated in terms of their relative administrative efficiency, using a new approach—data envelopment analysis (DEA)—first proposed by Charnes et al. [1]. The DEA is based upon the economic notion of Pareto optimality which states that a given decision making unit (DMU) is inefficient if some other DMU, or some combination of other DMUs, can produce at least the same amounts of all outputs with less of some resource input and not more of any other resource. Conversely a DMU is said to be efficient if the above is not possible. Charnes et al. [1] generalized the usual input/output ratio measure of efficiency for a given unit in terms of a fractional linear program with fractional constraints. In the case of courts, the efficiency of any particular court is calculated by forming the ratio of a weighted sum of outputs to a weighted sum of inputs, where the weights for both outputs and inputs are to be selected in a manner that calculates the Pareto-Koopmans efficiency of the court. This paper reviews the DEA method and illustrates its application to a data base for 100 criminal superior courts in North Carolina.     

Evaluating the impact of utility company billing plans on residential energy consumption

Many utility companies offer their customers the choice of participation in an average payment plan, which enables them to pay a fixed sum for their utility bill each month (with final settlement at the end of the billing year), instead of the conventional “pay as you go” billing procedure. Because customers on average payment plans are protected from paying large bills during peak energy-use seasons and because the information about monthly energy use and its cost is perhaps less salient to them, it was hypothesized that customers on the average payment plan would use more electricity than customers not on the plan. Using a nonequivalent control group design, the electricity consumption of a selection of customers of two utility companies (Ns = 475 and 74) was examined. The results showed that there was no evidence to support the hypothesis. Since the logic of hypothesis testing does not permit the ready acceptance of the null hypothesis, several procedural, methodological, and statistical points were made to buttress the conclusion that the average payment plans had no effect on electricity consumption.