Where local and national evaluators meet: unintended threats to ethical evaluation practice

The ethical work of program evaluators is based on a covenant of honesty and transparency among stakeholders. Yet even under the most favorable evaluation conditions, threats to ethical standards exist and muddle that covenant. Unfortunately, ethical issues associated with different evaluation structures and contracting arrangements have received little attention in the evaluation research literature. This article focuses on the unintended ethical threats associated with multitiered evaluation contexts. After briefly reviewing the various frames through which evaluation theory and ethics are commonly viewed, we discuss ethical challenges associated with multitiered evaluation designs including examples drawn from our evaluation projects. The article concludes with specific findings and recommendations for evaluators, grantors, grantees, and researchers.     

Injunctive Norms and Problem Gambling among College Students

Two studies examined the relationships among injunctive norms and college student gambling. In study 1 we evaluated the accuracy of perceptions of other students’ approval of gambling and the relationship between perceived approval and gambling behavior. In study 2 we evaluated gambling behavior as a function of perceptions of approval of other students, friends, and family. In study 1, which included 2524 college students, perceptions of other students’ approval of gambling were found to be overestimated and were negatively associated with gambling behavior. The results of study 2, which included 565 college students, replicated the findings of study 1 and revealed positive associations between gambling behavior and perceived approval of friends and family. Results highlight the complexity of injunctive norms and the importance of considering the reference group (e.g., peers, friends, family members) in their evaluation. Results also encourage caution in considering the incorporation of injunctive norms in prevention and intervention approaches.     

College and university compliance with a required meningococcal vaccination law

OBJECTIVE: Maryland became the first state to pass a vaccination law requiring college and university students living on campus to obtain a meningococcal vaccination or to sign a waiver refusing vaccination because college students are at increased risk for disease. The authors sought to identify how Maryland colleges addressed the law and determine whether schools were in full compliance. PARTICIPANTS: The authors surveyed 32 college/university administrators via a self-administered questionnaire. METHODS: The authors calculated vaccination and waiver rates and assessed compliance with the law overall and with specific law components. RESULTS: Among 28 participating schools, annual vaccination rates and waiver rates among students during 2000-2004 ranged from 66%-76% and 12%-17%, respectively. Two (7%) schools were compliant with all components of the law. CONCLUSIONS: Mandatory vaccination laws do not ensure compliance at the college and university level. Mandatory reporting, increased education, and collaboration between colleges and universities and public health agencies are needed.     

Summer learning programs and student success in the global economy

In the United States and around the rest of the world, there is a renewed focus on ensuring that schools are providing students with the skills necessary to compete in the global economy. High-quality summer learning programs are an ideal vehicle to help students gain content knowledge and develop innovative skills: they provide time for individual exploration and hands-on, experiential opportunities that can instill a lifelong love of learning that carries into the classroom and the workforce.     

An evaluation of retail outlets as part of a community prevention trial to reduce sales of harmful legal products to youth

Communities across the nation have become increasingly concerned about inhalant use and use of harmful legal products among youth because of increasing prevalence rates and deleterious health consequences from abusing these products. The increasing concern of communities about inhaling and ingesting legal products has been coupled with increasing awareness and concern about ability of youth to access and abuse a variety of other legal retail products. There are few examples of scientifically designed community prevention projects that seek to reduce youth abuse of such legal products. This article describes a community prevention trial that is designed to reduce sales of inhalants and other harmful legal products to youth and demonstrates how the retailer component of the trial can be rigorously evaluated. It also shows how data from youth purchase attempts can complement survey data from retailers.     

Quasi-binomial zero-inflated regression model suitable for variables with bounded support

In recent years, a variety of regression models, including zero-inflated and hurdle versions, have been proposed to explain the case of a dependent variable with respect to exogenous covariates. Apart from the classical Poisson, negative binomial and generalised Poisson distributions, many proposals have appeared in the statistical literature, perhaps in response to the new possibilities offered by advanced software that now enables researchers to implement numerous special functions in a relatively simple way. However, we believe that a significant research gap remains, since very little attention has been paid to the quasi-binomial distribution, which was first proposed over fifty years ago. We believe this distribution might constitute a valid alternative to existing regression models, in situations in which the variable has bounded support. Therefore, in this paper we present a zero-inflated regression model based on the quasi-binomial distribution, taking into account the moments and maximum likelihood estimators, and perform a score test to compare the zero-inflated quasi-binomial distribution with the zero-inflated binomial distribution, and the zero-inflated model with the homogeneous model (the model in which covariates are not considered). This analysis is illustrated with two data sets that are well known in the statistical literature and which contain a large number of zeros.     

Foreign-born emigration: A new approach and estimates based on matched CPS files

The utility of postcensal population estimates depends on the adequate measurement of four major components of demographic change: fertility, mortality, immigration, and emigration. Of the four components, emigration, especially of the foreign-born, has proved the most difficult to gauge. Without "direct" methods (i.e., methods identifying who emigrates and when), demographers have relied on indirect approaches, such as residual methods. Residual estimates, however are sensitive to inaccuracies in their constituent parts and are particularly ill-suited for measuring the emigration of recent arrivals. Here we introduce a new method for estimating foreign-born emigration that takes advantage of the sample design of the Current Population Survey (CPS): repeated interviews of persons in the same housing units over a period of 16 months. Individuals appearing in a first March Supplement to the CPS but not the next include those who died in the intervening year, those who moved within the country, and those who emigrated. We use statistical methods to estimate the proportion of emigrants among those not present in the follow-up interview. Our method produces emigration estimates that are comparable to those from residual methods in the case of longer-term residents (immigrants who arrived more than 10 years ago), but yields higher--and what appear to be more accurate--estimates for recent arrivals. Although somewhat constrained by sample size, we also generate estimates by age, sex, region of birth, and duration of residence in the United States.     

Mainstreaming kink: the politics of BDSM representation in U.S. popular media

This article explores nonpractitioners' understandings of and responses to the increasingly mainstream representation of BDSM in U.S. media, focusing on the film Secretary (Shainberg, 2002). Survey, focus group, and interview data indicate that popular images of SM promote the acceptance and understanding of sexual minorities through two mechanisms: acceptance via normalization, and understanding via pathologizing. Rather than challenging the privileged status of normative sexuality, these mechanisms reinforce boundaries between protected/privileged and policed/pathological sexualities. Instead of celebrating increased representation, this article argues that political energy might be directed toward the desire that the popularity of BDSM representations signifies: the desire to encounter authentic, undisciplined, and noncommodified representations that would transgress the sexual norms of American postmodern consumer culture.     

A midwife program of newborn resuscitation

A very small proportion of newborns fail to establish a normal respiratory pattern without some assistance at birth and newborns requiring resuscitative measures at birth should have a skilled practitioner able to provide it. In this small hospital midwives felt unskilled in newborn resuscitation and paediatricians were not always immediately available. A stakeholder group gathered to discuss the problem. A training program was implemented that improved the skills, confidence and support of the attending midwife to resuscitate the newborn effectively. The aim was to improve the outcome for the infant whilst maintaining the mother's choice of birthing in a small local hospital close to family and friends.