Legal standards for evaluation research: A reply to Smith

Smith (1981), asserting that not all evaluative studies require the same degree of evidence for decision-making, suggests a legal paradigm for determining how much certainty is necessary for informed decision-making. Specifically, he argues for the use of three levels of certainty, i.e., suggestive, preponderant, or conclusive evidence, modeled after the legal standards of proof. Unfortunately, such an approach is untenable for several reasons. Smith's suggestion that decision-makers adopt legal terminology, for example, is really a recommendation of form rather than substance and, furthermore, his analogy from the law to the evaluation context is based upon a misunderstanding of the trial process. These and other problems with Smith's suggestions are discussed.     

Peer-led and adult-led school drug prevention: a meta-analytic comparison

Several studies have suggested that peer-led drug prevention programs are more effective than adult-led programs, but the evidence is not conclusive. In this article the results are presented of a meta-analysis of studies that compare drug prevention programs led by peers to the same programs led by adults. Twelve studies were identified in a systematic literature search. The quality of these studies was not optimal, and the interventions and target groups differed considerably among studies. Overall, peer-led programs were found to be somewhat more effective than adult-led programs (standardized difference d: 0.24). Large differences between studies were found, with some studies indicating greater effects for peer-led programs and other studies showing greater effects for adult-led programs. It is concluded that the effectiveness of a prevention program is determined by several characteristics of the programs. The leader may constitute one of those characteristics.     

THE EFFECTIVENESS OF FAMILY INTERVENTIONS IN THE TREATMENT OF PHYSICAL ILLNESS

Although a large body of research demonstrates that the family has a powerful influence on physical health, the evidence for the effectiveness of family interventions in physical illness is less conclusive. Family therapy and other family interventions appear to be most effective in chronic childhood illnesses such as asthma and diabetes. Family interventions have also been shown to be effective in the management of some cardiovascular and neurologic disorders and for the treatment of obesity. Family therapy appears to be more effective than individual therapy for some groups of patients with anorexia nervosa. This research supports the increasingly important role of medical family therapy in the new health care system. Recommendations for future research are discussed.     

Evaluations of the special supplemental program for Women,infants, and children's (WIC's) effectiveness

The U.S. General Accounting Office (GAO) analyzed the evaluations of the Special Supplemental Program for Women, Infants, and Children (WIC) to determine whether they support assertions that have been made about the program's positive effects for five outcomes. Insufficient evidence was found for making any general or conclusive judgments about WIC's effectiveness overall, but in a limited way, the information does indicate the likelihood that WIC has positive effects in some areas. GAO also assessed problems in the state of evaluation efforts. That the program evaluations do not reveal whether WIC is having the effect intended by the legislation underscores the need to design and implement better studies. Generally speaking, GAO believes that if the lessons learned from past efforts are heeded, it should be possible to produce information on the overall effectiveness of WIC.     

“What About the Rest of Us?” An Overview of LGBT Poverty Issues and a Call to Action

In this article, I argue that, despite the myth of gay affluence, existing research is conclusive enough to claim that lesbian, gay, bisexual, and transgender (LGBT) adults are overall less financially secure than their heterosexual, cisgendered counterparts. I demonstrate that LGBT poverty is a broad social issue that can no longer be viewed as affecting only specific subpopulations of LGBT communities. I argue that the social work profession and the LGBT movement need to recognize LGBT poverty as a social issue. I then present a call to action for social work practitioners, researchers and LGBT organizations.     

Narrative review of strategies by organizations for building evaluation capacity

Program evaluation is an important source of information to assist organizations to make “evidence-informed” decisions about program planning and development. The objectives of this study were to identify evaluated strategies used by organizations and program developers to build the program evaluation capacity of their workforce, and to describe success factors and lessons learned. Common elements for successful evaluation capacity building (ECB) include: a tailored strategy based on needs assessment, an organizational commitment to evaluation and ECB, experiential learning, training with a practical element, and some form of ongoing technical support within the workplace. ECB is a relatively new field of endeavor, and, while existing studies in ECB are characterized by lower levels of evidence, they suggest the most successful approaches to ECB are likely to be multifaceted. To build the level of evidence in this field, more rigorous study designs need to be implemented in the future.     

Post-evaluation determination of a program's generalizability

The literature on the generalizability of program effects focuses exclusively on the a priori development of evaluation designs which enable certain generalizations to be made. Due to a variety of factors, new questions of a program's generalizability often arise only after the completion of the formal evaluation study. This paper suggests secondary analysis procedures which can be employed using existing evaluation data to estimate a program's generalizability when followup field studies are not feasible.     

Assessing the Advantages of Bilingualism for the Children of Immigrants1

This article responds to the current academic debate on the advantages of bilingualism to the children of immigrants in the United States. The author utilizes data from the 1992–1993 and 1995–1996 Children of Immi rants Longitudinal Study to estimate the effects of bilingualism on efucational outcomes. In contrast to a recent study, the author rovides conclusive evidence that there are advantages to bilingualism beyond the functional ability to communicate with one's parents. The author also provides evidence that demonstrates that bilingualism is only advantageous in those communities with low levels of English proficiency and high levels of resources and networks.     

A Systematic Review of Strengths and Resilience Outcome Literature Relevant to Children and Adolescents

The concepts of strengths and resilience are essential for understanding and promoting positive development in children and adolescents. These concepts have been studied in the research literature for many years and more recently have been applied to child and adolescent assessment and intervention research. However, strength and resilience based intervention programs have not been evaluated rigorously for their use of empirical methodology. In this article, we systematically identified and reviewed all of the outcome studies over the last decade for strength and resilience based intervention programs to assess the extent to which these studies utilized controlled empirical methodology. The results of the review yielded 11 outcome studies that examined strength and resilience based practices. Using the Quality Assessment Tool for Quantitative Studies developed by the Effective Public Health Practice Project, we found three studies to be high quality, exhibiting high levels of experimentally controlled research. The remaining 8 studies we considered to be moderate to weak quality research. We concluded that these 11 studies provide preliminary support for the efficacy of strength and resilience based interventions. Our systematic review also highlights areas where methodology in future studies can be strengthened to provide more conclusive evidence of these approaches.     

Education and fertility in Iran

Studies providing evidence concerning literacy's relationship to fertility in Iran are reviewed. Reliable demographic data are unavailable for Iran before the 1st census in 1956. The 1966 census revealed a reversal of the normally expected larger female population, with a sex ratio of 107 men for every 100 women. The female population in Iran is accorded low status; only 29.6% of the population over the age of 10 was literate according to the 1966 census. A negative relationship between literacy or levels of education and fertility seems to have become a basic tenet of demographic theory. The hypothesis that as a woman's education increases she has fewer children has been confirmed in numerous studies, and, in response to this information, the Iranian government has sponsored several projects which incorporate family planning education into literacy projects. In view of the associations noted in other studies of the relationship between education and fertility, it seems wise to examine the effects of education on fertility in Iran. None of the studies reviewed give conclusive evidence that literacy is unrelated to fertility in Iran. Several of the studies reveal built-in biases: the husbands in Siassi's study were all military personnel; Gulick interviewed women who were already attending family planning clinics; Edlefsen and Liberman made some highly abstract and speculative predictions, and Lieberman et al. were basically measuring incomes instead of education. All of the studies do, however, give some indication of an irregular effect of education on fertility in Iran and swggest the need for further study of this variable.     

Factors Related to Prosecution of Child Sexual Abuse Cases

ABSTRACT

This study explored how various factors regarding the victim, offender, abuse situation, and case evidence were related to prosecution decisions in child sexual abuse cases. Data were collected from records of 200 closed child sexual abuse cases served at a southwestern United States agency during 1989–1990. Results indicated that cases involving recently reported abuse and offenders who were charged with abusing multiple child victims were significantly more likely to be prosecuted than cases involving less recently reported abuse and offenders charged with abusing only one victim, respectively. In terms of the victim-offender relationship, prosecution was most likely for cases with offenders who were strangers, next most likely for acquaintances and step and extended family members, and least likely for biological nuclear family members. Also, cases with medical evidence of abuse were more likely to be prosecuted than cases without medical evidence only when serious abuse was involved. In addition, prosecution was significantly less likely for cases with younger victims than for cases with older victims. Seriousness of abuse, the presence of medical evidence, and recency of abuse did not account for this victim age-prosecution status relationship. Furthermore, no cases involving possible custody disputes were prosecuted. Implications are discussed concerning the need for focused and integrated efforts in responding to allegations of child sexual abuse.     

The Woodwork Effect: Estimating It and Controlling the Damage

Many patients in home- and community-based services (HCBS) are not people who, without HCBS, would be in nursing homes. Those attracted to HCBS tend to be people who are younger, better supported, less dependent, and more mentally intact than their nursing home counterparts. Studies show that only about a quarter of the clients selected as likely to enter nursing homes within the coming year are likely to do so, even though they receive no HCBS. Of the 43 studies reported, more than two-thirds had rates of control group nursing home admission of less than 20%. Most patients would also be likely to have experienced only a short nursing home stay even if they were admitted. The result: Receiving HCBS reduced nursing home use rates on average by only a small percentage, not enough to offset the costs of HCBS. Moreover, both older and more recent studies show only small to insignificant effects on most adverse patient outcomes.     

Empirically based conversion factors for calculating couple-years of protection

Couple-years of protection (CYP) is one of several commonly used indicators to assess international family planning efforts. It has been the subject of much debate, relating in part to the specific conversion factors used to translate the quantity of the respective contraceptive methods distributed to a single measure of protection. This article outlines a comprehensive effort to revisit those conversion factors based on the best available empirical evidence. In most instances, the analysis supports previously established standard conversion factors. However, there are two notable departures. Fewer condoms and spermicides are recommended for each CYP (120 vs. 150), primarily because coital frequency among condom users is lower than previously assumed. Furthermore, for sterilization, the authors recommend the use of country or region-specific conversion factors. Every program evaluation indicator has strengths and weaknesses, and the best program evaluation efforts use a variety of indicators. If CYP is used to evaluate programs, however, the authors believe that the conversion factors presented reflect the best available evidence.     

ETHNIC ENCLOSURE OR ETHNIC COMPETITION: Ethnic Identification Among Hispanics in Texas

Recent theoretical debates have focused on the utility of two alternative perspectives on ethnic identification. However, empirical support for either is neither consistent nor conclusive and previous analyses seldom conceptually or empirically examine the aggregate macrostructural determinants of ethnic identification. This study reevaluates the relative merits of the ethnic enclosure and ethnic competition perspectives among Texan Hispanics using aggregate 1980 Census of Population data for 139 Texas cities with large Hispanic populations. The rejection of the ethnic enclosure thesis in some recent research is unwarranted, as the empirical evidence provides it substantial support and little for the ethnic competition perspective. Further analyses of structural factors in ethnic identification are merited.     

Productivism is allegedly dead, long live productivism. Evidence of continued productivist attitudes and decision-making in South-East England

The adjustment of the European Union's Common Agricultural Policy (CAP) initiated in the mid-1980s in response to its high cost and in-built tendency for overproduction set in train a series of measures that have been interpreted as reversing the former emphasis on agricultural production and diverting farmers towards alternative approaches to running their businesses. The policy reform measures have been characterised as contributing to a structural transition from a ‘productivist’ to ‘post-productivist’ era in agriculture, although empirical evidence for such reorientation at the farm level is less than conclusive. This paper reports on results from an analysis of large-scale commercial farmers in an area of relatively intensive arable and mixed livestock farming using documentary and survey sources to seek evidence of this transition over the long-term. Although these farmers have engaged with policy reform measures where these do not conflict with their primary objective, they continue to intensify and specialise their agricultural operations and to concentrate productive farm resources through accumulation and expansion.     

From bedside to bench: does mental and physical activity promote cognitive vitality in late life?

A wide range of animal and human studies provide evidence for the potential of physical and cognitive exercise in promoting cognitive health later in life. The effects of such activities on intermediate outcomes, such as cognitive performance, are becoming clearer, as are the molecular mechanisms involved. Physical and cognitive exercise might increase "cognitive reserve" and increase the overall health of the brain, thereby reducing or delaying cognitive impairment and dementia. However, conclusive evidence for such benefits is not yet established. The third annual Bedside to Bench conference, cosponsored by The American Geriatrics Society and the National Institutes of Health's National Institute on Aging, reviewed current knowledge regarding the role of physical and cognitive exercise in promoting cognitive vitality. Conference attendees identified gaps in our current understanding of these processes and recommended next steps for research. In particular, researchers will need to explore clinical issues related to the timing, intensity, and duration of various types and combinations of physical and cognitive activities in animal models to elucidate the mechanisms involved and inform the design of future human studies. The concept of the enriched environment currently employed in animal studies to promote physical activity, socialization, and problem solving should be explored in human studies.     

Age group differences in political activism in Malaysia

ABSTRACT

There is a dearth of studies on age-related patterns of political activism in Malaysia, specifically on young people’s patterns of political participation relative to their elders, and in relation to the rich literature that has developed in Western democracies. By analysing survey data from Wave 6 (2010–2014) of the World Values Surveys (WVS), this study aims to investigate the differences in political engagement between younger and older people in Malaysia, including new repertoires outside the mainstream politics, by addressing the question of whether young Malaysians are more active in political activities compared to older groups. The findings conform to the expected patterns in the literature that young people are less likely to participate in conventional political activities than their respective elders. However, we find no significant differences for unconventional political participation. The study further shows that demographic indicators such as the levels of education, gender and ethnic group belonging do not appear to be linked to the age gap between youth and their elders in political activism. As such, the study provides evidence that young people in Malaysia are less likely to be politically active than their elders and that this is not clearly attributable to the socio-demographic factors analysed.     

Effectiveness of continuing care interventions for substance abusers. Implications for the study of long-term treatment effects

Substance-abusing patients are frequently urged to participate in lower intensity continuing care interventions, also known as "stepdown care" or "aftercare," following an initial phase of treatment. Since 1988, 15 controlled studies of continuing care for alcohol or drug abuse have been published, with follow-up data on substance use presented in 14 of these studies. In the studies that featured an active control condition, only 1 of 7 yielded positive findings. In the studies that featured a minimal- or no-treatment control, 3 of 7 studies yielded positive findings. The relative paucity of continuing care studies, coupled with the lack of stronger evidence of clinical effectiveness, provides a convincing rationale for conducting evaluations of continuing interventions, as well as evaluations of combinations of various primary and continuing interventions. Methodological issues in the evaluation of continuing care and potential research questions that could be addressed in long-term follow-up studies are outlined and discussed.     

Mental health around and after the menopause

The menopause is a time in a woman's life when it is recognized that biological and social changes can impact upon mental wellbeing. Several studies have investigated the relationship between menopause and psychological symptoms, especially depression, with mixed results. In part, this is due to a considerable overlap between depressive symptoms and those due to declining estrogen levels, causing challenges in assessment. However it appears that vulnerable women are at a higher risk of succumbing to depression during menopausal transition. Antidepressants remain the mainstay of treating depressive symptoms, with little conclusive evidence for hormone replacement therapy. Memory problems during menopause are a common complaint, but there is no demonstrated link to subsequent dementia. This paper also reviews considerations of diagnosis and treatment of postmenopausal depression.     

The Association Between Same-Sex Romantic Attractions and Relationships and Running Away Among a Nationally Representative Sample of Adolescents

Sexual minorities are overrepresented among the runaway population, and sexual minority runaways are at greater risk for adverse health outcomes than their heterosexual peers. Our knowledge of this vulnerable population has been restricted by methodological limitations of existing studies. This study used a nationally representative sample of U.S. adolescents to explore the association between same-sex romantic attractions and relationships and run away behavior over a 2 year period. Results indicated that although the association between sexual orientation and running away appears to be partially attenuated by other risk factors for running away, there remains a significant positive association between same-sex romantic attractions and running away. Furthermore, youth with no romantic or sexual relationships were significantly less likely to report running away compared to youth with only opposite-sex relationships. These associations remained significant even after controlling for other risk factors.