Portfolio assessment in a collaborative program evaluation: the reliability and validity of a family literacy portfolio

Evaluations increasingly use open-ended assessments, such as portfolios, to gather information about program impact. Portfolios, however, present challenges in achieving acceptable levels of reliability and often lack evidence to support validity. This article describes the components of a portfolio assessment system developed in a collaborative evaluation of a family literacy program. Staff of a family literacy program and two evaluators collaborated to develop the assessment and the tools that frame the review of the portfolios. Rubrics, exemplar portfolios, portfolio logs, and lists of ‘look-fors’ were developed to guide raters in the scoring and to improve the reliability of scores and validity of decisions about the program. Inter-rater reliability for the portfolio assessment was 0.79 for holistic scores and 0.74 for analytic scores. With respect to validity, holistic and analytic scores correlated with criterion measures from 0.50 to 0.59, providing initial evidence of a common construct.     

FACILITATING INTIMACY: INTERVENTIONS AND EFFECTS

The Present study investigated by effects of two sets of marital interventions taken from Emotionally Focused Therapy (EFT) and Cognitive Marital Therapy (CMT) on level of marital intimacy, dyadic trust, and dyadic adjustment. It was hypothesized that both EFT and CMT would have a positive effect on levels of intimacy, trust, and adjustment as compared to a wait-list control group and that there would be a differential effect in favor of EFT as compared to CMT. Thirty-six couples free of marital distress and seeking to enhance theor intimate relationship were randomaly assigned to EFT, CMT, or a wai-list control group. Therapists' interventions were monitored and found to be faithfully implemented. Groups were equivalent on demographic variables and the quality of the therapeutic alliance. Both EFT and CMT group posttest means were found to be significantly higher than controls on the self-report measures of intimacy, Observational measures of intimacy revealed differential effects in favor of EFT as comopared to CMT at posttest. At a 10-week follow-up, EFT group means were significantly higher than CMT on self-reported intimacy and adjustment.     

DEREGULATION AND THE RELIGIOUS MARKET IN TAIWAN: A Research Note

The religious economy model predicts that when encountered with competition, loosely organized religions will fail or will be transformed into congregational religions. Over time, competition will drive congregational religions to establish an extended relationship with their consumers by generating exclusivist claims and exclusivist socialization. And thus exclusive religion tends to occupy the biggest market share. This model, however, has rarely been tested empirically. By analyzing religious trends in Taiwan after the deregulation of the late 1980s, we find that state suppression contributed to the weakness of organized religion while enhancing the popularity of unchurched congregational religions in Taiwan. We also find that deregulation is associated with the rise of organized and congregational faiths. But whether or not these newly organized religions become exclusive or not needs further studies. Implications of the findings for future research are offered.     

Two‐Wave Panel Analysis: Comparing Statistical Methods for Studying the Effects of Transitions

Study of the effect of transitions on individual and family outcomes is central to understanding families over the life course. There is little consensus, however, on the appropriate statistical methods needed to study transitions in panel data. This article compares lagged dependent variable (LDV) and change score (CS) methods for analyzing the effect of events in two‐wave panel data. The methods are described, and their performances are compared both with a simulation and a substantive example using the National Survey of Families and Households two‐wave panel. The results suggest that CS methods have advantages over LDV techniques in estimating the effect of events on outcomes in two‐wave panel data.     

School Size and the Interpersonal Side of Education: An Examination of Race/Ethnicity and Organizational Context*

Objectives. The purpose of this study was to extend research on the connection between school size and student outcomes by examining how school size was related to interpersonal processes and whether the interpersonal effects of school size varied by race/ethnicity. Methods. We applied multilevel modeling techniques to a sample of 14,966 students in 84 schools from the National Longitudinal Study of Adolescent Health. Results. Increasing school size was associated with decreasing student attachment to school and to teachers as well as extracurricular participation. Student attachment and teacher bonding diminished with increasing school size at a decreasing rate (reaching minimums in schools with between 1,700–2,000 students), but extracurricular participation dropped at a steady rate. These patterns did not differ substantially by race/ethnicity. Conclusions. The size of the educational institution influences interpersonal dynamics among actors in the institution and does so similarly across student groups. More generally, this research demonstrates the importance of organizational characteristics for social life.     

Do universal non‐contributory old‐age pensions make sense for rural areas in low‐income countries?

The need for old‐age security coverage in rural areas of many developing countries is rapidly increasing for several reasons, including population ageing and the weakening of family support networks. These trends have generated intense interest in policies that might help respond to the growing problem of rural old‐age destitution. The focus of our analysis is on one of the most promising alternatives under consideration: universal non‐contributory old‐age pensions. This model has some limitations and it is not appropriate for all developing countries, but it would be of potential benefit to far more than the six that have already implemented variants of this approach.     

Family roles and work values: Processes of selection and change

This study focuses on whether marriage and parenthood influence work values after taking into account the influence of work values on family formation. In a recent panel of young adults (N= 709), stronger extrinsic and weaker intrinsic work values during adolescence predicted marriage and parenthood 9 years out of high school. Controlling these relationships, wives, but not husbands, came to attach less importance to extrinsic rewards, and both husbands and wives attached less importance to intrinsic rewards, compared to single men and women. Fathers came to place greater importance on extrinsic rewards than men who had not become parents. The effect of motherhood on extrinsic values depended upon marital status, with positive effects only evident among single mothers. The findings are discussed in terms of their implications for models of work‐family relationships and understanding the meaning of contemporary family roles, especially motherhood and fatherhood.     

Sexual abuse prevention: a rural interdisciplinary effort

The alliance of social work and theater is a natural and powerful coalition. The cooperation of two undergraduate programs to produce a preventive program on sexual abuse education reached over 4,000 children. Social work was the catalyst in terms of identifying the need, obtaining grant money, and developing community support. Theater provided the talent to produce an outstanding performance. Communities planning to develop successful prevention programs must develop community support, clear goals, a well-trained follow-up team, education for professionals who work with children daily, a clear channel for reporting abuse, and an evaluation process. The use of volunteers keeps the cost of the project to a minimum.