Portfolio assessment in a collaborative program evaluation: the reliability and validity of a family literacy portfolio

Evaluations increasingly use open-ended assessments, such as portfolios, to gather information about program impact. Portfolios, however, present challenges in achieving acceptable levels of reliability and often lack evidence to support validity. This article describes the components of a portfolio assessment system developed in a collaborative evaluation of a family literacy program. Staff of a family literacy program and two evaluators collaborated to develop the assessment and the tools that frame the review of the portfolios. Rubrics, exemplar portfolios, portfolio logs, and lists of ‘look-fors’ were developed to guide raters in the scoring and to improve the reliability of scores and validity of decisions about the program. Inter-rater reliability for the portfolio assessment was 0.79 for holistic scores and 0.74 for analytic scores. With respect to validity, holistic and analytic scores correlated with criterion measures from 0.50 to 0.59, providing initial evidence of a common construct.     

Managing human resource shortages in a unionized setting: Best practices in air traffic control

Human resource shortages require effective human resource management (HRM). Findings from research about ongoing labor shortages in air traffic control (ATC) are used to build a preliminary theory of appropriate HRM responses. Our international sample of major ATC agencies generally developed a set of best HRM practices to attract, motivate, and retain human assets. Key factors included (1) cultural and institutional norms, (2) technological change, (3) union responses, and (4) organizational form and structure (e.g., civil service versus commercial firms). While ATC’s rare human aptitudes, lengthy training to develop firm-specific human capital, and lifelong employment may limit the preliminary theory’s general applicability, crucial lessons emerge about human resource planning. This research was conducted with the support of the Social Sciences and Humanities Research Council, the Rice Fellowship, the Ziegler Fellowship, and the Center for International Business Studies at the University of Alberta. We are indebted to the individuals interviewed.     

The demographic evolution of human populations: The role of selection and environmental factors

Selection (genetic and cultural) and environmental variation are the principal mechanisms determining patterns of demographic change in human populations. Conditions exist under which the nature and intensity of these forces can be inferred from temporal trends in the demographic variables. These conditions, which can be expressed in terms of relations between the Malthusian parameter and population entropy, provide a means for evaluating the effect of selective and nonselective factors on demographic trends in human populations. The distinction between the roles of selection and environmental factors is illustrated by a study of the demographic transition in Sweden (1778-1965). This study shows that demographic changes during the pre- and posttransitional phases are determined mainly by environmental factors, whereas the changes during the transitional phase are mainly due to cultural selection. This analysis provides, for all three phases of the demographic transition, quantitative measures of the intensity of the forces (selective and nonselective) acting on both mortality and fecundity distributions.     

Community councils as a medium for public participation: a case study in Grampian region

Planning authorities in Scotland are obliged to consult the public before finalising policies and proposals to be included in their development plans. Community councils are intended to operate as ‘the voice of a neighbourhood’ and this paper analyses an attempt by a regional planning authority to use community councils as a vehicle for consulting the public in the preparation of a structure plan for a rural area. The paper concludes that the attempt was unsuccessful because the community councils were not clear about the role they were expected to play; nor were they adequately prepared for their role. The authors believe, however, that the involvement of community councils has potential for promoting greater public participation in the preparation of development plans.     

Relational Aggression, Relational Victimization, and Language Development in Preschoolers

We investigated language development, relational aggression, and relational victimization in ethnically, socioeconomically diverse preschoolers. Relational aggression was positively related to language development. Girls were more relationally aggressive than boys, and higher‐socioeconomic status (SES) children were more relationally aggressive and victimized than lower‐SES children. Neither gender nor SES conclusively moderated the relation between language and relational aggression, though some findings suggest the possibility of stronger relations among boys and lower‐SES children. Teachers agreed on ratings of relational aggression and relational victimization to a moderate extent.     

Participation or practice innovation: tensions in inter‐agency working to address disciplinary exclusion from school

This paper explores dilemmas and tensions between two models of school based inter‐agency meetings to prevent disciplinary exclusion from school. The first model is characterised by innovative practice developed through long established professional relationships and addresses both individual and strategic issues in supporting young people who are at risk of disciplinary exclusion from school. The second model strongly emphasises the right to participation of young people and their families in school based inter‐agency meetings. Research participants in three Scottish councils (parents, pupils, teachers and other professionals 1 ) had identified school based inter‐agency meetings as key to the process of inter‐agency working to prevent school exclusion.