Portfolio assessment in a collaborative program evaluation: the reliability and validity of a family literacy portfolio

Evaluations increasingly use open-ended assessments, such as portfolios, to gather information about program impact. Portfolios, however, present challenges in achieving acceptable levels of reliability and often lack evidence to support validity. This article describes the components of a portfolio assessment system developed in a collaborative evaluation of a family literacy program. Staff of a family literacy program and two evaluators collaborated to develop the assessment and the tools that frame the review of the portfolios. Rubrics, exemplar portfolios, portfolio logs, and lists of ‘look-fors’ were developed to guide raters in the scoring and to improve the reliability of scores and validity of decisions about the program. Inter-rater reliability for the portfolio assessment was 0.79 for holistic scores and 0.74 for analytic scores. With respect to validity, holistic and analytic scores correlated with criterion measures from 0.50 to 0.59, providing initial evidence of a common construct.     

Influence diagnostics for the structural sharpe model under normal/independent distributions

A method is proposed in this paper to assess the local influence of minor perturbations for the Sharpe model when the normal distribution is replaced by normal/independent (NI) distributions. The family of NI distributions is an attractive class of symmetric heavy-tailed densities that includes as special cases the normal, t-Student, slash, and the contaminated normal distributions. Since the returns of the market are not observable, the statistical analysis is carried out in the context of an errors-in-variables model. An influence analysis for detecting influential observations (atypical returns) is developed to investigate the sensitivity of the maximum likelihood estimators. Diagnostic measures are obtained based on the conditional expectation of the complete-data log-likelihood function. The results are illustrated by using a set of shares of companies traded in the Chilean stock market.     

The Journey Around My PhD: Pitfalls,Insights and Diamonds

Embarking on postgraduate research involves making a transition from practitioner to researcher. While there is a well established body of knowledge to address research methodology, it is presented in a fashion that suggests the research process is straightforward and linear and fails to offer insights into the ways postgraduate students construct their researcher identities. This paper will draw on the authors' experiences as PhD students and highlight what was learned about the research process from involvement in a research project. The paper will highlight some of the challenges of undertaking postgraduate research as well as some of the insights gained.     

An Agenda for the Future: Student Portfolios in Social Work Education

Portfolios have been used in a variety of academic settings for outcomes measures and to present students' best work. This article introduces the idea of electronic portfolios to be used with social work majors both in the graduate and undergraduate curriculums. The literature around portfolios, an explanation of our process and the points to consider regarding pursuing an electronic portfolios process are addressed.     

Learning to be interprofessional through the use of reflective portfolios?

Learning portfolios are used extensively in health and social care. There is evidence of their value as a tool to consolidate learning although limited information is available regarding their use in social work education. This study explores the use of a portfolio to encourage social work students to reflect on their interprofessional learning (IPL). The portfolio offers a means of demonstrating professionalism concerning knowledge, skills and attitudes in the context of collaborative practice. The findings of this research suggest that qualifying students were largely capable of reflecting on their development of interprofessional competence after attending specific IPL events, which were part of a wider programme. Social work students found reflective writing difficult, although this improved over time. In particular students struggled to write about skills and attitudes. Students perceived the portfolio to be a good way to assess their progress and believed this helped them to engage with their learning and make meaning through reflection and analysis. They appreciated that IPL and feedback from their assessments had advanced their abilities for self-analysis; despite needing help with reflective writing, they felt better prepared for ongoing use of reflection in their professional development, and in ‘working together’.     

The Passing of the Practice Teaching Award: History,Legacy, Prospects

This article reviews the origin, development and prospective demise of the Practice Teaching Award, as a prelude to considering the scope for reconfiguring practice teacher training and assessment on the GSCC landscape of social care codes of practice, qualifying programmes in social work and an integrated post‐qualifying framework. As a bridge from the past to the future, the article highlights a rich PTA ‘legacy’, identifying a particularly valuable ‘bequest’ in the ‘mainstreaming’ of portfolio assessment. Transcending the sphere of education and training as such, the reflective self‐assessment characteristic of effective portfolio construction is identified as a major contribution to the ‘professionalisation’ of social work practice as a whole.