A Psychometric Analysis of Field Evaluation Instruments Designed to Measure Students’ Generalist-Level Social Work Competencies

ABSTRACT

There is a dearth of research on the evaluation of the psychometric performance of instruments designed to measure students’ generalist-level social work competencies. There is also uncertainty on the performance of various response option formats used to measure students’ competencies in assessment instruments. Using a sample of 198 master of social work students and 198 field instructors, the current study employs confirmatory factor analysis to assess the psychometric performance of a field evaluation instrument designed to measure students’ generalist-level social work competencies. The results provide evidence to support the validity and reliability of the instrument. The results also highlight nuances associated with a 5-point response option format for items used to measure competency indicators. Implications, limitations, and directions for future research are discussed.     

Use of Multicriteria Decision Analysis to Support Weight of Evidence Evaluation

Weight of evidence (WOE) methods are key components of ecological and human health risk assessments. Most WOE applications rely on the qualitative integration of diverse lines of evidence (LOE) representing impact on ecological receptors and humans. Recent calls for transparency in assessments and justifiability of management decisions are pushing the community to consider quantitative methods for integrated risk assessment and management. This article compares and contrasts the type of information required for application of individual WOE techniques and the outcomes that they provide in ecological risk assessment and proposes a multicriteria decision analysis (MCDA) framework for integrating individual LOE in support of management decisions. The use of quantitative WOE techniques is illustrated for a hypothetical but realistic case study of selecting remedial alternatives at a contaminated aquatic site. Use of formal MCDA does not necessarily eliminate biases and judgment calls necessary for selecting remedial alternatives, but allows for transparent evaluation and fusion of individual LOE. It also provides justifiable methods for selecting remedial alternatives consistent with stakeholder and decision‐maker values.     

Marginal and hazard ratio specific random data generation: Applications to semi-parametric bootstrapping

Cox's partial likelihood for censored time-to-event data can be interpreted as a permutation probability, whereby covariate values are permuted to the observed times-to-event and censoring times. This interpretation facilitates a simple method for jointly generating times-to-event and covariate tuples with considerable flexibility, including time dependence of the hazard ratio and specification of both the marginal time-to-event and covariate distributions. This interpretation also facilitates a method for semi-parametric bootstrapping of hazard ratio estimators.     

Family Dilemmas and Secrets: parents' disclosure of information to their adult offspring with learning disabilities

This paper describes the role parents play in providing knowledge of learning disability to their adult offspring with learning disabilities. Data were derived from an in-depth qualitative study of the nature of parent-adult-offspring co-residence. The findings reveal that while parents recognised and had to deal with the stigma learning disability exerted in their own lives, they had taken steps to prevent their adult offspring from having to deal with similar difficulties. It is argued that it remains the case that learning disability is treated as a stigmatised identity and as such is rendered invisible through the strategic control of information. However, findings point towards the conclusion that there has been a cultural reversal in how this process is managed.     

Defining child abuse: Exploring variations in ratings of discipline severity among child welfare practitioners

This study investigated child welfare practitioners’ ratings of the severity of parental discipline practices. Ratings varied by the type of act, age of the child, and by chronicity. Exploratory investigation into changes across time found that current practitioners (N = 27) rated several practices (e.g. spanking and shaking) as more severe than did professionals (N = 24) sampled in 1977. Results underscore the complexity of defining child maltreatment and offer implications for practitioners, applied researchers, and child welfare policy makers.The authors Stephen D. Whitney, Emiko A. Tajima, Todd I. Herrenkohl, and Bu Huang are affiliated with the School of Social Work, University of Washington.Work on this project is supported by funds from the Social Work Prevention Research Center, School of Social Work, University of Washington (National Institute of Mental Health Grant R24MH56599, Lewayne Gilchrist, PI) and by the University of Washington Royalty Research Fund.     

Self‐Awareness in Human and Chimpanzee Infants: What Is Measured and What Is Meant by the Mark and Mirror Test?

The objective study of self‐recognition, with a mirror and a mark applied to the face, was conducted independently by Gallup (1970) for use with chimpanzees and monkeys, and by Amsterdam (1972) for use with infant humans. Comparative psychologists have followed the model (and assumptions) set by Gallup, whereas developmental psychologists have followed a different model (e.g., Lewis & Brooks‐Gunn, 1979). This article explores the assumptions in the definitions and methods of self‐recognition assessments in the 30 years since these initial studies, and charts the divergence between the developmental mark test and the comparative mark test. Two new studies, 1 with infant chimpanzees and 1 with infant humans, illustrate a reconciliation of the 2 approaches. Overt application of the mark, or other procedures related to how the mark is discovered, did not enhance mirror self‐recognition. In contrast, maternal scaffolding appears to enhance performance, perhaps by eliciting well‐rehearsed verbal responses (i.e., naming self). When comparable testing procedures and assessment criteria are used, chimpanzee and human infants perform comparably. A combined developmental comparative approach allows us to suggest that mirror self‐recognition may be based on a specific aspect of mental representation, the cognitive ability to symbolize.     

Using categorical markers as auxiliary variables in log‐rank tests and hazard ratio estimation

Markers, which are prognostic longitudinal variables, can be used to replace some of the information lost due to right censoring. They may also be used to remove or reduce bias due to informative censoring. In this paper, the authors propose novel methods for using markers to increase the efficiency of log‐rank tests and hazard ratio estimation, as well as parametric estimation. They propose a «plug‐in» methodology that consists of writing the test statistic or estimate of interest as a functional of Kaplan–Meier estimators. The latter are then replaced by an efficient estimator of the survival curve that incorporates information from markers. Using simulations, the authors show that the resulting estimators and tests can be up to 30% more efficient than the usual procedures, provided that the marker is highly prognostic and that the frequency of censoring is high.     

Modeling Growth and Reduction of Microorganisms in Foods as Functions of Temperature and Time

Food safety objectives (FSOs) are established in order to minimize the risk of foodborne illnesses to consumers, but these have not yet been incorporated into regulatory policy. An FSO states the maximum frequency and/or concentration of a microbiological hazard in a food at the time of consumption that provides an acceptable level of protection to the public and leads to a performance criterion for industry. However, in order to be implemented as a regulation, this criterion has to be achievable by the affected industry. In order to determine an FSO, the steps to produce and store that food need to be known, especially where they have an impact on contamination, growth, and destruction. This article uses existing models for growth of Listeria monocytogenes in conjunction with calculations of FSOs to approximate the outcome of more than one introduction of the foodborne organism throughout the food-processing path from the farm to the consumer. Most models for the growth and reduction of foodborne illnesses are logarithmic in nature, which fits the nature of the growth of microorganisms, spanning many orders of magnitude. However, these logarithmic models are normally limited to a single introduction step and a single reduction step. The model presented as part of this research addresses more than one introduction of food contamination, each of which can be separated by a substantial amount of time. The advantage of treating the problem this way is the accommodation of multiple introductions of foodborne pathogens over a range of time durations and conditions.     

Looking Forward Not Looking Back: The Evaluation of Community Living

This article outlines the development of evaluative methods within the field of mental handicap services. It suggests that evaluators have too often taken for granted the tacit assumptions underlying service models, using these to determine the criteria for evaluating success. It argues that evaluators should be more explicit about the values they adopt, and what patterns of life services should be enabling people to achieve. By more closely linking evaluation criteria to what people with a mental handicap should achieve, evaluation can become more effective in promoting positive change in service models. The article describes an approach developed by the authors for the evaluation of the 'All-Wales Strategy for the Development of Services for Mentally Handicapped People'.