Whole Curriculum Mapping of Assessment: Cartographies of Assessment and Learning

Approaches to curriculum design often occur at the unit or course level within social work education. Only rarely have ‘whole of curriculum’ approaches been discussed in the literature. This paper describes the creation of a ‘whole of curriculum approach’ to social work teaching and learning within an Australian University. The project involved the creation of a methodology and conceptual framework to map assessment across an entire social work curriculum. In doing so, the mapping exercise provided a way to evaluate the sequencing and integration of assessment tasks across the four-year degree pathway, and judge the effectiveness that such assessments fit with theories and research on assessment more broadly, and with the graduate outcomes for a social work degree. This paper outlines the background to the 2013 assessment project and its alignment to the curriculum mapping. It argues and explains how a systematic approach to mapping and improving social work curriculums can be achieved.     

Integrating Art Therapy Methodology in Brief Inpatient Substance Abuse Treatment for Adults

ABSTRACT

Decades of drug addiction research and clinical work have underscored the need for multifaceted and comprehensive treatment responses in order to sufficiently address the varied needs of individuals struggling with addiction. One valuable treatment component that can be incorporated into traditional treatment protocols to expand the comprehensive nature of treatment response is art therapy. A conceptual framework is presented, detailing the integrative opportunities and benefits of including an art therapy component to short-term hospital-based inpatient substance abuse treatment programs. A creative arts component can be particularly beneficial for brief inpatient programs, where the client population is diverse, in crisis, and at high-risk for relapse; and where clinicians need to obtain comprehensive client information from multiple sources in a short amount of time. Art therapy methodology can provide a mechanism for collecting such collateral information for assessment purposes, can be employed to facilitate therapeutic change, and is used to track and document client progress and clinical change over time. Practice guidelines and specific treatment techniques are presented through short case examples.     

Mismatch of school desks and chairs by ethnicity and grade level in middle school

The purpose of this article is to introduce the cross-disciplinary competency standards for work-related assessments, why they are needed and how they have been developed in New South Wales (NSW). Cross-disciplinary competency standards communicate the benchmarks for effective performance of work-related assessments. They outline what is expected of rehabilitation professionals, including the ability to apply and transfer competence across different conditions and workplace contexts. Outcomes in occupational rehabilitation are affected by the efficacy of the work-related assessments performed, which is dependent upon competent, clinical decision-making by rehabilitation professionals. However, in Australia, work-related assessment practice is not governed by universally accepted competency standards or by any competency-based training/education and assessment system. To enhance professional practice, WorkCover NSW has developed cross-disciplinary competency standards for work-related a ssessments. The competencies provide (i) quality standards for professional workplace training and development, (ii) benchmarks for assessing the competence of rehabilitation professionals, (iii) a framework for evidence-based practice, (iv) benchmarks for measuring service quality and (v) "real world" learning outcomes and assessment criteria for professional education programs.     

When work hurts: A conceptual framework explaining how organizational culture may perpetuate workplace bullying

This work was motivated by research findings, suggesting that the prevalence of workplace bullying is increasing across the world. The workplace bullying research further suggests that the basic risk determinants of bullying lie in an organization’s work environment and that prevalence of workplace bullying may vary by occupation, sector, and country. Upon reviewing the existing literature, it becomes apparent that while organizational culture can be both indirectly and directly related to workplace bullying, references to the relationship between organizational culture and workplace bullying remain scant and what is available lacks substantive conceptual foundation. To address this apparent gap in research, the main purpose of this article is to present an integrated conceptual framework proposing the relationships between specific organizational culture dimensions and workplace bullying. The article was specifically written in accordance with previous studies which highlight factors that may perpetuate workplace bullying within organizations. While highly theoretical and conceptual in nature, this article is one that may be important in explaining how some organizational cultures may motivate, facilitate, perpetuate, enable, and precipitate workplace bullying, and thus offers insights into how to prevent workplace bullying by creating less enabling environments. The article concludes by offering theoretical arguments for how organizations should monitor, manage, and eradicate changeable organizational cultural practices that may otherwise enable workplace bullying.     

Digital technologies and power dynamics in the organization: A conceptual review of remote working and wearable technologies at work

In this article, we examine the kinds of control practices that emerge with the introduction of digital technologies, and how these technologies are employed to shape power within workplaces. We present a comparative conceptual review of work practices by contrasting remote work and the use of workplace wearables. We trace forms of power and control that have been enacted with the adoption of these work‐related technologies and associated practices. We find that the prevailing literature focuses on the practices enacted by management in order to control workers and exert power over them, and we propose that a more comprehensive approach be taken. In support of this view, we show how the concept of appropriation emerges from science and technology studies, and we argue that such a concept would be useful for exploring how workers use and incorporate digital technologies into their daily lives, thus reshaping power in organizations.     

Giving the community a voice: Lessons learned from a comprehensive survey in an urban neighborhood

Weinland Park, an urban neighborhood adjacent to The Ohio State University, has been targeted for revitalization following several decades of disinvestment. The goal of these efforts is to develop holistic solutions that break the cycle of poverty. Such an undertaking requires collecting baseline data to understand community needs, inform programming, and guide revitalization efforts. This paper describes the development and implementation of the Weinland Park Evaluation Project (WPEP) – a collaborative and comprehensive neighborhood survey and needs assessment. Using the RE-AIM framework as a conceptual model, the paper describes how the WPEP was designed to meet short-, medium-, and long-term community needs. In addition, it offers lessons learned as a guide for researchers designing neighborhood surveys and conducting community assessments. An Appendix A includes indicators measured via the survey tool.     

Use of Psychological Tests in Child Custody Assessment

SUMMARY

This article describes a functional, comprehensive approach to the use of psychological tests and measures in a child custody evaluation. I describe a conceptual framework to be used in choosing assessment techniques that are used to assess functional aspects of parenting competencies and other related variables helpful in creating a reliable foundation from which to generate opinions about custodial placement and visitation access. Finally, I provide a practical example of how psychological test data might be presented in an advisory report to the court.     

Spiritual assessment in marital and family therapy: a methodological framework for selecting from among six qualitative assessment tools

Emerging professional and cultural developments underscore the importance of spiritual assessment. Most marriage and family therapists, however, appear to have received little training on the topic. Consequently, this article overviews a complementary family of six recently developed qualitative assessment approaches or tools, an initial brief assessment tool and five comprehensive assessment tools, and presents a methodological framework for using the six tools. To help decide whether or not a comprehensive assessment is warranted after conducting an initial brief assessment, two general guidelines are offered. Suggestions for selecting the appropriate comprehensive assessment tool are also presented, and summarized graphically in the form of a decision tree. The overall methodological framework is designed to be congruent with the recent spiritual assessments recommendations issued by the Joint Commission on Accreditation of Healthcare Organizations (JCAHO), the largest healthcare accrediting organization in the United States.     

Work functioning: a conceptual framework

Adequate and reliable methods for evaluation of clients with work disabilities are crucial for both the individuals who are assessed and for society as a whole. Sound and precise work assessments are needed to guide clients to suitable interventions using a minimum of rehabilitation resources. Occupational therapy literature contains evidence that work function assessments are complex and that there is confusion over work assessment concepts. Therefore, further development and evaluation of adequate concepts and theoretical models within the area of work assessment is needed. This article proposes a conceptual framework for different dimensions of work functioning and points out important factors for work assessment. The concepts proposed and defined in the article are: work functioning, work participation, work performance, and individual capacity.     

Multidisciplinary eHealth survey evaluation methods

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the developers of health interventions to identify, select, and use the most appropriate and relevant survey tools. The primary contributors included survey methodologists, computer scientists, informaticians, technical communications specialists, educators, evaluators, clinical practitioners, and health services researchers, who together developed a comprehensive ontology to describe the electronic survey domain. This paper will describe the survey ontology development process and detail lessons learned in the creation of the web survey system evaluation framework.     

Teaching Students to Perform Assessments

In recent years, assessment methods and skills have been increasingly emphasized in the social work literature. Little information, however, has been provided about how to teach students assessment skills in a classroom setting. This article addresses that gap in the literature and presents an integrative skills assessment approach for teaching students to perform assessments. This approach is based on technical eclecticism and combines assessment methods and skills from three practice models: (1) psychosocial, (2) cognitive—behavioral, and (3) systems. Knowledge and skills about measurement, computerized assessment models and expert systems also are included in this approach to teaching assessment skills. The authors provide suggestions and tools for teaching assessment skills in a classroom, including an integrative skills assessment protocol and several techniques that may be used to teach students to gather assessment data. In teaching assessment skills, possible links may be developed with the field practicum and the classroom experience of students. In addition, the authors suggest that students benefit from the integrative skills approach. The approach is comprehensive, flexible, competency based, technological, and empirically based. However, shortcomings are that the approach is a clinical practice approach that excludes other forms of practice and that the integrative skills assessment approach does not help students develop skills for performing the rapid assessments frequently required for brief interventions.     

Conceptual framework for development of a toolkit for prevention of work-related musculoskeletal disorders

The World Health Organisation (WHO) network of Collaborating Centres in Occupational Health aims to promote the development, implementation use of "toolkits" for workplace use in reducing the risk of injuries and disease. As a major partner within this network, the International Ergonomics Association is committed to developing a toolkit to reduce the risk of musculoskeletal disorders. This paper outlines the kind of conceptual framework required to support this work.     

Juvenile offender rehabilitation in Estonia: interprofessional collaboration in written assessments and specialists’ perceptions

Qualitative and quantitative research methods were used to study an interprofessional assessment model in rehabilitation services and its implementation in Estonia based on (1) a sample of rehabilitation plans for 160 juvenile offenders aged 7–18 and (2) expert interviews with 10 members of an interprofessional assessment team. Each specialist’s role was compared with the assessments. While each team member is assigned a discrete role based on discipline, in practice, the disciplines’ work overlapped considerably during the assessment process. The overlap seems to occur because team members conduct their assessments individually, rather than following the collaborative best practice model for interprofessional teams described in the literature. The expert interviews indicate that rehabilitation specialists perceive the individual-level elements of interprofessional teamwork to be consistent with the ideals articulated in the Perception of Interprofessional Collaboration Model, while the substantial overlap in assessments that occurred in practice could be related to lack of interprofessional collaboration at group and organizational levels. Recommendations to improve the functioning of teams serving juvenile offenders include establishing an interprofessional education system, increasing the flexibility of the legal framework for service provision, and improving the interprofessional assessment instrument.     

Assessment of undergraduate and graduate programs

Data from an international survey of public relations educators and practitioners raises a number of concerns about how achievement is measured among public relations students. Fewer than one in four academic programs have actually assessed learning outcomes and used the results to enhance their students' educational experiences. Fewer than one in four practitioners have been involved in some way as assessors. The survey suggests that educators place too much stock in grades alone as an appropriate assessment tool.While both educators and practitioners value portfolio reviews as an assessment protocol, practitioners see much greater value in their involvement in this form of assessment than their faculty counterparts. These differences of opinion notwithstanding, current practice and the opinions of educators and practitioners coalesce around the value of capstone experiences such as internships, simulation or case study analysis and surveys of alumni satisfaction as a core around which assessment plans can be built.The Assessment Task Team at the 1998 NCA Summer Conference developed a multidimensional model of assessment that reflects three principles of good practice. First, assessment plans which measure knowledge, behavior and affect at various points in students' academic careers rather than only at the end of a degree program are able to demonstrate change and the value added by the program of study. Second, specific outcomes may be measured by repeated applications of the same assessment protocol or by the use of different protocols over time. Third, appropriate use of a single assessment protocol to measure multiple outcomes, especially when those outcomes are drawn from two or more of the broad categories of knowledge, behavior and affect results in maximizing the information gained while minimizing the resources devoted to assessment.     

Alcohol, drugs, and links to sexual risk behaviors among a sample of Virginia college students

This project was significant in that it administered the National College Health Risk Behavior Survey (NCHRBS), a health risk assessment, to a sample of students at three public universities in Virginia. Virginia was never included in the original or subsequent nationwide assessments using this instrument. This health risk assessment is comprehensive, easy to administer, and free. The NCHRBS assesses risk behaviors in six categories including: (1) behaviors that contribute to unintentional and intentional injuries; (2) tobacco use; (3) alcohol and other drug use; (4) sexual behaviors that contribute to unintended pregnancy and STDs, including the HIV infection; (5) unhealthy dietary behaviors; and (6) physical inactivity. This article focuses on student responses to questions about alcohol and other drugs and sexual behaviors linked to the use of these substances. It provided baseline data on health risk behaviors of college students which can help determine wellness/health education course objectives and health promotion programming and services provided to the students within the universities. In addition, this project provided protocol to expand use of the survey statewide.     

A comprehensive health service evaluation and monitoring framework

ObjectiveTo develop a framework for evaluating and monitoring a primary health care service, integrating hospital and community services.MethodA targeted literature review of primary health service evaluation frameworks was performed to inform the development of the framework specifically for remote communities. Key principles underlying primary health care evaluation were determined and sentinel indicators developed to operationalise the evaluation framework. This framework was then validated with key stakeholders.ResultsThe framework includes Donabedian's three seminal domains of structure, process and outcomes to determine health service performance. These in turn are dependent on sustainability, quality of patient care and the determinants of health to provide a comprehensive health service evaluation framework. The principles underpinning primary health service evaluation were pertinent to health services in remote contexts. Sentinel indicators were developed to fit the demographic characteristics and health needs of the population. Consultation with key stakeholders confirmed that the evaluation framework was applicable.ConclusionData collected routinely by health services can be used to operationalise the proposed health service evaluation framework. Use of an evaluation framework which links policy and health service performance to health outcomes will assist health services to improve performance as part of a continuous quality improvement cycle.     

Validity of work-related assessments

Insufficient evidence of the validity of work-related assessments is frequently reported as a major concern in occupational rehabilitation. Despite this concern, and the continuing development of new and old assessments, no comprehensive evaluation of the evidence has been conducted. OBJECTIVES: The purpose of this study was to first determine the extent and quality of available evidence for the validity of work-related assessments, and then where sufficient evidence was available, determine the level of validity. STUDY DESIGN: This study examined available literature and sources in order to review the extent to which validity has been established for 28 work-related assessments. RESULTS: The levels of evidence and validity are presented for each assessment. Most work-related assessments have limited evidence of validity. Of those that had adequate evidence, validity ranged from poor to good. There was no instrument that demonstrated moderate to good validity in all areas. Very few work-related assessments were able to demonstrate adequate validity in more than one area, or with more than one study, even when contributory evidence was included. CONCLUSION: With this study clinicians will be able to examine their options with regard to the validity of the assessments they choose to use.     

EADS - Ergonomics Affinity Design System

The Ergonomics Affinity Design System (EADS) is a systematic problem-solving tool used to analyze and solve ergonomics issues. The basis of EADS is the identification and ranking of affinities or relationships that exist among the factors that influence job performance in the workplace. The five-step system can be applied to the workplace at varying levels of complexity based on need. It can be used at the design phase or in a redesign/modification application. Applicable for use in any work environment, the system can be an important part of the overall ergonomics process.     

Semi-structured interview protocol for constructing logic models

This paper details a semi-structured interview protocol that evaluators can use to develop a logic model of a program's services and outcomes. The protocol presents a series of questions, which evaluators can ask of specific program informants, that are designed to: (1) identify key informants basic background and contextual information, (2) generate logic model elements, (3) model program inputs, activities, outputs, and outcomes, (4) build a rational theory, (5) develop a program theory, (6) prioritize logic model elements, and (7) build a graphical or tabular logic model. The paper will also provide an example of how this approach was used to develop a logic model for a youth mentoring program. It is our hope and belief that with this interview protocol, novice evaluators will be able to generate comprehensive logic models like seasoned professional evaluators.     

Understanding workplace deviant behavior in nonprofit organizations

Workplace deviant behavior has traditionally been studied with respect to business or for‐profit organizations. In this article, we argue that nonprofit organizations also experience deviance, and due to their unique characteristics, they deserve special attention for extending the understanding of workplace deviant behavior to other types of organizations. Based on a review of the literature on deviance, we develop a general model of workplace deviance that we apply to nonprofit organizations. Based on the integrative conceptual framework, we advance relevant propositions for understanding and explaining deviance in nonprofit organizations.