Assessment of Work Performance (AWP)--development of an instrument

Adequate work assessments are a matter of importance both for individuals and society [5,29,31,38,40,46,52]. However, there is a lack of adequate and reliable instruments for use in work rehabilitation [14,15,20,21,31,44]. The purpose of this study was to develop and evaluate an observation instrument for assessing work performance, the AWP (Assessment of Work Performance). The purpose of the 14-item instrument is to assess the individual's observable working skills in three different areas: motor skills, process skills, and communication and interaction skills. This article describes the development and results of preliminary testing of the AWP. The testing indicates a satisfactory face validity and utility for the AWP and supports further research and testing of the instrument.     

Construct validity of the instrument DOA: a dialogue about ability related to work

This study examined the construct validity of the newly developed instrument A Dialogue About Ability Related To Work (DOA). DOA [18] was developed using concepts from the Model of Human Occupation [20] as theoretical framework. The instrument assumes the assessment of work ability by both the client and the occupational therapist, and is followed by a dialogue which is expected to distinguish possible goal-setting for further rehabilitation [18,19]. Twenty-one professionals and 126 clients from three clinics in Sweden participated in the study. All clients were involved as outpatients in psychiatric work rehabilitation in county councils or community services. Results of a Rasch analysis test indicated that items are well separated and generally work together in five unidimensional continuums to measure work ability. Twenty-nine of 34 items showed goodness-of-fit statistics, which means acceptable infit MnSq values from > or = 0.6 to < or = 1.4 in association with Z values from -2 to 2. The five misfit items have to be revised. The study has indicated that DOA is a valid instrument in psychiatric work rehabilitation and ought to be useful in the dialogue between occupational therapists and clients about goalsetting and treatment planning.     

Expert review of an approach to functional capacity evaluation

Functional capacity evaluation (FCE) is a widely used tool in work rehabilitation, despite the limited examination of the soundness of its measurement properties. This paper outlines the development of a new approach to FCE, the GAPP FCE, and reports on the findings of an expert review of aspects of its content validity and technical adequacy and how it meets established test criteria. Five expert occupational therapists reviewed the materials of the GAPP FCE then completed a questionnaire related to the content validity, technical adequacy and safety, reliability, validity, practicality and utility of the GAPP FCE. The experts gave support to most aspects of these criteria. The main issue identified by the review was related to interpretation and extrapolation of the FCE results for return to work. This and other issues are discussed in relation to recent developments in FCE and plans for future development of the GAPP FCE.     

Case report: a work simulation program for a manual worker with a fracture injury

Work rehabilitation programs targeting different client groups are available in nearly all major hospital occupational therapy departments in Hong Kong. Clients receiving work rehabilitation are referred from various out-patient clinics and other occupational therapists. Those clients experience limitation in work after their injuries or diseases and plan to return to work after rehabilitation. Program objectives are 1) to assist clients to reach maximum work capacity as rapidly as possible 2) to ensure clients return to work safely 3) to improve clients' work readiness. This case report describes an individualized work simulation program at a general hospital in Hong Kong provided for a typical client who is preparing to return to his worker role. Specific job analysis, goals and program rationale for the client are discussed.     

Reliability of the instrument DOA: dialogue about ability related to work

The aim of this study was to examine the reliability of the new instrument "DOA--a dialogue about ability related to work" [6]. DOA was developed using the Model of Human of Occupation as a theoretical base [12,13]. The instrument is divided into two sections; client self-assessment and professional assessment focusing on the individual's ability to perform work-related activities. Assessments are followed by a dialogue to distinguish goals for the return-to-work process based on the client's own preferences [6,14]. 34 outpatients' clients and 14 professionals from four clinics within psychiatric work rehabilitation in Sweden participated in the study. The Spearman Rank Correlation test generally showed acceptable significant correlations in test-retest (n=34). A greater part of items correlated "moderate to good" (r=0.51-0.75). In the raters' test (n=14) Percentage of agreement (PA) was good ranging between 93.1%-96.5%, which is above the acceptable criteria of 80%. There were no significance differences between the raters. The study has indicated that items in DOA work with generally good reliability to measure ability related to work. The instrument was demonstrated to be a reliable therapeutic tool in goal setting for return-to-work in a position outside of the clients' preferences.     

Content validation on the Work Performance Rating Scale for sheltered workshop workers

The purpose of this study was to revise the content of the Work Performance Rating Scale (WPRS) as a valid assessment tool for sheltered workshop workers. A focus group of 11 sheltered workshop workers was recruited to collect their opinions about the relevance of the WPRS from the service users' perspectives. A panel of 23 frontline practitioners who had experience in using various work assessment instruments provided at their work setting was recruited to review the content of the WPRS. A 14-item amended version of the WPRS with five new items added was proposed based on the opinions of service users, frontline practitioners, and the concept of the Minnesota Theory of Work Adjustment (MTWA). An expert panel of 12 professionals at the senior level from various vocational rehabilitation settings was recruited to comment on the content validity of the 14-item amended version of the WPRS. The expert panel agreed that the amended version of the WPRS was related to the concept of job satisfactoriness which could be used to assess the work performance of sheltered workshop workers. Thus, the use of the MTWA for improving the content validity of the WPRS to assess the employability of sheltered workshop workers was supported by the findings of the study.     

Intervention options: Participation in work activities for people with schizophrenia

Vocational rehabilitation is a method by which people with disabilities are able to learn skills and receive supports that are necessary to take part in work activities. Vocational rehabilitation interventions can be used in a wide variety of settings with many different populations of people with disabilities, including those with schizophrenia. However, there is little available research to help guide clinicians to identify which vocational rehabilitation intervention methods may be the most effective for their clients. OBJECTIVES: The purpose of this paper is to identify what is the best practice for obtaining and maintaining participation in work activities for people with schizophrenia. STUDY DESIGN: This paper reviewed sixteen previously conducted studies (seven specific solely to schizophrenia) to identify which vocational rehabilitation method is the best practice to aid those with schizophrenia to obtain and maintain participation in work activities. RESULTS: The reviewed literature suggests that there are a variety of vocational rehabilitation intervention methods that may be effective treatment interventions. The effective interventions were those programs that had a client-centered approach and enabled the client to play an active role in his/her vocational rehabilitation. CONCLUSION: With this study review, clinicians will be able to examine a variety of successful client-centered vocational rehabilitation methods that may aid in helping their clients with schizophrenia to obtain and maintain participation in work activities.     

Assessing readiness for couple therapy: the Stages of Relationship Change Questionnaire

Client readiness for change is garnering increased interest both conceptually and methodologically. This article describes the reliability, validity, and utility of a measure of readiness for couple relationship change, Schneider's (2003) Stages of Relationship Change Questionnaire (SRCQ). Based on the Transtheoretical Model of Change, the instrument measures change along nine domains of marital functioning. Results indicate that this one-factor instrument may reliably measure readiness for change and discriminate between various stages of change. Most in this sample (n = 406) were in early stages of change, with men more often in the stage of precontemplation and women more often in contemplation. The SRCQ can be completed and scored in under 10 min. Clinical use and research implications are discussed.     

A Design for Teaching Human Behavior in a Generalist Undergraduate Program

This paper presents a design for teaching human behavior to undergraduate social work students that is multidisciplinary in its knowledge base, employs a comparative and analytical approach to a variety of theoretical concepts, and is directly linked to the problem-solving competencies of practice. The design assumes that practitioner skills must rest on a broad base of behavioral knowledge that not only integrates large system, sociologically oriented theory with a range of smaller system social and psychological theories, but critically evaluates them in terms of their implications for human welfare and for their validity and utility in the assessment of client problems.     

The theory evaluation scale: An epistemological tool for analyzing social work theories

The profession of social work places a strong emphasis on the utilization of theories in classroom settings as well as in clinical milieus. Therefore, it is understandable that social work students, scholars, researchers, and practitioners feel compelled to make sense of theoretical underpinnings in their professional lives. This study sought to develop an instrument to critically appraise social work theories. Through Qualtrics, a panel of 14 internationally recognized experts in social work theories assessed the content of 16 items, which emanated from the literature on scale development. All of these items were described in accordance with Lawshe’s (1975) content-validity framework. Nine of the original 16 criteria survived expert scrutiny to constitute the Theory Evaluation Scale. Coherence, conceptual clarity, philosophical assumptions, connection with previous research, testability, empiricism, limitations, client context, and human agency were the final criteria on the empirically supported instrument. Implications for research, practice, and social work education are discussed.     

The Worker Role Interview: a powerful tool in Icelandic work rehabilitation

A pilot-study using the Worker Role Interview (WRI) was conducted to gather information from clients attending a work- rehabilitation program in an Icelandic psychiatric center. The work rehabilitation program traditionally used a performance-capacity-oriented assessment (PCA) to evaluate work readiness. Clients scoring 90% or higher on the PCA were considered able to re-enter the job market. However, scoring over 90% did not result in automatic return to work for the majority of clients. As a result, many questions were proposed about the effectiveness of the PCA to predict client ability to re-enter the work force. A pilot study using the Worker Role Interview was conducted with an aim to gain insight into what barriers prevented clients from entering the work force. Ten clients scoring 90% or over on the PCA were interviewed using the WRI. Qualitative methods were used to analyze the data. Results from the WRI indicated that clients failed to join the work force due to a number of psychosocial factors, such as lack of personal causation and self-efficacy combined with environmental factors. The WRI provided clients with an opportunity to express their attitudes and opinions towards work. Information gained through the WRI also gave new direction in goal setting for the work rehabilitation program and validated the need to expand occupational therapy services.     

Psychometric properties of the Transitions from Foster Care Key Leader Survey

This study summarizes the development and piloting of the Transitions from Foster Care Key Leader Survey (TFC-KLS), an instrument designed to measure change in systems serving young people transitioning from foster care to adulthood. The Jim Casey Youth Opportunity Initiative’s logic model was used as a basis for instrument development. The instrument was piloted with 119 key leaders in six communities. Seven of eight latent scales performed well in psychometric testing. The relationships among the 24 measures of system change were explored. A CFA testing overall model fit was satisfactory following slight modifications. Finally, a test of inter-rater reliability between two raters did not find reliable reporting of service availability in a supplemental portion of the survey. The findings were generally positive and supported the validity and utility of the instrument for measuring system change, following some adaptations. Implications for the field are discussed.     

A method for diagnosing and planning the treatment of adolescent drug abusers (the Adolescent Drug Abuse Diagnosis [ADAD] instrument)

There is a need for a diagnostic method and an instrument appropriate for adolescent drug abuse clients, that permits the assignment of clients to the most appropriate treatment setting, provides the basis for individualized treatment planning, and facilitates comparability across research studies. The development of the Adolescent Drug Abuse Diagnosis (ADAD), a 150-item instrument with a structured interview format, modeled after the Addiction Severity Index (ASI) (which is for adults), is described. The ADAD produces a broad-spectrum comprehensive evaluation of the client, the interviewer's ten-point severity ratings, and composite scores for each of nine life problem areas that are often relevant to the treatment needs of adolescent drug abuse clients. A series of validity and reliability tests are described. The characteristics of the standardization sample (N = 1,042), and the comparison of the characteristics of the three subsamples (outpatient, residential or non-hospital, and inpatient) are also presented.     

The multi-disciplinary nature of low vision rehabilitation--a case report

This paper presents the case of a 47-year-old female with low vision secondary to high myopic macular degeneration who remains active in the work force as a spiritual and religious care coordinator for a large institution. An ophthalmologist with a specialty in low vision rehabilitation initially assessed the client. The ophthalmologist prescribed optical devices which used residual retinal vision available at preferred retinal loci. This availed better vision for viewing targets located at far, near and intermediate distances from the client. An optician provided and dispensed the devices prescribed to the client. Additionally, the ophthalmologist made a referral to an occupational therapist. The occupational therapist conducted a series of sessions to further enhance reading and writing skills and a work place assessment aimed at optimizing workplace conditions in order to achieve optimal functional vision. This case illustrates and emphasizes the multi-disciplinary nature of low vision rehabilitation, which involved in this case co-operation between ophthalmology, occupational therapy and opticianry.     

The power of outcomes: FOTO Industrial Outcomes Tool -- Initial assessment

OBJECTIVE: To demonstrate how outcomes assessment can assist in describing clients receiving rehabilitation in occupational health rehabilitation clinics and to describe the preliminary assessment of internal consistency reliability and construct validity of the FOTO Industrial Outcomes Tool. METHODS: 266 adults referred for acute work rehabilitation (AWR), work conditioning/hardening (WC/WH) or a Functional Capacity Evaluation (FCE) comprised the data set. Clients were treated between July 1998 and January 1999 in 15 clinics from 6 states by 46 clinicians participating in the Focus on Therapeutic Outcomes (FOTO) national rehabilitation database beta test. For AWR and WC/WH, clients completed a health status questionnaire on intake and discharge, and health status was assessed prior to the FCE. Comprehensive demographic data were collected describing the clinics, clinicians, clients and work status collected 2 weeks following discharge. RESULTS: Internal consistency reliability coefficients for the health status scores ranged from 0.57 to 0.89. Construct validity was supported. CONCLUSION: Results demonstrate the power of collecting outcomes from a variety of constructs for clients receiving industrial rehabilitation services. Initial reliability and construct validity findings were adequate and support continuing data analyses.     

The Parent Concerns Questionnaire: evaluation of a mothers' self report instrument for the identification of problems and needs in child and family social work

The measurement of problems and needs is a major issue for policy and practice in social work and social service provision. There has, furthermore, in recent years, been an increasing emphasis on gaining an understanding of users or clients' views of needs and service provision. However, there have been few attempts to develop practitioner and ‘client friendly’ ways of gaining information on problems and needs, either on an individual basis, or through the collection of aggregated data which can be used by local authorities as a whole. Where these have taken place there has been little attempt to assess their reliability or validity. This paper reports on the design and development of the Parent Concerns Questionnaire, an instrument designed to obtain the views of mothers in general, and depressed mothers in particular, in families subject to child and family care intervention. The paper reports on the reliability and validity of this instrument, which is presented as appropriate for use, both with families containing depressed mothers and other families subject to child and family care intervention. It may be used to examine problems and needs both on an individual family‐by‐family basis, and through the aggregation of data, on an authority‐wide basis. Copyright © 2000 John Wiley & Sons, Ltd.     

Social Work Assessment of Adaptive Functioning Using the Vineland Adaptive Behavior Scales

Abstract

The assessment of client adaptive functioning is often an important component of a comprehensive social work evaluation. The Vineland Adaptive Behavior Scales (VABS) are the most commonly used quantitative measures of adaptive functioning for clients meeting the criteria for a wide range of disorders. We review the development of the VABS and current knowledge pertaining to the instrument's reliability and validity. We conclude that the ability to administer and interpret the VABS is an important skill for clinical social workers to acquire.     

Taking the measure: a participatory approach to measuring and monitoring psychological empowerment in social work practices

For years, the professional field has been searching for methods that could be used to chart the effectiveness of social services. Social workers report that their current systems for registration and measurement do not provide an accurate reflection of their practice. The measurement of client empowerment might offer an alternative method that could improve the evaluation of social services. This method links the need for measuring instruments to the paradigm of empowerment, which has shaped contemporary social work. A scale for measuring psychological empowerment was developed in consultation with social workers and people in poverty, based on validated and reliable measurement scales. It was subsequently tested in two Public Centres for Social Welfare in Flanders (Belgium). Results of confirmatory factor analysis indicate that the measurement model provides a good fit for the data and that the various latent factors are reliable and valid. We conclude that the factors emerging from the factor analysis reflect the three dimensions that form the concept of psychological empowerment: the intrapsychic, interpsychic and behavioural components. Results from the post-test survey indicate that this measurement instrument is promising, and that it could offer a response to current needs, although additional efforts are needed in order to improve the instrument’s handling.     

Career decision-making,career exploration behaviors,and self-regulated learning

Helping individuals make a career decision is a key aim of career counseling. Determining how to encourage self-regulated learning and behaviors needed to achieve this goal often underlies career interventions. The English version of the Career Exploration Behavior survey (CEB-E) measures activities individuals engage in to learn about career options. The present study explored the psychometric properties of the CEB and its impact on various career outcomes. In the first study (N = 498), a good-fitting second-order factor model with four group-level scales and loadings was retained as the best model. In the second study (N = 143), convergent validity and incremental validity of the CEB dimensions were explored through correlation and regression analyses. The CEB predicted commitment making, metacognitions, and vocational identity. Results suggest the CEB-E is a psychometrically sound assessment of career exploration behaviors with potential utility for theory development, program evaluation, and monitoring client progress.     

THE DEVELOPMENT OF A FORGIVENESS SCALE

This paper reports on the development, validity, and reliability of a self-report instrument designed to assess a respondent's perspective of pain resulting from relational violations and work toward relational forgiveness based on framework proposed by Hargrave (1994a). Presented here is the five-stage procedure used in the development of the Interpersonal Relationship Resolution Scale. Construct validity and reliability were determined from an initial sample of 164 subjects. Concurrent validity of the scal was supported by another sample of 35 respondents who took the Interpersonal Relationship Resolution Scal, the Personal Authority in the Family System Questonnaire, the Relational Ethics Scale, the Fundamental Interpersonal Relations Orientation-Behavior scale, and the Burns Depression Checklist. Finally, a predictive validity study of the scale was performed with a clinical and nonclinical sample of 98 volunteers. Data are presented that support the validity and reliability of the instrument, as will as the final version of the scale.