Development and Evaluation of the Trauma-Informed System Change Instrument: Factorial Validity and Implications for Use

In this paper, we present the process of developing and evaluating an instrument designed to measure the extent to which a complex community system has changed as a result of a community initiative, and for purposes of this research, doing this within the content area of developing local trauma-informed child welfare systems in specific communities in Michigan. The instrument was designed for the Southwest Michigan Children’s Trauma Assessment Center’s (CTAC) Substance Abuse and Mental Health Services Administration (SAMHSA)-funded initiative to bring a trauma-informed perspective to professionals working with children in child welfare. The Trauma Informed System Change Instrument was developed with the input of experts in trauma-informed system change. Two parts of the instrument were analyzed separately using confirmatory factor analysis. A two factor model was fit for Community Characteristics and a three factor model for Individual Characteristics. Although adequate factorial validity was obtained for the instrument, specific items on the instrument that were problematic in fitting the model were identified, and suggestions for revising the instrument for improved functionality are offered, as are other potential uses of the instrument.     

Development of the Edmonson Psychiatric Fall Risk Assessment Tool

The purpose of this study was to develop a fall risk assessment instrument for the inpatient psychiatric population. Nine risk factors were identified through a review of the literature. The instrument was applied retrospectively to patient records, and the percentage of those who fell who triggered each of the items in each domain was calculated. The expected value of the population and weighting system were established. The Morse Fall Scale and Edmonson Psychiatric Fall Risk Assessment Tool (EPFRAT) were administered simultaneously to inpatient psychiatric patients. Sensitivity of the EPFRAT was 0.63, compared with 0.49 for the Morse Fall Scale; specificity of the EPFRAT was 0.86, compared with 0.85 for the Morse Fall Scale. Initial psychometric testing of the EPFRAT indicates the instrument is more sensitive in assessing fall risk in the acutely ill psychiatric population than those currently available. Additional psychometric testing is needed to determine the reliability and validity of the EPFRAT.     

Assessment of Work Performance (AWP)--development of an instrument

Adequate work assessments are a matter of importance both for individuals and society [5,29,31,38,40,46,52]. However, there is a lack of adequate and reliable instruments for use in work rehabilitation [14,15,20,21,31,44]. The purpose of this study was to develop and evaluate an observation instrument for assessing work performance, the AWP (Assessment of Work Performance). The purpose of the 14-item instrument is to assess the individual's observable working skills in three different areas: motor skills, process skills, and communication and interaction skills. This article describes the development and results of preliminary testing of the AWP. The testing indicates a satisfactory face validity and utility for the AWP and supports further research and testing of the instrument.     

The revised safe at home instrument for assessing readiness to change intimate partner violence

This article describes the development and factor structure of the Revised Safe At Home instrument, a 35-item self-report measure designed to assess individuals' readiness to change their intimate partner violence behaviors. Seven new items have been added, representing content specific to the Maintenance stage, and other items have been revised to strengthen the assessment of earlier stages and address gender concerns. Confirmatory factor analysis using multisite data (two sites, a total of 281 men at intake) supported the conclusion that a four-factor model (Precontemplation, Contemplation, Preparation/Action, and Maintenance stages) was consistent with the observed covariances. A high degree of correlation between the Preparation/Action and Maintenance scales was observed, but subsequent testing indicated a need to treat the two as distinct factors in the model. It is recommended that scoring include only 31 items that perform well.     

Advancing Social Capital Measurement: Using General Social Survey Cycles to Develop an Efficient Survey Instrument

The General Social Survey (GSS) has provided significant insight about the state of societies around the world through the International Social Survey Programme (ISSP). Although broadly applicable, in this study the context for developing a new social capital survey instrument covers the Canadian GSS since 1985. Questions in the GSS are often used by researchers who are interested in specific questions or themes for use in some form of re-sampling. Given significant social and relational themes, GSS cycles from 1985 to 2013 were reviewed using a social capital framework to produce a new Social Capital GSS survey instrument. A process of vetting and sorting questions led to development of a 41 question instrument that includes 16 demographic and context variables and 25 social network and trust variables. After testing and refinement, the instrument was used with a randomly sampled group across selected East Hamilton Census Tracts that are differentiated by median income and a standard deviation above and below respectively (n?=?97).     

Developing and testing a satisfaction survey for nursing home residents: the Ohio Experience

Input from consumers has become an important part of quality improvement in long-term care and for consumer decision-making. This paper documents the development of the Ohio Nursing Home Resident Satisfaction Survey (ONHRSS) through a partnership of state government, research, and industry experts. The instrument was tested and refined through two waves of data--a pretest phase and later with statewide data. Exploratory and confirmatory analyses with statewide data identified eight primary factors along with an underlying, secondary Global Satisfaction factor. Reliability of the domains ranged from .69 to .95. Recommendations for further refinement and testing of the instrument are discussed along with policy and practice implications.     

Assessing state substance abuse prevention infrastructure through the lens of CSAP's Strategic Prevention Framework

Although the organizational structures and operating procedures of state substance abuse prevention systems vary substantially across states, there is scant empirical research regarding approaches for rigorous assessment of system attributes and which attributes are most conducive to overall effectiveness. As one component of the national cross-site evaluation of the SPF State Incentive Grant Program (SPF SIG), an instrument was developed to assess state substance abuse prevention system infrastructure in order to measure infrastructure change and examine the role of state infrastructure in achieving prevention-related outcomes. In this paper we describe the development of this instrument and summarize findings from its baseline administration. As expected, states and territories were found to vary substantially with respect seven key characteristics, or domains, of state prevention infrastructure. Across the six domains that were assessed using numeric ratings, states scored highest on data systems and lowest on strategic planning. Positive intercorrelations were observed among these domains, indicating that states with high capacity on one domain generally have relatively high capacity on other domains as well. The findings also suggest that state prevention infrastructure development is linked to both funding from state government and the presence of a state interagency coordinating body with decision-making authority. The methodology and baseline findings presented will be used to inform the ongoing national cross-site evaluation of the SPF SIG and may provide useful information to guide further research on state substance abuse prevention infrastructure.     

Construction of a survey to assess workload and fatigue among AMT operators in Mexico

Operators of machinery classified as Advanced Manufacturing Technology (AMT) are exposed to high levels of workload and fatigue. However, only few studies have been conducted on this topic in Hispanic-American countries workers. Several instruments be used to assess workload and fatigue; however, only few of them have been adapted to Spanish language. This paper reports on the development and validity testing of a survey instrument in Spanish, aiming to subjectively assess workload and fatigue among AMT operators in Mexico. Method: After an exhaustive literature review in search of already available measurement instruments, they were adapted for content and later translated into Spanish; a pilot test was conducted to evaluate validity and reliability; afterwards appropriate modifications were made to the testing instruments. Final version of the instrument was applied to a group of 121 operators of CNC lathes. Reliability was analyzed using KMO and Cronbach alpha indices. Results: For the assessment of workload, both NASA-TLX and ISTAS 21 methods were incorporated to the survey instrument. As for fatigue assessment tools, these were SOFI-S, FAS and OFER questionnaires. Results show KMO value and Cronbach alpha above 0.6.Conclusions. The survey instrument as designed, allows the collection of reliable and valid data regarding workload and fatigue among AMT operators in Mexico.     

The hierarchy of needs to inclusive design

This paper focuses Design importance in the development of effectively inclusive products based on Design Emotional approach, allowing children with disabilities to experience playing in the childhood as an instrument for social integration. The methodology used to develop this study was based on literature review, considering the following themes: emotional design, accessibility and inclusion, emotion and development of children. As a result, we propose a new level of need to model the hierarchy of needs, of Jordan ("usability", "functionality" and "pleasure"), level with the inclusion of "dignity."     

Developing and Testing a Satisfaction Survey for Nursing Home Residents

Abstract

Input from consumers has become an important part of quality improvement in long-term care and for consumer decision-making. This paper documents the development of the Ohio Nursing Home Resident Satisfaction Survey (ONHRSS) through a partnership of state government, research, and industry experts. The instrument was tested and refined through two waves of data—a pretest phase and later with statewide data. Exploratory and confirmatory analyses with statewide data identified eight primary factors along with an underlying, secondary Global Satisfaction factor. Reliability of the domains ranged from .69 to .95. Recommendations for further refinement and testing of the instrument are discussed along with policy and practice implications.     

THE DEVELOPMENT OF A RELATIONAL ETHICS SCALE*

In order for empirical testing to be performed systematically on family therapy theories, appropriate testing instruments must be developed and validated. The purpose of this study was to develep a reliable and valid scale for measuring the related constructs of relational ethics as described in contextual family therapy (Boszormenyi-Nagy & Krasner, 1986). Presented here is the five-stage procedure used in development in Relational Ethics Scale, data supporting the validity and reliability of the scale, and the final version of the instrument.     

Assessment of the Psychometric Properties of a New “Acceptance of an Alcoholic Identity” Instrument

ABSTRACT

This paper describes the design and psychometric testing of a new instrument, the Acceptance of an Alcoholic Identity Instrument (AAII), for abstinent alcoholics. Subscales include Denial, Shame, Self-Efficacy, Surrender, Gratitude and Love Affair with the Drug. When quantified, the response yields a profile of the subject's acceptance of an alcoholic identity. Individually, various instrument items highlight aspects of the acceptance of such an identity, and indicate whether the individual is still struggling with specific aspects comprising this instrument. The use of the LAAII instrument can help clinicians establish a treatment plan that includes measurable and defined objectives aiding in the transformation and solidification of an acceptance process of being an alcoholic. The AAII is designed for use at any stage of recovery and is expected to provide an opportunity for personal insight and change for the recovering alcoholic.     

The effect of self-care information on health-related attitudes and beliefs of college students

We conducted a study to determine whether an intervention using self-care information would change college students' attitudes and beliefs concerning personal responsibility and involvement in their own health care. Individuals entering a student health service were randomly assigned to a treatment or control group. Members of the treatment group (n = 187) received the intervention and completed the survey instrument. Members of the control group (n = 204) completed the survey instrument only. The intervention consisted of one page of general information about the benefits to individuals of taking responsibility for their own health and a booklet containing excerpts from a consumer-oriented health care book. The survey instrument was composed of a measure of attitudes toward information and behavioral involvement in health care and a measure of beliefs regarding control over one's health. Results indicated that the intervention was able to change the treatment group's attitudes regarding active participation in health care. The treatment group's responses also reflected less belief that health was outside of the individual's control. The study showed that a positive change in health-related attitudes and beliefs can result from a relatively uncomplicated informational intervention.     

Development priority zoning (DPZ)-led scenario simulation for regional land use change: The case of Suichang County, China

China has experienced an extraordinary level of economic development since the 1990s, following excessive competition between different regions. This has resulted in many resource and environmental problems. Land resources, for example, are either abused or wasted in many regions. The strategy of development priority zoning (DPZ), proposed by the Chinese National 11th Five-Year Plan, provides an opportunity to solve these problems by coordinating regional development and protection. In line with the rational utilization of land, it is proposed that the DPZ strategy should be integrated with regional land use policy.As there has been little research to date on this issue, this paper introduces a system dynamic (SD) model for assessing land use change in China led by the DPZ strategy. Land use is characterized by the prioritisation of land development, land utilization, land harness and land protection (D-U-H-P). By using the Delphi method, a corresponding suitable prioritisation of D-U-H-P for the four types of development priority zones, including optimized development zones (ODZ), key development zones (KDZ), restricted development zones (RDZ), and forbidden development zones (FDZ) are identified. Suichang County is used as a case study in which to conduct the simulation of land use change under the RDZ strategy.The findings enable a conceptualization of DPZ-led land use change and the identification of further implications for land use planning generally. The SD model also provides a potential tool for local government to combine DPZ strategy at the national level with land use planning at the local level.     

The Self-Care Center for Cuts: A Model for Student Development

Abstract

We conducted a study to determine whether an intervention using self-care information would change college students' attitudes and beliefs concerning personal responsibility and involvement in their own health care. Individuals entering a student health service were randomly assigned to a treatment or control group. Members of the treatment group (n = 187) received the intervention and completed the survey instrument. Members of the control group (n = 204) completed the survey instrument only. The intervention consisted of one page of general information about the benefits to individuals of taking responsibility for their own health and a booklet containing excerpts from a consumer-oriented health care book. The survey instrument was composed of a measure of attitudes toward information and behavioral involvement in health care and a measure of beliefs regarding control over one's health. Results indicated that the intervention was able to change the treatment group's attitudes regarding active participation in health care. The treatment group's responses also reflected less belief that health was outside of the individual's control. The study showed that a positive change in health-related attitudes and beliefs can result from a relatively uncomplicated informational intervention.     

Development and psychometric testing of the childhood obesity perceptions (COP) survey among African American caregivers: A tool for obesity prevention program planning

Currently, public health practitioners are analyzing the role that caregivers play in childhood obesity efforts. Assessing African American caregiver’s perceptions of childhood obesity in rural communities is an important prevention effort. This article’s objective is to describe the development and psychometric testing of a survey tool to assess childhood obesity perceptions among African American caregivers in a rural setting, which can be used for obesity prevention program development or evaluation. The Childhood Obesity Perceptions (COP) survey was developed to reflect the multidimensional nature of childhood obesity including risk factors, health complications, weight status, built environment, and obesity prevention strategies. A 97-item survey was pretested and piloted with the priority population. After pretesting and piloting, the survey was reduced to 59-items and administered to 135 African American caregivers. An exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) was conducted to test how well the survey items represented the number of Social Cognitive Theory constructs. Twenty items were removed from the original 59-item survey and acceptable internal consistency of the six factors (α = 0.70–0.85) was documented for all scales in the final COP instrument. CFA resulted in a less than adequate fit; however, a multivariate Lagrange multiplier test identified modifications to improve the model fit. The COP survey represents a promising approach as a potentially comprehensive assessment for implementation or evaluation of childhood obesity programs.     

Constructing a consensus-based prevention outcome measurement instrument

This article describes Ohio's Prevention Evaluation Project (PEP). The purpose of the project was to develop a process and instrument to assess behavioral and attitudinal outcomes in primary drug abuse prevention programs targeting young people aged twelve to seventeen. One of PEP's principal achievements was the inclusion of community prevention program providers from throughout the state in the evaluation instrument development. The effort produced a self-administered questionnaire to capture data on young peoples' drug use practices, attitudes toward drugs, and problematic behaviors. Most significantly, the product produced was the acceptance and endorsement of community-based programs. The forty-one-item questionnaire has good to excellent reliability for virtually all measures, as assessed by the test-retest method. The instrument is a product of a process that brought together a university-based research team, state alcohol and drug abuse prevention administrators, and representatives of public programs. PEP demonstrates how to productively link service providers, administrators, and evaluators to develop a process for assessing the effectiveness of prevention programs. The process and tools described serve as a model for other communities wanting to evaluate their prevention programming.     

A culturally relevant measure of client satisfaction in child welfare services

Child welfare professionals increasingly recognize the importance of the client's perspective in evaluating service outcomes, but there is a dearth of well-developed instruments that meet the needs of service providers and planners. This article describes the implementation of a measure of primary caregivers' satisfaction with mandated child welfare services. This measure is significant for its flexibility regarding the nature of the child welfare population to be surveyed and for its attention to cultural aspects of the clients' experience. The instrument is an adaptation of Harris, Poertner, and Joe's (2000) client satisfaction measure and includes selected items from related instruments in the field. The measure was developed with the help of an Aboriginal child welfare agency and piloted with that agency's clients. The adapted instrument also includes items requested by the pilot testing agency to reflect high quality child welfare practice including specific attention to the clients' racial, ethnic, and cultural identity. This project furthers Harris et al.'s (2000) prior work by using the instrument in another country (Canada) and with diverse populations, thereby adding to the body of evidence supporting the development of this measure. Future research with larger samples could further enhance the validation of the measure and its usefulness to policy makers and practitioners.     

Juvenile offender rehabilitation in Estonia: interprofessional collaboration in written assessments and specialists’ perceptions

Qualitative and quantitative research methods were used to study an interprofessional assessment model in rehabilitation services and its implementation in Estonia based on (1) a sample of rehabilitation plans for 160 juvenile offenders aged 7–18 and (2) expert interviews with 10 members of an interprofessional assessment team. Each specialist’s role was compared with the assessments. While each team member is assigned a discrete role based on discipline, in practice, the disciplines’ work overlapped considerably during the assessment process. The overlap seems to occur because team members conduct their assessments individually, rather than following the collaborative best practice model for interprofessional teams described in the literature. The expert interviews indicate that rehabilitation specialists perceive the individual-level elements of interprofessional teamwork to be consistent with the ideals articulated in the Perception of Interprofessional Collaboration Model, while the substantial overlap in assessments that occurred in practice could be related to lack of interprofessional collaboration at group and organizational levels. Recommendations to improve the functioning of teams serving juvenile offenders include establishing an interprofessional education system, increasing the flexibility of the legal framework for service provision, and improving the interprofessional assessment instrument.     

Der Entwicklungsraum als Ort professioneller Gestaltung im Coaching – Stabilisierung und Destabilisierung als Elemente eines nachhaltigen Veränderungsprozesses

The following contribution is preoccupied with the question of, what conditions, for example what framework is necessary, in order to coach clients in a skilled and sustainable manner – sustainable in the sense of aware, balanced ,and very important long-lasting – supportive to development. Coaching in the following will not be considered as an attempt to optimize achievement or viewed as an instrument towards the short termed attainment of goals, but on the contrary as a process of development , which swings between the stabilization and the destabilization of the client. In this article we will consider the level of the settings and the interventions.