Measurement of the subjective work environment

Abstract

This paper considers the various issues that frame the development and use of measures of the subjective work environment. It begins by questioning the role of the work environment in determining occupational health, and explores the possible mechanisms by which that environment might exert its influence. It concludes that one of the important final common pathways is psycho-physiological in nature, and is rooted in individual perception and cognition and the experience of stress. Important for this model are the concepts of mediation and moderation. The measurement of the subjective work environment has often been idiosyncratic to the study in hand, and there are few well-established measures in common use. It is argued that researchers should be careful when deciding not to use established measures and effectively ‘invent’ their own. In developing new measures, decisions have to be made concerning the nature of the measure along with its ‘granularity’ and complexity. It is also argued that it is important that researchers should follow good psychometric practice in the development of those measures. Suggestions for ‘good practice’ are discussed. Attention is drawn to the issues of reliability and validity, and this paper discusses the role of triangulation in the planning and execution of data collection and analysis. The paper ends by reviewing the recommendations made towards the development and use of measures of the subjective work environment.     

A note on the score reliability for the Satisfaction With Life Scale: an RG study

The purpose of the present study was to meta-analytically investigate the score reliability for the Satisfaction With Life Scale. Four-hundred and sixteen articles using the measure were located through electronic database searches and then separated to identify studies which had calculated reliability estimates from their own data. Sixty-two articles met this criterion, providing 76 reliability coefficients. The articles comprising the sample were next coded to identify potential sample or test characteristics that might affect the variation in reliability estimates. Results indicate that score standard deviation, mean, percent female, US samples, English test version, and youth samples demonstrated significant relationships with score reliability. Results from this study provide useful information, in terms of scale performance, for researchers interested in using the measure for future academic endeavors.

Reimagining the General Health Questionnaire as a measure of emotional wellbeing: A study of postpartum women in Malta

BackgroundPostpartum health has been subject to a focus on psychological morbidity, despite positive associations between postpartum recovery and maternal emotional wellbeing. There are currently many validated tools to measure wellbeing and related concepts, including non-psychiatric morbidity. The General Health Questionnaire, 12 items (GHQ-12) is one such instrument, widely used and validated in several languages. Its use in postpartum settings has been documented with disagreement about the instrument's utility in this population, particularly in relation to scoring method and threshold. The GHQ-12 has never been translated into Maltese. This study explored the psychometric properties of the GHQ-12 in a Maltese postpartum population to consider if the use of a different scoring method (visual analogue scale) in the GHQ-12 can determine postpartum wellbeing.MethodsOne hundred and twenty-four postpartum women recruited from one hospital in Malta completed the translated and adapted GHQ-12 as a wellbeing measure (GHQ-12(WB)) at four postpartum time points. The psychometric properties of the GHQ-12(WB) were explored using confirmatory factor analysis, discriminant and divergent validity and reliability analysis.ResultsThe GHQ-12(WB) demonstrated good divergent and known-groups validity and internal consistency. No models offered a good fit to the data. The overall consistent best-fit to the data was an eight item, two factor model (GHQ-8). Model fit improved across all models in terms of CFI at 13 weeks.ConclusionFindings generally support the reliability and validity of the Maltese version of the GHQ-12(WB). Model fit changes over time reflect the dynamic nature of postpartum recovery. Further evaluation of the GHQ-8(WB) is recommended.     

The use of concept mapping in measurement development and evaluation: Application and future directions

The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation.     

Psychometric Properties of the PsychoSomatic Problems Scale: A Rasch Analysis on Adolescent Data

The PsychoSomatic Problems (PSP)-scale is built upon eight items intended to tap information about psychosomatic problems among schoolchildren and adolescents in general populations. The purpose of the study is to analyse the psychometric properties of the PSP-scale by means of the Rasch model, with a focus on the operating characteristics of the items. Cross-sectional adolescent data collected in Sweden at six points in time between 1988 and 2005 are used for the analysis. In all more than 15,000 students aged 15–16 are included in the analysis. Data were examined with respect to invariance across the latent trait, Differential Item Functioning (DIF), item categorisation and unidimensionality. The results show that the PSP-scale adequately meets measurement criteria of invariance and proper categorisation of the items. Also the targeting is good and the reliability is high. Since the scale works invariantly across years of investigation it is appropriate for re-current monitoring of psychosomatic health complaints in general populations of adolescents. Taking DIF into account through principles of equating provides a scale that shows no statistically significant signs of gender-DIF enabling invariant comparisons also between boys and girls.     

The four-dimensional symptom questionnaire (4DSQ): measuring distress and other mental health problems in a working population

In non-clinical (working) populations it is important to differentiate between general distress, on the one hand, and psychiatric symptoms—depression, anxiety and somatization—on the other hand. The Four-Dimensional Symptom Questionnaire (4DSQ) is a new instrument that measures these four symptom dimensions (Terluin, ). This study aimed to investigate the psychometric properties of the 4DSQ in a working population. A postal stress and health survey was sent to all employees of a Dutch telecom company, 51% of whom responded (N=3852). The mailing included the 4DSQ, a set of questionnaires concerning job stress (e.g. psychological demands), coping style (e.g. problem-focused coping, avoidant coping), and indicators of strain (e.g. emotional exhaustion, fatigue). Cronbach's α for the four sub-scales of the 4DSQ ranged from .79 to .90. Factor analysis showed four factors corresponding to the four scales of the 4DSQ: distress, depression, anxiety, and somatization. The validity of the 4DSQ was assessed using (partial) correlations with job stress, coping, and strain. As expected, the distress scale showed the strongest correlations with the indicators of strain, as well as with job stress and coping. In conclusion, the 4DSQ is a reliable and valid instrument that can be used in a working population to distinguish between stress-related symptoms and psychiatric illness.     

Life satisfaction in persons with schizophrenia living in the community

Subjective well-being is an increasingly common indicator of adequacy of psychiatric services. An easy-to-administer assessment tool of subjective well-being that is conceptually sound, valid, and reliable is needed for use in persons with schizophrenia. The purpose of this paper was to validate the 5-item Satisfaction with Life Scale (SWLS)-Taiwan version for persons with schizophrenia living in the community. Specifically, the internal consistency reliability, construct validity and criterion-related validity were examined. Data were obtained from a total of 443 patients with schizophrenia at multiple areas of Taiwan. Item analysis and confirmatory factor analysis were performed. The results revealed that the SWLS had good international consistency reliability and suggested a single-factor structure in life satisfaction among this patient group. The SWLS has good criterion-related validity with the brief World Health Organization Quality of Life Assessment (WHOQOL-BREF). It is concluded that the SWLS is a sound measurement to be used with persons with schizophrenia living in the community.     

An Assessment of the Psychometric Properties of Lithuanian Versions of DSM-IV-MR-J and SOGS-RA

Objective: Since no Lithuanian instrument focuses specifically on the measurement of pathological gambling in adolescence, we aimed to adapt commonly used international instruments (SOGS-RA, DSM-IV-MR-J) and assess their psychometric properties. Methods: Cross-cultural adaptation of DSM-IV-MR-J and SOGS-RA was performed in several steps including translations, synthesis of translations, back-translations, expert committee review, and pre-testing. Adapted instruments were administered to randomly selected adolescents in grades V through XII from all schools in the second largest Lithuanian city (Kaunas). Results: The DSM-IV-MR-J identified 4.2% of the representative sample as pathological gamblers, whereas the SOGS-RA generated prevalence of 5.2%. Cronbach’s alpha for DSM-IV-MR-J in this sample was 0.80 and 0.75 for the SOGS-RA. The correlation coefficient between the SOGS-RA and the DSM-IV-MR-J was statistically significant (Pearson correlation = 0.892, P < 0.001). Using the DSM-IV-MR-J as the baseline for pathological gambling in adolescence, the overall classification accuracy of the SOGS-RA was judged to be adequate, correctly identifying 34 out of 35 pathological gamblers (Kappa = 0.833, P < 0.001). Conclusions: The Lithuanian versions of DSM-IV-MR-J and SOGS-RA exhibited acceptable validity and reliability. The DSM-IV-MR-J was found to be a more conservative measure of pathological gambling.     

Measuring the willingness to foster children with emotional and behavioral problems

Many children in foster care have emotional or behavioral problems or are at risk for these problems. It is important to identify parents willing to foster children with these problems in order to ensure placement, care, stability and well-being of such children. This study presents a new 40-item self-report measure of the willingness of parents to foster children with emotional and behavioral problems, and two 20-item parallel forms of this measure. In addition, this study presents evidence of reliability and validity of scores derived from these measures with a national sample of 297 foster mothers. Coefficient alpha for these measures was .92 or greater, indicating excellent internal consistency reliability. Scores from these measures were unrelated to demographic characteristics, providing evidence of discriminant validity. In addition, scores from these measures were higher for foster mothers licensed to provide treatment foster care than for mothers only licensed to provide regular foster care, providing support for known groups validity. Finally, support for construct validity is provided by the fact that foster mothers with higher scores on these measures had fostered longer, were fostering more children at the time of this study, and had fewer children removed from their home at their request.