Invariance Testing of the SF-36 Health Survey in Women Breast Cancer Survivors: Do Personal and Cancer-related Variables Influence the Meaning of Quality of Life Items?

Quality of life (QoL) is affected by issues specific to illness trajectory and thus, may differ, and potentially take on different meanings, at different stages in the cancer process. A widely used measure of QoL is the SF-36 Health Survey (SF-36; Ware 1993); therefore, support for its appropriateness in a given population is imperative. The current study aimed to examine the conceptual (measurement) model of the SF-36, as well as closely related models, and test the measurement invariance of the SF-36 to determine if meaningful comparisons could be made among three groups of breast cancer survivors (N = 358 [data collected in 2007–2008]; divided on time since treatment, type of treatment, and age). Good model fit was found for one of three models based on the original design of this instrument—the items to subscales model. Two models were considered for measurement invariance testing: (a) items to physical health/mental health and (b) items to subscales. Strong invariance was found for time since treatment and type of treatment for both models. Weak invariance was found for age in the first model, while strict invariance was confirmed for the subscales model. Group comparisons in QoL were made where justified. Significant differences were found only on age for physical functioning, role limitations due to emotional problems, vitality, mental health, and social functioning. Overall, results suggest that while the SF-36 can be used to examine differences in QoL for various breast cancer survivors, some conceptual issues with this instrument need to be further examined.     

Assessing the Structural Robustness of Self-Rated Satisfaction With Life: A SEM Analysis

Structural invariance of self-rated satisfaction with life data was assessed using four data sets collected in earlier studies by using the Satisfaction With Life Scale. Three measurement models were compared to account for structural variability of the data. Strict structural invariance was rejected. Departure from the one-factor model was only found in data gathered using the items in successive order. When the items were scattered among other items, only quantitative variability was found. The findings did not support the view of a generalized one-factor model but suggested measurement artifacts. Qualitative structural variability impacted the scale reliability estimates. Although experimental replication of an ordering effect is warranted, this study suggests that scattering the items can be recommended in order to optimize the structural validity of this concept.     

Psychometric Properties of the PsychoSomatic Problems Scale: A Rasch Analysis on Adolescent Data

The PsychoSomatic Problems (PSP)-scale is built upon eight items intended to tap information about psychosomatic problems among schoolchildren and adolescents in general populations. The purpose of the study is to analyse the psychometric properties of the PSP-scale by means of the Rasch model, with a focus on the operating characteristics of the items. Cross-sectional adolescent data collected in Sweden at six points in time between 1988 and 2005 are used for the analysis. In all more than 15,000 students aged 15–16 are included in the analysis. Data were examined with respect to invariance across the latent trait, Differential Item Functioning (DIF), item categorisation and unidimensionality. The results show that the PSP-scale adequately meets measurement criteria of invariance and proper categorisation of the items. Also the targeting is good and the reliability is high. Since the scale works invariantly across years of investigation it is appropriate for re-current monitoring of psychosomatic health complaints in general populations of adolescents. Taking DIF into account through principles of equating provides a scale that shows no statistically significant signs of gender-DIF enabling invariant comparisons also between boys and girls.     

Factorial Validity and Invariance of the Rosenberg Self-Esteem Scale Among Portuguese Youngsters

The purpose of the present study was to examine the reliability, factorial validity and measurement invariance (across gender, age and physical activity participation) of a Portuguese version of the Rosenberg Self-Esteem Scale (RSES). The sample consisted of 1,763 Portuguese youngsters (731 male and 1,032 female) with ages between 15 and 20 years. Reliability estimate for the one-factor solution was .845, although some proposed RSES’s underlying dimensions were lower than .70. Confirmatory factor analysis revealed that the best-fitting model was a single self-esteem factor, plus simultaneous correlated uniqueness for positively and negatively worded items. Multigroup analysis supported measurement invariance across age and physical activity participation, and partial metric invariance across gender, as three items failed to show metric equivalence. These results provide evidence that RSES has excellent psychometric properties and it is a valid self-esteem measure to be used among Portuguese youngsters.     

The Measurement of Ethnic and Religious Divisions: Spatial,Temporal, and Categorical Dimensions with Evidence from Mindanao,the Philippines

Survey research on subjective wellbeing in The Netherlands started in the early 1970s. The time series happiness and life satisfaction that have emerged since then are unfortunately based on slightly different survey items of which one part uses verbal response scales and another part uses numerical response scales. The diversity of the survey items and a number of other measurement issues, such as the effects of changes in survey mode, hamper comparison over time and make it difficult to establish whether life became any better over the last forty years. These problems can be tackled using the recently developed Reference Distribution Method with which responses to equivalent but not identical survey questions can be pooled to obtain long, consistent time series. We applied the Reference Distribution method to pool time series of happiness and life satisfaction. We conclude that in the past 40 years the Dutch have become slightly happier and satisfied with their lives.     

Development of a survey instrument to evaluate women’s experiences of their maternity care

BackgroundThe process of developing a survey instrument to evaluate women’s experiences of their maternity care is complex given that maternity care encapsulates various contexts, services, professions and professionals across the antenatal, intranatal and postnatal periods.AimTo identify and prioritise items for inclusion in the National Maternity Experience Survey, a survey instrument to evaluate women’s experiences of their maternity care in the Republic of Ireland.MethodsThis study used an adapted two-phase exploratory sequential mixed methods design. Phase one identified items for possible inclusion and developed an exhaustive item pool through a systematic review, focus groups and one to one interviews, and a gap analysis. Phase two prioritised the items for inclusion in the final item bank through a Delphi study and consensus review.FindingsFollowing iterative consultation with key stakeholder groups, a bank of 95 items have been prioritised and grouped within eight distinct care sections; care during your pregnancy, care during your labour and birth, care in hospital after the birth of your baby, specialised care for your baby, feeding your baby, care at home after the birth of your baby, overall care and you and your household.ConclusionRobust and rigorous methods have been used to develop a bank of 95 suitable items for inclusion in the National Maternity Experience Survey.     

Designing response scales with multi-trait-multi-method experiments

ABSTRACT

Split-ballot multi-trait-multi-method experiments are used to evaluate the quality of measurement of different response scales of survey items gauging “evaluation of government services” and “political trust.” The response scales differ by agree/disagree scales, item-specific scales, total number of categories, and the presence of fixed reference points on their constructing extreme items. The Center for Opinion Studies of the Catalan government in Spain conducted the survey in 2011. The best response scale depends on the complexity of the topic and of the formulation of the question. For simple topics and formulations, the format of the response scale has no effect on the quality of measurement.     

The Subjective Well-being of Adolescents from Two Different Cultures: Applying Three Versions of the PWI in Algeria and Spain

This paper analyses the crosscultural comparability of well-being among 13–20 year-old adolescents using two samples, one from Oran County (Wilaya) in Algeria and another from Catalonia (Spain). The following are used as well-being indicators: a modified version of the original Personal Well-being Index (PWI) (Cummins et al. in Soc Indicat Res 64:159–190, 2003b), a single-item scale on overall life satisfaction (OLS) and a list of complementary items on satisfaction with various life domains. This research tests the original version of the PWI with some changes and two other versions with additional items. Confirmatory factor analyses show good fit statistics for the three versions with the pooled sample of adolescents from the two countries. The multigroup models show that correlations and regressions may be compared between the two samples, but not means, probably due to different cultural response styles among adolescents in the two countries. Structural equation models including OLS also show good fit statistics. When gender and age are included in these models, the former does not show any correlation with PWI11 in either of the two countries, whereas age shows a clearly negative correlation in both. A new version of the PWI with 11 items has shown higher standardized regression coefficients when the items are regressed on OLS and higher R² and each of the items has shown to contribute with unique explained variance using the pooled sample, although 3 of the original scale items do not show a significant contribution in Algeria. The fact that a multigroup model using this 11-item version shows good fit with constrained loadings when comparing samples from such different cultural and linguistic contexts as Catalonia and Algeria offers new opportunities for international comparative research of adolescents’ subjective well-being.     

A Note on the Measurement of Generalized Trust of Immigrants and Natives

In recent years, research on the important value of generalized trust has been expanded to include immigrants as a group, but it may be questioned whether the frequently employed generalized trust construct is a valid cross-group measure of this phenomenon for natives and non-Western immigrants in Western societies. Building on a Danish survey of two generations of natives and immigrants, this paper assesses the cross-group validity of the generalized trust measure by testing the measurement invariance and examining the construct validity of this construct. Both tests quite clearly document that the generalized trust construct in fact refers to the same phenomenon for both natives and immigrants and thus can be safely used when comparing levels, causes and consequences of trust for the two groups.     

A New Approach to the Study of Tolerance: Conceptualizing and Measuring Acceptance,Respect, and Appreciation of Difference

Previous empirical research on tolerance suffers from a number of shortcomings, the most serious being the conceptual and operational conflation of (in)tolerance and prejudice. We design research to remedy this. First, we contribute to the literature by advancing research that distinguishes analytically between the two phenomena. We conceptualize tolerance as a value orientation towards difference. This definition—which is abstract and does not capture attitudes towards specific out-groups, ideas, or behaviors—allows for the analysis of tolerance within and between societies. Second, we improve the measurement of tolerance by developing survey items that are consistent with this conceptualization. We administer two surveys, one national (Sweden) and one cross-national (Australia, Denmark, Great Britain, Sweden, and the United States). Results from structural equation models show that tolerance is best understood as a three-dimensional concept, which includes acceptance of, respect for, and appreciation of difference. Analyses show that measures of tolerance have metric invariance across countries, and additional tests demonstrate convergent and discriminant validity. We also assess tolerance’s relationship to prejudice and find that only an appreciation of difference has the potential to reduce prejudice. We conclude that it is not only possible to measure tolerance in a way that is distinct from prejudice but also necessary if we are to understand the causes and consequences of tolerance.

     

Validation of the 12 Item Short form Health Survey in a Sample from Region Central Jutland

In 2010 the Danish regions started a new program of public health surveillance in collaboration with the national and local health authorities using the short form health survey (SF-12) for measuring and reporting on health related quality of life among the Danish adult population. The instrument has not, however, been validated in a Danish setting. The aim of this study was to assess the reliability and validity of the physical component summary (PCS) and the mental component summary (MCS) score of the 12-item short form health survey (SF-12) in a sample from Central Denmark Region. A total of 26,397 persons above the age of 25 were included in the analyses. Reliability was assessed by Cronbach’s α. The validity was assessed using known-groups comparisons and convergent validity. The factor structure was investigated through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). The Cronbach’s α showed high reliability with a score of 0.90 and 0.85 for PCS and MCS respectively. The SF-12 discriminated well with respect to gender, age, educational status and long term illness. Individual items correlated higher with own hypothesized scales than with other scales and summary measures corroborating the convergent validity. The EFA gave a two-factor structure. Irrespective of the chosen rotation method (varimax and oblimin) the items related to PCS loaded on one factor and the items related to MCS loaded on another factor. The factor structure was validated with acceptable model-fit values in CFA. The SF-12 instrument is a reliable and valid measure of health related quality of life among the population of Central Denmark Region.     

Testing the Comparability of Different Types of Social Indicators Across Groups

The social indicator movement has realized a considerable increase in importance during the last 50 years. This happened not the least by the publications in the journal Social Indicators Research. Social indicators have been developed for many aspects of life. The scores on these indicators often are compared through time and across groups. An essential requirement for such research is that the measures used are comparable through time and across groups. The comparability through time is not such a big problem but the comparability of measures across groups is not so obvious. This requires harmonization of indicators based on objective variables and invariance testing for indicators based on subjective and objective variables. In this paper we discuss how the comparability of different types of social indicators based on subjective and objective variables can be tested using invariance testing. This is a relevant issue because the existing testing procedure is designed for only one type of social indicators and this test is not directly applicable on the other types of social indicators.     

Measuring subjective health among adolescents in Sweden

The cross-national WHO-study Health Behaviourin School-Aged Children (HBSC) is acomprehensive adolescent survey ongoing inEurope based on a public health perspective.The present study, examining theHBSC-instrument on subjective health, uses theunidimensional Rasch model. Items are analysedwith respect to their operating characteristicsacross the whole range of the subjective healthscale and the empirical operation of theresponse categories intended to be ordered forall items. The study is based oncross-sectional data collected in Sweden duringthe 1980s and 1990s among students in yearsfive, seven and nine.The analyses reveal that the symptom checklistin the HBSC-instrument does not workconsistently with the Rasch model when alleight items are analysed simultaneously. Inparticular, the response categories do not workas intended. Hence, the original set of eightitems should not be used to construct a latentmeasure of subjective health. In order tobring the instrument to meet the requirementsof the Rasch model, three items were removed. The reduced set of five items did workconsistently with the model with respect to theresponse categories, and did show relativeinvariance across the latent trait. Since a fewof the remaining items showed lack ofinvariance across genders and grades thatproblem should be solved, if the reduced itemset is to be used for post-hoc analyses.Furthermore, the analysis of the reduced set ofitems suggests that both ``somatic' and``psychological' complaints might be consideredas parts of one higher order dimension ofsubjective health.In order to improve the questionnaire, furtherattention should be paid to the response formatof the items.     

Evaluating Item Discrimination Power of WHOQOL-BREF from an Item Response Model Perspectives

Quality of life (QOL) has become an important component of health. By using the methodology of psychometric theory, we examine the item properties of the WHOQOL-BRIEF. Samejima’s graded response model with natural metrics of the logistic response function was fitted. The results showed items with negative natures were less discriminating. Items written in a specific way were more suitable to assess certain subgroups. The national items showed variation in discriminatory power. Questions measuring objective and specific issues performed worse than items assessing general aspects of the QOL.     

Testing for Measurement Invariance in the Satisfaction with Life Scale: A Comparison of Russians and North Americans

This study examined the comparability of Satisfaction With Life Scale (SWLS) [Diener, Emmons, Larsen, & Griffin, 1985, Social Indicators Research, 34: 7–32] scores across U.S. and Russian student and community groups. Criteria for weak measurement invariance were met when comparing U.S. and Russian groups (combining student and community samples). Criteria for weak and strong measurement invariance were met when comparing the U.S. and Russian student samples. However, when comparing the U.S. and Russian community samples, the results showed a significant statistic for a baseline model, indicating a lack of comparability across samples. The costs of failing to meet criteria for weak, strong, and strict measurement invariance are discussed. An erratum to this article is available at .     

Development of a social monitoring system at the local level: An experiment in the Southern Region of the Democratic Republic of Sudan

Subjective indicators of life quality are used frequently in the planning and decision making process. The limitations inherent in the use of subjective indicators often go unnoticed among those most likely to use such data in the context of planned change. We direct attention to a potential source of error in subjective evaluations of community services and facilities. Specifically, we utilize repeated measures to test for response bias that results from placing items in alternative sections of the same survey instrument. Evidence concerning the hypothesized presence of systematic bias was mixed. When overall service evaluation items were embedded within a section devoted exclusively to that service, considerable systematic bias was observed. The findings indicate that the choice of question format depends upon the ultimate use to which the data will be put.     

Happiness in Italy: Translation,Factorial Structure and Norming of the Subjective Happiness Scale in a Large Community Sample

The Subjective Happiness Scale (SHS) is one of the most commonly used measures of happiness. Many translations and validation studies have been carried out in different countries and languages. The aim of the current paper was to investigate the psychometric properties of the Italian translation of the SHS and to provide normative data. The SHS was administered with life satisfaction items, anxiety and depression scales to a community sample of 993 participants, aged 18–85 years, living in different parts of Italy. Age and gender distributions were stratified according to the population pyramid. Confirmatory Factor Analysis supported the unidimensionality of the SHS, with acceptable fit indexes (NNFI = .96; CFI = .99; RMSEA = .08; 95 % C.I. [.04–.12]). Multi-group analyses supported total invariance of the SHS measurement model for males and females, and partial invariance for younger (i.e., 18–44 years old) and older (i.e., 45–85 years old) participants. Significant correlations with satisfaction items, anxiety and depression provided evidence for concurrent validity. These findings showed that the Italian SHS translation is a reliable and valid tool, which adds to existing translations and validation studies in different countries and languages.     

Why Get Involved? Exploring Gay and Bisexual Men's Experience of the Gay Community

Involvement in a gay community is a necessary step in the formation of a positive gay identity. However, how gay individuals think of a gay community and how they participate in these communities remains largely unexplored from a psychological perspective. The current study used an online survey containing several open-ended response items asking participants how they define the gay community, their first experience with it, and the advantages and disadvantages resulting from their involvement. The responses of a nationwide sample of 129 gay and bisexual men were coded in accordance with grounded theory. The results revealed substantial diversity in the perceptions and experiences of the gay community. Implications regarding these findings are discussed.     

Investigating Longitudinal and Cross Cultural Measurement Invariance of Inglehart’s Short Post-materialism Scale

Inglehart applies a four item ranking scale to measure post-materialism which is used for cross-cultural and cross-temporal comparative purposes. The aim of this research is to test measurement invariance of the scale to establish to what extent the scale produces comparable results in time and between countries. We use Eurobarometer data to test longitudinal comparability for ten countries (France, Belgium, the Netherlands, Italy, West-Germany, Luxembourg, Denmark, Ireland, Great Britain and North Ireland) over a period of 20 years (1976–1997). With the exception of Denmark the within-country longitudinal comparisons indicate that measurement invariance is a tenable assumption. However, the findings of the cross-cultural analyses indicate that the meaning assigned to the four items differs slightly between countries, indicating a lack of comparability of the average level of post-materialism between countries. Findings also suggest that a lack of unidimensionality of the scale might cause this incomparability.