Importance is Not Unimportant: The Role of Importance Weighting in QOL Measures

The effect of relative domain importance as a weighting mechanism in quality of life (QoL) measures has been a topic of debate for decades. Studies investigating the role of domain importance in QoL measures have produced mixed results. The mixed results may very well be the consequences of a limited choice of global satisfaction or QoL measures, measurements of domain satisfaction, measurements of domain importance and weighting approaches applied to date. This study investigated the effect of importance weighting without assigning any arbitrary weighting function of domain importance. A cluster analysis was first used to classify individuals into groups, based on their perceived importance of various life domains, and then the relationship between global life satisfaction measure and the composite of domain satisfaction scores between these groups was compared. Results of this study showed that the relationship between global life satisfaction and composite of satisfaction scores did not remain consistent for respondents with different importance rankings of major life domains, which suggested an important effect of domain importance in QoL measures.     

Can We Weight Satisfaction Score with Importance Ranks Across Life Domains?

The main purpose of this study was to investigate the utility of importance weighting when importance ranks were considered as the weighting values by (1) examining the range-of-affect hypothesis in the within-subject context and (2) comparing performances of weighted and unweighted satisfaction scores in predicting overall judgment of subjective well-being. Participants were 167 undergraduates at National Taiwan University. The mean age was 19.80 years (SD = 1.98). They were first asked to complete the measurements for global life satisfaction and overall QOL and then completed a QOL questionnaire for rating satisfaction, perceived have–want discrepancy on 12 life domains and ranking importance on these domains. Hierarchical linear modeling with a random-coefficients regression model was applied to examine the range-of-affect hypothesis in the within-subject context. Correlation analysis was applied to evaluate performances of weighted and unweighted satisfaction scores in predicting overall judgment of subjective well-being. Results of this study supported the range-of-affect hypothesis, showing that the relationship between item have–want discrepancy and item satisfaction is stronger for high importance items than low importance items for a given individual. Correlation analysis found that the four weighted satisfaction scores computed from the algorithms proposed by Hsieh (Social Indicators Research 61:227–240, 2003) were not superior to unweighted satisfaction score in predicting overall QOL and global life satisfaction. All these findings suggested that weighting satisfaction scores with importance ranks may not have theoretical basis and empirical contribution.     

Investigating Importance Weighting of Satisfaction Scores from a Formative Model with Partial Least Squares Analysis

This study introduced a formative model to investigate the utility of importance weighting on satisfaction scores with partial least squares analysis. Based on the bottom-up theory of satisfaction evaluations, the measurement structure for weighted/unweighted domain satisfaction scores was modeled as a formative model, whereas the measurement structure for global satisfaction scores was modeled as a reflective model according to top-down theory. The purpose was to see if the predictive effect of importance-weighted domain satisfaction scores is stronger than unweighted domain satisfaction scores in predicting global satisfaction scores. Three datasets in life, self, and job satisfaction were analyzed. In the life satisfaction dataset, 237 undergraduates at Central Taiwan University of Science and Technology voluntarily provided their responses. The mean age of respondents was 20.80 years (SD = 1.05). In the self-satisfaction dataset, 269 undergraduates at National Taiwan University provided their responses. The mean age of respondents was 19.78 years (SD = 1.44). Finally, in the job satisfaction dataset, 557 staff members in seven Taiwan provincial hospitals provided their responses. The mean age of respondents was 35.87 years (range from 21 to 65, SD = 8.60). Three measures of domain satisfaction, domain importance, and global satisfaction were collected in each dataset. Partial least squares analysis was used in model estimation. All the results revealed that unweighted domain satisfaction scores have a stronger predictive effect for global satisfaction measures than importance-weighted domain satisfaction scores, indicating that importance weighting on satisfaction scores did not have an empirical benefit.     

Should We Give Up Domain Importance Weighting in QoL Measures?

The purpose of this article is to examine the recent claims calling for abolishing domain importance weighting in quality of life (QoL) measures by considering the evidence conceptually and empirically. Based on a close review of evidence presented to date, it is suggested that using the range-of-affect hypothesis as a possible explanation of the poor performance of weighted satisfaction composite in predicting or correlating with global satisfaction or QoL measures can be beneficial to our understanding of the life satisfaction literature. However, given the conceptual focus and the empirical approach of the range-of-affect hypothesis presented in the life satisfaction context, using the range-of-affect hypothesis to argue against domain importance weighting raised more questions than answers. Calling for abolishing domain importance weighting in QoL measures, based on the evidence of range-of-affect hypothesis, is premature.     

Do We Need to Weight Satisfaction Scores with Importance Ratings in Measuring Quality of Life?

Trauer and Mackinnon (2001; Quality of life research 10, pp. 579–585) recently proposed that weighting satisfaction scores by importance ratings in measuring quality of life is undesirable and unnecessary. However, they didn’t use empirical data to support their claim. In this study, different weighting algorithms developed by Cummins (1997; Comprehensive Quality of Life Scale – Adult: Manual [Deakin, University Australia]), Raphael et al. (1996; Journal of Adolescent Health 19, pp. 366–375), Ferrans and Powers (1985; Advances in Nursing Science 8, pp. 15–24) and Frisch (1992; Comprehensive Casebook of Cognitive Therapy [Plenum Press, New York]) for measuring quality of life (QOL) were applied. Weighted scores computed from these weighting algorithms were compared with unweighted scores in predicting a global life satisfaction measure by correlation and moderated regression analyses. One hundred and thirty undergraduate students at National Taiwan University participated in the study voluntarily. They completed a 15-item questionnaire on quality of campus life developed by the authors. They also completed the Satisfaction with Life Scale (SWLS), a global life satisfaction measure developed by Diener et al. (1985; Journal of Personality Assessment 49, pp. 71–75). The correlation results revealed that the weighted scores computed from different algorithms didn’t have higher correlations to the SWLS than the unweighted scores. The moderated regression results also revealed that item importance did not moderate the relationship between item satisfaction and the overall life satisfaction. All these findings revealed that weighting satisfaction with importance is unnecessary. This paper was a part of the first author’s Master Thesis     

Do We Need to Weight Item Satisfaction by Item Importance? A Perspective from Locke’s Range-Of-Affect Hypothesis

Importance weighting is a common idea in quality of life (QOL) measurement. Based on the common idea that important domains should have more contributions to individuals’ QOL total score, the weighting procedure of multiplying item satisfaction by item importance was adopted in many QOL instruments. However, in Locke’s [1969, Organizational Behavior and Human Performance 4, pp. 309–336; 1976, in: M.D. Dunnette (eds.), Handbook of Industrial and Organizational Psychology (Rand McNally, Chicago), pp. 1297–1343] range-of-affect hypothesis, he indicated that the satisfaction evaluation of an item was determined by the have–want discrepancy, importance and their interaction (discrepancy × importance), implying that item satisfaction has incorporated the judgment of item importance, therefore, weighting an item satisfaction score with an item importance score is unnecessary. The purpose of this study was to examine the range-of-affect hypothesis in the context of QOL research. Three hundred and thirty two undergraduate students at National Taiwan University (NTU) participated in the study. Item satisfaction, importance and perceived have–want discrepancy were measured for 12 different life-area items. Global life satisfaction was measured as well. Regression analysis results showed that item importance and perceived have–want discrepancy have a significant interaction effect on item satisfaction, supporting Locke’s range-of-affect hypothesis. In addition, regression analysis results also showed that item importance and item satisfaction did not have a significant interaction effect on global satisfaction, suggesting that weighting item satisfaction score by item importance value does not have advantages in predicting global satisfaction. In a summary, the findings revealed that item satisfaction has incorporated the judgment of item importance, and, thus, the procedure of importance weighting on item satisfaction is unnecessary.     

Which Life Domains Impact Most on Self-Rated Health? A Cross-Cultural Study of Switzerland and its Neighbors

General life satisfaction (GLS) is a strong health correlate and can be conceptualized as an aggregate of satisfactions in different life domains and as a proxy for quality of life. Little is known about which life domains—measured as domain satisfactions—contribute most to GLS and are the best predictors of self-rated health (SRH) and whether these associations differ between countries and/or language areas. We used stepwise logistic regression models to investigate how domain satisfactions, GLS and SRH are interrelated and compared German-speaking and French/Italian-speaking Switzerland with the corresponding neighboring countries of Germany, Austria, France and Italy. The associations of domain satisfactions with GLS and SRH varied significantly in magnitude and between countries and language areas. GLS was strongly related to self-rated health in all populations, but more so in the German-speaking than the French/Italian-speaking regions. Adjusted for all domain satisfactions, satisfaction with one’s financial situation and job satisfaction showed independent effects on SRH and were the most important predictors of GLS, although no clear geographical pattern emerged. Domain-specific satisfactions were similarly associated with GLS and SRH, but the strength of the association varied between German-, French- and Italian-speaking populations. Any similarity between Swiss language areas and neighboring countries was limited to German-speaking populations. Country- and language-specific life domain satisfactions may provide useful pointers for targeting policies in the respective domains.     

Does Weighting Capture What’s Important? Revisiting Subjective Importance Weighting with a Quality of Life Measure

The present study evaluated subjective importance weighting using data collected with the Injection Drug User Quality of Life Scale (IDUQOL). Weighted and unweighted IDUQOL scores from 241 adults were correlated with convergent, discriminant, and criterion measures. Regression analysis was used to examine the contribution of importance ratings to scores on a global measure of life satisfaction and the corrected weighted IDUQOL total scores. Overall, the results showed that weighted scores did not perform better than unweighted scores in measuring quality of life. However, the mean satisfaction ratings for important domains correlated significantly higher with convergent measures than did the mean satisfaction ratings for unimportant domains. This finding suggests further attention needs to be paid to the meaning and measurement of subjective importance and how it may be incorporated more effectively into measures of quality of life.     

Socio-demographic vs domain predictors of perceived stress: Racial differences among American women

Using data from a national probability sample of black and white females, this study focuses on racial differences and similarities in factors affecting levels of global perceived stress. Selected socio-demographic characteristics as well as satisfactions with the major domains of life — such as self, standard of living, health, family life, and leisure — are examined as predictors of global perceived stress. Generally, domain satisfactions are found to be stronger predictors of perceived stress than are socio-demographic characteristics. Moreover, no racial differences between black and white females are found when socio-demographic factors are controlled. However, a significant racial difference is encountered for one domain: satisfaction with leisure appears to be a stronger predictor of perceived stress for black females than it is for white females.     

Issues in Evaluating Importance Weighting in Quality of Life Measures

For most empirical research investigating the topic of importance weighting in quality of life (QoL) measures, the prevailing approach has been to use (1) a limited choice of global QoL measures as criterion variables (often a single one) to determine the performance of importance weighting, (2) a limited option of weighting methods to develop importance weighting, and (3) a limited number of domains to construct the (formative-indicator) measures. Although limitations resulted from a limited choice of global QoL measures as criterion variables to determine the performance of importance weighting and a limited option of weighting methods to develop importance weighting have been recognized previously, little attention has been paid to the impact of non-comprehensive domains in QoL measures constructed based on the formative-indicator approach. Using empirical data, this article revealed the potential impacts of non-comprehensive domains on the evaluation of importance weighting in QoL measures. Results presented in this article showed that both of the two most popular methods of evaluating the performance of importance weighting in QoL measures, correlation and moderated regression analysis, could produce misleading results in the situation when QoL measures constructed using the formative-indicator approach did not include comprehensive domains. Issues discussed in this article are of great importance to research in the field of QoL, especially on the topic of importance weighting in QoL measures.     

Throwing the Baby Out with the Bathwater: Evaluation of Domain Importance Weighting in Quality of Life Measurements

This paper examined major inconsistencies between claims made and the evidence presented in recent studies on evaluating the role of domain importance weighting in quality of life (QoL) measures. Three inconsistencies were discussed and they were: (1) treating the failure to support a particular importance weighting function as the evidence of uncovering no importance weighting necessary at all, (2) considering domain importance weighting and multiplicative scores synonymous, and (3) extending findings with a within-domain focus to an across-domain focus. Overlooking these inconsistencies may lead to an overgeneralization of study findings, which would likely result in premature or even erroneous conclusions. Caution must be given in interpreting study results in order to avoid overgeneralization which limits our understanding of the true role that domain importance weighting may play in QoL measures.     

City Life: Rankings (Livability) Versus Perceptions (Satisfaction)

I investigate the relationship between the popular Mercer city ranking (livability) and survey data (satisfactions). Livability aims to capture objective quality of life such as infrastructure. Survey items capture subjective quality of life such as satisfaction with city. The relationship between objective measures of quality of life and subjective measures is weak (correlation of about 0.4). Trust is highly correlated with both, objective livability (0.8) and subjective satisfaction with city (0.65). I postulate to pay more attention to subjective indicators of quality of life. After all, what matters is what we perceive, not what is out there.     

Importance has been Considered in Satisfaction Evaluation: an Experimental Examination of Locke’s Range-of-affect Hypothesis

Importance weighting is a common practice in quality of life (QOL) measurement research. Based on the widespread idea that important domains should make a greater contribution to individuals’ QOL total score, the weighting procedure of multiplying item satisfaction by an item’s importance has been adopted in many QOL instruments. Locke’s [1969, Organizational Behavior and Human Performance 4, 309–336; 1976, Handbook of Industrial and Organizational Psychology. Rand McNally, Chicago, pp. 1297–1343] range-of-affect hypothesis indicated that a satisfaction evaluation is determined by the have-want discrepancy, importance, and the interaction of the have-want discrepancy and importance, implying that a satisfaction evaluation incorporates the judgment of importance and weighting the satisfaction score with the importance score is unnecessary. The purpose of the current study was to address the issue of importance weighting by examining Locke’s range-of-affect hypothesis in the context of QOL research. A within-subject experiment was conducted to see if, given a varying amount of discrepancy, participants would reveal whether or not satisfaction/dissatisfaction is related to the dimension of importance placed on the object. Forty undergraduate students at National Taiwan University participated in the current study. Results revealed that the association between have-want discrepancy and object satisfaction is stronger on the high important dimension than the less important dimension. Generally, the results were consistent with Locke’s range-of-affect hypothesis, revealing that a satisfaction evaluation has incorporated the judgment of item importance, suggesting that the procedure of importance weighting is unnecessary. This paper was a part of the first author’s Master’s Thesis.     

The prediction of perceived well-being

Regression analysis of data from a sample of Northwestern Wisconsin residents shows that a limited number of domain satisfactions accounts for a significant proportion of the variance in life satisfaction. Most life satisfaction is derived from domains which are personal, broader in scope, and central to the individual, and which gain ascendency in the social and psychological life space of the individual as a result of differences in sex, age and income. Satisfaction with health, family and even community override work satisfaction as the main source of men's life satisfaction, while satisfaction with family life easily overwhelms other domain satisfactions as predictors of the life satisfaction of women. Also, the effect of family satisfaction is much stronger for women than men, and during the socially and biologically most productive years of life than in maturity. The contribution of satisfaction with sparetime activities, family, work, etc. to the life satisfaction of the elderly is consistent with a theory of re-engagement in fewer but more meaningful roles. Income differences do not sharply discriminate among the predictors, except at the extremes. Overall, the study demonstrates the efficacy of domain satisfaction measures as predictors of life satisfaction.     

On the Predictive Effect of Multidimensional Importance-Weighted Quality of Life Scores on Overall Subjective Well-Being

This study aimed to examine the effectiveness of importance weighting in predicting outcome variables in a hierarchical and multidimensional measurement context. A total of 146 undergraduate students (female = 76; mean age = 20.25) from two universities in Taiwan and China participated in this study. They evaluated their quality of life on 22 facets from the WHOQOL-BREF scale, which covers four domains (i.e., physical health, psychological health, social relationships, and environmental health). They were also asked to rate the importance of these 22 facets and items for three general subjective well-being indices, including overall quality of life, general health, and life satisfaction. A multiplicative formula was used to create importance-weighted scores for each facet, and four domain scores were obtained by averaging facet scores under specific domains. Results of regression analysis revealed that after applying the weighting procedure, the four domain scores did not account for more variances in the three indices for overall subjective well-being, and predictive effects of the four domain scores became less differential. Our findings suggest that importance weighting did not have its expected benefits but instead may negatively impact the predictive effects.     

The Relationship between Subjective Well-being and Domain Satisfactions in South Africa

This paper examines the relationship between subjective well-being and domain satisfactions. In the past different models have been specified. The most commonly applied model is the bottom-up model in which domain satisfactions affect subjective well-being. The more recent top-down model suggests a reversed relationship. Finally there is the supposition that the correlations between these variables can be spurious due to the effect of personality characteristics. Empirical research has shown that different models are found for different domains and in different countries. Focussing on the effects of the domain satisfactions of finances, housing and social contacts it has been found that subjective well-being is mainly affected by satisfaction with social contacts in Western developed countries and by satisfaction with finances in East European countries. The question we should like to answer in this study is whether a similar pattern obtains for the factors which influence subjective well-being among the different race groups in South Africa. Interestingly, coloured people and Asians did indeed show the expected effects but the groups with the most extreme living conditions did not. Evaluation of life circumstances by black and white South Africans was determined by expectations for the future rather than by current living conditions. This surprising result is discussed in the light of the political situation in South Africa.     

Examining the appropriateness of importance weighting on satisfaction score from range-of-affect hypothesis: hierarchical linear modeling for within-subject data

This study examines the range-of-affect hypothesis in a within-subject context using the weighting situation faced in quality of life (QOL) measurement. Data collected in Wu and Yao’s (2006b) study were used (332 undergraduates at National Taiwan University). The mean age was 19.80 years (std = 1.98). They completed a QOL questionnaire and indicated satisfaction, importance, and perceived have–want discrepancy on 12 life domains. Hierarchical linear modeling with a random-coefficients regression model was applied. At the first level (within-individual level), the satisfaction scores for each item were regressed on the have-want discrepancy, importance, and the interaction between have-want discrepancy and importance (have-want discrepancy ×  importance) of the same item. At the second level (between-individual level), the intercept, coefficients of have-want discrepancy, importance and the interaction between have-want discrepancy and importance at the first level were regarded as varying randomly over all participants. Results of this study supported the range-of-affect hypothesis, showing that the relationship between item have-want discrepancy and item satisfaction is stronger for high importance items than low importance items for a given individual. Implications for important weighting on item satisfaction scores were discussed.     

贫困少数民族山区农村老年人社会支持网与生活满意度关系研究

本文利用笔者在贵州贫困少数民族山区的调查数据,分析了贫困少数民族山区农村老年人社会运行综合网的人数规模及其与生活满意度之间的关系,并初步探讨了不同社会角色提供的支持对老年人生活满意度的影响.     

To Weight or not to Weight: The Role of Domain Importance in Quality of Life Measurement

Although there are problems associated with thepractice of deriving weighted satisfactionscores by multiplying importance ratings andsatisfaction ratings of life domains, theseproblems do not seem sufficient to justify theabandonment of incorporating domain importanceweighting into quality of life (QoL)instruments. This paper shows that domainimportance as a weighting mechanism in QoLinstruments can be conceptually,psychometrically and empirically reasonable. Given the lack of conceptual or theoreticaldevelopment regarding the role of domainimportance in QoL instruments, it is importantto focus our attention on how to weight.     

The Latent Profiles of Life Domain Importance and Satisfaction in a Quality of Life Scale

The present study aimed to use a latent profile analysis to distinguish between populations in terms of life domain importance and satisfaction profiles. Then, a multinomial logistic regression was used to determine how background variables (e.g., gender, living areas, and school levels) and self-perceived health predict each latent quality of life (QoL) profile. We also investigated how the latent groups of adolescents predicted negative and positive well-being indicators (e.g., problem behaviors and overall life satisfaction). The sample consisted of 720 Taiwanese secondary school students. Three latent groups were established as follows: “unimportant-unsatisfied,” “important-unsatisfied,” and “important-satisfied.” The results indicate the following: (a) boys were more likely to fall into the “unimportant-unsatisfied” group than were girls; (b) better health increased the likelihood of being in the “important-satisfied” group; (c) high school students were more likely to be in the “unimportant-unsatisfed” group than were middle school students; and (d) no relationship was found between latent groups and living areas. The function of importance rating was not present when evaluating the importance-satisfaction profiles and their relationship with problem behaviors and overall life satisfaction. The problems of the “unimportant-unsatisfied” profile among youth are discussed.