Testing the Comparability of Different Types of Social Indicators Across Groups

The social indicator movement has realized a considerable increase in importance during the last 50 years. This happened not the least by the publications in the journal Social Indicators Research. Social indicators have been developed for many aspects of life. The scores on these indicators often are compared through time and across groups. An essential requirement for such research is that the measures used are comparable through time and across groups. The comparability through time is not such a big problem but the comparability of measures across groups is not so obvious. This requires harmonization of indicators based on objective variables and invariance testing for indicators based on subjective and objective variables. In this paper we discuss how the comparability of different types of social indicators based on subjective and objective variables can be tested using invariance testing. This is a relevant issue because the existing testing procedure is designed for only one type of social indicators and this test is not directly applicable on the other types of social indicators.     

Social indicators of perceived life quality

Modern societies in both developing and developed countries have real and legitimate concerns about the enhancement, maintenance, and redistribution of individual well-being. Indicators of perceived well-being provide direct measures of what societies are trying to achieve, permit cross-sector comparisons, can indicate the adequacy of coverage of ‘objective’ indicators, and can contribute to social policy making. in both the long and short run. Some commentators, however, have suggested perceptual indicators suffer from methodological weaknesses associated with their validity, interpretability, completeness, and utility. Each of these possible weaknesses is addressed in some detail. New research evidence and certain philosophical perspectives are presented, and it is concluded that none of these presumed weaknesses is sufficient to invalidate the development and use of perceptual indicators. Suggestions are made concerning methodological research needed to support the development of indicators of perceived well-being. It is noted that the materials and results developed in the author's research on Americans' perceptions of life quality may be useful for suggesting approaches to the development of indicators of perceived life quality relevant to other cultures.     

A Benefit Recipiency Approach to Analysing Differences and Similarities in European Welfare Provision

In comparative welfare state research, the question of how to measure and understand cross-country differences and similarities in extents of public welfare provision has led to a major discussion about the indicators that could be used for this purpose. Much scholarly attention approaching this so-called ‘dependent variable problem’ concentrates on social expenditure or on social rights data as indicators of ‘welfare stateness’ or ‘welfare generosity’. However, recently, micro-level data on benefit receipt as another promising but hitherto underused indicator was brought into this discussion. The article at hand extends existing knowledge about the conceptual, methodological and empirical potentials and challenges of this alternative indicator compared to the two prevailing indicators. For the empirical analysis, it uses cash benefit recipiency data from the EU-SILC to investigate differences and similarities in extents of public welfare provision between 29 European countries for the period 2003–2012. The study reveals parallels to findings from research in which indicators of social expenditure and social rights are applied, but it also adds new insights beyond their cost and paper reality. This is mainly the case where priority is given to household-related assistance benefits rather than individual insurance benefits. The main conclusion of the paper is that the benefit recipiency indicator—despite not being flawless and requiring further research—complements existing knowledge on differences and similarities in welfare provision by European welfare states.     

Priming Effects in Measuring Life Satisfaction

Life satisfaction, as an indicator of subjective well-being, has received increasing attention in the recent decades. It has become a potential indicator of development, to be used complementary to objective measures. However, no clear consensus exists on the relationship between life satisfaction and satisfaction with the various domains of life as well as on the measurement of life satisfaction. This paper addresses the relationship between overall life satisfaction and domain satisfaction (DS). The objective is to identify potential biases induced by priming effects when measuring DS. Four types of theoretical models, derived from existing literature, are tested in different scenarios. Data from three waves of the European Quality of Life Surveys are analyzed using a structural equation modeling framework to provide empirical evidence. An original experimental design is employed to demonstrate that priming effects cannot be ignored. A comparison of models including priming effects and those ignoring such biases shows that the former is a better fit and has higher propensity to explain the variations in life satisfaction and DS.

     

Educational Mismatch of Graduates: a Multidimensional and Fuzzy Indicator

In this paper we attempt to measure the educational mismatch, seen as a problem of overeducation, using a multidimensional and fuzzy methodology. Educational mismatch can be difficult to measure because many factors can converge to its definition and the traditional unidimensional indicators presented in literature can offer a restricted view of the problem. We discovered two dimensions that properly define overeducation. The first includes information regarding job satisfaction, the use of expertise and the coherence between study and work, but also the measure on which the traditional indicator is based and the second concern earning aspects. We then calculate a degree of membership to the set of overeducated workers using the defined dimensions. We believe that in this manner we can partially overcome the rigidity of the traditional measures. Our findings suggested that generally women have a degree of mismatch higher than men and the graduates in Pharmacy, Medicine and Engineering are the least overeducated in terms of the first dimension, even if in terms of the earnings dimension they have similar mismatches to the other fields of education. Self-employment and collaboration contracts reduce overeducation when the first dimension is considered; on the other hand, when the second dimension is taken into account graduates with collaboration contracts are the most mismatched out of those having a job. Additionally, university reform introduced in the academic year 2001–2002 in the Italian higher education system is shown as not contributing to a reduction of the overeducation phenomenon.     

Highlighting Methodological Limitations in the Steps of Composite Indicators Construction

The paper opens the debate on the need to find a stable methodological framework in the construction of composite indicators (CIs) in order to address the methodological challenges including those of sensitivity and uncertainties related to methods used. As CIs are well-known to be essential in public debate, their methodological construction must be known by a large public. Illustrating CIs’ construction steps by a simple indicator, the paper aims to “democratize” this disciplinary field which is still a black box for some researchers but also to show how composite scores are sensitive to methods used and then, its impacts on policies. For example, in the Sustainable Development Indicator case, the geometric aggregation system is favorable to emerging countries which lead the ranking table whereas high income countries (which are leaders in the linear and equal weight system) except Australia, are misclassified. Uncertainty and sensitivity analysis confirm these results showing that the indexes’ scores seem to be influenced by the orientation (implied theoretical framework) given by its sponsors including policy makers. Regarding the validity of the index, correlation tests with some lights and well known indicators, reveal very consistent results.     

A system of social indicators for the CMEA countries and for Hungary

This paper discusses the reasons for the growing demand for social indicators in Hungary and in other European socialist countries. A brief history of the construction of a system of social indicators within the framework of the Council of Mutual Economic Aid is given. The subsystems and the main indicators are described. The present practice and the problems of social classifications used in the social indicator systems and in social surveys are treated. In addition to the existing data sources of social indicators, sample surveys were considered to be necessary to provide a full and detailed view of Hungarian society. In addition to objective indicators, recently, subjective indicators have also been collected.     

Static Numbers to Dynamic Statistics: Designing a Policy-Friendly Social Policy Indicator Framework

In line with the economic crisis and rapid socio-demographic changes, the interest in ??social?? and ??well-being?? indicators has been revived. Social indicator movements of the 1960s resulted in the establishment of social indicator statistical frameworks; that legacy has remained intact in many national governments and international organisations. With this background, this research examines whether existing social indicator frameworks are valid and effective enough to address increasingly complex social issues. The authors argue that, despite some improvements, current social indicators fail to provide an effective framework and tool for measuring the progress of social welfare and also for developing or reforming social policy to cope with newly emerging social problems. While proposing a new social indicator framework based on the Organisation for Economic Co-operation and Development??s pressure-state-response (PSR) model, the paper argues that the new framework should be more than displaying static numbers but should use dynamic statistics revealing causes and effects and shedding light on social and policy changes.     

Indicators and Indices of Child Well-being: A Brief American History

This paper traces the history of indicators and indices of child well-being from its origins in the social indicator movement of the 1970s through recent developments in the field. Initial work calling for comprehensive sets of indicators of child well-being and later recommendations for indicator improvement are detailed. Products that resulted from these recommendations, such as comprehensive indicator reports and online resources are described. The development of child well-being indices is shown to parallel the history of indicators. The contributions of state and international indicator and index projects are included as well. Important aspects of child well-being indicator development are uncovered through documenting its history, including the need to focus on subjective as well as objective measures of well-being, and the need to develop indicators for the multiple ecological contexts of children’s lives, but to separate measures of context from measures of child outcomes. A rough consensus emerges across the history of indicator efforts on the critical domains of child well-being: physical, psychological, cognitive, social, and economic well-being. Recent recognition of the importance of indicators of positive development is noted. This paper was funded by the KIDS COUNT project of the Annie E. Casey Foundation.     

The Unbalance Penalisation Method for Metrics of Social Progress

This study contributes to the debate on the development of aggregate metrics of societal progress. Summarising societal progress into a single number poses various methodological challenges, including the choice of indicators, normalisation, weighting and aggregation. This paper addresses the issue of aggregation in the case of metrics of well-being and uses as a case study the European Union regional Social Progress Index—EU-SPI—published by the European Commission. The index is an aggregate measure of 55 social and environmental indicators observed for all the European regions grouped into 12 components. In metrics of this type, while complete substitutability among components is rarely acceptable, controlling their level of substitutability is highly desirable. To this aim, we adopt a modified version of the unbalance penalisation approach originally proposed by Casadio Tarabusi and Guarini (Soc Indic Res 112:9–45, 2013). A penalisation is applied to the regions whose performance across the index components is unbalanced, that is when they perform well on some components but worse on others. The penalisation applied by this approach depends on two parameters that, in its original formulation, are generally arbitrarily chosen. We design a data-driven approach allowing for an informed choice of the penalisation parameters. The comparison between the EU-SPI original and penalised scores shows that the penalisation effect is particularly evident for regions with a strongly unbalanced profile across the components. The proposed method allows for adjusting the level of substitutability between components when constructing an aggregate metric, an important functionality especially when measuring societal progress for policy-making.

     

Quantitative Storytelling in the Making of a Composite Indicator

The reasons for and against composite indicators are briefly reviewed, as well as the available theories for their construction. After noting the strong normative dimension of these measures—which ultimately aim to ‘tell a story’, e.g. to promote the social discovery of a particular phenomenon, we inquire whether a less partisan use of a composite indicator can be proposed by allowing more latitude in the framing of its construction. We thus explore whether a composite indicator can be built to tell ‘more than one story’ and test this in practical contexts. These include measures used in convergence analysis in the field of cohesion policies and a recent case involving the World Bank’s Doing Business Index. Our experiments are built to imagine different constituencies and stakeholders who agree on the use of evidence and of statistical information while differing on the interpretation of what is relevant and vital.

     

The inter-temporal aspect of well-being and societal progress

The perceptions on well-being and societal progress are influenced also by the quantitative indicators and measures used in the measurement, presentation and semantics of discussing these issues. The article presents a novel generic statistical measure S-time-distance, with clear interpretability that delivers a broader concept to look at data, to understand and compare situations. This methodology can provide a new insight to many problems, an additional statistical measure, and a presentation tool for policy analysis and debate expressed in time units, readily understood by policy makers, media and general public. The benefits of this new view in comparisons, competitiveness issues, benchmarking, target setting and monitoring for economic, employment, social, R&D and environment indicators at the world, OECD, EU, country, regional, city, sector, socio-economic groups, company, project, household and individual levels could be immediately applied to a wide variety of substantive fields at macro and micro levels using existing data and indicator systems from international, national, state, city and local sources. These suggestions are illustrated by comparisons between EU15 and USA.

Application of Different Techniques of Factor Analysis to Develop Neighborhood Social Capital Rating Scale

Composite indicators are widely used to determine the ranking of countries, organizations or individuals in terms of overall performance on multiple criteria. Their calculation requires standardization of the individual statistical criteria and aggregation of the standardized indicators. These operations introduce a potential propagation effect of extreme values on the calculation of the composite indicator of all entities. In this paper, we propose robust composite indicators for which this propagation effect is limited. The approach uses winsorization based on a robust estimate of the distribution of the sub-indicators. It is designed such that the winsorization affects only the composite indicator rank but has no effect on the entities ranking in each sub-indicator. The simulation study documents the benefits of distribution-based winsorization in the presence of outliers. It leads to a ranking that is closer to the clean data ranking when compared to the ranking obtained using either no winsorization or the traditional winsorization based on empirical quantiles. In the empirical application, we illustrate the use of winsorization for ranking countries based on the United Nations Industrial Development Organization’s Competitive Industrial Performance index. We show that even though the sub-indicator ranking does not change, the robust winsorization approach has a material impact on the ranking of the composite indicator for countries with large discrepancies in the scores of the sub-indicators.

     

Big Data and Social Indicators: Actual Trends and New Perspectives

Big Data are a top subject in international research articles and a vast debate is taking place on their actual capability of being used to complement or even substitute official statistics surveys and social indicators in particular. In this paper we analyse the metadata of the Scopus database of academic articles on Big Data and we show that most of the existing and intensively growing literature is focused on software and computational issues whilst articles that are specifically focused on statistical issues and on the procedures to build social indicators from Big Data are a much smaller share of this vast production. Nevertheless the works that focus on these topics show promising results because in developed countries Big Data seem to be a good information base to create reliable proxies of social indicators, whereas in developing countries their use (for instance using satellite images) may be a viable alternative to traditional surveys. However, Big Data based social indicators deeply suffer of a number of open issues that affect their actual use: they do not correspond to any sampling scheme and they are often representative of particular segments of the population; they generally are private process-produced data whose access by national statistical offices is rarely possible although the intrinsic value of the information contained in Big Data has a social importance that should be shared with the whole community; Big Data lack the socio-economic background on which social indicators have been founded and their help to policy makers in their decision process is a fully open point. Therefore Big Data may be a big opportunity for the definition of traditional or new social indicators but their statistical reliability should be further investigated and their availability and use should be internationally coordinated.     

CONSTRUCTING A HEALTH AND SOCIAL INDICATOR FRAMEWORK FOR INDIGENOUS COMMUNITY HEALTH RESEARCH

Health and social indicators that capture the distinct historical, social, and cultural contexts of Indigenous communities can play an important role in informing the planning and delivery of community interventions. There is currently considerable interest in cataloguing and vetting meaningful community-level health and social indicators that could be applied to research and health promotion activities in Indigenous communities in Australia, Canada, and New Zealand, inclusive of conventional indicators as well as measures developed specifically for use in or with Indigenous communities. To avoid haphazard selection of indicators, and to assure the comprehensiveness and relevance of any given set of indicators, a framework that can accommodate and conceptually classify indicators representing a full range of domains is required. We report here on the development of a conceptual framework, by which Indigenous community indicators, and more general community-level social indicators, can be sorted, catalogued, and systematically classified within four hierarchical levels. The indicator framework was developed across Canada, Australia and New Zealand in consultation with academic researchers and Indigenous community stakeholders, building from established health and social indicator systems. The Indigenous indicator framework permits Indigenous communities, public health researchers, and funding agencies to compare and select the most appropriate indicators for application in specific contexts from the multitude of existing indicators.     

Overeducation of Young Workers in Spain: How Much Does the First Job Matter? Social Indicators Research

This article contributes to recent overeducation literature on the impact of an initial education mismatch on workers’ future careers. Specifically, using the 2009 ad-hoc module of the Spanish Labour Force Survey, we quantify the differences in the probability of overeducation depending on the quality of individuals’ first match. To do this, we apply an extension of the recursive bivariate probit model, which allows potential endogeneity problems to be taken into account, as well as a dissimilar impact of the initial match for workers with different educational attainment. The results indicate that overeducation is a trap, since young workers who were mismatched in their first job are 40.2 percentage points more likely to be overeducated in a later one than those who were not. When decomposing this difference in two parts, one related to the pure effect of the initial mismatch and another one related to workers’ characteristics, we conclude that the pure effect is more important, and it depends on educational attainment.     

Conceptualising and Measuring Social Cohesion in Africa: Towards a Perceptions-Based Index

Social cohesion is a key concept in development studies. Weak social cohesion is often related to slow economic growth and (violent) conflict. So far few attempts have been made to measure this complex concept in a systematic manner. This paper introduces an innovative method to measure national-level social cohesion based on survey data from 19 African countries. We distinguish three dimensions of social cohesion; i.e. the extent of perceived inequalities, the level of societal trust, and the strength of people’s adherence to their national identity. Importantly, our Social Cohesion Index (SCI) is based on individuals’ perceptions vis-à-vis these three different dimensions of social cohesion rather than certain macro-level ‘objective’ indicators such as GDP/capita or Gini-coefficients. We develop two social cohesion indices: a national average SCI and a Social Cohesion Index Variance-Adjusted (SCIVA); the latter one takes into account the level of variation across different ethnic groups within countries. The SCI and SCIVA are computed for and compared across nineteen African countries for the period 2005–2012 on the basis of Afrobarometer survey rounds 3, 4 and 5. We also investigate quantitatively the relationship between countries’ levels of social cohesion and the occurrence of a range of conflict events. As expected, we find that countries with low levels of social cohesion in a particular year according to our SCI are more likely to experience a range of different violent conflict events in the subsequent year.     

Some social indicators for multiple family housing

This research suggests some social indicator candidates for families housed in multiple-family environments. Objective, subjective, and behavioral data sets are all represented in the analysis. This range of social statistics and the utilization of appropriate statistical analysis are viewed as necessary conditions for generating social indicators rather than simply relying on arbitrarily selected social statistics and assume they are indicators. Analysis of 1253 interviews in 88 Alberta subsidized housing projects reveals that subjective data from the tenant category of housing variables rank highest in accounting for present levels of user satisfaction and are viewed therefore as reasonable social indicators with respect to that issue.     

Labor force composition and underemployment trends, 1969–1980

Underemployment indicators are both ‘objective’ indicators of individual well-being and social welfare and ‘normative’ indicators for programmatic use. Components of an underemployment indicator framework, the Labor Utilization Framework (LUF), are operationally defined and shown to be closely related to a family of proposed alternatives. Using CPS data, a 12-year time series of LUF indicators is developed for the U.S. labor force and its key subgroups. The across-time heterogeneity of the labor force is analyzed in relation to a ‘basic’ demographic group-by-LUF-by-time contingency, showing how the complexity of labor force structure that emerges from a multi-state indicator of underemployment can be rigorously modeled. Standard loglinear models, which focus on the temporal aspects of data from repeated cross-sectional surveys, provide the analytic technique. Changes in the demographic composition of the labor force account for about 30% of the overall period variability, and age structure has made the most important contribution to the compositional change.     

What is a quality of life indicator?

The concepts of indicator, social indicator, and life quality indicator are defined and exemplified. An indicator is characterized as an observable variable assumed to point to, or estimate, some other (usually unobservable) variable. It is, then, a symptom of something else. An indicator-indicated relation can be functional or it can consist in statistical correlation. It is a corrigible hypothesis, not an arbitrary definition. As such it is best justified when incorporated into a theory, e.g. a mathematical model. A social indicator is of course an indicator belonging to some sociological context. Finally, a quality of life indicator is one that allows one to estimate degrees of well-being. Some of the problems posed by this definition are discussed. The upshot of the discussion is that a better understanding and assessment of the quality of life calls for more intense theoretical and methodological work rather than an increase in the amount of social and environmental statistics. Here as elsewhere data without ideas are sterile when not misleading.