Bioecological Theory, Early Child Development and the Validation of the Population-Level Early Development Instrument

The Early Development Instrument (EDI; Janus and Offord in Canadian Journal of Behavioural Science 39:1–22, 2007) project is a Canadian population-level, longitudinal research project, in which teacher ratings of Kindergarten children’s early development and wellbeing are linked to health and academic achievement variables at the individual level, and to demographic, cultural, and socioeconomic variables at the community level. In this article, we draw from Bronfenbrenner’s bioecological theory of human development to create a coherent theoretical framework for guiding validation research within a population-level approach to child development research in general and for the EDI project in particular. The discussion draws from a range of social and health sciences as well as validity theory. The paper seeks to align complex conceptual, theoretical, methodological, and psychometric considerations, to provide specific design, methodology, and validation recommendations for a population-level approach to studying children’s development and wellbeing, and to discuss the strengths and challenges of this approach.     

Validation Theory and Research for a Population-Level Measure of Children’s Development,Wellbeing, and School Readiness

This paper delineates general validity and research questions that are underlying an ongoing program of research pertaining to the Early Development Instrument (EDI, Janus and Offord 2007), a population-level measure, on which teachers rate kindergarten children’s developmental outcomes in the social, emotional, physical, cognitive, and communicative domains. It describes the large-scale research projects that are using the EDI to measure children’s developmental outcomes for entire populations (e.g., provinces, cities). Given the uniqueness of the EDI’s use as monitoring tool, or social indicator, for children’s developmental health at an early age, we spell out the opportunities and challenges that these projects provide with regard to validation research. The article sets the stage for the special issue, as it is dedicated to showcase the different aspects of the conceptual, theoretical, and empirical validation research as well as the collaborative community-based projects that are currently being undertaken with respect to the EDI.     

Validity and the Consequences of Test Interpretation and Use

The vast majority of measures have, at their core, a purpose of personal and social change. If test developers and users want measures to have personal and social consequences and impact, then it is critical to consider the consequences and side effects of measurement in the validation process itself. The consequential basis of test interpretation and use, as introduced in Messick’s (Educational measurement, Macmillan, New York, pp. 13–103, 1989) progressive matrix model of unified validity theory, has been misunderstood by many measurement experts, test developers, researchers, and practitioners. The purposes of this paper were to (a) review Messick’s unified view of validity and clarify his consequential basis of test interpretation and use, (b) discuss the kinds of questions evoked by value implications and social consequences and their role in construct validity and score meaning, (c) present a reframing of Messick’s model and a new model of unified validity and validation, (d) bring the concept of multilevel measures under the same validation umbrella as individual differences measures, and (e) offer some thoughts and directions for more explicit consideration of value implications, intended social consequences, and unintended side effects of legitimate test interpretation and use. This paper has implications for the interpretation, use, and validation of both individual differences and multilevel measures in education, psychology, and health contexts.     

An Indigenous Knowledges Perspective on Valid Meaning Making: A Commentary on Research with the EDI and Aboriginal Communities

Offering an Indigenous perspective, this commentary discusses collaborative research, shared meaning making, and knowledge building specific to child development, and reflects on social, cultural, and historical aspects that influence these processes. Drawing upon experiences of developing a collaborative research approach with which to engage Aboriginal communities to appreciate, understand, and potentially use the Early Development Instrument (EDI; Janus and Offord in Can J Behav Sci 39:1–22, 2007), a teacher-administered rating scale on kindergarten children’s development, the commentary focuses on five key questions relevant to research processes undertaken with Indigenous Peoples, and the importance of social, ethical, and cultural aspects of validity: How do Indigenous epistemologies and knowledges inform and influence research processes that utilize the EDI as a measurement tool? How can the EDI be used as a measurement tool within a research process that fosters the thriving of children and their families in Aboriginal communities while promoting Indigenous Peoples’ self-determination? In what ways do local, Indigenous cultural and ethical considerations inform aspects of validation research pertaining to the EDI? How can (Western mainstream) universities build research capacity that is informed by Indigenous knowledges and ways of being, doing, and knowing? What are the potential consequences of using normative research tools—such as the EDI—as a method to build knowledge on children’s development with Indigenous Peoples and Aboriginal communities? This commentary suggests that from an Indigenous perspective, research on child development is valid and meaningful knowledge if it is clearly linked to the children’s and families’ wellbeing according to local cultural norms and values.     

The Volunteer Satisfaction Index: A Validation Study in the Chinese Cultural Context

Using a Hong Kong-sourced sample of 261 participants, this study set out to validate the Volunteer Satisfaction Index (VSI) in the Chinese cultural context and to evaluate its psychometric properties. The VSI was originally developed by Galindo-Kuhn and Guzley (2001) to measure the outcomes of volunteer experiences. In this study, exploratory factor analysis (EFA) yielded a different factor structure from that proposed by the scale developer. The three factors found were personal gain, relationship within organization and relationship with peers. Cronbach’s alpha values were high for all three subscales. Results from correlation and regression analysis also confirmed the construct and criterion-related validity of the scale. Thus, the reliability and validity of the scale were confirmed. Implications for the assessment of volunteer satisfaction and further directions for cross-cultural studies on related topics are discussed.     

The Early Development Instrument: An Examination of Convergent and Discriminant Validity

The convergent and discriminant validity of the Early Development Instrument (EDI), a teacher-rated assessment of children’s “school readiness”, was investigated in a multicultural sample of 267 kindergarteners (53% male). Teachers evaluations on the EDI, both overall and in five domains (physical health/well-being, social competence, emotional maturity, language/cognition, communication/general knowledge), were related to direct, child-based assessments of performance on two standardized measures of school readiness, and measures of phonological awareness and early social competence. Regression analysis indicated that together the four comparison measures accounted for 36% of variance in overall EDI scores, each making a significant and unique contribution. Results supported the convergent validity of overall EDI scores but not the discriminant validity of EDI domain scores. Moreover, correlations between EDI scores and comparison measures varied widely across teachers, suggesting considerable individual differences in teacher’s ability to evaluate school readiness relative to direct, child-based assessments, and confirming that the EDI is more appropriate for deriving inferences at higher aggregated levels such as community or region. The validation of EDI domain scores remains an important challenge in future research.     

Fifty Years After the Social Indicators Movement: Has the Promise Been Fulfilled?

In spite of its currency both in academic research and political rhetoric, there are numerous attempts to define and conceptualize the social cohesion concept but there has been paid little attention to provide a rigorous and empirically tested definition. There are even fewer studies that address social cohesion in a framework of cross-cultural validation of the indicators testing the equivalence of the factorial structure across countries. Finally, as far as we know there is no study that attempt to provide an empirically tested multilevel definition of social cohesion specifying a Multilevel Structural Equation Model. This study aims to cover this gap. First, we provide a theoretical construct of social cohesion taking into account not only its multidimensionality but also its multilevel structure. In the second step, to test the validity of this theoretical construct, we perform a multilevel confirmatory factor analysis in order to verify if the conceptual structure suggested in first step holds. In addition, we test the cross-level structural equivalence and the measurement invariance of the model in order to verify if the same multilevel model of social cohesion holds across the 29 countries analysed. In the final step, we specify a second-order multilevel CFA model in order to identify the existence of a general factor that can be called “social cohesion” operating in society that accounts for the surface phenomena that we observe.     

Investigating the Structural Validity of Ryff’s Psychological Well-Being Scales Across Two Samples

Ryff’s (1989b) Psychological Well-Being (PWB) scales measure six related constructs of human functioning. The present paper examined the validity of Ryff’s 6-factor PWB model, using data from a life events study (N = 401) and an organisational climate study (N = 679). Previous validation studies, using Confirmatory Factor Analysis (CFA), have identified alternative PWB models, but limitations include the use of shorter scale versions with items relating to a number of life domains within the same PWB factor, and failure to examine the influence of participants’ socio-demographic characteristics on PWB. In this study, Exploratory Factor Analysis (EFA) mostly found consistency in the PWB items and structure between the two studies whereby a 3-factor model delineated between items relating to Autonomy, Positive Relations and a super-ordinate factor comprising the other PWB factors. Using CFA, Goodness of Fit indices reached acceptable levels for the adjusted PWB model identified by the EFA, whilst differences between adjusted models of PWB previously identified in the literature were hardly evident. Post-hoc analysis by gender demonstrated socio-demographic effects on the structure and items that comprise PWB. Further development of PWB measures is needed to reflect its hierarchical and multi-dimensional nature. In the scales’ current form, the construct validation of the PWB factors will continue to be problematic and will fail to adequately evaluate the nature and impact of PWB.     

Investigating Validity Evidence of the Satisfaction with Life Scale Adapted for Children

This study introduces the Satisfaction with Life Scale adapted for Children (SWLS-C) and presents psychometric findings regarding its validation. The SWLS-C was adapted from the Satisfaction with Life Scale (SWLS; Diener et al. 1985), which is one of the most commonly used measures to assess satisfaction with life in adults. Three subject matter experts adapted the SWLS by changing the wording of the item stem and response format in order to make it more understandable for children. A stratified random sample of 1,233 students (48% girls) in grades 4–7 (mean age 11 years and 7 months) provided data on the SWLS-C and measures of optimism, self-concept, self-efficacy, depression, emphatic concern, and perspective taking. The SWLS-C demonstrated a unidimensional factor structure and high internal consistency. Furthermore, differential item functioning and differential scale functioning analyses indicated that the SWLS-C measures satisfaction with life in the same way for different groups of children (i.e., with regard to gender, first language learned at home—English vs. other language(s) than English—and across different grades) at the item and at the scale level. Associations between scores on the SWLS-C and demographic variables were statistically non-significant or of small effect size. In addition, the SWLS-C showed evidence of convergent and discriminant validity in relation to the other measures. Our results indicate that the SWLS-C is a psychometrically sound instrument that demonstrated evidence of construct validity for this age group. Limitations and future directions are discussed.     

How do Positive Views Maintain Life Satisfaction?

This study proposes three mediation pathways to explain how the positive views (perceived control, optimism and self-enhancement) proposed by Cummins and Nistico (Journal of Happiness Studies 3:37–69 2002) maintain life satisfaction. The three pathways were enhancing self-esteem, reducing have-want discrepancy and changing importance perceptions. Two hundred and seventy-two undergraduates from Central Taiwan University of Science and Technology and Nan Kai Institute of Technology voluntarily participated in this study. Questionnaires measuring sense of control, optimism, self-enhancement, self-esteem, have-want discrepancy and importance of life domains, and global life satisfaction were administered to participants in a classroom setting. Correlation and structural equation modeling analyses were conducted to examine the mediation effects of these three pathways. Generally, results of correlation and structural equation modeling analyses were consistent with hypothesized relations among variables and showed that the relationship between positive views and life satisfaction was completely mediated by self-esteem, have-want discrepancy and shifting tendency of importance perception, indicating that the three pathways of enhancing self-esteem, reducing have-want discrepancy and changing importance perceptions had unique effects to explain how positive views maintain life satisfaction.     

A Comparison of Alternative Models of Individual Quality of Life for Social Service Recipients

There is considerable debate in the area of individual quality of life research regarding the factor structure of the QOL construct that is focused on the number and composition of QOL factors and domains, and its hierarchical nature. The main goal of this study involve testing by means of confirmatory factor analyses five models that have been pointed out by recent scientific literature: firstly, an unidimensional model; secondly, a QOL model that consisted of eight inter-correlated domains proposed by Schalock and Verdugo (2002); thirdly, a model composed of these eight 1st-order factors and one 2nd- order factor; the forth and five are model with the eight 1st-order factors and three 2nd-order factor that has been denominated in other studies ‘Salamanca model’ and ‘Schalock model’. Data were collected from 3.029 social service recipients from Catalonia (Spain) who completed the GENCAT Scale, an objective QOL questionnaire. The best fit of the eight inter-correlated and 1st order domains was empirically demonstrated. Implications for future research are also discussed.     

Construct Validation and Application of a Common Measure of Social Cohesion in 33 European Countries

The aim of the paper is to assess the construct validation of a multidimensional measure of social cohesion which is well theoretically grounded and has an equivalent/comparable interpretation across all European countries. Up-to-now published research on social cohesion is deficient in either one or both of these important aspects. This paper attempts to cover this gap. The task is accomplished in two steps. In the first step, we conceptualize social cohesion, flowing mainly from Bernard and Chan’s definitions of social cohesion. Based on this theoretical framework we operationalize social cohesion and derive a set of intermediate indicators in the data. By return we verify whether these indicators empirically reflect/corroborate the multidimensional structure of the concept proposed by the theory. In the second step, we examine whether the obtained intermediate indicators of social cohesion form the same constructs across countries and whether they can yield a cross country equivalent measure of social cohesion. To test the validity of the theory we use multidimensional scaling and confirmatory factor analysis. Both models are able to verify the equivalence of the structural results between groups (i.e. countries). Confirmatory factor analysis produces further meaningful measures of these constructs. The analyses are based on the data from the 1999 European Values Study (EVS). The outcomes of the analyses reveal that, firstly, the existence of the multifaceted construct of social cohesion suggested by the theory has been corroborated by empirical analysis of the EVS data (i.e. social cohesion consists of components of formal and substantial relationships and political and socio-cultural domains). Secondly, the proposed constructs measuring social cohesion are equivalent across all analysed countries and thus allow the calculation of internationally comparable national scores of social cohesion. Application of the aggregate measures at the country level will illustrate the interest of the approach for further research.     

A Measure of Subjective Happiness: Preliminary Reliability and Construct Validation

Using a 'subjectivist' approach to the assessment of happiness, a new 4-item measure of global subjective happiness was developed and validated in 14 studies with a total of 2 732 participants. Data was collected in the United States from students on two college campuses and one high school campus, from community adults in two California cities, and from older adults. Students and community adults in Moscow, Russia also participated in this research. Results indicated that the Subjective Happiness Scale has high internal consistency, which was found to be stable across samples. Test-retest and self-peer correlations suggested good to excellent reliability, and construct validation studies of convergent and discriminant validity confirmed the use of this scale to measure the construct of subjective happiness. The rationale for developing a new measure of happiness, as well as advantages of this scale, are discussed.     

Household production in a collective model: some new results

Household models estimated on labour supplies alone generally assume non-market time to be pure leisure. Previous work on collective household decision-making is extended here by taking domestic work into account in the Chiappori et al. (J Polit Econ 110(1):37–72, 2002) model. Derivatives of the household “sharing rule” can then be estimated in a similar way. Using the 1998 French Time-Use Survey, we compare estimates of labour supply functions assuming first that non-market time is pure leisure and then taking household production into account. The results are similar but more robust when household production is included. Collective rationality is rejected when domestic work is omitted.     

The Political Use and Abuse of the “Pedophile”

ABSTRACT

The cognitive/affective construct designated by the term “pedophile” is delineated on the basis of how he is presented in the popular media. His salient characteristics are listed and then examined in the light of scientific and historical data. The “pedophile” is discovered to be a “social construct that floats in the thin air of fantasy.” Since the truth-value of the construct “pedophile” approaches zero, we are confronted with the question of why he continues to be such a central and emotionally fraught aspect of American culture. The answer to this question is found in his political usefulness. Specifically, the religious right uses him to further its agenda of sexual repression, and the political right uses him to dismantle the machinery of a free society.     

Differential Item Functioning of a Family Affluence Scale: Validation Study on Data from HBSC 2001/02

Methodology for making cross-national comparisons is an area of increasing interest in social and public health related research. When studying socio-economic differences in health outcomes cross-nationally, there are several methodological issues of concern, especially when data is derived from self-reported questionnaires. Health Behaviour in School-aged Children (Currie et al. 1998) is a WHO cross-national study using school samples. HBSC provides comparable data, and thereby a unique opportunity to study associations between social indicators and health outcomes within an international perspective. In 2001/02 data was collected from a total of 162,323 children in 32 countries (Austria, Belgium, Canada, Croatia, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Greenland, Hungary, Ireland, Israel, Italy, Latvia, Lithuania, Macedonia, Malta, Netherlands, Norway, Poland, Portugal, Russia, Slovenia, Spain, Sweden, Switzerland, Ukraine, United Kingdom, USA.). Studies of social inequalities requires that a comparable measure of socio-economic position (SEP) is in use. HBSC has developed a proxy for social position measuring material wealth, the Family Affluence Scale (FAS). This paper studies FAS and whether it is comparable across population subgroups defined by country, age and gender. Initial analysis revealed that an item measuring perceived family wealth was a valid FAS item. Including this item in the FAS score will improve the reliability of FAS. Graphical log-linear Rasch models (GLLRM) showed that FAS contain differential item functioning (DIF) with respect to country, age, and gender as well as local dependency (LD) between items. During the analysis, test equating techniques where used to adjust for the test bias generated by DIF. We recommend that the equated scores are used whenever FAS is included as a variable. This study suggests that HBSC-FAS should contain five items (additional item: perceived family wealth) when analysing data from HBSC 2001/02, and furthermore that each country should adjust for the DIF or make use of the converted FAS scores provided. If using FAS as a proxy for social position at an international level, it is not advised to compare the absolute levels of FAS, but weigh the scale by ridit transformation.

Does the EDI Equivalently Measure Facets of School Readiness for Aboriginal and Non-Aboriginal children?

The aim of the current paper was to examine the equivalence of the Early Development Instrument (EDI), a teacher rating measure of school readiness, for Aboriginal and non-Aboriginal children. The current study used an approach, which analyzes the structure and properties of the EDI at the subdomain level. Similar subdomain score distributions would suggest that the EDI measures subdomains similarly for both Aboriginal and non-Aboriginal groups, whereas systematic variations in distributions would suggest the presence of bias at the subdomain level. The EDI was completed on a population of kindergarteners in 2003 in Saskatoon, Saskatchewan, Canada. Results indicate that mean scores for all the domains and subdomains were significantly lower for Aboriginal children. However, the distributions of subdomains in which children were rated as ‘challenges exist’ were similar among both groups. The findings suggest an equivalent structure of the EDI at the subdomains level for Aboriginal and non-Aboriginal children. The next step is to examine the specific correlates, beyond the structure of the EDI, that are associated with disparities in EDI subdomain scores, such as contextual factors and social conditions.     

Alegría! Flow in Leisure and Life Satisfaction: The Mediating Role of Event Satisfaction Using Data from an Acrobatics Show

The aim of the current study was to examine the role of satisfaction-with-event as a mediator in the relations between flow and life satisfaction based on the bottom-up theory (Andrews and Withey in Social indicators of well-being: Americans’ perceptions of life quality. Plenum, New York, 1976; Lee et al. in J Macromarketing 22(2): 158–169, 2002). Four hundred and thirty-four participants with a mean age of 35.60 (SD = 11.76) were recruited from the audience of a “Cirque du Soleil” acrobatics show, performed in Taiwan in 2009. Participants completed the flow scale (Csikszentmihalyi in Flow: the psychology of optimal experience. Harper & Row, New York, 1990), a satisfaction-with-event scale (Lin and Hsu in Mark Rev 3(4): 497–528, 2008), and a satisfaction-with-life scale (Diener et al. in J Pers Assess 49:71–75, 1985) immediately after viewing the show. Structural equation modeling was conducted to examine our hypothesis that satisfaction-with-event levels would fully mediate the relationship between flow and overall life satisfaction. Results supported our prediction and are discussed in terms of bottom-up theory. Implications of the study are also provided for the leisure managers.     

More Evidence for Trends in the Intergenerational Transmission of Divorce: A Completed Cohort Approach Using Data From the General Social Survey

Many studies have demonstrated that the children of divorce are disproportionately likely to end their own marriages. In previous work, I showed that the transmission of divorce between generations weakened substantially for General Social Survey (GSS) respondents interviewed between 1973 and 1996 (Wolfinger 1999); Li and Wu (2006, 2008) contended that my finding is a methodological artifact of the GSS’s lack of marriage duration data. This article presents a completed-cohort approach to studying divorce using the GSS. The results confirm a decline in the probability of divorce transmission that cannot be explained by the right-censoring bias alleged by Li and Wu. This finding contributes to an ongoing debate about trends in the negative consequences of parental divorce, as well as demonstrating a useful approach to right-censored phenomena when event history data are not available.     

Exploring Time Perspective in Greek Young Adults: Validation of the Zimbardo Time Perspective Inventory and Relationships with Mental Health Indicators

In this article we examine the factorial structure of the Greek version of the Zimbardo Time Perspective Inventory (ZTPI; Zimbardo and Boyd in J Personal Soc Psychol 77:1271–1288, 1999), in a sample of 337 university students, using principal axis factoring (PAF) with oblique rotation, and its dimensionality using parallel analysis. Moreover, we evaluate the internal consistency reliability, the convergent validity (through associations with mental health indicators such as dispositional optimism, self-esteem, trait anxiety, depression, and proactive coping), as well as discriminant, and differential validity of this instrument. The results indicated that the ZTPI had a 5-factor structure (past negative, past positive, present fatalistic, present hedonistic, future). Correlational analyses indicated that an aversive view of the past, and a fatalistic attitude toward life were positively and significantly associated with trait anxiety and depression, while they were negatively correlated with self-esteem, proactive coping, and dispositional optimism. Future time perspective was positively associated with proactive coping, whereas a positive attitude toward the past was negatively associated with depression and trait anxiety. Psychometric properties of the five ZTPI scales were satisfactory (Cronbach’s alphas ranging from .710 to .845), thus facilitating the robust investigation of time perspective in Greek speaking populations. However confirmatory factor analyses revealed that the “positive attitude toward the past” dimension might not be a good indicator of time perspective. We discuss the theoretical implications of these findings for future studies of time perspective.