Methodological considerations in using complex survey data: an applied example with the Head Start Family and Child Experiences Survey

Complex survey data are collected by means other than simple random samples. This creates two analytical issues: nonindependence and unequal selection probability. Failing to address these issues results in underestimated standard errors and biased parameter estimates. Using data from the nationally representative Head Start Family and Child Experiences Survey (FACES; 1997 and 2000 cohorts), three diverse multilevel models are presented that illustrate differences in results depending on addressing or ignoring the complex sampling issues. Limitations of using complex survey data are reported, along with recommendations for reporting complex sample results.     

Complex sample data recommendations and troubleshooting

Complex survey data, as highlighted in this issue of Evaluation Review, provide a wealth of opportunities for answering methodological and/or applied research questions. However, the analytic issues of nonindependence and unequal selection probability must be addressed when analyzing this type of data. Thus, to ensure that research questions are accurately answered when using complex survey data, researchers must take extra precautions to ensure complex survey data are correctly analyzed. The purpose of this article is to provide software recommendations for analysis of and tips on troubleshooting when analyzing complex sample data.     

Lost in Translation? Embracing the Challenges of Working With Families From a Refugee Background

This article describes the difficulties a mainstream family therapy service experienced in working with families from a refugee background. The experience of six therapists and five bicultural workers, who are also the referring agents, was captured in focus groups, and the reflections that emerged shaped a four‐part approach for working with families from a refugee background. Live consultation, either by the family therapist or bicultural worker, is suggested as a way to marry the expertise of family therapists who are not cultural ‘insiders’ with the ‘lived experience’ and cultural expertise of bicultural support workers. The process of reflecting on therapeutic failure resulted in several principles for working therapeu‐tically with families with a history of refugee trauma, unmet resettlement needs and family relationship challenges. These include maintaining a flexible approach to therapy, ascertaining a clear understanding of the referral context, defining an explicit therapeutic contract from the first session, being mindful of the important role that language plays and terminating therapy if it is contra‐indicated.     

Prevention of homicidal violence in schools in Germany: the Berlin Leaking Project and the Networks Against School Shootings Project (NETWASS)

Since 1999, Germany has experienced at least twelve serious cases of targeted school violence. This article describes two projects designed to fill the gap between universal prevention and emergency response in preventing severe forms of school violence in Germany. The Berlin Leaking Project examined the viability of preventive efforts based on early identification of leaking behavior that often precedes targeted school attacks. Leaking refers to any behavior or communication that indicates a student is preparing to carry out a violent attack. This would include explicit or implied threats of violence, apparent fascination with prior acts of violence such as Columbine, and any evidence of planning or preparation to carry out an attack. The NETWASS project will test a training program and intervention strategy based on those findings, examining the usefulness of a threat assessment approach to prevent violence by training teachers to recognize leaking behavior by students. This approach is extended by training teachers on a larger scale to identify leaking and then having a school-based team evaluate the student and initiate appropriate interventions, such as mental health services, and in some cases, law enforcement action.     

Aging behind bars:health care for older female inmates

As the numbers of women in prison have increased, so have the number of older women behind bars. These older women present unique problems for institutions trying to meet their health care needs. We report findings from our national pilot study of federal and state prisons for women. Prisons report basic services for physical and mental health care, and most report having hospice services. However, those that house larger percentages or that expect to house larger percentages of older prisoners do not significantly differ in their approaches to assessing and providing health care from their counterparts. By failing to anticipate the increase in older women, prisons may be failing to provide for many of the health needs of this vulnerable population.     

Development Mobilities: Identity and Authority in an Angolan Development Programme

This ethnographic essay considers how international non-governmental organisations are able to make claims to authoritative knowledge about development work by offering the transnational mobilities of their staff members as evidence. I examine how one professional's biography—his trajectory from Angola to Britain and back again—was differentially presented to external donors and internal staff members as befitting the institutional needs of an international good governance intervention in Angola. These presentations reflect a commoditisation of the cosmopolitanism of professionals' histories in the service of development as a regime of mobility. I argue that, in this development regime, a global hierarchy prevents some individual professionals, particularly those from developing nations, from realising the same benefits of their cosmopolitan mobility as professionals from industrialised nations. While one of mobility studies' many strengths is that it highlights global interconnectedness, social scientists should not read equality in these interconnections but examine how patterns of transnational mobility may produce and reproduce global structures of inequality.     

What’s love got to do with it? Homogamy and dyadic approaches to understanding marital instability

What determines marital instability is an important area of research for demography, sociology and economics, with a host of public policy implications. This paper improves our understanding of the issue through the use of rich longitudinal data and the application of advanced research approaches for one of the first times anywhere, and certainly uniquely for Australian data. The combination of method and recent Australian data represents a significant advance in this research area. Using data from waves 1–7 of Household, Income and Labour Dynamics in Australia Survey, 2,482 married couples—where both partners are respondents in the first wave—are traced over 6 years to identify factors associated with marital separation. The data are analysed dyadically; that is, the characteristics of both partners in each couple are considered in tandem. This allows assessment of whether marriages between partners with similar characteristics (homogamy) are more likely to last than are marriages between dissimilar partners, or whether particular characteristics of wives or husbands—independent of their partners’—are more strongly associated with marital stability. A Cox proportional hazards model with time-varying covariates is used to assess the association of characteristics with marital separation. Our most important contribution relates to the role of homogamy in marital stability or instability and in the context of spousal differences we find the following factors associated with higher risk of marital separation: age, education, preference for a child, and drinking and smoking behaviour. As well, there is a clear positive association between separation and: dissatisfaction with the relationship; husband’s unemployment and perceived financial stress; early age at marriage; separation of parents; second-plus marriage; resident children born before marriage; and low household income. The last of these findings should matter directly for public policy formulation.     

Income Pooling between Australian Young Adults and Their Parents

We test whether young adults who co‐reside with their parents derive influence over household‐level expenditure by earning income. We propose a new variant of the Engel curve consistent with the Quadratic Almost Ideal Demand System, which allows a simple test of income pooling. Our tests suggest that young adults and parents mostly pool their income — pooling is not rejected for 8 out of 12 expenditure categories. We are more likely to reject income pooling between young adults and their parents in those expenditure categories where the model fit is highest, so our results may be interpreted as an upper bound on income pooling. We also apply our tests to income pooling between husbands and wives and find that pooling holds for 9 out of 12 expenditure categories. We find the opposite relationship with fit — expenditure categories where fit is poor are those where we are most likely to reject income pooling.     

Seven years later: effects of a neighborhood mobility program on poor Black and Latino adults' well-being

This study explored program effects on adults' well-being seven years following the implementation of a court-ordered neighborhood mobility program. Low-income black and Latino adults residing in poor, segregated neighborhoods in Yonkers, New York were randomly selected to relocate to publicly funded townhouses in middle-class neighborhoods within the city. Adults who moved (n = 141) and demographically similar adults who were not selected to move (n = 106) were interviewed. Data indicate that 85 percent of adults who moved to the new housing remained there at follow-up. Results revealed that adults who moved resided in neighborhoods with higher collective efficacy and less disorder and danger but had fewer neighborhood social ties than adults who stayed in poor neighborhoods. Movers were also more likely to work and less likely to receive welfare than nonmovers. Adults who remained in low-poverty neighborhoods at the time of the follow-up reported better physical health than adults residing in poor neighborhoods, but mental health did not vary by neighborhood.     

The response of household parental investment to child endowments

The theoretical and empirical literature on parental investment focuses on whether child-specific parental investments reinforce or compensate for a child’s initial endowments. However, many parental investments, such as neighborhood quality and family size and structure, are shared wholly or in part among all children in a household. The empirical results of this paper imply that such household parental investments compensate for low endowments, as proxied by low birth weight.