Rating methodological quality: toward improved assessment and investigation

Assessing methodological quality is considered essential in deciding what investigations to include in research syntheses and in detecting potential sources of bias in meta-analytic results. Quality assessment is also useful in characterizing the strengths and limitations of the research in an area of study. Although numerous instruments to measure research quality have been developed, they have lacked empirically-supported components. In addition, different summary quality scales have yielded different findings when they were used to weight treatment effect estimates for the same body of research. Suggestions for developing improved quality instruments include: distinguishing distinct domains of quality, such as internal validity, external validity, the completeness of the study report, and adherence to ethical practices; focusing on individual aspects, rather than domains of quality; and focusing on empirically-verified criteria. Other ways to facilitate the constructive use of quality assessment are to improve and standardize the reporting of research investigations, so that the quality of studies can be more equitably and thoroughly compared, and to identify optimal methods for incorporating study quality ratings into meta-analyses.     

How Many Balance Functions Does it Take to Determine a Utility Function?

Call b your balance function at wealth W if you are indifferent between W and a 50–50 lottery with outcomes x and b(x). Given one b, u is arbitrary on one side of W but then determined on the other. Given two b‘s, u is arbitrary between the two W′ s but then determined elsewhere. Additional properties of u restrict the b’s but do not ordinarily make u unique. Contradictions can occur. Given three b′ s, an algorithm is developed using minimal domains of definition that determines the relative utility of the W’s. If it is irrational, then the set S generated by applying all combinations of b’s to W′ s is dense and u is determined. If finitely many b’s are rationally related, then S is discrete, a further algorithm determines it, the values of u on S are equally spaced, and u is arbitrary between any two adjacent points of S but then determined elsewhere. Infinitely many balance functions determine u unless they are rationally related in a uniform way.JEL Classification: D81     

An Empirical Investigation of the Assumptions of Risk-Value Models

Do participants make decisions consistent with risk-value tradeoffs? One hundred and five undergraduate business students made risk and preference judgments about lottery pairs in a series of paper surveys. The data indicate that the participants’ responses were generally consistent with the key assumptions of risk-value models, but that some extensions of the theory would improve this consistency. In particular, we find that modifying the risk assumptions of the risk-value theory so they are consistent the concept of the reflection of the risk attitude in the domains of gains and losses increases the agreement between the theory and the participants’ responses.     

Parental divorce and subsequent disadvantage: A cross-cohort comparison

Although many studies have examined the link between parental divorce and subsequent well-being, some theories of the effects of divorce suggest that the negative associations should have declined over time. However, few studies have examined the extent to which the associations have remained stable over time. Using data from two British cohorts, we analyzed both shorter- and longer-term outcomes of children who experienced parental divorce and the extent to which the associations have changed over time. Estimating similar models for both cohorts, we found little evidence of any change in the size of the relationship as divorce became more commonplace.     

Demographers’ Involvement in Twentieth-Century Population Policy: Continuity or Discontinuity?

The second half of the twentieth century witnessed the development of a crusading spirit and massive technical aid aimed at reducing fertility levels and rates of population growth in developing countries, and also the involvement of demographers in these events. The demographers at Princeton University’s Office of Population Research, Frank Notestein and his colleagues, have been singled out by recent authors as playing a unique role in bringing about these changes, and they have been criticized for encouraging demographers to become involved, so eroding their scientific objectivity. This paper examines the development of relevant population thought and theory in the English-language literature over the first half of the twentieth century. It concludes that in the circumstances of the second half of the twentieth century, it was inevitable that developed countries and their demographers would become involved in controlling fertility levels in developing countries. The OPR story should be seen largely in terms of how the world’s leading demographic center and its demographic transition theory were swept along by global changes. As those developments started, attitudes to population change in densely settled Asia became Malthusian, even as population growth accompanied by mortality decline in Asia demonstrated that, at least in the short term, the positive checks were disappearing.