A research design for generalizing from multiple case studies

Many evaluations would be more useful to decision makers if their results were both explanatory and generalizable. In view of the limitations of traditional methods in meeting both these goals at the same time, the authors describe a research design explicitly intended for generalizing about the range of applicability of “explanatory patterns” (within a designated “target” population of cases). The paper presents an overview of the main features of a “multiple case study design,” shorthand for a multiple site, structured case study design. It then discusses the nature of explanatory patterns, how case study investigators pursue and recognize valid patterns, and how an analyst can apply the same logic to cross-site analysis in order to make valid inferences about the limiting conditions under which particular explanatory patterns apply to particular populations.     

Ist mein Einkommen gerecht?

Based on the “Status-Value-Theory”, “A New Theory of Distributive Justice” and the exchange theories it can be concluded that individuals evaluate their own income as being just or unjust according to the average reference incomes, income inequality and their social position within an income hierarchy. In order to analyze this issue, a web-based survey with an integrated experimental set-up was carried out in the beginning of 2012. The analysis of the experimental data of 906 participants shows that the respondents based their income justice evaluations on average incomes of people with same professional qualifications and supports the “Status-Value-Theory”. Evidence for the impact of the income distribution among the reference group on justice evaluations, as stated by “A New Theory of Distributive Justice”, could only be found for respondents ranked at the lower end of the income scale. A similar pattern could be found for the effect of a respondent’s social position on his or her income justice evaluations that was expected on the basis of the exchange theories. The social position affects the income justice evaluations only in case that incomes are sufficiently unequally distributed. This article may also be of interest to readers who are rather interested in methodological issues than in the topic of income justice. The stimuli used in this study were designed by taking into account the information provided by the respondents (dynamic stimuli).     

Using network analysis to conduct a system-wide program evaluation within a university

ObjectiveTo conduct a system-wide assessment using social network analysis (SNA) to examine how 14 important issues (e.g., consent; racism) are addressed through education, training, and programming at a university.MethodsEvaluators conducted interviews with campus departments responsible for educating/training on the 14 issues. Interviews revealed which programs (n = 52) were offered that addressed the 14 issues, and data on audience characteristics, date of delivery, and which issues were covered in each program were collected. SNA was used to calculate degree and create visualization graphs illustrating patterns of content-coverage across all 52 programs.ResultsThe average degree was 19.38 (SD = 9.70), meaning programs overlapped in topic area with nearly 20 other programs, on average. Most programs (n = 36; 69.2 %) were attended by audiences of 500 people or less. “Diversity and inclusion” represented the topic area with the most programs (n = 23), whereas “suicide” and “bullying/hazing” had the least number of programs (n = 3). Degree was negatively correlated with attendance numbers (r=-.310, p < .001), indicating the more a program overlapped in content with other programs, the smaller the audience.ConclusionsThis study supports the use of network analysis in conducting systemic evaluations of programs offered at a university, complementing the work of ongoing, local-level program evaluations.     

Response to Amundson,Lux and Hindmarch: Critique of Investigative Practices Article

ABSTRACT

This article responds to a commentary by Amundson, Lux and Hindmarch (2005), in which they offer a pejorative criticism about our article (Austin & Kirkpatrick, 2004) in which we described the investigative component within comprehensive child custody evaluations–something they label as “maximalist” evaluations and contrast with a model they prefer called the “minimalist” approach. We believe our approach to custody evaluations is in keeping with the current standard of practice and professional guidelines.     

Differential validity: Another threat to compensatory education evaluations

The effects of the changing nature of intelligence test items during the follow-up period for compensatory education program evaluations on the judgements about the efficacy of such programs are examined. Data generated from Stanford-Binet test items, assuming known “true” underlying motor and verbal scores, as well as data from three compensatory education evaluations, are examined. The changing nature of the IQ test items, i.e., the differential validity of the tests, is put forth as an explanation for the often disheartening results of such program evaluations. Methods for dealing with the problem of differential validity are suggested.     

Du « zèle » à l’autogestion : retour sur les usines récupérées d’Argentine

Since the turn of the century, Argentina has been the scene of a renewal in “self-management”. More than twenty years after the end of the Yugoslavian experiment, a wave of factory occupations and “recuperations” by their wage-earners has unfurled in this South American land, and aroused the interest of those opposed to globalization. This activism represents a major alternative to “neoliberal” globalization. As this exhaustive examination of a symbolic instance of “recuperation” shows however, those involved undertake their actions in the name of a special relation with company directors and out of an “ethos of zeal”. In this sense, their struggle and the implementation of self-management is an example laden with lessons for analyzing activism.     

Competency-Based Training: Objective Structured Clinical Exercises (OSCE) in Marriage and Family Therapy

The field of marriage and family therapy (MFT) has recently engaged in the process of defining core competencies for the profession. Many MFT training programs are adapting their curriculum to develop more competency-based training strategies. The Objective Structured Clinical Examination (OSCE) is widely used in the medical profession to assess clinical competence. These examinations involve using simulated clinical situations as a tool in conducting summative evaluations of trainee competence. This article describes an adaptation of the OSCE procedures for competency-based training of MFT students. Instead of using the procedures as a summative examination as is typical in medical education, this article proposes how to use them as formative exercises in the development of student competence. The development of the OSCE is discussed, including “blueprinting,” focused competencies, procedures, and feedback protocols. The article concludes with suggestions of how to continue the development of the OSCE for evaluation in MFT education.     

A user-focused model for the utilization of evaluation

It is proposed that the present low level of utilization of evaluation findings is traceable in part to their failure to address directly the information needs of a clearly specified decision maker. An alternative model proceeding from such specification is proposed here, with evaluation closely interwoven with the on-going innovation process. The model suggests a number of implications for the organizational role of evalutors, for the design of evaluations, and for directions for methodological development. In particular, we suggest that evaluation designs be assessed against possible “threats to utility” as well as against the traditional “threads to validity.”     

Elijah the Prophet in Crime and Punishment

Post-Soviet scholarship has produced a plethora of new studies on Konstantin Pobedonostsev, focusing on his political “conservatism” and its current relevance. This scholarship, however, has marginalized two critical dimensions – the religious (so important to Pobedonostsev) and the transnational (so powerful a force because of post-1870 globalization). This study offers a critique of the new scholarship and draws on archival materials to reassess Pobedonostsev’s role as chief procurator (ober-prokuror) of the Holy Synod. Here it is argued that: (1) Pobedonostsev was not the embodiment of sterile negativism (as many claimed), but rather insisted that the change be gradual and based on Russian reality, not foreign models; (2) Pobedonostsev’s influence declined not only in the government (as is well known), but also in the Church; (3) Pobedonostsev became increasingly alienated from the “Church” and clergy, coming to identify with “simple believers”; (4) to meet their needs, Pobedonostsev laboured to build parish schools and reopen parish churches, and in the 1890s focused on religious writing; (5) at odds with the Church hierarchy, Pobedonostsev increasingly identified with the parishioners as the real repository of piety.     

Le métier de conseiller d’insertion et de probation : dans les coulisses de l’État pénal ?

This study of the changing profession of “counselors of integration and probation” (conseillers d’insertion et de probation, Cip) proposes a sociology of occupational groups that takes into account both statutory and moral considerations. Turning social services in prisons into a “penitentiary service of integration and probation” has involved professionalization, “juridicization” (with a shift from social work to the field of law) as well as a switch from a “compassionate” toward a “repressive” pole of interventions. Based on a survey conducted in prison, this study of work situations and conflicts helps us formulate the problems of ruptures and continuities in relation to both these employees’ individual trajectories and the institutional framework of their actions. This case study of Cip, an occupational group seen herein as a litmus test of what the penal institution does to persons under a court order, enables us to imagine an ethnography of the “state in acts”.     

The Person Behind The Word: Mead's Theory Of Universals And A Shift Of Focus In Symbolic Interactionism

Careful consideration of Mead's theory of universals proves to be a corrective to a number of tendencies evident in the work of at least some influential contemporary symbolic interactionists. Mead avoids any realistic hypostatization of separate universals (“meanings,” “forms,” or “essences” while at the same time eschewing nominalistic and conventionalistic views of language. His principle of the objective reality of perspectives (1932:161-175) allows him to grant objective reality to universal characteristics of concrete objects, but entails neither hypostatization nor idealization of the universal. In addition to contravening nominalism and conventionalism, Mead's theory of universals provides a perspective from which the reality of the self, and the importance of intentional action for the development of a firmly felt sense of self and autonomy, can both be affirmed. Far from being an illusion or mer.e symbolic construct, the self is seen to be an objectively real universal within the perspective of social action.     

Performance measurement: Some conceptual issues

Measures of how well a system is operating are clearly of interest to a wide range of users, from organizational researchers to system managers. The current literatures in such areas as “performance measurement, ” “organizational effectiveness, ” and the like show little consistency in their definitions of terms or in their methods for generating measures. The present paper attempts a clarification of these issues in the form of a conceptual minimalist position which requires only three basic definitions, and leaves, as far as possible, all remaining issues open to empirical investigation.We first review the literature on “organizational effectiveness” contrasting the organizational goals and systems paradigms, and note the lack of either theoretical or empirical convergence between the two. An examination of the nature of effectiveness statements suggests that this failure of convergence flows mainly from the different criterion sets generated by the two paradigms — and, importantly, that one should not expect convergence on a single measure or set of measures which uniquely define how well a system is performing. One's view of how well a given system is performing is a function of where one stands (either theoretically or in relationship to the system), and pursuit of the one true set of performance measures is a futile exercise. Instead, we propose to redirect attention to the identification of the various individuals and groups (“constituencies”) with an interest in system performance, and to the investigation of those items of system relevant information (their “performance measure sets”) which do, in fact, change their evaluations of how well the system is performing. This perspective will, we hope, redirect effort from futile theoretical debate to empirical investigations of what measures are used, by whom, and to what effect, in specific settings.     

Thinking with the Mind,Syncing with the Body: Ballet as Symbolic and Nonsymbolic Interaction

Symbolic interactionist theory describes self‐consciousness as arising through symbolic interaction. I use one empirical case, ballet training, to suggest that symbolic interaction can, by producing self‐consciousness, cultivate unself‐consciousness. Using in‐depth interviews with twenty‐three individuals reporting on training experiences in six countries and twenty‐three American states, I show that dancers can learn, through self‐conscious symbolic interaction, how it feels to embody what an audience sees, as they strive to train their bodies to portray an institutionalized aesthetic. The embodiment of technique facilitates a markedly unself‐conscious “flow” experience while performing. In contrast, having an acute awareness of embodying an incompatible physiology inhibits flow and often motivates dancers to self‐select out of ballet. These interactionist sources of “nonsymbolic” interaction both evoke and suppress “mind” through social interaction.     

Ethical Actions: A Comparison of Individual and Group Recommendations

In order to examine the way ethical decisions are made, we asked ethicists, regulatory officials, and experienced researchers to review a set of scenarios that depict important ethical tensions in research. The method employed was “protocol analysis,” a talk-aloud technique pioneered by cognitive scientists. Each individual was asked to make recommendations for courses of action. Later, we held a focus group of university faculty and staff with either institutional review board experience or research ethics training. They too were asked to recommend actions. The results show there are areas where the two data collection approaches agree, as well as areas of considerable difference. Implications for training in the responsible conduct of research are discussed.     

Beyond Repair: Interpretation,Reparation, and Melanie Klein’s Clinical Play-Technique

This article puts clinical child psychoanalysis into conversation with recent debates about critical method in order to question the turn toward so-called “reparative reading” in feminist and queer theory. While Eve Kosofsky Sedgwick’s original call for a new kind of reparative method culled its key terms (“reparative” and “paranoid”) from child psychoanalyst Melanie Klein, the scholars who have adopted reparativity in critical theory pay little attention to Klein’s work. In this article, I take up Klein’s theory of the depressive position and reparativity as she elaborated them in her clinical work with children, particularly her wartime analysis of “Richard” in 1941. Klein interpreted Richard’s play—his clinical “war games”—through her idiomatic vocabulary of “attack” and “repair.” By situating this case and Klein’s larger theory of psychic reparations in the political climate of wartime Europe, I argue that Klein’s writings point to the ethico-political dangers inherent in reparative endeavors, which name the object and narrate its injury and repair according only to the perimeters of one’s own self. From this reading, I propose that there might be a benefit to foregoing the injury/repair framework implicit in reparative agendas—both critical and clinical alike. By returning reparativity to Klein, I therefore aim not to offer a corrective to Sedgwick or to the scholars following her, but rather to interrogate the ethical stakes of all reparative endeavors, be they political, intellectual, or clinical. At the most basic level, then, this article argues that the space of the clinic is an important (and often undervalued) object for the consideration of critical method.     

Risky Business: Breastfeeding Promotion Policy and the Problem of Risk Language

Over the past decades, the rhetoric surrounding breastfeeding promotion policy has been increasingly focused on couching formula feeding in terms of “risk” rather than, as had been the norm, focusing on the “benefits” of breastfeeding. We examine this major policy shift in breastfeeding promotion and public health efforts. Analyzing qualitative data collected from 214 expectant mothers exposed to differently worded breastfeeding promotion materials, we identify several overwhelming trends in evaluations of the materials by those women exposed to “risk” language. These trends, we argue, point to strategic and normative reasons to reconsider this policy shift to the language of risk.     

State “Technical Assistance Programs” for Nursing Home Quality Improvement: Variations and Potential Implications

To improve nursing home quality, many states have developed “technical assistance programs” that provide on-site consultation and training for nursing facility staff. We conducted a national survey on these state programs to collect data on program design, operations, financing, and perceived effectiveness. As of 2010, 17 states had developed such programs. Compared to existing state nursing home quality regulations, these programs represent a collaborative, rather than enforcement-oriented, approach to quality. However, existing programs vary substantially in key structural features such as staffing patterns, funding levels, and relationship with state survey and certification agencies. Perceived effectiveness by program officials on quality was high, although few states have performed formal evaluations. Perceived barriers to program effectiveness included lack of appropriate staff and funding, among others. In conclusion, state technical assistance programs for nursing homes vary in program design and perceived effectiveness. Future comparative evaluations are needed to inform evidence-based quality initiatives.     

The primacy of mediated action in sociocultural studies

After a brief overview of the reasons for using “sociocultural,” as opposed to “cultural‐historical,” “sociohistorical,” or some other term, it is argued that an adequate account of the agenda for sociocultural research must be grounded in the notion of “mediated action.” Drawing on the writings of Vygotsky, Bakhtin, and others it is argued that mediated action must be understood as involving an irreducible tension between the mediational means provided by the sociocultural setting, on the one hand, and the unique, contextualized use of these means in carrying out particular concrete actions, on the other. In this view, any attempt to reduce the basic unit of analysis of mediated action to the mediational means or to the individual in isolation is misguided. It is suggested that by using mediated action as a unit of analysis the human sciences will be in a better position to address some of today's most pressing social issues.     

Evaluations of Women and Men Among Black and White College Students1

Rainwater's assertion that blacks have low self-evaluations because they receive more negative evaluations from other blacks than whites receive from other whites is challenged here by reference to Heiss and Owens evidence that negative self evaluation among blacks is limited to work-related traits. Substantial support was found for our major hypotheses that, compared to whites, (1) blacks would report more negative evaluation of “most men” but not of “most women” (since the provider role is traditionally ascribed primarily to men), and (2) the more negative evaluation of “most men” by blacks would be limited to work-related traits.     

卓越人才培养模式探讨

以实施“卓越工程师教育培养计划”为出发点,在分析国内高等工程教育现状和“3＋1”教学模式的基础上,从人才培养新机制、培养模式和人才培养标准等方面对卓越工程师教育培养进行了探讨。