Herausbildung einer akademischen Elite?

Given a tendency to higher third-party funding, the mechanisms of distribution of research money become more and more relevant for individual academic careers as well as for scientific institutions at large. This article focuses on an empirical test of hypotheses on the impact of universities’ size and reputation on the chances of grant approval. Using multivariate analysis of register data provided by the German Research Foundation (DFG) for all applications for single grants from 1992–2004, individual chances of grant approval as well as success rates in departmental grant acquisition are estimated. The analyses detect neither strong context effects on individual chances of grant approval nor a clear tendency towards a higher concentration of research funding on fewer universities. Only scientists working in West German universities with a long standing tradition have a slightly better chance to get research funding. At the level of university departments, higher personnel resources translate into a higher number of applications and approvals only for very large institutions. Regarding funding of single grants, there is no trend of a growing inequality among the universities. Finally, these results are discussed with a specific reference to the recently launched “Initiative for Excellence” – a program designed in order to foster high level research in Germany – and are contrasted to some arguments of Richard Münch.     

SCOPE

This article presents an integrated framework for multi‐attribute decision making named SCOPE (System for Combined Planning and Evaluation) that was developed to assess infrastructure policy initiatives—in complex decision environments. The framework comprises scanning as well as assessment issues that are supported by a methodology of both a systemic and a systematic type. Specific use is made of operational research methods such as critical systems heuristics, scenario technique, stakeholder analysis and multi‐attribute decision making (MADM). To deal with issues of complexity and ambiguity, planning is redefined as being a systemic endeavour embedded in multi‐methodology and reflection‐in‐practice. The article addresses the purpose, background and principles of systemic planning, and exemplifies the SCOPE process with reference to the Øresund Fixed Link.     

Time matters: the potential and pitfalls of using mixed methods approaches in longitudinal program evaluation

While social programs are often assessed using short-term impact studies, longitudinal designs allow evaluators to capture change over time, identify longer-term outcomes, adapt instruments, and better understand participants in transition. A mixed methods design can be critical in understanding these dynamics; yet there is a lack of literature exploring the practical considerations of planning and conducting qualitative and quantitative data collection and analysis within longitudinal studies. This paper examines two different mixed methods frameworks used in a 5-year evaluation of three youth entrepreneurship programs in East Africa. We show how the evaluation team dealt with unique challenges across methods and over time, and how the design ultimately facilitated a richer understanding of program impacts and processes. Considerations for conducting this type of study are explored, related to the impact of longevity on analysis and research staff. Successfully using a longitudinal mixed methods approach requires researchers to be strategic and reflexive, and work in close collaboration.     

A content analysis of research in family therapy journals

In order to assess trends in family therapy research, empirical articles (N = 195) from three family therapy journals over a 5-year period were coded for several variables: authorship, external funding, methodology, sample, purpose, cost effectiveness, use of therapeutic model, and topic. Results indicated that a large pecentage of research in these journals focused on nonclinical issues and used nonclinical samples. Authors were affiliated with a wide variety of disciplines and reported low levels of external funding for their research. While a majority of the studies used quantitative methods, there appeared to be a growing number of studies using qualitative methods. Implications of these findings are discussed in light of research reviews over the past two decades.     

Connecting the dots: implementing and evaluating a network intervention to foster scientific collaboration and productivity

This article presents the design and implementation of a network intervention to foster scientific collaboration at a research university, and describes an experimental framework for rigorous evaluation of the intervention’s impact. Based on social network analysis of publication and grant data, an innovative type of research funding program was developed as a form of alteration of the university’s collaboration network. The intervention consisted in identifying research communities in the network and creating a new collaborative relation between pairs of unconnected researchers in selected communities. The new collaboration was created to maximally increase the overall cohesion of the target research community. In order to evaluate the impact of the program, we designed a randomized experiment with treatment and control communities based on the Rubin Causal Model approach. The paper describes the intervention design, reports findings from the program implementation, and discusses the statistical framework for future evaluation of the intervention.     

Evidenztriangulation in der Gesundheitsforschung

The contribution starts with weaknesses of a strict quantitative methodology in social research. Especially in health research variable connections are so complex that a broader understanding of research methods seems to be necessary. The dominance of quantitative-experimental ongoing in the sense of randomized controlled trials (RCT) at the top of the evidence hierarchy is criticized and a concept of evidence triangulation in the sense of mixed methods is proposed as alternative. An example study shows the logic of this research design. An institution of drug addicts counseling and therapy is analyzed in its effects through an evaluation study, using four different methodological approaches, an experimental pre-post design, qualitative interviews with the clients, and qualitative and document analysis using qualitative content analysis are combined. Each of them is developed in criticizing and supplementing the other approaches. The mixed methods procedure therefor follows a dialectical theory of science.     

Mixed-methods evaluation in complex programmes: The national reading plan in Portugal

This article highlights the evaluation strategies of a complex programme, which were essentially based on a pluralist, integrating approach founded on the use of mixed methods. The programme under analysis is the National Reading Plan (NRP), a public policy initiative that aims to increase literacy levels and reading habits among the Portuguese population. It was evaluated throughout its first phase, which lasted five years (2006–2011), using an evaluation model that made it possible to continuously and systematically monitor and analyse the way in which this programme was developed and implemented. A number of different quantitative and qualitative methodological operations gathered information from a broad range of sources and social actors, covering the vast set of projects promoted by the NRP. We particularly look at the contributions made by mixing methods to the evaluation of the programme's impacts, and point out its potentials when it comes to evaluating wide-ranging, long and complex programmes.     

Lottery Funding and Changing Organizational Identity in the UK Voluntary Sector

This paper focuses upon ways in which National Lottery funding impacts upon aspects of identity for small- to medium-sized organizations in the United Kingdom, and highlights some of the less-anticipated difficulties that groups may experience after receipt of a grant. A large Lottery grant can facilitate rapid expansion and may necessitate a degree of organizational learning for which groups are often unprepared. The paper suggests that a Lottery grant may lead to changes in the ways in which an organization identifies itself, or is identified by stakeholders. However, these changes may not be accompanied by a corresponding change in the organization's capacity or underlying cultural ethos. On the basis of the primary research carried out in 2003, the paper examines the implications of these changes for individual organizations and for the sector more widely.     

Redistributive Policy and Devolution: Is State Administration a Road Block (Grant) to Equitable Access to Federal Funds?

Over the last several decades, block grants have been a keyinstrument by which policy authority is devolved from federalto state governments. Whether the block grant approach producesmore effective redistributive policy management (on equity orefficiency grounds) is an open and central question. We focuson the equity dimension by positing an explanatory frameworkthat links access to federal block grant funding to the transactioncosts associated with intergovernmental grant contracting. Weargue that grant access is a function of both state-level institutionalchoices and the administrative capacity of local governments—whichcombine to influence the salient transaction costs associatedwith grant contracting. We apply our theoretic framework tothe non-entitlement portion of the Community Development BlockGrant (CDBG) program and analyze granting data across distinctinstitutional settings. We find that local administrative capacityis a key to access, indicating that some localities most inneed are least equipped to capture grants, which raises equityconcerns. However, the specific way in which states structurearenas of grant competition can make access more equitable.In short, we show that state-level institutional arrangementscritically affect access to federal block grant funds when thosefunds are allocated through competitive grant contracting tolocal governments.     

Mixed Methods – Stand der Debatte und aktuelle Problemlagen

While mixed methods research is already much advanced and institutionalized in textbooks, handbooks and its own journal on an international level, the German-language debate on mixed methods lags behind. Thus, this introductory paper starts with outlining the history and key concepts of mixed methods designs as well as the current state of the international debate. Next, we explain the aims and concept of this special issue as well as the crucial arguments of the single papers in the overall context of the special issues. Namely, the debate in this special issue of the Kölner Zeitschrift für Soziologie und Sozialpsychologie circles around the following four topics: philosophical, methodological and methodical foundations of mixed methods research; mixed methods designs and mixed methods sampling; modes of combining data and issues of validity; and process-oriented analysis, longitudinal analysis and evaluation. Based on the observations that, firstly, both the international social science research community and social problems are globalizing and, secondly, that social research itself is changing, especially by the increasing relevance of social media and big data, the paper concludes with suggestions for future research.     

Social network research and human subjects protection: Towards more effective infectious disease control

The issue of human subject protection in relation to social network research on the spread and control of human pathogens is considered. As this area derives most of its concepts and methods from social network analysis more generally, the present discussion has wider relevance. One problem is that some Institutional Review Boards (IRBs) have assumed that if a participant (who gave informed consent) is to be asked to name network associates these too — automatically — would be human subjects from whom informed consent also must be obtained. Invariably, if this occurs proposed research — whatever its funding and potential contributions might be — is blocked. A conservative approach is taken here. The Common Rule is assumed to provide relevant guidance, the responsibility of IRBs is to make decisions based on the Common Rule, and in consequence the burden is on those proposing social network research to design — and defend — their planned work with this in mind. At the same time, it is argued that it is important not to stifle beneficial research by adding to one inherently conservative review process (of grant proposals) another (of IRBs) so that work is prevented simply because it is research at the frontiers rather than ‘safe’ research.     

The Relationship Between Liberian CSOs and International Donor Funding: Boon or Bane?

The Liberian environment is characterized by enormous reliance on international aid, substantial amounts of which is channeled through civil society organizations (CSOs). These civil society organizations have played an important role in Liberia’s redevelopment since the end of the civil war in 2003, despite the fact that international aid to Liberia is increasingly characterized by unstable funding patterns and shifting donor priorities. This makes it vital to deepen our understanding of international aid funding to Liberian CSOs. This study uses mixed methodology to examine what impacts the ability of Liberian CSOs to attract aid funding, the nature of the donor–CSO relationship, and how this relationship impacts the capacity and behavior of CSOs. Results indicate CSO competence and efficiency are associated with ability to attract aid funding. Pressures and imbalance in the donor–CSO relationship contribute to high levels of environmental uncertainty for Liberian CSOs in the sample, leading to adaptive behaviors related to activities and funding streams.     

Mixed Methods Research in Marriage and Family Therapy: A Content Analysis

Considering mixed methods research is gaining reputability in the marriage and family therapy field (Research methods in family therapy, Guilford, 2005), we conducted a mixed methods content analysis to examine the prevalence and quality of published mixed and multimethod research during the past 10 years in eight prominent MFT journals (N = 32). Our purpose was to determine the characteristics of studies that utilized both qualitative and quantitative methods, the themes of the rationales for combining methods, and their respective topics of study. We found 16 mixed methods articles, many of which used surveys and interviews, focused on the process of therapy, and did not discuss their methodology as mixed. We encourage authors of mixed methods studies to explicitly define design types, to establish a clear rationale for the combination of methods, to state how qualitative and quantitative methods and data were mixed, and to use theory effectively.     

New materialist social inquiry: designs,methods and the research-assemblage

This paper discusses issues of research design and methods in new materialist social inquiry, an approach that is attracting increasing interest across the social sciences as an alternative to either realist or constructionist ontologies. New materialism de-privileges human agency, focusing instead upon how assemblages of the animate and inanimate together produce the world, with fundamental implications for social inquiry methodology and methods. Key to our exploration is the materialist notion of a ‘research-assemblage’ comprising researcher, data, methods and contexts. We use this understanding first to explore the micropolitics of the research process, and then – along with a review of 30 recent empirical studies – to establish a framework for materialist social inquiry methodology and methods. We discuss the epistemological consequences of adopting a materialist ontology.     

Using Social Network Analysis to Enhance Nonprofit Organizational Research Capacity: A Case Study

As donor agencies become more specific in funding requirements, research that can demonstrate the collaborative efforts of a nonprofit agency with its organizational neighbors and how those efforts pay off in terms of capacity and provision of services is highly useful. Recognizing these benefits, a local funding agency in Virginia commissioned a study to look at the ways in which social network analysis (SNA) can enhance the data resources available to nonprofits for funding and grant requests. In this article, we present a case study of a network of 52 nonprofit organizations to illustrate the viability of SNA in terms of funding and research needs specific to nonprofit organizations. We discuss the outcomes of the case study in terms of how the visual and metric outputs of SNA can be used by nonprofits to enhance the accomplishment of their organizational missions and strengthen their grant requests.     

Interdisciplinary Work Is Essential for Research on Puberty: Complexity and Dynamism in Action

Puberty is associated with changes in behavior and psychosocial well‐being, and is important in lifelong health. We present five different facets regarding interdisciplinary research that are important to puberty. A short history of philosophical issues instrumental in promoting early interdisciplinary research is first presented. We discuss then what is hard and what is easy about interdisciplinary research, the purpose of which is to alert scientists to challenges and opportunities for interdisciplinary research on puberty. Readers then are introduced to advances and obstacles in interdisciplinary research on development. Recommendations for tailoring graduate education toward interdisciplinarity are introduced. Finally, issues related to publication, education of scientists, and policy makers are described. The report concludes with a discussion of funding and policy issues.     

Pockets of Participation: Revisiting Child‐Centred Participation Research

This article revisits the theme of the clash of interests and power relations at work in participatory research which is prescribed from above. It offers a possible route toward solving conflict between adult‐led research carried out by young researchers, funding requirements and organisational constraints. The article explores issues of participation in child‐centred research in a cross‐cultural context and gives examples from research carried out with young refugees. The author discusses what might be the best way forward for researchers against a backdrop of critical dialogues concerning child participation on the one hand and funders’ frequent calls for participatory methodologies on the other. In doing participatory research with children and young people on the margins of society, issues of power, knowledge, ethical relations, funding processes and research methodologies and practices may seem at odds and difficult to resolve. In this article a methodology of creating pockets of participation that can be owned by the young researchers is suggested as a possible route.     

Assessing competency-based evaluation course impacts: A mixed methods case study

The contexts in which evaluators develop and apply their expertise are increasingly complex; evaluator education needs to provide robust opportunities to support and assess the progressive, lifelong development of relevant knowledge and skills. This mixed methods case study begins to address the dearth of empirical evidence assessing the impacts and learner experiences of competency-based approaches to evaluator education. A decade-in-the-making doctoral evaluation course based on the Canadian Evaluation Society’s Competencies for Canadian Evaluation Practice created an opportune study setting. We applied a systems perspective to Stufflebeam’s Context, Input, Process, and Product (CIPP) model to frame the case study analysis and presentation of the complex impacts generated by pre/post course competency self-assessments and reflections, integrated with an end-of-course focus group. Seven insights shed new light on the effective course design and implementation features for developing intended and unintended evaluator competencies. We conclude with a discussion of the theoretical, practical, and methodological implications for effective competency-based evaluator education.

• •Keywords: Case study; Competency-based approach; Evaluator education; Mixed methods research