The problems and prospects in the teaching of mixed methods research

There are pedagogical challenges USA students and instructors face within mixed methods classrooms. Instructors of mixed methods are often self-taught, lacking adequate training in both qualitative and quantitative approaches to research. Students are not often trained in both research approaches. These dual training gaps can result in deep pedagogical issues compromising students’ ability to fully understand mixed methods research praxis and leaving teachers feeling ill equipped to address students’ learning concerns. To tackle the myriad of challenges confronted in the mixed methods classroom requires structural changes to the current way graduate training programs in social research methods are organized and taught. Developing a team-based teaching approach to mixed methods research that provides students with instructors who have the requisite qualitative and quantitative knowledge can serve as a pedagogical model that can begin at least to address the current methods and methodological skills gap in the teaching of mixed methods research.     

Time matters: the potential and pitfalls of using mixed methods approaches in longitudinal program evaluation

While social programs are often assessed using short-term impact studies, longitudinal designs allow evaluators to capture change over time, identify longer-term outcomes, adapt instruments, and better understand participants in transition. A mixed methods design can be critical in understanding these dynamics; yet there is a lack of literature exploring the practical considerations of planning and conducting qualitative and quantitative data collection and analysis within longitudinal studies. This paper examines two different mixed methods frameworks used in a 5-year evaluation of three youth entrepreneurship programs in East Africa. We show how the evaluation team dealt with unique challenges across methods and over time, and how the design ultimately facilitated a richer understanding of program impacts and processes. Considerations for conducting this type of study are explored, related to the impact of longevity on analysis and research staff. Successfully using a longitudinal mixed methods approach requires researchers to be strategic and reflexive, and work in close collaboration.     

Exploring intercultural sensitivity in early adolescence: a mixed methods study

The purpose of this mixed methods study was to explore levels of intercultural sensitivity in a sample of fourth to eighth grade students in the United States (n = 162). Intercultural sensitivity was conceptualised through Bennett’s Developmental Model of Sensitivity, and assessed through the Adapted Intercultural Sensitivity Index. Follow-up interviews provided additional information regarding the views and understandings of individual student participants. Quantitative data analysis indicated many early adolescents in this sample were accepting of cultural difference. However, subsequent qualitative data analysis suggested this acceptance was largely hypothetical, due to the participants’ perceived isolation from diversity. The implications of these findings are discussed.     

Developing a methodology to assess the impact of research grant funding: A mixed methods approach

This paper discusses the development of a mixed methods approach to analyse research funding. Research policy has taken on an increasingly prominent role in the broader political scene, where research is seen as a critical factor in maintaining and improving growth, welfare and international competitiveness. This has motivated growing emphasis on the impacts of science funding, and how funding can best be designed to promote socio-economic progress. Meeting these demands for impact assessment involves a number of complex issues that are difficult to fully address in a single study or in the design of a single methodology. However, they point to some general principles that can be explored in methodological design. We draw on a recent evaluation of the impacts of research grant funding, discussing both key issues in developing a methodology for the analysis and subsequent results. The case of research grant funding, involving a complex mix of direct and intermediate effects that contribute to the overall impact of funding on research performance, illustrates the value of a mixed methods approach to provide a more robust and complete analysis of policy impacts. Reflections on the strengths and weaknesses of the methodology are used to examine refinements for future work.     

Critical realism in empirical research: employing techniques from grounded theory methodology

Whilst critical realism (CR) is becoming recognised as a significant meta-theory for the social sciences, there is little guidance on how to produce research which is consistent with its ontological and epistemological assumptions. This article contributes to an emerging discussion about how CR can be applied, drawing on an example of a qualitative study that has sought to understand and explain the causes of unmet need amongst a group of rural labourers in Tunisia . Using this study as an illustration, I show how techniques from grounded theory methodology can be usefully harnessed in the data collection, coding and analysis stages of a research project that adopts a CR philosophical and methodological framework. I illustrate how an ‘abductive’ variant of grounded theory allowed drawing on pre-existing theoretical knowledge throughout the research stages; whilst open and axial coding techniques could be harnessed for identifying and postulating CR causal mechanisms. This article should be of interest to students and researchers involved with grounded theory and applied critical realism.     

Using video and dialogue to generate pedagogic knowledge: teachers,learners and researchers reflecting together on the pedagogy of social research methods

Developments in pedagogical knowledge in the teaching of social research methods have largely been generated through teachers reflecting on their practice. This paper presents an alternative approach to generating data through reflective dialogue between researchers, teachers and learners. The approach incorporates elements of video stimulated recall and reflective dialogue within focus group interviewing. The rationale and affordances are discussed in relation to the goals of discussing teachers’ pedagogical decision-making and learners’ experience of, and response to, various pedagogical practices. The context is a study of capacity-building short courses in advanced social science research methods, specifically courses on: multi-modal analysis, computer-assisted qualitative data analysis software, multi-level modelling, and systematic review. The paper examines the methodological challenges of capturing the everyday realities of methods classrooms for teachers and learners and the affordances of using dialogue on observed teaching sessions to gain further insight into each other’s thinking and action. It concludes with lessons learned about methodological and pedagogical processes and an argument about the value of bringing methods and standpoints together in creative dialogue.     

Studying at-home income generation: Issues and methods

Methods used to locate and study 899 home-based workers and their households in nine states are described in detail, with emphasis on the rationale behind the decisions about the definition of home-based work, sampling, the development of the interview schedule, data collection procedures, and data preparation. More than 10% of all households in the nine states include someone who is engaged in home-based work; 7% of the households have a member who has been engaged in the activity for more than 1 year and who spends at least 312 hours annually in the activity. The respondents have a mean age of 42.5 years, and have completed a mean of 13.8 years of education. More than half live in communities of 2,500 or over, and have lived there for more than 10 years. More than 40% of the sample consist of individuals who are married and have children living in the home. The average household income in 1988 was just over $42,000.This article reports results from the Cooperative Regional Research Project, NE-167, entitled, At-Home Income Generation: Impact on Management, Productivity and Stability in Rural/Urban Families, partially supported by the Cooperative States Research Service, U. S. Department of Agriculture and the Experiment Stations at the University of Hawaii, Iowa State University, Lincoln University (Missouri), Michigan State University, Cornell University (New York), The Ohio State University, The Pennsylvania State University, Utah State University, and the University of Vermont.In addition to at-home income generation, her research interests include divorce settlements and time use. She received her Ph.D. from Cornell University in 1978.Her current research interests include family resource management in Mexico, determinants and consequences of intergenerational co-residence, as well as family management in households in which there is at-home income generation. She received her Ph.D. from The Pennsylvania State University in 1970.Her dissertation involves the estimation of a reservation age for home-based workers.She has had 15 years of experience in survey research, 10 years as Projects Coordinator, and served as Project Manager for this study.     

Inside out: some notes on carrying out feminist research in cross-cultural interviews with South Asian women immigration applicants

This article considers a number of important issues raised in the growing literature with regard to the place of ethnicity in feminist research methodology and the woman-to-woman interview. Drawing on examples from the author's experiences of conducting interviews with South Asian women immigration applicants, the article firstly illustrates that because of a different ethnicity, a white feminist researcher is likely to be regarded as an outsider by the minority-ethnic interviewees, regardless of the sharing of gender. Secondly, using the ideas of 'personal' and 'structural' power the article discusses how the researcher's outsider status complicates the power relations between the interviewer and the participants.     

Assessing competency-based evaluation course impacts: A mixed methods case study

The contexts in which evaluators develop and apply their expertise are increasingly complex; evaluator education needs to provide robust opportunities to support and assess the progressive, lifelong development of relevant knowledge and skills. This mixed methods case study begins to address the dearth of empirical evidence assessing the impacts and learner experiences of competency-based approaches to evaluator education. A decade-in-the-making doctoral evaluation course based on the Canadian Evaluation Society’s Competencies for Canadian Evaluation Practice created an opportune study setting. We applied a systems perspective to Stufflebeam’s Context, Input, Process, and Product (CIPP) model to frame the case study analysis and presentation of the complex impacts generated by pre/post course competency self-assessments and reflections, integrated with an end-of-course focus group. Seven insights shed new light on the effective course design and implementation features for developing intended and unintended evaluator competencies. We conclude with a discussion of the theoretical, practical, and methodological implications for effective competency-based evaluator education.

• •Keywords: Case study; Competency-based approach; Evaluator education; Mixed methods research

     

Teaching mixed methods research: using a socio-ecological framework as a pedagogical approach for addressing the complexity of the field*

Mixed methods research is growing in acceptance and complexity, which translates into significant pedagogical challenges for teaching about mixed methods research. To address this challenge and to contribute to creating a pedagogical culture for teaching research methods, we developed a practically focused conceptual framework for describing the field of mixed methods research and used this framework to structure an Introduction to Mixed Methods Research course. Our socio-ecological framework describes the field of mixed methods within three nested and interacting levels: the mixed methods research process, content, and contexts. The course introduces students to each level and its components and considers how the framework accounts for different perspectives, issues, and debates found within the field. Course evaluations suggest that the new pedagogical approach helps students successfully understand and navigate the complexity and nuances of the mixed methods field, and develop foundational knowledge for designing and implementing a mixed methods study.     

Teaching research methods to social work students in India and Australia: reflections and recommendations

This paper draws on the reflections of two social work educators who have, for many years taught research methods to undergraduate and postgraduate social work students in India and Australia. The intent is to suggest measures for enhancing the quality of social work research education. The reflections are embedded in a social justice and human rights framework, privileging the educators’ unique social and cultural contexts and their commitment to engage with indigenous knowledge. The authors recommend effective social work research education requires the educator to draw on a deep understanding of their own context, as well as globally accepted research traditions. Particularly, we encourage research teachers to adopt student-centred approaches that emphasise a broad ‘research mindedness’ (in their students and themselves), building students’ practical capacities and confidence to become effective, research informed practitioners; capable of contributing to their own communities and to the social work profession more broadly.     

The Common-Sense Model of Illness Representation: Theoretical and Practical Considerations

This article focuses on several areas. After reviewing the most commonly used approaches in the study of health behaviors, (e.g., the medical model, the health belief model, and the theory of reasoned action) the common-sense model is presented as an alternative. By presenting evidence across a wide range of illness domains, we demonstrate the usefulness of the common-sense, self-regulatory approach. We then discuss the importance of the common-sense model for health research among minorities. We conclude the article with examples of the operationalization of illness representations in past research and directions for future research.     

Teaching social research methods after the critical turn: challenges and benefits of a constructivist pedagogy

An increasing challenge for teaching methods courses in the social sciences is the ‘critical turn’, which has encouraged some students to adopt an anti-empirical orientation. We present a case study of a compulsory undergraduate methods course in a political science department strongly influenced by post-structuralist philosophies. The first author redesigned the course to implement four constructivist pedagogical principles: (1) develop a full understanding of students’ pre-existing perceptions of political science research methods; (2) encourage students to see methodology as an inevitably contested field; (3) provide space for students to choose a methodological approach that best aligns with their personal stance on knowledge; and (4) encourage students to view research as an ongoing ‘conversation’. We critically reflect on the implementation of these constructivist pedagogical strategies and argue they improve students’ critical engagement with course material, increase linkages between methods teaching and other disciplinary subject matter, and accommodate diverse student perspectives and needs.     

Learning to manage and share data: jump-starting the research methods curriculum

Researchers’ responsibilities towards their research data are changing across all domains of social scientific endeavour. Government, funders and publishers expect greater transparency of, open access to, and re-use of research data, and fears over data loss call for more robust information security practices. Researchers must develop, enhance and professionalise their research data management skills to meet these challenges and to deal with a rapidly changing data sharing environment. This paper sets out how we have contributed to jump-starting the research methods training curriculum in this field by translating high-level needs into practical guidance and training activities. Our pedagogical approach involves applicable, easy-to-digest, modules based on best practice guidance for managing and sharing research data. In line with recent findings on successful practices in methods teaching, we work on the principle of embedding grounded learning activities within existing narratives of research design and implementation.     

Unintended consequences in traffic-light food labeling: A call for mixed methods in public health research

Abstract

Nudge theory describes how indirect suggestions and positive reinforcement can influence decision-making. We used nudge theory to implement a traffic-light labeling and choice architecture (modifying product placement) intervention at Harvard University cafeterias, but found no significant change in sales. Survey and focus group data showed that some students thought the labeling may exacerbate eating disorders, however, there is extremely limited research on potential negative consequences of labeling. One way to describe these findings is through 20th century philosopher Michel Foucault’s concept of biopower. Biopower manipulates cultural norms and nudges individuals to engage in self-surveillance and self-discipline, de facto subjugating themselves to certain ways of being. Biopower may lead to the creation of an in-group and an out-group based on who can adopt the new behaviors, such as healthy eating. Those in the out-group may face additional unintended consequences, highlighting the need for mixed-methods research to better evaluate public health interventions.     

A learning process within an education research group: an approach to learning qualitative research methods

This paper builds on the history of Esbrina, an established research group in Spain with almost 20 years’ experience and a deeply-rooted tradition of self-reflection and learning. We start by analysing the academic and social contexts in which the group was created and recognised. We make explicit team members’ backgrounds, dispositions and positionalities, to provide insight into the tensions aroused in deciding research topics, methodological approaches and research methods. Then we focus on two specific projects and explore the learning processes of those engaged in them: the first involves micro-ethnography, for which we examine our apprenticeship process through interviews, observation, inferential analysis and visual documentation. The second involves collaborative ethnography, for which we give an analytical account of how we created different ways of learning through collaborating and narrating. Throughout the paper, we reflect on our determination to create a methods-learning environment in which we constantly challenge our comfort zone by trying to do research on topics involving authentic learning. The most innovative aspect of the process is that senior and junior researchers, including group directors, play both the role of teachers and learners.     

Decolonising research in a Sub-Saharan African context: exploring Ubuntu as a foundation for research methodology,ethics and agenda

In all parts of the world, researchers are addressing the colonial legacy of research. This article aims to contribute to the decolonisation of research in a sub-Saharan African context by exploring Ubuntu as an indigenous Southern African research paradigm. Drawing on lessons learnt from participatory action research with South African science teachers and on Ubuntu research literature, I develop, and reflect on, characteristics of an Ubuntu research ethics, agenda and methodology. Understood as humanness, Ubuntu encompasses a dimension of becoming human and being human. Both dimensions are realised through lived community and respectful, caring relations with other living beings and the environment. Thus, ethical protocols evolve around relating positively to others. Ubuntu research agendas contribute to strengthening community and methodologies are community based, relational and participatory. The emphasis of the article is not on presenting Ubuntu research as categorically oppositional to conventional methodologies, but on an approach to research that is grounded in indigenous African epistemologies.     

Ethnic monitoring in higher education: Some reflections on methodology

Ethnic Monitoring in higher education has been limited and piecemeal. It often fails to explore the relationships between ethnicity and student progress and achievement, and to account for any ethnic inequalities revealed. In this paper an approach to ethnic monitoring that utilizes quantitative and qualitative methods is discussed. We argue that such an approach gives a clear statistical picture of group progress and achievement, identifies social, economic and institutional factors that might account for ethnic inequalities, and highlights the processes of racism and discrimination in higher education. All of these aspects are vital to a thorough understanding of ethnic inequalities in the higher education sector in the United Kingdom.