The problems and prospects in the teaching of mixed methods research

There are pedagogical challenges USA students and instructors face within mixed methods classrooms. Instructors of mixed methods are often self-taught, lacking adequate training in both qualitative and quantitative approaches to research. Students are not often trained in both research approaches. These dual training gaps can result in deep pedagogical issues compromising students’ ability to fully understand mixed methods research praxis and leaving teachers feeling ill equipped to address students’ learning concerns. To tackle the myriad of challenges confronted in the mixed methods classroom requires structural changes to the current way graduate training programs in social research methods are organized and taught. Developing a team-based teaching approach to mixed methods research that provides students with instructors who have the requisite qualitative and quantitative knowledge can serve as a pedagogical model that can begin at least to address the current methods and methodological skills gap in the teaching of mixed methods research.     

Using Active Learning Projects to Teach Research Skills Throughout the Sociology Curriculum

A core element of the sociology curriculum is the methods course, intended to teach students the value of systematic observation and analysis of the social world. However, this one-shot approach to teaching methodological skills is ineffective and not well liked by students or faculty. A more effective approach is the integration of active learning assignments and projects that teach and reinforce these skills throughout the curriculum, from the introductory course to the substantive content courses. This paper describes my experiences with this approach, outlining various activities and research projects used to teach methodological skills. Also highlighted are the outcomes reported by students and the benefits for teaching sociology courses. A discussion of the possibilities for disseminating and using the research beyond the classroom and the strengths and weaknesses of integrating research across the curriculum, as well as several teaching tips are also included.     

Teaching research methods to social work students in India and Australia: reflections and recommendations

This paper draws on the reflections of two social work educators who have, for many years taught research methods to undergraduate and postgraduate social work students in India and Australia. The intent is to suggest measures for enhancing the quality of social work research education. The reflections are embedded in a social justice and human rights framework, privileging the educators’ unique social and cultural contexts and their commitment to engage with indigenous knowledge. The authors recommend effective social work research education requires the educator to draw on a deep understanding of their own context, as well as globally accepted research traditions. Particularly, we encourage research teachers to adopt student-centred approaches that emphasise a broad ‘research mindedness’ (in their students and themselves), building students’ practical capacities and confidence to become effective, research informed practitioners; capable of contributing to their own communities and to the social work profession more broadly.     

Rethinking integration in mixed methods research using data from different eras: lessons from a project about teenage vocational behaviour

Mixed methods research requires integration of qualitative and quantitative data. However, there is debate about how to define integration and what is required for integration to occur. This paper describes a mixed methods research project which revisits datasets from different eras, which were originally instigated for different purposes and had different theoretical frameworks. Using selected results about the relationship between teenagers’ vocational aspirations and adult occupations we show how the research topic and question integrated the projects within a constructivist theoretical position. We argue that reanalysing and comparing historical datasets can provide new insights into a topic even with minimal integration of the data. We recommend a broad definition of integration and reflexive research practice to encourage innovation and diversity in mixed methods research, particularly with regard to reanalysis of datasets from different eras.     

Teaching mixed methods research: using a socio-ecological framework as a pedagogical approach for addressing the complexity of the field*

Mixed methods research is growing in acceptance and complexity, which translates into significant pedagogical challenges for teaching about mixed methods research. To address this challenge and to contribute to creating a pedagogical culture for teaching research methods, we developed a practically focused conceptual framework for describing the field of mixed methods research and used this framework to structure an Introduction to Mixed Methods Research course. Our socio-ecological framework describes the field of mixed methods within three nested and interacting levels: the mixed methods research process, content, and contexts. The course introduces students to each level and its components and considers how the framework accounts for different perspectives, issues, and debates found within the field. Course evaluations suggest that the new pedagogical approach helps students successfully understand and navigate the complexity and nuances of the mixed methods field, and develop foundational knowledge for designing and implementing a mixed methods study.     

A learning process within an education research group: an approach to learning qualitative research methods

This paper builds on the history of Esbrina, an established research group in Spain with almost 20 years’ experience and a deeply-rooted tradition of self-reflection and learning. We start by analysing the academic and social contexts in which the group was created and recognised. We make explicit team members’ backgrounds, dispositions and positionalities, to provide insight into the tensions aroused in deciding research topics, methodological approaches and research methods. Then we focus on two specific projects and explore the learning processes of those engaged in them: the first involves micro-ethnography, for which we examine our apprenticeship process through interviews, observation, inferential analysis and visual documentation. The second involves collaborative ethnography, for which we give an analytical account of how we created different ways of learning through collaborating and narrating. Throughout the paper, we reflect on our determination to create a methods-learning environment in which we constantly challenge our comfort zone by trying to do research on topics involving authentic learning. The most innovative aspect of the process is that senior and junior researchers, including group directors, play both the role of teachers and learners.     

Aligning theory and methodology in mixed methods research: Before Design Theoretical Placement

When a theoretical framework (and its components) is not clearly linked to research methods, researchers risk designing flawed studies, wherein the stated research question is inconsistent with the research design. Explicitly identifying one’s theoretical orientation can provide an orderly schematic for linking observations from separate investigations (i.e. qualitative, quantitative) thereby facilitating understandings and guiding research designs particularly in fields of social and health sciences where complex phenomena are an aspect of the subject of inquiry. Although this has been established, how researchers might position their research theoretically to guide mixed methods research is less clear. In this paper, we propose the Before Design Theoretical Placement as a general guide for specifying and locating studies in a broader theoretical grounding, and discuss how it may inform overall study considerations. We then use this approach to illustrate how theories and methods can work together to facilitate professional knowledge development from a relational perspective.     

Using video and dialogue to generate pedagogic knowledge: teachers,learners and researchers reflecting together on the pedagogy of social research methods

Developments in pedagogical knowledge in the teaching of social research methods have largely been generated through teachers reflecting on their practice. This paper presents an alternative approach to generating data through reflective dialogue between researchers, teachers and learners. The approach incorporates elements of video stimulated recall and reflective dialogue within focus group interviewing. The rationale and affordances are discussed in relation to the goals of discussing teachers’ pedagogical decision-making and learners’ experience of, and response to, various pedagogical practices. The context is a study of capacity-building short courses in advanced social science research methods, specifically courses on: multi-modal analysis, computer-assisted qualitative data analysis software, multi-level modelling, and systematic review. The paper examines the methodological challenges of capturing the everyday realities of methods classrooms for teachers and learners and the affordances of using dialogue on observed teaching sessions to gain further insight into each other’s thinking and action. It concludes with lessons learned about methodological and pedagogical processes and an argument about the value of bringing methods and standpoints together in creative dialogue.     

Formative research methods to understand patient and provider responses to heart attack symptoms

Formative research is often required for program planning, and for reducing uncertainty about generalizability of program effects. This article describes and justifies methods of formative research conducted for the REACT study (Rapid Early Action for Coronary Treatment), a multi-center collaborative randomized community trial aimed at reducing patient delay in seeking care for acute myocardial infarction (AMI). Formative research cast light on patient and community members’ decision-making process in seeking help for AMI, as well as barriers and facilitators of this process. Investigators at all five REACT Field Centers participated in the formative research. The process consisted of: (1) developing a common theoretical framework for the study intervention; (2) conducting a literature review and qualitative research to identify and address gaps in knowledge; and (3) developing a common protocol for the REACT study that accommodated the diversity of the target communities in terms of services, resources, history, and ethnicity. Analysis employed triangulation, defined as an explicit search for heterogeneous data sources to reduce uncertainty about forces at work and opportunities for intervention across settings and populations. Because the collection and interpretation of data went in stages, staff of several REACT Field Centers had independent input to the overall synthesis, then shared and revised the results. Advantages and limitations of this approach are discussed.     

Advancing towards inclusive social research: visual methods as opportunities for people with severe mental illness to participate in research

This article explores the possibilities offered by visual methods in the move towards inclusive research, reviewing some methodological implications of said research and reflecting on the potential of visual methods to meet these methodological requirements. A study into the impact of work on social inclusion and the social relationships of people suffering from severe mental illness (SMI) serves to illustrate the use of visual methods such as photo elicitation and graphic elicitation in the context of in-depth interviews with the aim of improving the aforementioned target group’s participation in research, participation understood as one of the basic elements of inclusive approaches. On the basis of this study, we reflect on the potential of visual methods to improve the inclusive approach to research and conclude that these methods are open and flexible in awarding participantsa voice, allowingpeople with SMI to express their needs, and therefore adding value to said approach.     

Using creative methods to research across difference. An introduction to the special issue

ABSTRACT

This special issue explores some of the methodological challenges that are brought into play when scholars deploy creative methods to research across difference. This introductory article defines what we mean by ‘creative methods’ and discusses some of the strengths and weaknesses of using this approach within social science research. It then outlines how creative methods can be used to research across difference, specifically, and introduces the seven articles that make up the special issue.     

Generalizing from social media data: a formal theory approach

ABSTRACT

Researchers increasingly draw on social media data to answer big questions about social patterns and dynamics. However, as with any data source, social media data present both opportunities and significant challenges. One major critique of social media data is that the data are not generalizable outside of the platforms from which the data originate. Problems of generalizability stem from non-universal participation rates on various platforms, demographically biased samples, as well as limited access to data based on infrastructural constraints and/or user privacy practices. We suggest that instead of empirical generalizability, social media data are theoretically generalizable in the formal theory tradition. Through a case example in which we use YouTube comments to test and extend a key tenet of identity theory, we show how social media data can instantiate theoretical variables and thus generalize to theoretical propositions. Mediated through formal theory, social media data maintain the capacity to address broad social questions while upholding methodological integrity.     

Denying the data: Learning from the accomplished sciences

Accomplished sciences are distinguished by an active orientation to data. Rather than explaining passive observations or even laboratory results, these sciences put a premium on creating effects or objects never before observed. Theories provide a basis for denying the data, in showing how nature can be better organized to produce some new effect or object. In this paper, a method for constructing these theories is developed. A sociological application is carried out to the point where an accomplishment is claimed. A very peculiar object is discovered — a relationship. Though it does not resemble anything we may have ever observed, it offers to groping actors a guide to something that works and hence could become something that is commonly observed. Likely scruples are addressed that might block the pursuit of such accomplishments.     

Effective assessment: a key knowledge and skill for a sustainable profession

Assessment is an essential element of social work practice. However, by trying to realize the so-called triple-mandate of social work, professionals and students on qualifying training sometimes struggle to consider simultaneously client and organizational aspects, and to embrace both outcome-orientation and process-orientation. Societal requirements focus on outcomes and standardized procedures whereas client’s needs require individualized and situationally appropriate consideration. The tensions are more acute with demands for rigorous professional decision making based on evidence, with increased attention to risks. Multiprofessional working has many benefits for clients, but places new demands on social work assessment. Current models are limited in embracing these tensions, and more integrated models are required. Established frameworks together with practice and teaching experience are applied in this paper to extend the traditional Taylor and Devine model to address these contemporary challenges. Elements of a new model (ALOHA) have been trialled on professionals as well as students on qualifying social work training. Such robust assessment models synthesized from theory, research, and best practice are essential to meet contemporary practice challenges, maintain public credibility, and sustain social work internationally.     

Using participatory and creative methods to facilitate emancipatory research with people facing multiple disadvantage: a role for health and care professionals

Participatory and creative research methods are a powerful tool for enabling active engagement in the research process of marginalised people. It can be particularly hard for people living with multiple disadvantage, such as disabled people from ethnic minority backgrounds, to access research projects that are relevant to their lived experience. This article argues that creative and participatory methods facilitate the co-researchers’ engagement in the research process, which thus becomes more empowering. Exploring the congruence of these methods with their professional ethos, health and care professionals can use their skills to develop them further. Both theory and practice examples are presented.     

Vignette development and administration: a framework for protecting research participants

This paper is a discussion regarding vignette development and administration as a means of protecting research participants in social research. Health and social care researchers investigate a plethora of issues that may be sensitive or upsetting, for example, abuse or bereavement. This exposes participants to potential emotional harm caused by revisiting the original trauma. Using research methods that offer a protective layer is important. Evidence suggests that vignettes provide protection for research participants by placing distance between their experience and that of the vignette character. However, there are few methodological papers regarding vignette use. Utilising examples from our own research, we engage in a critical discussion regarding vignette development and administration. The paper offers a new framework to support researchers – particularly those in health and social care – in the development and administration of vignettes. We contend that the framework supports best practice in vignette use, particularly when researching sensitive issues.     

Interface methods: renegotiating relations between digital social research,STS and sociology

This paper introduces a distinctive approach to methods development in digital social research called ‘interface methods’. We begin by discussing various methodological confluences between digital media, social studies of science and technology (STS) and sociology. Some authors have posited significant overlap between, on the one hand, sociological and STS concepts, and on the other hand, the ontologies of digital media. Others have emphasized the significant differences between prominent methods built into digital media and those of STS and sociology. This paper advocates a third approach, one that (a) highlights the dynamism and relative under‐determinacy of digital methods, and (b) affirms that multiple methodological traditions intersect in digital devices and research. We argue that these two circumstances enable a distinctive approach to methodology in digital social research – thinking methods as ‘interface methods’ – and the paper contextualizes this approach in two different ways. First, we show how the proliferation of online data tools or ‘digital analytics’ opens up distinctive opportunities for critical and creative engagement with methods development at the intersection of sociology, STS and digital research. Second, we discuss a digital research project in which we investigated a specific ‘interface method’, namely co‐occurrence analysis. In this digital pilot study we implemented this method in a critical and creative way to analyse and visualize ‘issue dynamics’ in the area of climate change on Twitter. We evaluate this project in the light of our principal objective, which was to test the possibilities for the modification of methods through experimental implementation and interfacing of various methodological traditions. To conclude, we discuss a major obstacle to the development of ‘interface methods’: digital media are marked by particular quantitative dynamics that seem adverse to some of the methodological commitments of sociology and STS. To address this, we argue in favour of a methodological approach in digital social research that affirms its maladjustment to the research methods that are prevalent in the medium.     

Case-based methods and agent-based modelling: bridging the divide to leverage their combined strengths

Two leading camps for studying social complexity are case-based methods (CBM) and agent-based modelling (ABM). Despite the potential epistemological links between ‘cases’ and ‘agents,’ neither camp has leveraged their combined strengths. A bridge can be built, however, by drawing on Abbott’s insight that ‘agents are cases doing things’, Byrne’s suggestion that ‘cases are complex systems with agency’, and by viewing CBM and ABM within the broader trend towards computational modelling of cases. To demonstrate the utility of this bridge, we describe how CBM can utilise ABM to identify case-based trends; explore the interactions and collective behaviour of cases; and study different scenarios. We also describe how ABM can utilise CBM to identify agent types; construct agent behaviour rules; and link these to outcomes to calibrate and validate model results. To further demonstrate the bridge, we review a public health study that made initial steps in combining CBM and ABM.