How to Construct a Mixed Methods Research Design

This article provides researchers with knowledge of how to design a high quality mixed methods research study. To design a mixed study, researchers must understand and carefully consider each of the dimensions of mixed methods design, and always keep an eye on the issue of validity. We explain the seven major design dimensions: purpose, theoretical drive, timing (simultaneity and dependency), point of integration, typological versus interactive design approaches, planned versus emergent design, and design complexity. There also are multiple secondary dimensions that need to be considered during the design process. We explain ten secondary dimensions of design to be considered for each research study. We also provide two case studies showing how the mixed designs were constructed.     

Developing a Common Language in Children's Services through Research‐based Inter‐disciplinary Training

Two sources of inertia to improving services for children in need are the difficulties of getting evidence into practice and the complications of inter‐agency working. Current training arrangements in social work and disparities between children's services professions as regards training requirements are contributory factors. The Common Language project is a work in progress, adopting a research‐based, inter‐disciplinary approach to working with social workers and other children's services professionals. It comprises core ideas and methods to complement the more specialist knowledge and skills required in each profession. Underpinned by a child development perspective and a scientific development cycle, it rests on a conceptual framework including need, threshold, service and outcome. The approach has three components (each of which includes training): (1) the implementation of practice tools; (2) the planning and development of integrated services; and (3) supporting materials, including practitioner‐orientated modules and a curriculum for PhD students. Distinguishing features include research utilisation, notably a focus on inculcating research‐mindedness as opposed to imparting findings, and also collaborative professional working, in particular via practical connections between different agencies, stakeholders and countries. The project is being evaluated in terms of uptake, change in professional thinking and practice and effects on child well‐being. Next steps for the project relate to broader lessons for social work training emerging from research and development elsewhere.     

Investigating the Effects of Pre‐school Provision: Using Mixed Methods in the EPPE Research

The Effective Provision of Pre‐school Education (EPPE) project is a longitudinal study of young children between the ages of 3 and 7 years. Research began in 1997 and both quantitative and qualitative methods were used to explore the effects of pre‐school education on children’s attainment and social/behavioural development at entry to school, and of any continuing effects on such outcomes at the end of Key Stage 1 (age 7). The sample included over 3,000 children and 141 pre‐school centres drawn from six different types of providers. In addition, a home sample of children who had not attended a pre‐school centre was included. In order to identify the processes that might influence centre effectiveness, observational data were collected and centre managers interviewed. In‐depth case studies of 12 more effective centres were used to explore and illuminate the processes, particularly in relation to pedagogy, associated with better child outcomes. A mixed method approach was adopted to simultaneously answer both confirmatory and exploratory questions, to support user engagement and provide triangulation. The paper argues that the mixed method approach supported the development of stronger research inferences.     

Editorial: Speaking in Tongues—Diversity in Mixed Methods Research

Pre‐testing is a standard tool to increase appropriateness and to capture the audience, yet rarely is this technique employed for population surveys. This study aimed to examine parental views on the content and methodology of a population child health survey. Forty‐eight Australian families of children aged 0–12 years were interviewed about the content and proposed data collection methods of the draft Victorian Population Survey of Child Health and Wellbeing. Concerns with instructions and items of several commonly used child health measures were identified. Parents preferred face‐to‐face methods rather than telephone interviews due to survey legitimacy; however, 72% of parents indicated that they would participate in a telephone survey. This study provided new findings about respondent views on child health measures and the conditions under which CATI versus face‐to‐face methods for child health data collection methods would be acceptable.     

Research Training and Professional Social Work Education: Developing Research‐Minded Practice

The movement towards developing practice more firmly grounded on empirical research has, arguably, been one of the most significant international trends in social work during the past decade. However, in the UK the implications of this trend for pedagogical practices and the design of educational programmes have still to be fully explored. This paper reports on the findings of a repeated cross‐sectional survey of MSW students in Queen's University Belfast which focused on their perceptions of the value of research training to professional practice. The study, conducted over a four year period, explored students' awareness of the relationship between research and practice and their readiness to engage with research training. The findings suggested that the majority of students perceived research training as a valuable component of professional development. However, the study also found a level of scepticism among students about its practical utility along with some resistance towards actively embracing a research agenda. The paper evaluates the significance of these findings for developing research and evidence‐based practice as integral components of the new degrees in social work in the UK and for social work education programmes in other countries aiming to develop research‐minded practice.     

Teaching Note—Developing a Professional Writing Course Using a Holistic View of Competence

ABSTRACT

Writing is a skill that spans many competencies. The Council on Social Work’s Educational Policy and Accreditation Standards promotes a holistic view of competence informed by knowledge, values, skills, and cognitive and affective processes. This teaching note contributes to the scholarship of teaching and learning by describing a professional writing course that uses a holistic pedagogical approach. We provide pragmatic strategies and assignments that can be readily adapted by other faculty and programs.     

Developing a Low‐Cost Technique for Parallel Cross‐Cultural Instrument Development: The Question Appraisal System (QAS‐04)

Many approaches are used to prepare instruments for multicultural administration, depending on the scope, schedule and budget of the study. Sequential questionnaire development, the most common approach to developing cross‐cultural instruments, is also the most affordable. Designers formulate and pretest an instrument in the source language, then translate it into the target language(s) using culture‐specific tailoring. In contrast, parallel development incorporates target cultures throughout the design and pretesting process. The disadvantages to parallel development are that it is expensive, time‐consuming and subject to version control problems. Question Appraisal System (QAS) is a coding tool for pretesting instruments. The QAS is supported by an item taxonomy of the cognitive demands of a question and documents the features that may lead to response error. Results of the appraisal are used to revise question wording, response wording, questionnaire format and question ordering. This article describes research conducted to update the QAS to identify problems due to cross‐cultural and cross‐linguistic application of questions.     

Teaching Note—Lessons Learned From Developing and Implementing a Dementia Caregiving Graduate-Level Service-Learning Course

ABSTRACT

This teaching note delineates seven lessons learned when designing and implementing a graduate-level dementia caregiving service-learning course. The course was designed during a 1-year faculty service-learning fellowship and implemented during the summer of 2015. The course used a person-in-environment framework to explain social work practice with family systems affected by dementia. It aimed to increase students’ knowledge about dementia and improve students’ attitudes toward working with people with dementia through respite visits with families affected by dementia. Three recommendations for future course offerings are described.     

Mixed Methods – Stand der Debatte und aktuelle Problemlagen

While mixed methods research is already much advanced and institutionalized in textbooks, handbooks and its own journal on an international level, the German-language debate on mixed methods lags behind. Thus, this introductory paper starts with outlining the history and key concepts of mixed methods designs as well as the current state of the international debate. Next, we explain the aims and concept of this special issue as well as the crucial arguments of the single papers in the overall context of the special issues. Namely, the debate in this special issue of the Kölner Zeitschrift für Soziologie und Sozialpsychologie circles around the following four topics: philosophical, methodological and methodical foundations of mixed methods research; mixed methods designs and mixed methods sampling; modes of combining data and issues of validity; and process-oriented analysis, longitudinal analysis and evaluation. Based on the observations that, firstly, both the international social science research community and social problems are globalizing and, secondly, that social research itself is changing, especially by the increasing relevance of social media and big data, the paper concludes with suggestions for future research.     

Research Note—A Pilot Cyber Counseling Course in a Graduate Social Work Program

Cyber counseling is a new and growing medium for offering mental health services to children and youth. However, there is a lack of identification of the core competencies required to provide effective online counseling. A school of social work, in partnership with a national service agency providing online counseling to children and youth, developed and offered a 13-week course to participating MSW social work students and agency staff. The development of online counseling competencies was assessed through individual interviews with participants and a content analysis of online posts. Participants scored well in areas of assessment and intervention. Challenges were identified in relationship building within an online environment.     

Reduction of Face‐to‐Face Contact Hours in Foundation Research Courses: Impact on Students' Knowledge Gained and Course Satisfaction

This study investigated the impact of reducing the number of face‐to‐face contact hours in a Masters of Science in Social Work (MSSW) foundation research course in an urban school of social work on students' knowledge gained and course satisfaction. A quasi‐experimental pretest/posttest comparison group design was used to test the following hypothesis: reducing the number of face‐to‐face contact hours will not negatively impact knowledge gain and course satisfaction in a foundation research course. The findings of this study suggest that reducing the number of face‐to‐face contact hours does not negatively affect student learning as both the comparison and the experimental group demonstrated an increase in foundation research knowledge. The level of course satisfaction was influenced by the number of hours completed in the program, age, and the number of hours worked in paid employment. Students who are especially vulnerable are younger students who have completed less course hours. They tend to struggle at the beginning to get used to new technology as part of their educational experience. This paper demonstrates that it is no longer ‘if’ web‐based and distance learning technologies are appropriate for social work education but rather ‘when’ and the degree to which their integration yields greatest educational value.     

Beyond Qualification: Experiences of Black Social Workers on a Post‐Qualifying Course

This article reports on the findings from a small‐scale qualitative study of the experiences of five black women studying on a Post‐Qualifying Child Care Award (PQCCA). The study considered the expectations of the women, their experiences of recruitment and selection, and support for the candidates from their agency and from the universities offering the programme. Also reported are the experiences of the course content, course completion and the specific experience of being a black candidate on the course. The article sets all this in the context of post‐qualifying education, current child care practice and the relevant literature. We make extensive use of the rich data provided by the five respondents in the study, and conclude with recommendations arising from the black women themselves and the researchers' reflections on their experiences.     

Disability Research by Disabled and Non‐Disabled People: Towards a Relational Methodology of Research Production

This paper explores some of the problems and opportunities that may derive from the development of working relationships between disabled and non‐disabled researchers. First a number of key barriers that face disabled researchers from the outset of research are sketched out. However, these barriers are not dwelt on as they have been documented and challenged well by others. Rather, in seeking to identify good research practice that can challenge such barriers, it is suggested that enabling modes of research production may often be uncovered through a careful examination of the working relationships between members of research teams. This approach is illustrated through a discussion of a range of relational issues that have impacted upon the authors’ own research partnership: (i) Relating in research: Tackling fears and issues around self‐disclosure; (ii)Psychoanalytic sensitivity: Privileging ontological experience and reflexivity; (iii) Towards a feminist ethics of care: Challenging methodological individualism; and (iv) Interdependence in research: towards enriched analysis. In terms of advancing an agenda for inclusive disability research, it is believed that making explicit the complexity of disabled/non‐disabled research relationships like this is one practical way in which general assumptions of a binary disabled/non‐disabled split may be challenged, whilst simultaneously recognizing that equitable working partnerships can only derive from the equal valuing of difference.     

Research Note—Multiple Time Point Course Evaluation and Student Learning Outcomes in an MSW Course

ABSTRACT

Evaluation methods play a key role in measuring student learning outcomes. Yet traditional assessments focus on assessing student satisfaction with instructors or courses rather than their progress toward competencies. In addition, the common pretest-posttest assessment is problematic because of response-shift bias. Although multiple time point assessment is suggested, very little is known about its application and potential in social work education. This research note examines how student self-assessments of their progress on core competencies in an MSW-level social work course change across three time points (pretest, posttest, retrospective test). The findings suggest that students underrated and overrated their competencies at the pretest. We argue that using multiple time point self-assessment addresses this internal validity threat and should be considered in social work course evaluation.     

Teaching Note—Integrating Theory and Research Methods in a First-Year Doctoral Sequence or Program

This teaching note describes an innovative process in which faculty members worked collaboratively to create an integrated three-course sequence of requisite course content in a PhD program, developed complementary assignments, and coordinated a classroom experience that led to the creation of an individualized area statement and eventual integrated literature review. Lessons learned from this experience are discussed.     

Teaching Note—Developing an Online Blended Learning Course on Psychiatric Diagnosis

ABSTRACT

It has been suggested that the task of teaching and learning social work practice in an online environment can greatly be facilitated if thoughtful attention is paid to course design. This article details the design of a blended-learning online course to teach MSW students the process of psychiatric diagnosis. First, the development of the course philosophy is discussed. Second, the choice of the VARK (visual, aural, read/write, kinesthetic) learning model is explained. Finally, the design of the course consistent with the philosophy and learning model is presented.     

“I Feel Like More of a Man”: A Mixed Methods Study of Masculinity,Sexual Performance,and Circumcision for HIV Prevention

Ethnographic studies from numerous societies have documented the central role of male circumcision in conferring masculinity and preparing boys for adult male sexuality. Despite this link between masculinity, sexuality, and circumcision, there has been little research on these dynamics among men who have been circumcised for HIV prevention. We employed a mixed methods approach with data collected from recently circumcised men in the Dominican Republic (DR) to explore this link. We analyzed survey data collected six to 12 months post-circumcision (N = 293) as well as in-depth interviews conducted with a subsample of those men (n = 30). We found that 42% of men felt more masculine post-circumcision. In multivariate analysis, feeling more masculine was associated with greater concern about being perceived as masculine (OR = 1.70, 95% CI: 1.25–2.32), feeling more potent erections post-circumcision (OR = 2.25, 95% CI: 1.26–4.03), and reporting increased ability to satisfy their partners post-circumcision (OR = 2.30, 95% CI: 1.11–4.77). In qualitative interviews, these factors were all related to masculine norms of sexually satisfying one’s partner, and men’s experiences of circumcision were shaped by social norms of masculinity. This study highlights that circumcision is not simply a biomedical intervention and that circumcision programs need to incorporate considerations of masculine norms and male sexuality into their programming.