Context matters: Using mixed methods timelines to provide an accessible and integrated visual for complex program evaluation data

The need for conducting evaluations which reflect of the influence of context on complex programs is increasingly recognized in the field of evaluation. Better data visualization techniques for connecting context with program evaluation data are needed. We share our experience developing a mixed methods timeline to visualize complexity and context with evaluation data. Mixed methods timelines provide a meaningful way to show change over time in both a visually stimulating and accessible format for evaluation audiences. This paper provides an innovative example of using mixed methods timelines to integrate evaluation data with key program activities and milestones, while also showing internal and external contextual influences in one cohesive visual. We present methods and best practices for collecting contextual data and for incorporating a variety of data sources into such a visual. We discuss several strategies to collect and organize context related data including: qualitative interviews, program materials, narrative reports, and member checking with stakeholders and staff. Gathering multiple perspectives is essential to better capture the multi-layered elements of program activities and context.     

The utility of positioning theory to the study of ageing: Examples from research with childless older people

Growing older is hard to make sense of. Opposing perspectives are presented on everything from individual to population ageing, and there is widespread ambivalence towards many aspects of ageing. Positioning theory is a research approach that can tolerate such ambiguity and provides a clear, useful framework to make sense of research data, while doing justice to its complexity. It is starting to be used in gerontology; the aim of this paper is to give gerontologists the tools and impetus to use it more. The positioning triad is outlined, comprising positions (how we position ourselves and others within a single conversation or across a lifetime), storylines (the individual and social narratives which furnish those positions), and the speech acts (and acts of research) through which storylines and positions are enacted. In addition, considering the rights and duties associated with different positions and storylines can usefully illuminate some of the tensions around competing positions on ageing. Worked examples from a qualitative study on childless older people (38 participants aged 63 to 93) in terms of their positioning of childlessness, views on residential care, and positioning of emotional support show how the complexity of such diverse topics can be usefully studied using a positioning theory framework.     

“I'm in this world for a reason”: Resilience and recovery among American Indian and Alaska Native two-spirit women

ABSTRACT

American Indian and Alaska Native sexual minority (two-spirit) women are vulnerable to substance misuse and mental health challenges due to multiple minority oppressed status and exposure to stress and trauma. Yet, these women find pathways toward healing and wellness. We conducted a qualitative data analysis of interviews derived from a national health study and gained an understanding of 11 two-spirit women's resilience and recovery patterns. Emergent from the data, a braided resiliency framework was developed which elucidates multilayered abilities, processes, and resources involved in their resiliency. We recommend that resilience-promoting strategies be incorporated into substance misuse and mental health interventions.     

Nursing-Home Resident Quality of Life: A Longitudinal Case Study Approach

Longitudinal quality-of-life (QOL) research incorporating multiple perspectives can add to knowledge about how nursing home residents experience QOL, but these methods are seldom used. This study employed interviews and participant observation to conduct multiple-perspective, longitudinal case studies of six residents. Close, reciprocal relationships with staff members, staff knowledge of residents, and autonomy were fundamental to QOL. Autonomy was experienced through choice and self-advocacy. Changes in QOL over time related to changes in resident health status, acclimation to the setting and family member availability. Study results may have implications for staffing and staff training.     

Exploring relational engagement practices in stroke rehabilitation using the Voice Centred Relational Approach

While discussions on patient engagement commonly focus on patient behaviors, a small body of research highlights the patient-practitioner relationship as critical in engagement. Understanding this relationship might be facilitated through a relationally-oriented methodology. The Voice Centred Relational Approach is one such qualitative methodology. Within this paper, we present one turn in a long conversation about this methodology. Drawing on our longitudinal observational study of engagement practices in stroke rehabilitation in New Zealand, we explicate how a theoretical framework can inform how the Voice Centred Relational Approach is enacted in the research process, from entering the field to dissemination. We detail how we adapted the associated analytic techniques (the Listening Guide and i-poems) for use with multiple forms and sources of data. We propose that the underlying relational ontology and relational orientation of this methodology makes it a useful approach in researching relational practice in healthcare.     

With a focus on well-being and capabilities

Most of the applied research on capabilities and well-being makes use of quantitative data and research techniques. This paper examines the possibilities of qualitative data gathering to explore the theoretical richness (and complexity) of the capabilities framework. With this objective, the capabilities theory is translated into a framework that enables focus group discussions on well-being. It turns out to be surprisingly easy to discus issues related to the theory of capabilities, as the concepts are recognizable for the focus participants.Being able to choose and making trade offs is related to the concepts of well-being of the participants. Provided one has ‘the basic capability to cope with capabilities’, possibilities and choices increases well-being. These findings show that the capability framework can be fruitfully used for applied research on well-being and that qualitative data gathering creates opportunities that are complementary to quantitative techniques.     

Children's Emotional Responses to a Paediatric Hospital Atrium

This paper illuminates children's emotional responses to an atrium in a contemporary Canadian paediatric hospital. It draws on a focused analysis of data elicited in a qualitative study that explored patients' perspectives on the design and architecture of the atrium. Children were involved in all phases of the project either as consultants on the research methods or participating in interviews and taking photographs of the space. The atrium consists of a main lobby with a high windowed ceiling, brightly coloured elevators with exposed mechanisms, information desks, a large fountain and food venues. Children expressed a range of emotions associated with the space. The findings demonstrate children's ability to identify multi‐faceted issues related to hospital design and affirm their rights to participate in decisions regarding spaces that purportedly are designed for them.     

Mixed-methods library evaluation integrating the patron,library, and external perspectives: The case of Namibia regional libraries

The article presents a mixed-methods evaluation of regional libraries in Namibia, which incorporates three perspectives: the patron perspective (library users), the library perspective (library staff, management, and related officials), and the external perspective (including evaluators and monitoring data). Seven data collection methods were used: patron surveys, patron panel studies, focus group discussions, key informant and staff interviews, secondary data analysis, media analysis, and observations. The goal of the evaluation was to assess library performance for both formative and summative purposes by addressing evaluation questions on areas such as library services, use, and operations. Building upon the literature review of how mixed-methods approaches can contribute to library evaluation, the aim of this article is to show how a mixed-methods evaluation can be designed to examine multi-faceted library performance and to illustrate how the evaluation design allows information complementarity and can be utilized to present diverse viewpoints of the above three perspectives. The evaluation design, analysis process, and lessons learned from this study may be useful to evaluators engaged in evaluation of public services or programs (including public libraries) that examine multiple aspects of service performance and involve a variety of stakeholders.     

Hindsight,foresight and insight: The challenges of longitudinal qualitative research

This paper describes a UK based longitudinal qualitative study following approximately 100 young people over 9 years. It provides an overview of the research design, methods of data collection and analysis as well as reflecting on the strengths and weaknesses of the strategies employed. We focus on the value of a devolved research design, complementary cross-section and temporal analytic approaches and the effects of being involved in a longitudinal study on researchers and participants. The paper aims to contribute to a growing understanding of the practical, ethical and epistemological challenges presented by longitudinal qualitative methods, and highlights those challenges that are specific to this method as well as those which are amplified by this kind of approach.     

‘It's a magnifying glass for your relationship’: a thematic analysis of motivations,benefits, and challenges in consensually non-monogamous relationships

The last decade has seen an increase in public and academic interest in consensual non-monogamy (CNM). CNM involves sexual and/or romantic relationships between multiple partners, with the consent of all individuals involved. Engagement in CNM is estimated at 5% of the general population, although due to stigma with the strong idealisation of monogamy in many cultures, it is a hidden population. This qualitative study explores the motivations, benefits, and challenges experienced in CNM relationships, an area that has been understudied despite the resurgence of interest in it. While previous research has mainly focused on comparisons between CNM and monogamy or individual types of CNM such as polyamory, this study seeks to provide a broader understanding of CNM relationships. We employ a critical realist framework and thematically analyse semi-structured interviews with eight participants. The results identify three overarching themes: mononormativity and cultural norms; growth and responsibility; and diversity and complexity; each has several subthemes. These findings suggest that CNM provides opportunities for greater diversification of needs and increased community and individual growth. The study also highlights the challenges experienced in CNM relationships and the strategies used to manage them, such as personal responsibility for managing difficult emotions and temporarily closing a relationship at times for relationship security. A novel finding in this study is that some individuals involved in CNM have internalised cultural norms and the idealisation of monogamy and need to unlearn these norms. This study adds to the existing knowledge on CNM and is expected to be of interest to clinicians and researchers seeking to understand its motivations, benefits, and challenges. Relationship therapists will benefit from increased knowledge of how to work with clients interested or engaged in CNM relationships. Overall, this study supports previous findings that CNM is a viable, enjoyable, yet sometimes challenging type of relationship.     

Industry Perceptions of University-Industry Relationships Related to Agricultural Biotechnology Research*

Abstract Following a rise in university-industry relationships (UIRs), scholars began questioning the efficacy of those relationships, as well as whether industry and university research interests and integrity are being compromised. Although many of these studies focus on the university, few examine the perspectives of industry participants. We conducted intensive interviews with 63 managers and scientists at agricultural biotechnology companies involved in UIRs related to agricultural biotechnology. Our analysis of their comments reveals nuanced critical perspectives of UIRs and creative ideas for reforming policies and practices. Industry representatives listed many advantages of UIRs, but some also expressed an interest in reforming policies to preserve a public-interest emphasis for university research. We conclude by considering the structural relationships that may explain the industry representatives' critical evaluations and by identifying policy implications.     

Longitudinal qualitative studies and the reflexive self

This paper reviews the utility of the framework offered by Giddens' 1991 work Modernity and Self Identity: Self and Society in a Late Modern Age , for the analysis of longitudinal qualitative studies. Working from two different longitudinal qualitative data sets, the authors explore the extent to which the notion of the 'reflexive project of self' and associated concepts might be operationalized to assist with the analysis and interpretation of empirical data. We first explore the notion of 'fateful moments' in a longitudinal qualitative interview-based study of young people's biographies. We then explore the importance of mechanisms of 'shame' as accompaniment to dramatic life transition, using data taken from a 3-year study of female sex workers in New Zealand. The paper concludes by arguing that although Giddens' work provides us with an interesting starting point and some useful operational tools, in practice the data outgrow the theory.     

Holocaust child survivors and child sexual abuse

This study utilized a qualitative analysis of child survivors of the Holocaust who were sexually abused during World War II. The research study aimed to give this specific group of survivors a voice and to explore the impact of multiple extreme traumas, the Holocaust and childhood sexual abuse, on the survivors. Twenty-two child survivors of the Holocaust who were sexually abused during the war completed open-ended interviews. The data was qualitatively analyzed according to Tutty, Rothery, and Grinnell's (1996) guidelines. Three major themes were found: issues relating to the sexual abuse trauma, survivors' perceptions of the abuse, and survivors' general perspectives towards life. The identity of the offenders, Jewish or non-Jewish, determined the survivors' feelings towards themselves, the perpetrators, and about the worth of life.     

Hispanic Women Managers and Professionals: Reflections on Life and Work

Much of the research on professional and managerial women actually describes the experiences of White women, excluding those of other racial and ethnic backgrounds. This exploratory qualitative study focuses on the life and work experiences of Hispanic women in managerial and professional positions and how those experiences influence their career possibilities. Data from individual interviews of first‐, second‐ and third‐generation Hispanic women in the USA are used to illustrate a framework of career possibilities that reflects both cultural and personal perspectives. Implications for further study are addressed.     

Researching an-'other' minority ethnic community: Reflections of a black female researcher on the intersections of race,gender and other power positions on the research process

There is a dearth of discussion on the methodological dilemmas faced by minority ethnic researchers who research minority ethnic communities of which they are not a part. The paper explores the political and ethical issues involved in a black woman researching South Asian women's lives, analysing the research process, and focusing on issues of choice of research group, access and placing. This paper represents a reflexive account of the research relationships developed in longitudinal qualitative doctoral research between a black (of African descent) postgraduate student and sample of 19 South Asian female student teachers in England and draws on literature of women interviewing women and ethnic or 'race' matched research. The methods employed were documentary analysis, observing meetings, a focus group, two student questionnaires, one-to-one interviews with staff and group and one-to-one interviews with South Asian female student teachers. It is argued that whilst social characteristics such as gender, language, religion and culture are important in determining notions of commonality and difference, a shared experience of racism between the researched and the researcher may affect the research relationship most significantly.     

Reasoning With Case Studies: Issues Of An Aging Workforce

Case studies are an ideal research approach to generate in-depth and contextualized data. Many specific data collection approaches can be incorporated to gather data through a case study, but the information so gathered is interpreted in terms of a single case. When a set of case studies is conducted on a particular research theme, the question arises as to what kinds of inferences can be made with a small number of cases. Problems of inference are increased when the cases have been selected opportunistically or haphazardly and when the universe of all potential cases cannot readily be defined. Charles Ragin has distinguished between the logic of multivariate analysis and the logic of comparative case analysis. Drawing on this distinction, this article will describe the ways in which inferences can be drawn, and the nature of such inferences, from a multiple case study approach. Reasoning from multiple case studies is an inductive process that uses comparisons to generate hypotheses and to provide limited tests through the principle of falsification. This approach was used in developing a synthesizing report based on seven large case studies from the project, “Issues of an Aging Workforce.” Five Canadian and two American case studies were conducted in corporate settings in different economic sectors. The case studies used qualitative methods (focus groups and key informant interviews) and survey data from employees and managers. Thus, the logic of multivariate analysis was used, along with inductive reasoning with qualitative data, within cases, and a logic of comparative case analysis when seeking to make and test generalizations based on the set of seven cases.     

Holocaust Child Survivors and Child Sexual Abuse

ABSTRACT

This study utilized a qualitative analysis of child survivors of the Holocaust who were sexually abused during World War II. The research study aimed to give this specific group of survivors a voice and to explore the impact of multiple extreme traumas, the Holocaust and childhood sexual abuse, on the survivors. Twenty-two child survivors of the Holocaust who were sexually abused during the war completed open-ended interviews. The data was qualitatively analyzed according to Tutty, Rothery, and Grinnell's (1996) guidelines. Three major themes were found: issues relating to the sexual abuse trauma, survivors' perceptions of the abuse, and survivors' general perspectives towards life. The identity of the offenders, Jewish or non-Jewish, determined the survivors' feelings towards themselves, the perpetrators, and about the worth of life.     

Quantifizierung

The challenge in data analysis often lies in taking account of the multi-dimensionality and complexity of the data and at the same time discovering patterns, which requires reduction and simplification. Quantitizing qualitative data can serve as an additional step during data analysis to broaden the perspective and collect complementary views. Examples from research illustrate how information gathered during one data collection can generate different types of data or how qualitative data can be transformed to be analysed statistically. Practicalities of integrating qualitative and quantitative analyses are illustrated to offer good-practice examples for transformation designs (QUAL → QUAN). With the methodological reflection of research practice I evaluate consequences for the field of mixed methods research, in which the statistical analysis of codes created during an interpretive phase plays a minor role.     

Community-Based Participatory Research (CBPR) needs assessment of parenting support programs for fathers

This study reports the results of a Community-Based Participatory Research (CBPR) needs assessment of programs, services, and support systems for fathers in the City of Detroit, Michigan. The goal of this needs assessment was to assess the availability of parenting support services to men through multiple perspectives. To enact a CBPR approach, the research team collected qualitative data through interviews with service providers and community dialogues with fathers and consulted a community advisory board for further guidance on the research efforts. The research team engaged in member checking to improve the accuracy and credibility of study findings. Results indicated that both service providers and fathers agreed that very few parenting support services are available to fathers, particularly young African American fathers, and they also largely agreed in establishing priorities to address community fathers' parenting needs. Practice implications include the need for greater collaboration across service sectors and for greater outreach, possibly through technology, to young fathers.