Application of logic models in a large scientific research program

It is the purpose of this article to discuss the development and application of a logic model in the context of a large scientific research program within the Commonwealth Scientific and Industrial Research Organisation (CSIRO). CSIRO is Australia's national science agency and is a publicly funded part of Australia's innovation system. It conducts mission-driven scientific research focussed on delivering results with relevance and impact for Australia, where impact is defined and measured in economic, environmental and social terms at the national level. The Australian Government has recently signalled an increasing emphasis on performance assessment and evaluation, which in the CSIRO context implies an increasing emphasis on ensuring and demonstrating the impact of its research programs. CSIRO continues to develop and improve its approaches to impact planning and evaluation, including conducting a trial of a program logic approach in the CSIRO Preventative Health National Research Flagship. During the trial, improvements were observed in clarity of the research goals and path to impact, as well as in alignment of science and support function activities with national challenge goals. Further benefits were observed in terms of communication of the goals and expected impact of CSIRO's research programs both within CSIRO and externally. The key lesson learned was that significant value was achieved through the process itself, as well as the outcome. Recommendations based on the CSIRO trial may be of interest to managers of scientific research considering developing similar logic models for their research projects. The CSIRO experience has shown that there are significant benefits to be gained, especially if the project participants have a major role in the process of developing the logic model.     

Speaking Out: Youth Led Research as a Methodology Used with Homeless Youth

Participatory action research is well documented with marginalized groups, but less is known about participatory action research with homeless youth. The use of youth led research as a methodology was examined among a population of homeless youth. Peer researchers (n = 10) reported on their experience utilizing youth led research methodology. Results indicate that youth led research is a promising methodology for use among homeless youth. Participants reported that the approach positively impacted the quality and quantity of data that could be collected from participants. Further, peer researchers reported individual benefits of feeling that participating in the project mattered, that people listened to them and that they had a voice.     

Lessons from a comparative study of user involvement

Abstract

Grounded in the context of the significant differences in service user involvement in social work education and research between the UK and Israel, a joint project between Anglia Ruskin University in the UK and Tel-Hai College in Israel was developed. Its aim was to develop a comparative research methodology to evaluate the outcomes of service user involvement in social work education. A main tenet of our research methodology consisted of partnering with a group of older people who used health and social care services as co-researchers from each country. This co-researching methodology together with the evaluation tools worked effectively in the two respective countries. The key findings highlight that while students in both countries valued the involvement of service users in their training, this occurred more so in Israel, where this is a very new development. Students in both countries developed rich concept maps illustrating the complexity of such an involvement. Yet, while the responses of both groups to vignettes describing user involvement scenarios reflected the positive impact of such an involvement, the UK students focused on the negative impact of potential risk more so than the Israeli students.     

Using Q-sort methodology as an educational tool in post-qualifying education whilst simultaneously gathering research data about views on parenting

Post-qualifying courses for social workers offer unique access to large numbers of practising social workers. Therefore, they present an opportunity to gather research data about current practice concerns. Asking students on post-qualifying courses to take part in research activity can also enable reflections upon the links between research and practice. However, ideally, any research activity should also contain an educational element so that students will directly gain from taking part. This paper describes a study in which Q-sort methodology was used as a method of both gathering data and as an educational tool. The study was an exploration of the links between views about both 'good enough' parenting and decision-making in child care and protection work. Subjects were students attending post-qualifying child protection courses. The methodology was successful both in gathering meaningful data and in stimulating lively debate about the issue. This paper will describe the study, briefly set out the research findings and discuss the advantages of the methodology as an educational tool.     

Pet ownership and homelessness: a scoping review

ABSTRACT

Between 5 and 25% of people experiencing homelessness have pets. Pet ownership can have a range of impacts in the lives of people experiencing homelessness, which may mitigate or further complicate the many adversities they face. However, there is a need to better understand the benefits and challenges associated with pet ownership to determine how this group can be best supported. Accordingly, a scoping review was conducted using PubMed, PsycINFO, and Google Scholar to address the question: What are the effects of pet ownership on people experiencing homelessness? All of the 18 reviewed studies used either qualitative or cross-sectional research designs. Three domains have been principally examined in relation to pet ownership and homelessness: (1) psychological health and purpose; (2) social support and connection; and (3) access to housing, employment, and service use. Physical health, violence, and crime were less frequently studied. Although the findings offer further support that there are both benefits and liabilities to pet ownership for people experiencing homelessness, there is a critical need for more rigorous research, including longitudinal and intervention studies. Recommendations for developing more pet-friendly services and using a strengths-based approach that considers animal companionship when working with people experiencing housing instability are also discussed.     

Reactions to Participating in Intimate Partner Violence and Minority Stress Research: A Mixed Methodological Study of Self-Identified Lesbian and Gay Emerging Adults

The purpose of this study was to examine lesbian and gay (LG) young adults’ reactions to participating in intimate partner violence (IPV) and minority stress research using a mixed methodological design. Participants were 277 U.S. college students currently involved in same-sex relationships and self-identified cisgender LG who completed an online questionnaire that included closed- and open-ended questions. Results suggested that IPV research was well tolerated by the vast majority of participants; close to one in 10 participants reported being upset by the study questions, yet 75% of upset individuals reported some level of personal benefit. Reasons for upset as identified in the open-ended responses included thinking about personal experiences with IPV, as the perpetrator or friend of a victim, as well as thinking about the uncertainty of their future with their current partner. The correlates of emotional reactions and personal benefits to research participation were also examined, and these varied among gay men and lesbian women. Implications of these findings underscore the importance of accurate reflection of risk and benefits in informed consent documents as well as systematic evaluation of sexual minority participants’ reactions to research participation in an effort to conduct ethically sound sexual science research.     

Spouses in mixed-orientation marriage: a 20-year review of empirical studies

Empirical studies on mixed-orientation marriage in social science journals from 1988 to 2008 were reviewed. Fifteen articles published in eight peer-reviewed journals were identified and discussed in terms of sampling, design, measures, rigor, theoretical framework, and literature review. An overview of each study is provided along with a summary of critical findings. Implications and recommendations for future research and education are offered.     

Involving Young Disabled People in the Research Process: The Experiences of the PIE Research Project Team

Young disabled people are still rarely involved in the research process, despite an increasing emphasis on their inclusion as participants. The Participation in Education (PIE) project examined how disabled children with little or no speech could be involved in their education. The project team worked with an existing group of young disabled people to develop ways in which they could take part in the research process. The group was involved in developing the methodology, group work, observation, commenting on findings and in the dissemination process. Their involvement undoubtedly enriched the research and the benefits of working with an established group were manifold.     

Family therapy for drug abuse: review and updates 2003-2010

Just 15 years ago, Liddle and Dakof (Journal of Marital and Family Therapy, 1995; 21, 511) concluded, based on the available evidence, that family therapy represented a "promising, but not definitive" approach for the treatment of drug problems among adolescents and adults. Seven years later, Rowe and Liddle (2003) review described considerable progress in this specialty with encouraging findings on adolescent-focused models based on rigorous methodology, as well as advances with adult-focused family-based treatments. The current review brings the field up to date with highlights from research conducted in the intervening 7 years, cross-cutting issues, recommendations for new research, and practice implications of these findings. Adolescent-focused family-based models that attend to the ecology of the teen and family show the most consistent and strongest findings in recent studies. Adult-focused models based on behavioral and systems theories of change also show strong effects with drug abusers and their families. The overarching conclusion is that family-based models are not only a viable treatment alternative for the treatment of drug abuse, but are now consistently recognized among the most effective approaches for treating both adults and adolescents with drug problems.     

Technology audit as a policy instrument to improve innovations and industrial competitiveness in countries in transition

Sustained economic growth in Central and Eastern European Countries depends, among other factors, on a radical technical restructuring. The instrument of technology audit supports policy makers in designing appropriate strategies for shaping science and technology policies in this process. The conceptual part of the article outlines the methodology for the analysis of strengths and weaknesses of R&D systems and future areas of competitiveness, which can be transferred also to other countries in periods of intense technological development. This approach is based on international best practice of evaluation research and practical experiences in the transition context. The empirical part outlines main findings of a technology audit in the field of biotechnology in Hungary.     

Toward a developmental family therapy: the clinical utility of research on adolescence

Tremendous advances have been made in our understanding of the intrapersonal, interpersonal, familial, and contextual characteristics and processes that contribute to adaptive as well as maladaptive developmental outcomes with high-risk and clinically referred adolescents. This empirical knowledge base offers clinically rich opportunities for systematic treatment development. An important step in this process is distinguishing which research findings in basic science areas such as developmental psychology and developmental psychopathology might have clinical relevance. Toward this goal, we review relevant but selective research in areas that are central to clinical work with adolescents (parent-adolescent relationship, biological aspects, and affect and cognition), and we offer examples of how basic research in these areas can inform treatment.     

“To get the word out”: LGBTQ+ Young adults’ motivations for participating in qualitative research studies

Understanding why socially marginalized individuals, such as lesbian, gay, bisexual, transgender and/or queer (LGBTQ+) people, participate in research can improve qualitative research designs, as well as social services and policies. In providing a participant-centered foundation, we interviewed 65 LGBTQ+ young adults and asked “Why are certain LGBTQ+ young adults motivated to engage in qualitative social science studies?” Many LGBTQ+ young people said they were committed to enacting social change and promoting advocacy. Participants also highlighted supporting scientific research and knowledge production. Finally, LGBTQ?+ participants engaged with research to introspectively analyze their identity development processes. These findings can facilitate access to socially vulnerable and underrepresented groups through a methodological focus on participant benefits.     

Developing a methodology to assess the impact of research grant funding: A mixed methods approach

This paper discusses the development of a mixed methods approach to analyse research funding. Research policy has taken on an increasingly prominent role in the broader political scene, where research is seen as a critical factor in maintaining and improving growth, welfare and international competitiveness. This has motivated growing emphasis on the impacts of science funding, and how funding can best be designed to promote socio-economic progress. Meeting these demands for impact assessment involves a number of complex issues that are difficult to fully address in a single study or in the design of a single methodology. However, they point to some general principles that can be explored in methodological design. We draw on a recent evaluation of the impacts of research grant funding, discussing both key issues in developing a methodology for the analysis and subsequent results. The case of research grant funding, involving a complex mix of direct and intermediate effects that contribute to the overall impact of funding on research performance, illustrates the value of a mixed methods approach to provide a more robust and complete analysis of policy impacts. Reflections on the strengths and weaknesses of the methodology are used to examine refinements for future work.     

Inclusive curricula in Spanish higher education? Students with disabilities speak out

This paper studies barriers and support affecting access, experience and performance as identified by students with disabilities at the University of Seville. Biographical-narrative research methodology is employed and the study is limited to an analysis of the design and development of subjects across the curriculum. Findings, which give voice to the students themselves, are organized in four topic areas: subject structure, methodology, tutorials, and assessment. The paper concludes with a review and discussion of key findings as well as suggestions for improvement and policy-making.     

Critical Thinking in Social Work Education: A Research Synthesis

In a meta-analytic review of critical thinking in social work education, findings revealed variability in research designs, methods, and subsequent findings. The 10 studies reviewed assessed different components of critical thinking and highlighted different potential moderator variables. Although there are significant limitations to all the studies analyzed in this review, findings suggest some practical significance and point to the need for future research to include more rigorous experimental research designs that include control groups and a comprehensive analysis of potential moderator variables that may include socioeconomic status, ethnicity, academic rank, and teaching methodology.     

Comment on Conflict Methodology: a Protagonist Position

In response to Lundman and McFarlane's assessment of what they understand to be conflict methodology, several points of exception and clarification are offered. Conflict methodology is neither a new data collection technology nor an abandonment of professional ethics by sociologists. It is an emerging movement away from the orthodoxy of consensus methodology by sociologists who recognize the ethical and epistemological weaknesses inherent in the dogmas of positivistic science. It proposes an evolutionary epistemology in opposition to the reductionism, operationalism, objectivism, and technocracy of consensus methodology Conflict methodology affirms the unity of science and the social discourse, the centrality of subjectivity in science, and the emancipatory interest in knowledge, while recognizing the threat to the scientific standing of sociology posed by institutional domination of social research.     

Teaching social research methods after the critical turn: challenges and benefits of a constructivist pedagogy

An increasing challenge for teaching methods courses in the social sciences is the ‘critical turn’, which has encouraged some students to adopt an anti-empirical orientation. We present a case study of a compulsory undergraduate methods course in a political science department strongly influenced by post-structuralist philosophies. The first author redesigned the course to implement four constructivist pedagogical principles: (1) develop a full understanding of students’ pre-existing perceptions of political science research methods; (2) encourage students to see methodology as an inevitably contested field; (3) provide space for students to choose a methodological approach that best aligns with their personal stance on knowledge; and (4) encourage students to view research as an ongoing ‘conversation’. We critically reflect on the implementation of these constructivist pedagogical strategies and argue they improve students’ critical engagement with course material, increase linkages between methods teaching and other disciplinary subject matter, and accommodate diverse student perspectives and needs.     

Estimating the costs of substance abuse: implications to the estimation of the costs and benefits of gambling

This presentation describes a recently developed set of guidelines for estimating the economic costs of substance abuse, summarizes the findings from a Canadian study that utilized these guidelines, and discusses the implications to the potential development of guidelines for estimating the costs and benefits of gambling. The guidelines for estimating the costs of substance abuse present a general framework of costs to be included and discuss methodological issues such as the definition of abuse; determination of causality; comparison of the demographic and human capital approaches; the treatment of private costs; the treatment of nonworkforce mortality and morbidity; the treatment of research, education, law enforcement costs, the estimation of avoidable costs and budgetary impact of substance abuse, and the significance of intangible costs. Utilizing these guidelines, a study was undertaken to estimate the economic costs of alcohol, tobacco, and illicit drugs to Canadian society in 1992. Based on this experience, it is argued that cost/benefit research should be conducted by multidisciplinary teams, that the real value of such work lies more in the detailed findings than in the bottom line results, and that focus should be placed on developing an ongoing process for developing consensus on how to conduct studies of the costs and benefits of gambling, rather than attempting to find a precise methodology that everyone agrees upon.