New pathways in the evaluation of programmes for men who perpetrate violence against their female partners

Today, evaluation research in the field of intervention programmes for men who perpetrate violence against their female partners still makes a fragmentary impression. Across Europe various evaluation studies have been performed. However, the methodologies applied are too heterogeneous to allow the combination of the results in a meta-analytical way. In this paper we propose a future pathway for organising outcome evaluation studies of domestic violence perpetrator programmes in community settings, so that today’s problems in this field can be overcome. In a pragmatic framework that acknowledges the limited pre-conditions for evaluation studies in the area of domestic violence perpetrator programmes as it is today, feasible approaches for outcome evaluation are outlined, with recent developments in the field taken as starting points. The framework for organising future evaluation studies of work with perpetrators of domestic violence is presented together with a strategy to promote this framework. International networks of practitioners and researchers play a central role in this strategy through upskilling the area of practical work, preparing the ground for evaluation research and improving cooperation between practitioners and researchers. This paper is based on the results of the European funded project IMPACT (under the Daphne-III-funding programme of the European Commission).     

Treatment of Adult Sexual Offenders: A Therapeutic Cognitive-Behavioural Model of Intervention

SUMMARY

Recent research indicates that, of the various forms of treatment available to sexual offenders, cognitive-behavioural methods are likely to have the greatest impact in reducing rates of sexual re-offending. Cognitive-behavioural treatment typically targets attitudes that support sexual offending, anger management, victim empathy, deviant sexual arousal, and relapse prevention. More recently, treatment has targeted cognitive processes more generally, management of other emotional states in addition to anger, intimacy deficits, and risk self-management (Marshall, Anderson, & Fernandez, 1999; Yates, Goguen, Nicholaichuk, Williams, & Long, 2000). This article describes the components of cognitive-behavioural treatment with sexual offenders, including recent developments, assessment, treatment methods, and the importance of therapist characteristics on the therapeutic process and on treatment outcome.     

Treatment of adult sexual offenders: a therapeutic cognitive-behavioural model of intervention

Recent research indicates that, of the various forms of treatment available to sexual offenders, cognitive-behavioural methods are likely to have the greatest impact in reducing rates of sexual re-offending. Cognitive-behavioural treatment typically targets attitudes that support sexual offending, anger management, victim empathy, deviant sexual arousal, and relapse prevention. More recently, treatment has targeted cognitive processes more generally, management of other emotional states in addition to anger, intimacy deficits, and risk self-management (Marshall, Anderson, & Fernandez, 1999; Yates, Goguen, Nicholaichuk, Williams, & Long, 2000). This article describes the components of cognitive-behavioural treatment with sexual offenders, including recent developments, assessment, treatment methods, and the importance of therapist characteristics on the therapeutic process and on treatment outcome.     

Learning for the Twenty-First Century: Maximising Learning Transfer from Learning and Development Activity

This article builds on the learning gathered from the evaluation of a Scotland-wide child protection training programme. Based on Kirkpatrick's four-level framework, the study aimed to evaluate the impact of the learning programme on the practice of participants in the workplace. The study prompted the authors to examine the literature on maximising learning transfer across a range of occupations. This literature is discussed in the light of the findings from the evaluation and the experience of the authors in designing and implementing continuous professional development programmes in social services.

The practice of inspection, monitoring and audit seems to have impacted negatively on staff's willingness to participate in data collection, and coupled with what appeared to be confusion about data protection legislation, the perceived burden of audit and inspection has significant implications for research and evaluation activity.

Suggestions are made for the future design, delivery and evaluation of learning and development activity, and the role of managers is explored in relation to their responsibility for preparation, support and follow-up of workplace learning.     

Some things in life can’t be ‘Googled:’ A narrative synthesis of three key questions in outdoor education.

In countries worldwide, Outdoor Education (OE) offers rich possibilities for learning. OE has been researched for many decades; however the field lacks an integrating framework for its different historical, geographical and disciplinary conceptualisations. The outcomes of OE programmes are well documented and appear diverse, yet also have common attributes suggesting there is scope for unifying approaches. Although substantive barriers to the conduct of OE programmes have been identified, these have seldom been synthesised. This paper offers a narrative review of the literature addressing three key questions designed to look rearward at where OE has come from: (i) how is OE conceptualised, and what theoretical models have been used in OE? (ii) what evidence exists regarding the effectiveness of OE programmes? (iii) what are the barriers to conducting OE programmes? The paper then advances onward with an integrated framework for reconceptualising OE and providing insights into how the field may be strengthened and augmented.20124     

Description and pre-post evaluation of a telephone and Internet based treatment programme for pathological gambling in Norway: a pilot study

Although the effectiveness of treatments for pathological gamblers is gaining support, only 10% of pathological gamblers seek treatment. Providing treatment via the Internet may lower the thresholds for treatment seeking. A new telephone and Internet based treatment programme for pathological gamblers is presented in this article, along with a pre-post evaluation of the programme. The participants (N = 112) were problem gamblers who were either self-referred or referred by their general practitioner. Data from post-treatment and 3-month follow-up are evaluated. The results suggest that using Internet and telephone-assisted treatment interventions can significantly reduce symptoms of pathological gambling (measured by the South Oaks Gambling Screen – Revised). The intervention was also associated with improvement on cognitive distortions, measured by the Gamblers Belief Questionnaire, and general psychological distress and psychopathology as measured by the Symptom Checklist-90-Revised. Although Internet-based treatment programmes have been suggested to have advantages compared to traditional face-to-face therapy, research in this area is scarce. This pilot study contributes to the growing literature in this area, and provides tentative support for the effectiveness of Internet based treatment interventions for pathological gamblers.     

Treatment of Female Pathological Gambling: The Efficacy of a Cognitive-Behavioural Approach

Given that a substantial proportion of current pathological gamblers are female, it is evident that women are underrepresented in the treatment outcome literature. The current study was designed to redress the limited information on the treatment of female pathological gambling. Although the use of cognitive-behavioural therapy is the most highly recommended approach as ‘best practice’ for the treatment of pathological gambling, no attempt to date has been made to evaluate the efficacy of this approach for female pathological gambling. Nineteen female pathological gamblers with electronic gaming machine problems were treated with a cognitive-behavioural program. While pathological gamblers placed on a waiting list did not show significant improvement on gambling behaviour and psychological functioning measures, the female pathological gamblers showed significant improvement on these measures over the treatment period, and maintained this improvement at the 6-month follow-up evaluation. By the completion of the follow-up period, 89% of participants no longer met diagnostic criteria for pathological gambling. Although further scientific demonstration and replication are required, the outcomes of this study indicate that the therapy that is considered ‘best practice’ in the treatment of pathological gambling is effective for female pathological gambling.     

Kein Kartell, kein Monopol, keine Oligarchie?

In the framework of the excellence programme designed to promote science and research at German universities, a debate broke out as to whether the programme would strengthen existing tendencies toward structures of cartel, monopoly and oligarchy. A most recent study wants to prove that such structures do not show up in the German Research Foundation’s programme of funding individual research projects. This finding is, however, not appropriate to give the all-clear. Among crucial factors supporting structures of cartel, monopoly and oligarchy, the shift from block grants to individual grants based on competition can be identified, just as the shift from funding of single research projects to funding large-scale coordinated programmes and funding institutions, most recently along with the excellence programme. It is exactly these crucial factors that have been excluded completely from the study. Hence, it slips into the tracks of a science of affirmation. This aberration can be explained by the entanglement of interests in research, research funding and research evaluation, which works against free research and is an epistemological barrier to science research.     

The effect of compliance-improving interventions on the cognitive-behavioural treatment of pathological gambling

This exploratory study investigated the effect of interventions designed to improve compliance and reduce dropout rates during the outpatient treatment of pathological gambling at a University-based gambling treatment clinic. Forty subjects (29 males, 11 females, mean age = 37.6) meeting DSM-IV criteria (APA, 1994) for pathological gambling were randomly assigned to either a cognitive-behavioural treatment or a cognitive-behavioural treatment combined with interventions designed to improve treatment compliance. Compliance was indicated by the completion of all treatment sessions. Outcome measures were DSM-IV criteria assessed by structured clinical interview, South Oaks Gambling Screen scores, and percentage of income gambled. Logistic regression analyses identified pretreatment characteristics predicting compliance and outcome. Compliance-improving interventions significantly reduced dropout rates, resulting in superior outcomes at posttreatment compared to the cognitive behavioural treatment alone. At 9-month follow-up, there was no difference in outcome between treatments, although both produced clinically significant change. Comorbid problem drinking, drug use, and problem gambling duration predicted poor compliance. Poor outcome was predicted by comorbid problem drinking. The clinical implications of these results are discussed in light of the exploratory nature of the study and the need for future research to address compliance, outcome, and comorbidity issues.     

Exploring the Potential of Shadow Controls in the Evaluation of Children’s Services

This article describes and presents a framework for an under‐used evaluation technique in the context of an evaluation of a programme for disaffected young people. Shadow controls—the use of expert judgement to estimate the success of a programme—are often dismissed in research design as an unreliable form of comparison, but can be useful in situations where there is limited scope for a control group or to enhance the causal inference attributable to non‐experimental evaluations. The exercise described uses a practice tool as a structure for making predictions about the situations of the young people on the programme, assuming they do not receive an intervention. These predictions (shadow controls) are then compared to outcome data for the young people at the end of the programme. The results of the exercise provide some important messages about the programme’s effectiveness and the potential for strengthening non‐experimental evaluation methods. The article also discusses how the method can usefully inform evaluations of social programmes and encourage agency and user collaboration.     

“They wouldn't get away with it at McDonalds”: Decriminalization,work, and disciplinary power in New Zealand brothels

New Zealand decriminalized sex work in 2004 with the passage of the Prostitution Reform Act (2003), which sets an explicit intention to prevent exploitation of sex workers and improve their welfare. This has demonstrably improved conditions for sex workers and provides a necessary context for addressing exploitation. However, little research has looked at how this works for brothel-based sex workers in New Zealand. This paper responds to that gap by examining how brothel operators in New Zealand exercise power and control and how sex workers experience that. The study draws on in-depth interviews conducted across New Zealand with 33 participants. These include staff from the New Zealand Sex Workers' Collective (2), brothel-based sex workers (18), operators (8), and sex worker/operators (5). We use a Foucauldian framework and Foucauldian Discourse Analysis to examine how disciplinary power informs brothel management, prompting the production of normative discourses of work that destabilize sex workers' safety at work. We conclude that decriminalization nevertheless provides an essential framework by which sex workers are able to resist disciplinary control (W/C 171).     

How do public investments in gender equality initiatives and publication patterns interrelate? The case of Germany

This article examines whether two of the major German flagship programmes to increase the participation of female researchers in the German science system, the "Women Professorship Programme" and the "Pact for Research and Innovation", have actually increased the number of women, especially in leadership positions. In a second step, we analyse whether such an assumed increase influences the publication patterns of authors with German affiliation. This article is based on literature and desk research as well as bibliometric analysis using Scopus. The most important result is that the number of women in research has indeed increased significantly in recent years and that, accordingly, more women are the (co)authors of scientific publications. In particular, it can be seen that quality indicators such as citations and excellence rates are high for female authors. This enables us to show that more women in the science system not only bring about a "gain in justice", but also a concrete scientific benefit.     

Sex Education Programmes for Students with Severe Learning Difficulties in Further Education and the Problem of Evaluation

This paper is based on a qualitative study of the evaluation of sex education programmes for young people with severe learning difficulties. In an area so fraught with dilemmas and controversies, any such research will be problematic and tentative. The approach to evaluation described here is one which attempts to realise the right of people with learning difficulties to make informed choices. The course aims both to provide students with information which has traditionally been denied to them and to promote greater self-confidence. The evaluation methodology which has been developed embodies principles which seek to empower young people with learning difficulties. The questions which arise reach not only into the lives, feelings and values of individuals, but also confront the oppression of people with learning difficulties in our society.     

A framework for evaluating eHealth research

Health care is in the midst of a consumer-oriented technology explosion. Individuals of all ages and backgrounds have discovered eHealth. But the challenges of implementing and evaluating eHealth are just beginning to surface, and, as technology changes, new challenges emerge. Evaluation is critical to the future of eHealth. This article addresses four dimensions of eHealth evaluation: (1) design and methodology issues; (2) challenges related to the technology itself; (3) environmental issues that are not specific to eHealth but pose special problems for eHealth researchers; and (4) logistic or administrative concerns of the evaluation methodology selected. We suggest that these four dimensions must be integrated to provide a holistic framework for designing and implementing eHealth research projects, as well as for understanding the totality of the eHealth intervention. The framework must be flexible enough to adapt to a variety of end users, regardless of whether the end user is a healthcare organization, a for-profit business, a community organization, or an individual. The framework is depicted as a puzzle with four interlocking pieces.     

Towards an assessment for organizational participatory research health partnerships: A systematic mixed studies review with framework synthesis

Within the health sciences, organizational participatory research (OPR) is defined as a blend of research and action, in which academic researchers partner with health organization members. OPR is based on a sound partnership between all stakeholders to improve organizational practices. However, little research on the evaluation of OPR health partnership exists. This systematic mixed studies review sought to produce a new theoretical model that structures the evaluation of the OPR processes and related outcomes of OPR health partnerships. Six bibliographic databases were searched together with grey literature sources for OPR health partnership evaluation questionnaires. Six questionnaires were included, from which a pool of 95 OPR health partnership evaluation items were derived. The included questionnaires were appraised for the quality of their origin, development and measurement properties. A framework synthesis was performed using an existing OPR framework by organizing questionnaire items in a matrix using a hybrid thematic analysis. This led to our proposed Organizational Participatory Research Evaluation Model (OPREM) that includes three axes, Trust, Collective Learning and Sustainability (with specific dimensions) and 95 items. This model provides information to help stakeholders comprehensively structure the evaluation of their partnerships and subsequent improvement; thus, potentially helping to improve health organization practices.     

Cultural Responsiveness: a framework for re-thinking students’ interculturality through study abroad

While intercultural competence is commonly a goal of university study abroad programmes, debates around criteria for assessing this competence have highlighted the challenges in appropriately identifying students’ intercultural learning in relation to specific university programmes. To overcome these issues, this research moves beyond conceptualising the intercultural in terms of ‘competence’ and instead proposes a framework termed Cultural Responsiveness to illustrate students’ intercultural learning. Through questionnaires and interviews, the experiences and perceptions of undergraduate students after a year of exchange in France or Switzerland were collected and analysed. Using the Cultural Responsiveness framework, three parameters of students’ intercultural experiences emerged: Awareness, Engagement and Bringing Knowledge Home.     

An evaluation of the postqualifying framework

A new strategy for postqualifying training in social work was launched in 1990 by CCETSW with the publication of Paper 31. This paper reviews the subsequent implementation of the policy framework and identifies several core issues: level and parity; access and numbers; funding and resources; consortia formation and cohesion; quality and standards; and the role of CCETSW in relation to a UK wide system.

It is argued that the slow development of the new system stemmed from an excessively decentralised partnership approach in developing consortia and the low priority and funding devoted to postqualifying education and training. The quicker pace of development since 1995 has only been achieved through government pressure and CCETSW taking on a stronger lead role together with the continued ring-fenced funding for consortia and bursaries. Without substantial funding from the Department of Health/National Offices and CCETSW, it is questionable whether the objectives of a national widely accessible system of postqualifying education and training will be achieved. The rapid development since autumn 1995 has led to some compromise in standards and the new systems of quality assurance have yet to be tested. Whatever the general merits of partnership/collaboration, CCETSW needs to maintain its more positive development role and clarify the relationship to consortia and the legal status of consortia.

Published research and data on postqualifying education and training is extremely limited and the authors have drawn on their experiences and impressions of the evolving PQ systems during the 1990s. Now that the framework is operational, accrediting programmes/portfolio routes and recruiting and assessing candidates, it is essential to undertake independent research and evaluation into the system and its effectiveness.     

An evaluation paradox in social work? An empirical study of evaluation use in connection with temporary programmes in Swedish social work

This article contributes to the debate on evaluation use by analysing temporary national programmes in Swedish social work. Previous empirical research shows a gloomy picture of evaluation use, thus supporting an evaluation paradox: evaluations are not used for learning and development, but are continually prioritised. The aim of this article is to study, through interviews and document analysis, how evaluations of temporary programmes in social work are designed and used. The results support the paradox and we found that it has two dimensions. First, evaluations are prioritised, but they function as a ritual, characterised by routine and unclear intentions, with limited relevance for professional learning and improvement. The second dimension is about limited use by those commissioning the evaluations, but the evaluators are using data for new purposes and in new contexts. This is, at best, a form of conceptual use, hopefully contributing indirectly to social work practice. The article ends in a discussion on how evaluations could be designed for learning and improvement by focusing on three normative models: utilisation-focused evaluation, responsive evaluation and evidence-based practice approach (EBP).     

Application of theory-based evaluation for the critical analysis of national biofuel policy: A case study in Malaysia

Theory-based evaluation (TBE) is an effectiveness assessment technique that critically analyses the theory underlying an intervention. Whilst its use has been widely reported in the area of social programmes, it is less applied in the field of energy and climate change policy evaluations. This paper reports a recent study that has evaluated the effectiveness of the national biofuel policy (NBP) for the transport sector in Malaysia by adapting a TBE approach. Three evaluation criteria were derived from the official goals of the NBP, those are (i) improve sustainability and environmental friendliness, (ii) reduce fossil fuel dependency, and (iii) enhance stakeholders’ welfare. The policy theory underlying the NBP has been reconstructed through critical examination of the policy and regulatory documents followed by a rigorous appraisal of the causal link within the policy theory through the application of scientific knowledge. This study has identified several weaknesses in the policy framework that may engender the policy to be ineffective. Experiences with the use of a TBE approach for policy evaluations are also shared in this report.     

The politics of rescue

In December 2002 the UN adopted a definition of ‘trafficking’ that critics worry discounts female agency in commercial sex and migration. This definition was already being used in Bosnia-Herzegovina (BiH) and Kosovo to tackle the violent sex industry that had developed alongside peacekeeping. This paper analyses official assumptions about female agency in commercial sex when ‘victims of trafficking’ (VoTs) are identified in BiH and Kosovo. In this context the Protocol definition helped extend access to resources to women and girls who could otherwise have been excluded. Those who had ‘been abroad’ before were no longer automatically rejected from VoT programmes but pathologised as sufferers of post traumatic stress disorder (PTSD); their illness establishing their ‘innocence’. Understanding the choice of migration for sex work as a symptom of PTSD allows anti-trafficking programmes to focus on victim rather than perpetrator behaviour. Strong pressures against tackling the way soldiers, police and contractors treat women and girls in the sex industry underlie this focus on victim behaviour. Those in the sex industry who are not ‘foreign’ or do not want to go ‘home’ are excluded from VoT status while anti-trafficking activity increases their risk of arrest, thus reifying the categories of innocent VoT and guilty prostitute.