A literature review about usability evaluation methods for e-learning platforms

The usability analysis of information systems has been the target of several research studies over the past thirty years. These studies have highlighted a great diversity of points of view, including researchers from different scientific areas such as Ergonomics, Computer Science, Design and Education. Within the domain of information ergonomics, the study of tools and methods used for usability evaluation dedicated to E-learning presents evidence that there is a continuous and dynamic evolution of E-learning systems, in many different contexts -academics and corporative. These systems, also known as LMS (Learning Management Systems), can be classified according to their educational goals and their technological features. However, in these systems the usability issues are related with the relationship/interactions between user and system in the user's context. This review is a synthesis of research project about Information Ergonomics and embraces three dimensions, namely the methods, models and frameworks that have been applied to evaluate LMS. The study also includes the main usability criteria and heuristics used. The obtained results show a notorious change in the paradigms of usability, with which it will be possible to discuss about the studies carried out by different researchers that were focused on usability ergonomic principles aimed at E-learning.     

A children, teachers and designers as evaluators of usability of educational software

This article sets out to discuss the results of evaluations of usability made by children, teachers and designers through methods targeted on their profiles and contexts of use. Based on a survey of methods for evaluating usability, a field study was conducted in which such users--stakeholders--explored the educational software called "Mundo da Crian?a" ("Child's World"). The focus of this study was the analysis of this system and principally of the appropriateness of methods as to the avenues they suggest such users and contexts might explore.     

Developing intercultural competence of teachers of English as a foreign language through an international project

This paper reports an international project which took place at Nicolaus Copernicus University, where students and teachers from four European universities met for a two-week summer school. The main objective was to develop intercultural competence of teachers of English as a foreign language and their ability to demonstrate this skill during an English lesson. The paper depicts the tools implemented in the project and shows how they affected the learning outcomes by presenting the students’ and teachers’ perspectives.     

The Intermodal Bike: multi-modal integration of cycling mobility through product and process innovations in bicycle design

The paper presents the early results of the UE-FP7 project "The Intermodal Bike". The research aim is to provide a super-compactable, super-lightweight folding bicycle as a realistic solution to graft the cycling mode onto the root of the public or private transportation systems. The folding bikes now on the international market reach weighs between 12-15 kg, with a variable footprint but occupying -when compacted- an average volume of about 100 liters. To encourage the use of this vehicle and to extend it to a larger number of users with different characteristics, the research project has set its goal in increasing as possible compactness and light weight, creating a bicycle with a volume when compacted of 20 liters (reduction factor =5), with a shape of 48 × 36 × 12 cm and a weight of 5 kg. max., ensuring stability and improving vehicle usability and efficiency, during the ride and in the phase of bike folding. To achieve this goal ergonomic and usability tests have been carried out. The tests allowed to find a posture that would ensure efficiency and comfort in the ride to as many users as possible. Parallel tests were made on the vehicle usability in the urban transport system and intermodal. The need for light weight has required special studies on the optimization of the vehicle's architecture and research on super-lightweight materials.     

Design for Usability; practice-oriented research for user-centered product design

The Design for Usability project aims at improving the usability of electronic professional and consumer products by creating new methodology and methods for user-centred product development, which are feasible to apply in practice. The project was focused on 5 key areas: (i) design methodology, expanding the existing approach of scenario-based design to incorporate the interaction between product design, user characteristics, and user behaviour; (ii) company processes, barriers and enablers for usability in practice; (iii) user characteristics in relation to types of products and use-situations; (iv) usability decision-making; and (v) product impact on user behaviour. The project team developed methods and techniques in each of these areas to support the design of products with a high level of usability. This paper brings together and summarizes the findings.     

Usability testing,initial implementation,and formative evaluation of an evidence-based intervention: Lessons from a demonstration project to reduce long-term foster care

The field of child welfare faces an undersupply of evidence-based interventions to address long-term foster care. The Permanency Innovations Initiative is a five-year federal demonstration project intended to generate evidence to reduce long stays in foster care for those youth who encounter the most substantial barriers to permanency. This article describes a systematic and staged approach to implementation and evaluation of a PII project that included usability testing as one of its key activities. Usability testing is an industry-derived practice which analyzes early implementation processes and evaluation procedures before they are finalized. This article describes the iterative selection, testing, and analysis of nine usability metrics that were designed to assess three important constructs of the project's initial implementation and evaluation: intervening early, obtaining consent, and engaging parents. Results showed that seven of nine metrics met a predetermined target. This study demonstrates how findings from usability testing influenced the initial implementation and formative evaluation of an evidence-supported intervention. Implications are discussed for usability testing as a quality improvement cycle that may contribute to better operationalized interventions and more reliable, valid, and replicable evidence.     

From usability requirement to technical specifications for hand-held tools and materials: an applied research in the construction field

Literature shows incidence of musculoskeletal disorders in bricklaying workers as well as the relevance of good designed hand-held tools in musculoskeletal disorders prevention. In this framework, it can be supposed that providing usable hand-held tools and material in construction worksites will help to improve bricklayers' working conditions. Here a study is presented aimed at framing a methodology for usability assessment of bricklayers handled objects, in order to provide employers with practical indicators for choosing tools and materials best fitting workers needs, under the effectiveness, efficiency and satisfaction perspective. On the basis of a task analysis, usability requirements for bricklaying hand-held tools and materials have been detailed and related, quantitative and qualitative, technical specifications have been elicited. Theoretical framework and usability assessment methodology are presented and, finally, findings from a field application are discussed.     

The Educational Experience With Tikuna: A Look Into the Complexity of Concept Construction

In this article I present a study on concept construction through diverse forms of semiotic mediation developed in the upper Amazon with Tikuna tribe lay teachers who are undergoing formal schooling to get their teacher certification. This project explores the process of concept construction related to the cultural context of development and focuses on the milieu as a source of different tools and possibilities of semiotic mediation. It analyzes the processes of human development when the relationship between individuals and milieu is altered by the introduction of new forms of activity and of semiotic systems and tools. I present the effort to articulate diverse forms of semiotic mediation by integrating drawings—the culturally developed form used extensively by the entire Tikuna community—with written language and by introducing diagrams.     

Teaching the Use of the Library

The purpose of the study was to examine if and how elementary preservice teachers’ perceptions about history were changed upon their completion of a class project that engaged them in a discipline-specific inquiry as a method of teaching history. Surveys were administered to assess any changes in their perception of the history before and after they participated in the class project. The preservice teachers’ reflective writings were used to explore any themes that emerged about historical inquiry as well as to understand their development of pedagogical knowledge about teaching history. The study results provide implications for inquiry-based teaching in social studies education.     

Ergonomic and usability analysis on a sample of automobile dashboards

This is a research study based on an analysis which sets out to identify and pinpoint ergonomic and usability problems found in a sample of automobile dashboards. The sample consisted of three dashboards, of three different makes and characterized as being a popular model, an average model and a luxury model. The examination was conducted by observation, with the aid of photography, notes and open interview, questionnaires and performing tasks with users, the bases of which are on the principles laid down by methodologies. From this it was possible to point to the existence of problems such as: complaints about the layout, lighting, colors, available area, difficult access to points of interaction, such as buttons, and the difficult nomenclature of dials. Later, the findings and recommendations presented show the need for a further, deeper study, using more accurate tools, a larger sample of users, and an anthropometric study focused on the dashboard, since reading and understanding it have to be done quickly and accurately, and that more attention be given to the study of automobile dashboards, particularly in the most popular vehicles in order to maintain the standards of usability, and drivers' comfort and safety.     

Examination of tools associated with the evaluation of knowledge uptake and utilization: A scoping review

Knowledge transfer and exchange (KTE) has become an integral part of organizational practice. Evaluation of KTE, as well as knowledge products generated through this process, is important for understanding the effectiveness of KTE strategies. This scoping review aimed to identify tools and frameworks used to evaluate knowledge uptake and utilization (KUU).The search strategy included review of PubMed and Scopus databases, hand searching of relevant journals, and citation tracing. Over 6500 abstracts were screened; 292 full-text articles were shortlisted by two reviewers.Seventy-two articles described tools for evaluating KUU. A total of 23 tools could be generally applied to knowledge products/processes used in different sectors; 36 evaluation tools were designed for specific knowledge products (i.e., websites); 9 tools were discipline-specific (i.e., medical field), and four articles described evaluations of knowledge products/processes using alternative methods such as Google Analytics or qualitative methods. The majority of tools (n = 40, 56 %) focused on usability of a knowledge product or process.This scoping review identified various tools being used to assess the effectiveness and impact of KTE processes/products, however, the measures were as varied as the projects, and were often not designed to evaluate KTE in particular.     

Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab

Background

Falls are common in older adults and can result in serious injuries. Due to demographic changes, falls and related healthcare costs are likely to increase over the next years. Participation and motivation of older adults in fall prevention measures remain a challenge. The iStoppFalls project developed an information and communication technology (ICT)-based system for older adults to use at home in order to reduce common fall risk factors such as impaired balance and muscle weakness. The system aims at increasing older adults’ motivation to participate in ICT-based fall prevention measures. This article reports on usability, user-experience and user-acceptance aspects affecting the use of the iStoppFalls system by older adults.

Methods

In the course of a 16-week international multicenter study, 153 community-dwelling older adults aged 65+ participated in the iStoppFalls randomized controlled trial, of which half used the system in their home to exercise and assess their risk of falling. During the study, 60 participants completed questionnaires regarding the usability, user experience and user acceptance of the iStoppFalls system. Usability was measured with the System Usability Scale (SUS). For user experience the Physical Activity Enjoyment Scale (PACES) was applied. User acceptance was assessed with the Dynamic Acceptance Model for the Re-evaluation of Technologies (DART). To collect more detailed data on usability, user experience and user acceptance, additional qualitative interviews and observations were conducted with participants.

Results

Participants evaluated the usability of the system with an overall score of 62 (Standard Deviation, SD 15.58) out of 100, which suggests good usability. Most users enjoyed the iStoppFalls games and assessments, as shown by the overall PACES score of 31 (SD 8.03). With a score of 0.87 (SD 0.26), user acceptance results showed that participants accepted the iStoppFalls system for use in their own home. Interview data suggested that certain factors such as motivation, complexity or graphical design were different for gender and age.

Conclusions

The results suggest that the iStoppFalls system has good usability, user experience and user acceptance. It will be important to take these along with factors such as motivation, gender and age into consideration when designing and further developing ICT-based fall prevention systems.

     

Addressing the cultural complexity of OHS in the Australian mining industry

This paper summarises the findings of the site assessments of ten pilot mine sites involved in a project entitled, Creating a world-leading OHS culture in the NSW Mining Industry which was undertaken for the New South Wales Mine Safety Advisory Council (NSW MSAC). NSW MSAC was established in 1998 in NSW Australia and aims to increase the emphasis on safety and health within the mining industry by reviewing and analyzing safety performance, setting strategic directions, providing advice and developing policy recommendations. The project itself aimed to deliver a self-sustaining method for achieving and monitoring continuous improvement in OHS culture and practice to the NSW mining industry. The pilot sites involved in the project tested a set of self-assessment tools to enable mines to assess and improve their own OHS culture and performance on key elements of an OHS management system. The tools allowed examination of the current OHS culture of the sites. Sites then used a participative planning process to develop an improvement plan. This paper provides summary data only, without identifying the individual sites that were the source of the data.     

Learning about and from the Holocaust: The development and implementation of a Complex Instruction Unit in Latvia

What and how to teach about the Holocaust in a specific country or region depends on both the political-historical context in which the Holocaust took place and on the specific educational context. It also depends on the motivations of teachers and developers. In many circumstances, Complex Instruction (CI) provides opportunities for students to learn actively about the events that took place in their respective countries and to express their feelings and opinions. This paper describes the development and implementation of the first CI-based unit on the Holocaust, which was designed within the Latvian context by a small international and intergenerational project group.     

Redress and Corporate Human Rights Harms: An Analysis of New Governance and the POSCO Odisha Project

Human rights harms caused by transnational business in the global South are increasingly being addressed using ‘new governance’ tools and their cooperative problem-solving processes. Such an approach is employed by OECD National Contact Points (NCPs), which received a complaint regarding Korean steel giant POSCO in India. This article explains the contested aspects of the POSCO project in its politico-economic context and shows how the NCP process sacrificed elements essential to an effective new governance approach. This case highlights the challenges facing new governance tools in advancing human rights in the global South raising significant questions about their usefulness in this context.     

Drama and Social Change: Working with Young People in Sarajevo

This is a brief article about my work with young people in Sarajevo. As part of a larger educational project, initiated by the Anne Frank House, I conducted drama workshops with teenagers in the Hrasno neighborhood, located on the front line during the recent conflict in Bosnia. In addition to using the play, Dreams of Anne Frank, / also conducted a workshop with teachers on bullying, using the same teenage actors.     

An exploration of factors which may influence how teachers perceive participatory action research tools being employed in schools

This article draws on a lead researcher's observations about participatory research collaboration within a qualitative research project involving teachers, pupils and members of the communities surrounding schools. It presents a practical account of research processes aimed at uncovering to how pupils, teachers and community members in economically and socially disadvantaged neighbourhoods perceived their own roles in relation to creative activity with groups of children, who had been identified by their schools as being in need of help to engage in learning. The activities were led by artists who would not normally be involved in schools. Social constructionist frameworks for evaluation are combined with the literature on participatory appraisal, in order to suggest a politically sensitive course of action by which practitioners and peer interviewers could be involved more usefully in the future, through direct collaboration on the planning tasks to reveal rarely articulated pupil attitudes.     

Discrimination Against Gay Men,Lesbians, and Transgender People Working in Education

Abstract

This paper explores the workplace experiences of 120 gay men, lesbians, and transgender people who were employed as teachers, academics, and educators. The data, drawn from a larger collaborative research project, explored the workplace experiences of 900 gay men, lesbians, and transgender people. Homophobic harassment and treatment were widespread amongst the lesbian, gay men, and transgender teachers, academics, and educators. The paper will utilize the stories of those who experienced discrimination to explicate the issues confronting gay men, lesbians, and transgender people who work in the education system.     

Using Activity Theory as an Analytic Lens for Examining Technology Professional Development in Schools

In this study, I examined a professional development program for integrating technology into school. The primary purpose of this study was to answer the following question: How did the participation of teachers in a year-long professional development program affect the transformation of newly introduced artifacts into cultural tools in the teachers' activity setting? To address this question, I examined the effects of the professional development program on participant teachers, nonparticipant teachers, and others in the school districts. I went about this by using activity theory (Engeström,1987) as an analytic lens to gain a historical understanding of the developments initiated as a result of interactions that took place between the participant teachers and the professional development.