Improving the Quality of Staff and Participant Interaction in an Acquired Brain Injury Organization

Weekly observations of direct-care staff in a facility for persons with brain injury yielded less than optimal interactional style with facility residents. Following an observational baseline, staff were asked to self-rate a 15-min video sample of their interaction behavior with participants on their unit. They were then asked to compare their self-ratings to those of a supervisor, as well as view a video exemplar of appropriate positive interaction behavior. Elements of their interactional style were highlighted and specific feedback was provided on how to improve their performance. Interaction style was then reevaluated via an unobtrusive observer and yielded positive gains for all participants. Subsequent on-the-job feedback sustained performance gains.     

HRD as design science

The aim of this study was to explore the evaluation practices of a sample of organizations in England and Wales who had signalled some commitment to training and evaluation by embarking on the UK's Investors in People (IiP) standard. A questionnaire survey was sent to 1,000 firms and usable responses were received from 394 organizations. It was found that formative and delayed evaluations were used less frequently than immediate and context (needs analysis) evaluations. In the majority of cases the responsibility for evaluation was that of managers and the most frequently used methods were informal feedback and questionnaires. Operational reasons for evaluating training were cited more frequently than strategic ones. Information derived from evaluations was used mostly for feedback to individuals and to inform the training process and less for return on investment decisions. There were some statistically significant effects of organizational size on evaluation practice. The results are discussed in terms of their implications for evaluation theory and research and HRD practice and policy.     

An Evaluation of Train-to-Code to Teach Implementation of PECS©

We evaluated the impact of a customized training program developed using an observation and behavioral coding software system (i.e., Train-to-Code) to teach implementation of Phase 3A of the Picture Exchange Communication System to four undergraduate students. The training program coached participants on all relevant steps of the procedure. To accomplish this, participants viewed multiple video exemplars of correct and incorrect implementation of each step in the sequence of behaviors, and coded these behaviors in accordance with a taxonomy developed by the experimenters. The training program provided prompts and feedback in real time based on participants’ current level of performance and required mastery of seven levels of training, each with fewer prompts and feedback, until an expert level of unprompted coding performance was demonstrated. A multiple baseline design across participants was used to evaluate the effectiveness of the training program on levels of procedural integrity during performance test probes conducted with a confederate learner before and after the completion of the training program. Results showed improved performance relative to baseline following training, and maintenance of performance at 2–4 weeks follow-up. A conceptual analysis of these findings will be discussed, along with implications for staff training in applied settings.     

An Evaluation of Training Procedures for Animal Shelter Volunteers

This study evaluated the effects of 3 training procedures on the correct implementation of a dog walking and enrichment protocol (DWEP). During the shelter’s typical training, volunteers correctly implemented just over half of all DWEP steps (M = 55.2%). Correct implementation of the DWEP procedure improved when participants completed a video-based self-training package (M = 75.3%) but did not reach the preestablished mastery criterion of 85% fidelity with 0 safety errors. Correct implementation improved during coaching (M = 90.6%), which consisted of modeling and positive and corrective feedback, and was maintained during 1-week and 1-month follow-up probes. Criterion performance was demonstrated by 2 of 3 participants at the conclusion of the study.     

Teaching Employees How to Receive Feedback: A Preliminary Investigation

ABSTRACT

There is a substantial literature on how to deliver feedback to change performance. However, to date no research has been conducted on teaching employees how to effectively receive feedback, even though employee behavior during a feedback session could moderate the effects of feedback. Thus, we developed a list of skills that should be exhibited by an employee while receiving verbal feedback. We then evaluated their acquisition after behavioral skills training using a nonconcurrent multiple-baseline design across participants. The results showed that participants were able to acquire and maintain appropriate feedback receiving behavior.     

A Comparison of Immediate and Post-Session Feedback with Behavioral Skills Training to Improve Interview Skills in College Students

ABSTRACT

Successful interviewing skills help maximize the probability that a job candidate will make a positive impression upon a prospective employer. Previous research described a method to increase appropriate interview skills using Behavioral Skills Training (BST) with post-session feedback. Immediate feedback has been shown as an effective method that may improve the effectiveness and efficiency of the training package described by previous research. The purpose of this study was to replicate past studies using BST to improve interview skills of college students and extend the study by comparing post-session and immediate feedback. All participants demonstrated improvements in interview skills, thus replicating previous findings. More specifically, BST with immediate feedback showed greater acquisition, maintenance, and generalization, with fewer training minutes required to meet mastery criteria compared to BST with post-session feedback.     

A Parametric Analysis of Rehearsal Opportunities on Procedural Integrity

Behavioral skills training (BST) involves instruction, modeling, rehearsal, and feedback. Despite its empirical support, the literature provides little to no guidance regarding the best way to implement rehearsal to ensure accurate implementation of behavioral procedures. Thus, the purpose of this study was to conduct a parametric analysis of rehearsal opportunities within a BST package. We evaluated the effects of 1, 3, and 10 rehearsals with feedback on correct implementation of functional analysis (FA). Regardless of the number of rehearsals, 18 undergraduate participants effectively learned to implement FA conditions. The most efficient training involved the use of single rehearsals with feedback until meeting mastery criterion. Participants maintained integrity during a follow-up session and rated the use of rehearsal as highly acceptable.     

A Comparison of Pyramidal Staff Training and Direct Staff Training in Community-Based Day Programs

This study evaluated two methods of training staff who were working with individuals with developmental disabilities: pyramidal training and consultant-led training. In the pyramidal training, supervisors were trained in the principles of applied behavior analysis (ABA) and in delivering feedback. The supervisors then trained their direct-care staff and, subsequently, provided ongoing performance feedback. In the consultant-led training, the direct-care staff was trained in the principles of ABA. Both groups learned similar amounts of knowledge of ABA principles, but pyramidal training was more effective in teaching staff to use correct teaching procedures with consumers. In addition, the pyramidal training group maintained the improvement in their teaching procedures at a 3-month follow up, while the consultant-led training group's performance declined.     

The Effects of Evaluating Video Examples of Staffs' Own Versus Others' Performance on Discrete-Trial Training Skills in a Human Service Setting

Many studies have been conducted evaluating the use of feedback in staff training in organizational settings. Central to this literature has been the use of a variety of forms of feedback, including videotaped feedback. A distinction is outlined between video modeling and a variety of possible video feedback procedures. Previous studies have indicated a possible positive training effect on staff skills from simply being exposed to relevant videotaped performances of those skills or as a result of evaluating video modeled performances. This study evaluated the effectiveness for training teaching skills of having staff evaluate videotaped teaching skills as performed by themselves versus others. The current study results replicate earlier research on the effectiveness of evaluating video models as a training method and do not suggest a difference between observing oneself as opposed to observing someone else. Future research suggestions for the general use of video in training are provided.     

Feedback Mechanisms,Judgment Bias,and Trust Formation in Online Auctions*

Online markets, like eBay, Amazon, and others rely on electronic reputation or feedback systems to curtail adverse selection and moral hazard risks and promote trust among participants in the marketplace. These systems are based on the idea that providing information about a trader's past behavior (performance on previous market transactions) allows market participants to form judgments regarding the trustworthiness of potential interlocutors in the marketplace. It is often assumed, however, that traders correctly process the data presented by these systems when updating their initial beliefs. In this article, we demonstrate that this assumption does not hold. Using a controlled laboratory experiment simulating an online auction site with 127 participants acting as buyers, we find that participants interpret seller feedback information in a biased (non‐Bayesian) fashion, overemphasizing the compositional strength (i.e., the proportion of positive ratings) of the reputational information and underemphasizing the weight (predictive validity) of the evidence as represented by the total number of transactions rated. Significantly, we also find that the degree to which buyers misweigh seller feedback information is moderated by the presentation format of the feedback system as well as attitudinal and psychological attributes of the buyer. Specifically, we find that buyers process feedback data presented in an Amazon‐like format—a format that more prominently emphasizes the strength dimension of feedback information—in a more biased (less‐Bayesian) manner than identical ratings data presented using an eBay‐like format. We further find that participants with greater institution‐based trust (i.e., structural assurance) and prior online shopping experience interpreted feedback data in a more biased (less‐Bayesian) manner. The implications of these findings for both research and practice are discussed.     

Effectiveness of Job Aids and Post Performance Review on Staff Implementation of Discrete Trial Instruction

Discrete-trial instruction (DTI) is a well-established instructional method for teaching children with autism. Accurate implementation of DTI procedures requires that staff be well trained. This study examined the effectiveness of job aids followed by post performance review of strengths, errors, and accuracy on discrete trial instructional accuracy in three participants who conducted DTI within their current job positions. Additionally, primary training procedures were embedded within a meta-shaping procedure, which involved the gradual and systematic introduction of three levels of behavioral components required for accurate implementation of the DTI sequence with mastery criteria set at 90% accuracy across all three levels. As demonstrated in a changing criterion within a multiple baseline design, staff demonstrated increases in DTI accuracy following the initiation of the job aid condition; however, some degree of performance-based feedback was required to establish high levels of procedural fidelity across the DTI sequence. Performance accuracy on maintenance probes remained at high levels. These findings provide support that job aids followed by performance-based feedback may be an effective and efficient method for shaping high levels of DTI procedural fidelity in staff. Additionally, gradual shaping of the DTI accuracy may scaffold performance, minimize errors, and increase social validity.     

The Effects of Social Comparison and Objective Feedback on Work Performance Across Different Performance Levels

This study investigated the interaction effects of feedback content type (social comparison feedback vs. objective feedback) and two different performance levels (high vs. low) on work performance. One hundred fifty participants were recruited and asked to perform a simulated work task in a preliminary session. Based on their performance, the upper 40% (high performance) and lower 40% (low performance) groups were selected for the main experiment. Participants in each group were randomly assigned to the two different experimental conditions: objective feedback and social comparison feedback. For the participants in the objective feedback condition, information on the number of correctly completed work tasks was provided. For the participants in the social comparison feedback condition, rank information on their performance was provided. The results indicated that social comparison feedback was more effective than objective feedback for the high performers, but was less effective for the low performers.     

Delivering instruction and training to the US and the non-US audiences: an interview with Dr. Hardy MacKenzie

The interview was conducted to identify best practices and methods of delivering training programmes for the US and the non-US audiences. Topics for discussion involved understanding the importance of preparing instructional content, identifying approaches and techniques for capturing and sustaining the attention of participants. The interview was conducted by the first author and concluded with Dr. MacKenzie providing suggestions for trainers who design and deliver training for the US and the non-US audiences. These recommendations are important for domestic and global HRD practitioners as they offer best practices in terms of the cultural adjustments trainers, facilitators, and instructional designers must adopt for enhancing individual learning and enhancing training effectiveness.     

Effects of Accurate and Inaccurate Feedback on Work Performance: The Role of the Awareness of Inaccuracy

ABSTRACT

This study compared the effects of accurate (i.e., contingent) and inaccurate (i.e., non-contingent) feedback on work performance under two different work conditions. Under one work condition, participants could clearly see the outcome of their performance (i.e., visible condition). Under the other condition, they could not clearly see the outcome of their performance (i.e., non-visible condition). One hundred and twenty participants were randomly assigned to four experimental conditions (i.e., accurate/visible, inaccurate/visible, accurate/non-visible, and inaccurate/non-visible) and asked to perform a simulated work task. The results indicated that inaccurate feedback was as effective as accurate feedback under the non-visible condition, but inaccurate feedback was less effective than accurate feedback under the visible condition.     

A Comparison of Two Data Analysis Training Methods for Paraprofessionals in an Educational Setting

Analyzing and using student educational data to guide instructional programming is a critical staff skill to ensure quality programming based on applied behavior analysis. We compared two training methods to teach staff to use rules to analyze graphed educational data to enact program changes: didactic instruction and behavioral skills training using direct practice. Participants showed improvements in verbally identifying data patterns using simulated data; however, participants in the latter group were also effective using actual student data. The lack of correspondence between rule identification and rule following challenges the assumption that an individual’s ability to identify rules predicts actual performance.     

The Effects of Safety Discrimination Training and Frequent Safety Observations on Safety-Related Behavior

The intent of the present study was to assess the effects of discrimination training only and in combination with frequent safety observations on five participants' safety-related behavior in a simulated office setting. The study used a multiple-baseline design across safety-related behaviors. Across all participants and behavior, safety improved from 53% during the baseline phase to 74% during the training phase, and improved further to 89% during the training plus observation phase. The results show that both discrimination training only and in combination with frequent observations improves safety-related behavior with a medium effect size. The study also measured participants' accuracy of observation, which was the extent of their correct classification of safe and at-risk behavior. Participants' accuracy of observation was above 80% and had little correlation with safety-related behavior. Based on the various measures, conducting observations appears to serve more than a skill acquisition function for the safety-related behavior.     

Behavior Skills Training with Voice-Over Video Modeling

The present study used behavior skills training (BST) to teach three adult participants to implement a video modeling intervention aimed at teaching social skills to adults with autism spectrum disorder (ASD). During baseline trials, participants were given access to written instructions before role-play with two actors (who simulated a quiet conversation) and one confederate (who played the role of an adult with ASD). During treatment, participants were given a video model with voice-over instruction depicting how to implement the video modeling intervention to teach social skills, repeated roleplay trials, and feedback following their performance. All participant scores (percentage of steps correctly implemented in each session) increased from baseline to treatment, and generalization was demonstrated with an actual consumer diagnosed with ASD. Additionally, after training participants to use a video model to teach one social skill, there was generalization to teaching as many as three additional novel social skills. Participants showed maintenance of skills during a treatment study that involved training adult clients with ASD to engage in the social skills.     

Well begun is half done: Toward an understanding of predictors for initial training transfer

As organizations face a rapidly changing marketing environment, they have an increased investment in training programs that aim to improve employees’ hard skills to successfully execute tasks and soft skills for healthy social relationships. Although managers question the transfer problem in hard- and soft-skills training, researchers have limited knowledge on this topic. This study focuses on improving the initial training transfer, an essential phase of the transfer process. Specifically, drawing on signaling theory, we introduce training characteristics (i.e., training content validity and transfer design) as the antecedents. This study also assesses the potential underlying mechanisms by examining the roles of training engagement and training criticality. Using a sample of 182 employees enrolled in a typical hard- and soft-skills training program (i.e., quality management training), we test a mediation model. As expected, the results indicate that both training content validity and transfer design positively impact initial training transfer. Furthermore, the links between training characteristics and initial training transfer are mediated by training engagement and training criticality. This study contributes to the research on initial training transfer by exploring training characteristics as the antecedents and integrating the research on transfer and personal attitudes under hard- and soft-skills training.     

Cellular Telephones and Driving Performance: The Effects of Attentional Demands on Motor Vehicle Crash Risk

This study examines the effects of conversation mode and split-attention communication training on driving performance. The study is based on an experiment where drivers with and without communication training (pilots vs. nonpilots) completed a simulated driving course while involved in one of three conversation modes: no conversation, conversation with passenger, or conversation on a hands-free cellular telephone. Results indicate that cellular telephone conversations consume more attention and interfere more with driving than passenger conversations. Cell phone conversations lack the nonverbal cues available during close-contact conversations and conversation participants expend significant cognitive resources to compensate for the lack of such cues. The results also demonstrate that communication training may reduce the hazardous effects of cell phone conversations on driving performance.     

Coaching at the heart of managerial effectiveness: A cross-cultural study of managerial behaviours

This article considers the assessed performances of non-commissioned officers in aprogramme perceived as an important career enhancing activity for British military personnel. We introduce the idea of cognitive style as an important individual difference affecting performance on programmes of training and development and the implications for career progression. The research methodology adopted involved mixed methods as an alternative way of ‘seeing’, ‘researching’ and ‘theorising’ human resources development in this context. The research drew upon a mix of data from course participants and organizers, and it comprised cognitive style testing, within course assessment data and notes recorded during field observation. The results revealed relationships between the factors associated with ‘styles’, ‘assessed learning performance’ and ‘course experience’. Key perspectives on the experiences of training in terms of success and strategic direction were also identified. The study provides a deeper understanding of career-development processes in the military organization, considers the implications in which knowledge of an individual's style may have for the individual and course organizers and imports new theoretical frameworks into the study of human resource development.