Interface Style and Training Task Difficulty as Determinants of Effective Computer-Assisted Knowledge Transfer*

The transfer of expert knowledge to novices is one means of improving decision quality. Research needs to identify (1) the knowledge to be transferred to novices, and (2) the best method for transferring that knowledge. Studies that compare the judgment behavior of experienced and novice auditors address the first issue. The present study addresses the second issue in the context of using a computer-assisted training (CAT) program. CAT was selected for study because of evidence that it can both improve the effectiveness and reduce the costs of training. An experiment was conducted in which two factors were manipulated: (1) the design of the human-computer interface of the CAT program, and (2) the content of training tasks. The judgment of interest involved causal reasoning about the relationships between various internal control procedures and possible errors. The results indicate that alternative styles of interaction with a CAT program differ in terms of learning effectiveness. In addition, there was also evidence that training task content affected learning.     

Increasing the Effectiveness of Student Evaluation of Instructor Data through a Factor Score Comparative Report

Effective student evaluation of instructor instruments must provide norm, or comparative, data to aid interpretation. This note highlights an innovative factor score comparative report. Rather than merely reporting comparative data on individual questions items, the innovative report provides comparative percentile data on the six factors underlying our thirty-three item questionnaire. The faculty indicated overwhelming support for the new report. The note also briefly mentions three other activities that are essential for student evaluation of instructor data to improve teacher effectiveness. Our goal is to stimulate other colleges to adopt the innovative norming practice once they have validated their local evaluation instruments. College-wide improvement of teaching will occur through such do-it-yourself efforts and only decision science faculty are technically qualified to lead such efforts.