SOME TESTS OF BINOMIAL PROBABILITY ASSESSMENTS

A replication of the Alpert-Raiffa probability assessment experiment is used to motivate the development of several tests for evaluating assessors. The tests permit an evaluation of an assessor's accuracy in estimating target quantities and in estimating his own uncertainty as well. Assumption of normal subjective distributions permits the determination of subjective variances. Data from trial assessments are employed to test models which assert that assessed quantities are equal to subjectively assessed error variances. Several tests of the latter type are compared using data from individual, as well as pooled, assessors.