Some aspects of probability forecasting |
| |
Authors: | Andrey Feuerverger Sheikh Rahman |
| |
Affiliation: | Department of Statistics , University of Toronto , Toronto, M5S 1A1, Canada |
| |
Abstract: | The problems of assessing, comparing and combining probability forecasts for a binary events sequence are considered. A Gaussian threshold model (analytically of closed form) is introduced which allows generation of different probability forecast sequences valid for the same events. Chi - squared type test statistics, and also a marginal-conditional method are proposed for the assessment problem, and an asymptotic normality result is given. A graphical method is developed for the comparison problem, based upon decomposing arbitrary proper scoring rules into certain elementary scoring functions. The special role of the logarithmic scoring rule is examined in the context of Neyman - Pearson theory. |
| |
Keywords: | probability forecasting proper scoring rules assessing, comparing, combining forecasts Gaussian threshold model elementary scores graphical methods Neyman - Pearson Lemma |
|
|