TY - JOUR
T1 - The effects of feedback and training on the performance of probability forecasters
AU - Benson, P. George
AU - Önkal, Dilek
PY - 1992/1/1
Y1 - 1992/1/1
N2 - An experiment examined the effects of outcome feedback and three types of performance feedback-calibration feedback, resolution feedback, and covariance feedback - on various aspects of the performance of probability forecasters. Subjects made 55 forecasts in each of four sessions, receiving feedback prior to making their forecasts in each of the last three sessions. The provision of calibration feedback was effective in improving both the calibration and overforecasting of probability forecasters, but the improvement was not gradual; it occurred in one step, between the second and third sessions. Simple outcome feedback had very little effect on forecasting performance. Neither resolution nor covariance feedback affected forecasters' performances much differently than outcome feedback. However, unlike outcome feedback, the provision of performance feedback caused subjects to manage their use of the probability scale. Subjects switched from two-digit probabilities to one-digit probabilities, and those receiving calibration and resolution feedback also reduced the number of different probabilities they used.
AB - An experiment examined the effects of outcome feedback and three types of performance feedback-calibration feedback, resolution feedback, and covariance feedback - on various aspects of the performance of probability forecasters. Subjects made 55 forecasts in each of four sessions, receiving feedback prior to making their forecasts in each of the last three sessions. The provision of calibration feedback was effective in improving both the calibration and overforecasting of probability forecasters, but the improvement was not gradual; it occurred in one step, between the second and third sessions. Simple outcome feedback had very little effect on forecasting performance. Neither resolution nor covariance feedback affected forecasters' performances much differently than outcome feedback. However, unlike outcome feedback, the provision of performance feedback caused subjects to manage their use of the probability scale. Subjects switched from two-digit probabilities to one-digit probabilities, and those receiving calibration and resolution feedback also reduced the number of different probabilities they used.
KW - Calibration
KW - Covariance decomposition
KW - Judgmental forecasting
KW - Outcome feedback
KW - Performance feedback
KW - Probability forecasting
KW - Resolution
KW - Scoring rules
KW - Subjective probability
U2 - 10.1016/0169-2070(92)90066-I
DO - 10.1016/0169-2070(92)90066-I
M3 - Article
AN - SCOPUS:38249007793
VL - 8
SP - 559
EP - 573
JO - International Journal of Forecasting
JF - International Journal of Forecasting
SN - 0169-2070
IS - 4
ER -