Affiliation:
1. Department of Economics, The University of Melbourne, Parkville, Victoria 3010, Australia;
2. Melbourne School of Psychological Sciences, The University of Melbourne, Parkville, Victoria 3010, Australia
Abstract
Modern forecasting algorithms use the wisdom of crowds to produce forecasts better than those of the best identifiable expert. However, these algorithms may be inaccurate when crowds are systematically biased or when expertise varies substantially across forecasters. Recent work has shown that meta-predictions—a forecast of the average forecasts of others—can be used to correct for biases even when no external information, such as forecasters’ past performance, is available. We explore whether meta-predictions can also be used to improve forecasts by identifying and leveraging the expertise of forecasters. We develop a confidence-based version of the Surprisingly Popular algorithm proposed by Prelec, Seung, and McCoy. As with the original algorithm, our new algorithm is robust to bias. However, unlike the original algorithm, our version is predicted to always weight forecasters with more informative private signals more than forecasters with less informative ones. In a series of experiments, we find that the modified algorithm does a better job in weighting informed forecasters than the original algorithm and show that individuals who are correct more often on similar decision problems contribute more to the final decision than other forecasters. Empirically, the modified algorithm outperforms the original algorithm for a set of 500 decision problems. This paper was accepted by Yan Chen, decision analysis.
Publisher
Institute for Operations Research and the Management Sciences (INFORMS)
Subject
Management Science and Operations Research,Strategy and Management
Reference33 articles.
1. Blackwell D (1951) Comparison of experiments. Neyman J, ed. Proc. Second Berkeley Sympos. Math. Statist. Probab. (The Regents of the University of California, Berkeley) 93–102.
2. Equivalent Comparisons of Experiments
3. Identifying Expertise to Extract the Wisdom of Crowds
4. Combining forecasts: A review and annotated bibliography
Cited by
12 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献