Affiliation:
1. Cornell University, Ithaca, NY
Abstract
This paper summarizes and analyzes the results of the 2004 KDD-Cup. The competition consisted of two tasks from the areas of particle physics and protein homology detection. It focused on the problem of optimizing supervised learning to different performance measures (accuracy, cross-entropy, ROC area, SLAC-Q, squared error, average precision, top 1, and rank of last). A total of 102 groups participated in the competition, 6 of which received awards or honorable mentions. Their approaches are described in other papers in this issue of SIGKDD Explorations. In this paper we do not analyze any particular approach, but give insight into the performance of the field of competitors as a whole. We study what fraction of the participants found good solutions, how well participants were able to optimize to different performance measures, how homogeneous their submitted predictions are, and if the best submissions represent the maximal performances that could reasonably be achieved. We are keeping the KDD-Cup 2004 WWW site open and have added an automatic scoring system for new submissions in order to encourage further research in this area.
Publisher
Association for Computing Machinery (ACM)
Cited by
19 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献
1. Stochastic Cutting Planes for Data-Driven Optimization;INFORMS Journal on Computing;2022-09
2. A sampling-based approach for efficient clustering in large datasets;2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR);2022-06
3. A survey of outlier detection in high dimensional data streams;Computer Science Review;2022-05
4. Fast and reliable incremental dimensionality reduction for streaming data;Computers & Graphics;2021-08
5. MS MARCO: Benchmarking Ranking Models in the Large-Data Regime;Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval;2021-07-11