The SIGMOD 2019 Research Track Reviewing System

Abstract

While organizing the submission evaluation process for the SIGMOD 2019 research track, we aim at maximizing the value of the reviews while minimizing the probability of misunderstandings due to factual errors, thereby valorizing impactful ideas. The objective is an educating and rewarding experience for both the authors and the reviewers. The actionable goals are: 1. Maximize review depth and breadth. For depth, optimizing the assignment of papers to reviewers is of key importance; "low confidence" reviews should be few to none, in order for reviewers to provide extensive and useful comments to the authors. To cover the breadth and to address controversial issues, recruit as many reviewers as needed to converge to a unanimous set of comments. 2. Ensure that all submissions are treated equally fairly by experts in the respective domains. 3. Obtain as much input from the authors as possible during the process. Enabling author feedback is the key step in the process. 4. Allow re-evaluation of papers with non-critical flaws through revisions.