1. Meysam Alizadeh, Maël Kubli, Zeynab Samei, Shirin Dehghani, Juan Diego Bermeo, Maria Korobeynikova, and Fabrizio Gilardi. 2023. Open-Source Large Language Models Outperform Crowd Workers and Approach ChatGPT in Text-Annotation Tasks. arXiv preprint arXiv:2307.02179 (2023).
2. Quality Control in Crowdsourcing Systems: Issues and Directions
3. Appen. 2021. Calculating Worker Agreement with aggregate (WAWA). https://success.appen.com/hc/en-us/articles/202703205-Calculating-Worker-Agreement-with-Aggregate-Wawa-
4. Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
5. Parikshit Bansal and Amit Sharma. 2023. Large Language Models as Annotators: Enhancing Generalization of NLP Models at Minimal Cost. arXiv preprint arXiv:2306.15766 (2023).