Measuring Bias in Generated Text Using Language Models—GPT-2 and BERT

Author:

Masuma FozilatunnesaORCID,Chakraborty ParthaORCID,Islam Al-Amin-UlORCID,Talukder Prince ChandraORCID,Roy ProshantaORCID,Yousuf Mohammad AbuORCID

Publisher

Springer Nature Singapore

Reference20 articles.

1. Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., Soricut, R.: ALBERT:A lite bert for self-supervised learning of language representations. In: International Conference on Learning Representations (2020)

2. Devlin, J., Chang, M. W., Lee, K., Toutanova, K.: 2019. BERT: pre-training of deep bidirectional transformers for language understanding. In: NAACL-HLT (1) (2019)

3. Dhamala, J., Sun, T., Kumar, V., Krishna, S., Pruksachatkun, Y., Chang, K. W., & Gupta, R.: BOLD: dataset and metrics for measuring biases in open-ended language generation. In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (2021)

4. Wang, A., Cho, K.: BERT has a mouth, and it must speak: BERT as a Markov Random field language model. In: Proceedings of the Workshop on Methods for Optimizing and Evaluating Neural Language Generation, pp, 30–36 (2019)

5. Bender, E.M., Friedman, B.: Data statements for natural language processing: toward mitigating system bias and enabling better science. Trans. Assoc. Comput. Linguist. (TACL) 6, 587–604 (2018)

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3