Affiliation:
1. State Key Laboratory of Integrated Chips and Systems, Fudan University, Shanghai, China
Funder
Major Project of the Science and Technology Innovation 2030
Strategic Priority Research Program of Chinese Academy of Sciences
National Natural Science Foundation of China
Shanghai Rising-Star Program
Zhangjiang Fudan International Innovation Center
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Subject
Electrical and Electronic Engineering,Hardware and Architecture,Software
Reference60 articles.
1. Attention is all you need;Vaswani
2. BERT: Pre-training of deep bidirectional transformers for language understanding;Devlin;arXiv:1810.04805,2018
3. Language models are unsupervised multitask learners;Radford;OpenAI Blog,2019
4. Language models are few-shot learners;Brown;arXiv:2005.14165,2020
5. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding