TaskFusion: An Efficient Transfer Learning Architecture with Dual Delta Sparsity for Multi-Task Natural Language Processing-Reference-Cited by-同舟云学术

TaskFusion: An Efficient Transfer Learning Architecture with Dual Delta Sparsity for Multi-Task Natural Language Processing

Published:2023-06-17 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 50th Annual International Symposium on Computer Architecture
language:
Short-container-title:

Author:

Fan Zichen¹^ORCID,Zhang Qirui¹^ORCID,Abillama Pierre¹^ORCID,Shoouri Sara¹^ORCID,Lee Changwoo¹^ORCID,Blaauw David¹^ORCID,Kim Hun-Seok¹^ORCID,Sylvester Dennis¹^ORCID

Affiliation:

1. Electrical and Computer Engineering, University of Michigan, Ann Arbor, Ann Arbor, MI, USA

Publisher

ACM

Reference56 articles.

1. Zaid Alyafeai , Maged Saeed AlShaibani, and Irfan Ahmad . 2020 . A survey on transfer learning in natural language processing. arXiv preprint arXiv:2007.04239 (2020). Zaid Alyafeai, Maged Saeed AlShaibani, and Irfan Ahmad. 2020. A survey on transfer learning in natural language processing. arXiv preprint arXiv:2007.04239 (2020).

2. Eunjin Baek , Dongup Kwon , and Jangwoo Kim . 2020 . A multi-neural network acceleration architecture . In 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA). IEEE, 940--953 . Eunjin Baek, Dongup Kwon, and Jangwoo Kim. 2020. A multi-neural network acceleration architecture. In 2020 ACM/IEEE 47th Annual International Symposium on Computer Architecture (ISCA). IEEE, 940--953.

3. Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell etal 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020) 1877--1901. Tom Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared D Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020) 1877--1901.

4. Daniel Cer , Mona Diab , Eneko Agirre , Inigo Lopez-Gazpio , and Lucia Specia . 2017. Semeval-2017 task 1: Semantic textual similarity-multilingual and cross-lingual focused evaluation. arXiv preprint arXiv:1708.00055 ( 2017 ). Daniel Cer, Mona Diab, Eneko Agirre, Inigo Lopez-Gazpio, and Lucia Specia. 2017. Semeval-2017 task 1: Semantic textual similarity-multilingual and cross-lingual focused evaluation. arXiv preprint arXiv:1708.00055 (2017).

5. Yujeong Choi and Minsoo Rhu . 2020 . Prema: A predictive multi-task scheduling algorithm for preemptible neural processing units . In 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA). IEEE, 220--233 . Yujeong Choi and Minsoo Rhu. 2020. Prema: A predictive multi-task scheduling algorithm for preemptible neural processing units. In 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA). IEEE, 220--233.