Preventing Catastrophic Forgetting in Continual Learning of New Natural Language Tasks-Reference-Cited by-同舟云学术

Preventing Catastrophic Forgetting in Continual Learning of New Natural Language Tasks

Published:2022-08-14 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
language:
Short-container-title:

Author:

Kar Sudipta¹,Castellucci Giuseppe¹,Filice Simone²,Malmasi Shervin¹,Rokhlenko Oleg¹

Affiliation:

1. Amazon, Seattle, WA, USA

2. Amazon, Tel Aviv, Israel

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3534678.3539169

Reference27 articles.

1. Rainbow Memory: Continual Learning with a Memory of Diverse Samples

2. Rich Caruana . 1993 . Multitask Learning: A Knowledge-Based Source of Inductive Bias. In ICML. Rich Caruana. 1993. Multitask Learning: A Knowledge-Based Source of Inductive Bias. In ICML.

3. Giuseppe Castellucci , Simone Filice , Danilo Croce , and Roberto Basili . 2021. Learning to Solve NLP Tasks in an Incremental Number of Languages . In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) . Association for Computational Linguistics , Online , 837--847. https://doi.org/10. 1865 3/v1/2021.acl-short.106 Giuseppe Castellucci, Simone Filice, Danilo Croce, and Roberto Basili. 2021. Learning to Solve NLP Tasks in an Incremental Number of Languages. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers). Association for Computational Linguistics, Online, 837--847. https://doi.org/10.18653/v1/2021.acl-short.106

4. Zhiyuan Chen , Bing Liu , Ronald Brachman , Peter Stone , and Francesca Rossi . 2018. Lifelong Machine Learning ( 2 nd ed.). Morgan-Claypool Publishers . Zhiyuan Chen, Bing Liu, Ronald Brachman, Peter Stone, and Francesca Rossi. 2018. Lifelong Machine Learning (2nd ed.). Morgan-Claypool Publishers.

5. Kevin Clark , Minh-Thang Luong , Urvashi Khandelwal , Christopher D. Manning , and Quoc V. Le . 2019. BAM! Born-Again Multi-Task Networks for Natural Language Understanding . In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics , Florence, Italy, 5931--5937. https://doi.org/10. 1865 3/v1/P19--1595 Kevin Clark, Minh-Thang Luong, Urvashi Khandelwal, Christopher D. Manning, and Quoc V. Le. 2019. BAM! Born-Again Multi-Task Networks for Natural Language Understanding. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Florence, Italy, 5931--5937. https://doi.org/10.18653/v1/P19--1595