RFR: Representation-Focused Replay for Overcoming the Catastrophic Forgetting in Lifelong Language Learning

Author:

Han Zhongyuan1ORCID,Peng Zeyang1ORCID,Kong Leilei1ORCID,Ye Zhanhong1ORCID,Huang Mingjie1ORCID,Qi Haoliang1ORCID

Affiliation:

1. FOSHAN university, China

Funder

the National Social Science Foundation of China

Publisher

ACM

Reference29 articles.

1. ScaIL: Classifier Weights Scaling for Class Incremental Learning

2. Arslan Chaudhry , Marc’Aurelio Ranzato , Marcus Rohrbach , and Mohamed Elhoseiny . 2019 . Efficient Lifelong Learning with A-GEM. In 7th International Conference on Learning Representations, ICLR 2019 , New Orleans, LA, USA , May 6-9, 2019. OpenReview.net. https://openreview.net/forum?id=Hkf2_sC5FX Arslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, and Mohamed Elhoseiny. 2019. Efficient Lifelong Learning with A-GEM. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net. https://openreview.net/forum?id=Hkf2_sC5FX

3. Lifelong Machine Learning

4. Matthias De Lange , Rahaf Aljundi , Marc Masana , Sarah Parisot , Xu Jia , Aleš Leonardis , Gregory Slabaugh , and Tinne Tuytelaars . 2021. A continual learning survey: Defying forgetting in classification tasks . IEEE transactions on pattern analysis and machine intelligence 44, 7 ( 2021 ), 3366–3385. Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Aleš Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. 2021. A continual learning survey: Defying forgetting in classification tasks. IEEE transactions on pattern analysis and machine intelligence 44, 7 (2021), 3366–3385.

5. Cyprien de Masson d’Autume , Sebastian Ruder , Lingpeng Kong , and Dani Yogatama . 2019 . Episodic Memory in Lifelong Language Learning. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019 , NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d’Alché-Buc, Emily B. Fox, and Roman Garnett (Eds.). 13122–13131. https://proceedings.neurips.cc/paper/2019/hash/f8d2e80c1458ea2501f98a2cafadb397-Abstract.html Cyprien de Masson d’Autume, Sebastian Ruder, Lingpeng Kong, and Dani Yogatama. 2019. Episodic Memory in Lifelong Language Learning. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d’Alché-Buc, Emily B. Fox, and Roman Garnett (Eds.). 13122–13131. https://proceedings.neurips.cc/paper/2019/hash/f8d2e80c1458ea2501f98a2cafadb397-Abstract.html

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3