Training and Serving System of Foundation Models: A Comprehensive Survey-Reference-Cited by-同舟云学术

Training and Serving System of Foundation Models: A Comprehensive Survey

Published:2024 Issue: Volume:5 Page:107-119
ISSN:2644-1268
Container-title:IEEE Open Journal of the Computer Society
language:
Short-container-title:IEEE Open J. Comput. Soc.

Author:

Zhou Jiahang¹^ORCID,Chen Yanyu²^ORCID,Hong Zicong³^ORCID,Chen Wuhui⁴^ORCID,Yu Yue⁵^ORCID,Zhang Tao¹^ORCID,Wang Hui⁵^ORCID,Zhang Chuanfu¹^ORCID,Zheng Zibin⁴^ORCID

Affiliation:

1. School of Systems Science and Engineering, Sun Yat-sen University, Guangzhou, China

2. School of Informatics, Xiamen University, Xiamen, China

3. Department of Computing, The Hong Kong Polytechnic University, Hong Kong SAR, China

4. School of Software Engineering, Sun Yat-sen University, Guangzhou, China

5. Peng Cheng Laboratory, Shenzhen, China

Funder

National Key Research and Development Plan

National Natural Science Foundation of China

National Natural Science Foundation of Guangdong

Major Key Project of PCL

CAAI-MindSpore Open Fund

Guangdong Provincial Pearl River Talents Program

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Link

http://xplorestaging.ieee.org/ielx7/8782664/10375894/10478189.pdf?arnumber=10478189

Reference97 articles.

1. Language models are few-shot learners;Brown,2020

2. Llama: Open and efficient foundation language models;Touvron,2023

3. PanGu-$\Sigma$: Towards trillion parameter language model with sparse heterogeneous computing;Ren,2023

4. PengCheng Mind

5. A Survey on Evaluation of Large Language Models

Cited by 1 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Green Edge AI: A Contemporary Survey;Proceedings of the IEEE;2024