Just-In-Time Checkpointing: Low Cost Error Recovery from Deep Learning Training Failures-Reference-Cited by-同舟云学术

登录注册会员服务联系我们

Just-In-Time Checkpointing: Low Cost Error Recovery from Deep Learning Training Failures

Published:2024-04-22 Issue: Volume:57 Page:1110-1125
ISSN:
Container-title:Proceedings of the Nineteenth European Conference on Computer Systems
language:
Short-container-title:

Author:

Gupta Tanmaey¹^ORCID,Krishnan Sanjeev¹^ORCID,Kumar Rituraj¹^ORCID,Vijeev Abhishek¹^ORCID,Gulavani Bhargav¹^ORCID,Kwatra Nipun¹^ORCID,Ramjee Ramachandran¹^ORCID,Sivathanu Muthian¹^ORCID

Affiliation:

1. Microsoft Research

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3627703.3650085

Reference39 articles.

1. BLOOM Training. https://huggingface.co/blog/bloom-megatron-deepspeed#training-difficulties.

2. Boost Checkpoint Speed and Reduce Cost with Nebula. https://learn.microsoft.com/en-us/azure/machine-learning/reference-checkpoint-performance-for-large-models.

3. CRIU: Checkpoint Restore in Userspace. https://criu.org/Main_Page.

4. Deepspeed. https://www.deepspeed.ai/.

5. DeepSpeed: Extreme-scale model training for everyone. https://www.microsoft.com/en-us/research/blog/deepspeed-extreme-scale-model-training-for-everyone/.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线，采集、加工和组织学术论文而形成的新型学术文献查询和分析系统，可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容，当前同舟云学术共收录了国内外主流学术期刊6万余种，收集的期刊论文及会议论文总量共计约1.5亿篇，并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询！咨询电话：010-8811{复制后删除}0370

www.globalauthorid.com

TOP