High-Level Data Abstraction and Elastic Data Caching for Data-Intensive AI Applications on Cloud-Native Platforms-Reference-Cited by-同舟云学术

High-Level Data Abstraction and Elastic Data Caching for Data-Intensive AI Applications on Cloud-Native Platforms

Published:2023-11 Issue:11 Volume:34 Page:2946-2964
ISSN:1045-9219
Container-title:IEEE Transactions on Parallel and Distributed Systems
language:
Short-container-title:IEEE Trans. Parallel Distrib. Syst.

Author:

Gu Rong¹^ORCID,Xu Zhihao²,Che Yang²^ORCID,Wang Xu¹,Dai Haipeng¹^ORCID,Zhang Kai²,Fan Bin³,Hou Haojun¹,Yi Li²,Ding Yu²,Huang Yihua¹^ORCID,Chen Guihai¹^ORCID

Affiliation:

1. State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China

2. Alibaba Group, Hangzhou, Zhejiang, China

3. Alluxio. Inc., San Mateo, CA, USA

Funder

National Natural Science Foundation of China

Jiangsu Province Science and Technology Key Program

Fundamental Research Funds for the Central Universities

Collaborative Innovation Center of Novel Software Technology and Industrialization

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Subject

Computational Theory and Mathematics,Hardware and Architecture,Signal Processing

Link

http://xplorestaging.ieee.org/ielx7/71/10248992/10249214.pdf?arnumber=10249214

Reference41 articles.

1. Characterizing Deep-Learning I/O Workloads in TensorFlow

2. DIESEL: A Dataset-Based Distributed Storage and Caching System for Large-Scale Deep Learning Training

3. Enabling Efficient Large-Scale Deep Learning Training with Cache Coherent Disaggregated Memory Systems

4. Hoard: A distributed data caching system to accelerate deep learning training on the cloud;pinto;Comput Res Repository,2018

5. Entropy-Aware I/O Pipelining for Large-Scale Deep Learning on HPC Systems