Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters-Reference-Cited by-同舟云学术

Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters

Published:2022-08-14 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
language:
Short-container-title:

Author:

Lian Xiangru¹,Yuan Binhang²,Zhu Xuefeng³,Wang Yulong³,He Yongjun²,Wu Honghuan³,Sun Lei³,Lyu Haodong³,Liu Chengjun³,Dong Xing³,Liao Yiqiao³,Luo Mingnan³,Zhang Congfei³,Xie Jingru³,Li Haonan³,Chen Lei³,Huang Renjie³,Lin Jianying³,Shu Chengchun³,Qiu Xuezhong³,Liu Zhishan⁴,Kong Dongying³,Yuan Lei³,Yu Hai³,Yang Sen³,Zhang Ce²,Liu Ji⁵

Affiliation:

1. Kwai Inc, Seattle , WA, USA

2. ETH, Zurich, Switzerland

3. Kuaishou, Beijing, China

4. Kuaishou, Beijng, China

5. Kwai Inc, Seattle, WA, USA

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3534678.3539070

Reference35 articles.

1. (n.d.) Avazu CTR. www.kaggle.com/c/avazu-ctr-prediction. (n.d.) Avazu CTR. www.kaggle.com/c/avazu-ctr-prediction.

2. (n.d.) Criteo CTR. ailab.criteo.com/download-criteo-1tb-click-logs-dataset. (n.d.) Criteo CTR. ailab.criteo.com/download-criteo-1tb-click-logs-dataset.

3. (n.d.) Parallel Distributed Deep Learning: Machine Learning Framework from Industrial Practice. https://www.paddlepaddle.org.cn/. (n.d.) Parallel Distributed Deep Learning: Machine Learning Framework from Industrial Practice. https://www.paddlepaddle.org.cn/.

4. (n.d.) Taobao CTR. www.kaggle.com/pavansanagapati/ad-displayclick-dataon-taobaocom. (n.d.) Taobao CTR. www.kaggle.com/pavansanagapati/ad-displayclick-dataon-taobaocom.

5. Jianmin Chen , Xinghao Pan , Rajat Monga , Samy Bengio , and Rafal Jozefowicz . 2016. Revisiting distributed synchronous SGD. arXiv preprint arXiv:1604.00981 ( 2016 ). Jianmin Chen, Xinghao Pan, Rajat Monga, Samy Bengio, and Rafal Jozefowicz. 2016. Revisiting distributed synchronous SGD. arXiv preprint arXiv:1604.00981 (2016).

Cited by 14 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Energy-Efficient Federated Knowledge Distillation Learning in Internet of Drones;2024 IEEE International Conference on Communications Workshops (ICC Workshops);2024-06-09

2. AtRec: Accelerating Recommendation Model Training on CPUs;IEEE Transactions on Parallel and Distributed Systems;2024-06

3. CAFE: Towards Compact, Adaptive, and Fast Embedding for Large-scale Recommendation Models;Proceedings of the ACM on Management of Data;2024-03-12

4. POSTER: Pattern-Aware Sparse Communication for Scalable Recommendation Model Training;Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming;2024-02-20

5. Enhancing the Accuracy of 6T SRAM-Based In-Memory Architecture via Maximum Likelihood Detection;IEEE Transactions on Signal Processing;2024