Peta-Scale Embedded Photonics Architecture for Distributed Deep Learning Applications-Reference-Cited by-同舟云学术

Peta-Scale Embedded Photonics Architecture for Distributed Deep Learning Applications

Published:2023-06-15 Issue:12 Volume:41 Page:3737-3749
ISSN:0733-8724
Container-title:Journal of Lightwave Technology
language:
Short-container-title:J. Lightwave Technol.

Author:

Wu Zhenguo¹^ORCID,Dai Liang Yuan¹,Novick Asher¹^ORCID,Glick Madeleine¹,Zhu Ziyi¹^ORCID,Rumley Sébastien²^ORCID,Michelogiannakis George³^ORCID,Shalf John³^ORCID,Bergman Keren⁴^ORCID

Affiliation:

1. Electrical Engineering, Columbia University, New York, NY, USA

2. Electrical Engineering, University of Applied Sciences and Arts Western Switzerland, Delemont, Switzerland

3. Computer Science, Lawrence Berkeley National Laboratory, Berkeley, CA, USA

4. Electrical Engineering Department, Columbia University, New York, NY, USA

Funder

ARPA-E ENLITENED Program

National Security Agency

Laboratory for Physical Sciences

Research Initiative

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Subject

Atomic and Molecular Physics, and Optics

Link

http://xplorestaging.ieee.org/ielx7/50/10164793/10124987.pdf?arnumber=10124987

Reference90 articles.

1. Efficient large-scale language model training on GPU clusters using megatron-LM

2. Hybrid Electrical/Optical Switch Architectures for Training Distributed Deep Learning in Large-Scale

3. Software-hardware co-design for fast and scalable training of deep learning recommendation models

4. Generalized Hypercube and Hyperbus Structures for a Computer Network

5. Nvidia v100 tensor core gpu,2020

Cited by 6 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Production;2024 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS);2024-05-05

2. Flexible silicon photonic architecture for accelerating distributed deep learning;Journal of Optical Communications and Networking;2024-01-09

3. Inter-Node Message Passing Through Optical Reconfigurable Memory Channel;IEEE Access;2024

4. Photonic Thought;SpringerBriefs in Applied Sciences and Technology;2024

5. Wavelength Reconfigurable Transceiver For Multi-Interface Compute Accelerator Networks;Optical Fiber Communication Conference (OFC) 2024;2024