1. 2016. A New Lightweight Modular and Scalable Deep Learning Framework. https://caffe2.ai/. 2016. A New Lightweight Modular and Scalable Deep Learning Framework. https://caffe2.ai/.
2. 2018. Baidu-allreduce. https://github.com/baidu-research/baidu-allreduce. 2018. Baidu-allreduce. https://github.com/baidu-research/baidu-allreduce.
3. 2019. Byteps A high performance and generic framework for distributed DNN training. https://github.com/bytedance/byteps. 2019. Byteps A high performance and generic framework for distributed DNN training. https://github.com/bytedance/byteps.
4. 2019. GpipeTalk. https://www.youtube.com/watch?v=9s2cum25Kkc. 2019. GpipeTalk. https://www.youtube.com/watch?v=9s2cum25Kkc.
5. 2019. Gradients Accumulation-PyTorch. https://gist.github.com/thomwolf/ac7a7da6b1888c2eeac8ac8b9b05d3d3. 2019. Gradients Accumulation-PyTorch. https://gist.github.com/thomwolf/ac7a7da6b1888c2eeac8ac8b9b05d3d3.