1. December. 15 2021. Effective Transformer. https://github.com/bytedance/effectivetransformer. December. 15 2021. Effective Transformer. https://github.com/bytedance/effectivetransformer.
2. December 15 2021. FasterTransformer. https://github.com/NVIDIA/FasterTransformer. December 15 2021. FasterTransformer. https://github.com/NVIDIA/FasterTransformer.
3. Scale-Out vs Scale-Up
4. TSM2
5. Tianqi Chen , Mu Li , Yutian Li , Min Lin , Naiyan Wang , Minjie Wang , Tianjun Xiao , Bing Xu , Chiyuan Zhang , and Zheng Zhang . 2015 . Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274(2015). Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. 2015. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274(2015).