1. Martín Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , : A system for large-scale machine learning . In OSDI , volume 16 , pages 265 -- 283 , 2016 . Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. Tensorflow: A system for large-scale machine learning. In OSDI, volume 16, pages 265--283, 2016.
2. Sparse Communication for Distributed Gradient Descent
3. The Convergence of Stochastic Gradient Descent in Asynchronous Shared Memory
4. Dan Alistarh , Demjan Grubic , Jerry Li , Ryota Tomioka , and Milan Vojnovic . Qsgd : Communicationefficient sgd via gradient quantization and encoding . In NIPS , pages 1709 -- 1720 , 2017 . Dan Alistarh, Demjan Grubic, Jerry Li, Ryota Tomioka, and Milan Vojnovic. Qsgd: Communicationefficient sgd via gradient quantization and encoding. In NIPS, pages 1709--1720, 2017.
5. Dan Alistarh , Torsten Hoefler , Mikael Johansson , Nikola Konstantinov , Sarit Khirirat , and Cédric Renggli . The convergence of sparsified gradient methods . In NIPS , pages 5977 -- 5987 , 2018 . Dan Alistarh, Torsten Hoefler, Mikael Johansson, Nikola Konstantinov, Sarit Khirirat, and Cédric Renggli. The convergence of sparsified gradient methods. In NIPS, pages 5977--5987, 2018.