ESCEPE: Early-Exit Network Section-Wise Model Compression Using Self-distillation and Weight Clustering-Reference-Cited by-同舟云学术

ESCEPE: Early-Exit Network Section-Wise Model Compression Using Self-distillation and Weight Clustering

Published:2023-05-08 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 6th International Workshop on Edge Systems, Analytics and Networking
language:
Short-container-title:

Author:

Khalilian Gourtani Saeed¹^ORCID,Meratnia Nirvana¹^ORCID

Affiliation:

1. Department of Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, Netherlands

Publisher

ACM

Reference29 articles.

1. Weight quantization in Boltzmann machines

2. Joseph Bingham , Noah Green , and Saman Zonouz . 2022. LegoNet: Memory Footprint Reduction Through Block Weight Clustering. In 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing , Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) . IEEE , 1--6. Joseph Bingham, Noah Green, and Saman Zonouz. 2022. LegoNet: Memory Footprint Reduction Through Block Weight Clustering. In 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech). IEEE, 1--6.

3. Xinshi Chen , Hanjun Dai , Yu Li , Xin Gao , and Le Song . 2020 . Learning to stop while learning to predict . In International Conference on Machine Learning. PMLR, 1520--1530 . Xinshi Chen, Hanjun Dai, Yu Li, Xin Gao, and Le Song. 2020. Learning to stop while learning to predict. In International Conference on Machine Learning. PMLR, 1520--1530.

4. Minsik Cho , Keivan A Vahid , Saurabh Adya , and Mohammad Rastegari . 2021 . Dkm: Differentiable k-means clustering layer for neural network compression. arXiv preprint arXiv:2108.12659 (2021). Minsik Cho, Keivan A Vahid, Saurabh Adya, and Mohammad Rastegari. 2021. Dkm: Differentiable k-means clustering layer for neural network compression. arXiv preprint arXiv:2108.12659 (2021).

5. CNN weight sharing based on a fast accuracy estimation metric