Dynamically Sacrificing Accuracy for Reduced Computation: Cascaded Inference Based on Softmax Confidence

Author:

Berestizshevsky KonstantinORCID,Even GuyORCID

Publisher

Springer International Publishing

Reference24 articles.

1. Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous systems (2015). Software available http://tensorflow.org/

2. Bodik, P.: Automating datacenter operations using machine learning. Ph.D. thesis, Berkeley, CA, USA (2010). aAI3555582

3. Bolukbasi, T., Wang, J., Dekel, O., Saligrama, V.: Adaptive neural networks for efficient inference, pp. 527–536 (2017)

4. Cambazoglu, B.B., et al.: Early exit optimizations for additive machine learned ranking systems. In: Proceedings of the Third ACM International Conference on Web Search and Data Mining, WSDM 2010, pp. 411–420. ACM, New York (2010). https://doi.org/10.1145/1718487.1718538

5. Chang, S., Lee, S.h., Kwak, N.: URNet: User-Resizable Residual Networks with Conditional Gating Module (2019). arXiv preprint: arXiv:1901.04687

Cited by 18 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Controlling the performance of deep neural networks using a single parameter;Evolutionary Intelligence;2024-04-24

2. Accelerating BERT inference with GPU-efficient exit prediction;Frontiers of Computer Science;2024-01-22

3. Multimodal Adaptive Inference for Document Image Classification with Anytime Early Exiting;Lecture Notes in Computer Science;2024

4. Prediction Privacy in Distributed Multi-Exit Neural Networks: Vulnerabilities and Solutions;Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security;2023-11-15

5. Zero time waste in pre-trained early exit neural networks;Neural Networks;2023-11

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3