Self-Distillation from the Last Mini-Batch for Consistency Regularization-Reference-Cited by-同舟云学术

Self-Distillation from the Last Mini-Batch for Consistency Regularization

Published:2022-06 Issue: Volume: Page:
ISSN:
Container-title:2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
language:
Short-container-title:

Author:

Shen Yiqing¹,Xu Liwu²,Yang Yuzhe²,Li Yaqian²,Guo Yandong²

Affiliation:

1. Shanghai Jiao Tong University

2. OPPO Research Institute

Publisher

IEEE

Link

http://xplorestaging.ieee.org/ielx7/9878378/9878366/09879630.pdf?arnumber=9879630

Reference44 articles.

1. Regularizing Class-Wise Predictions via Self-Knowledge Distillation

2. CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features

3. Peer Collaborative Learning for Online Knowledge Distillation

4. Harmonized Dense Knowledge Distillation Training for Multi-Exit Architectures

5. Knowledge distillation and student-teacher learning for visual intelligence: A review and new outlooks;wang;IEEE Transactions on Pattern Analysis and Machine Intelligence,2021

Cited by 40 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Positional normalization-based mixed-image data augmentation and ensemble self-distillation algorithm;Expert Systems with Applications;2024-10

2. Deep knowledge distillation: A self-mutual learning framework for traffic prediction;Expert Systems with Applications;2024-10

3. An efficient training-from-scratch framework with BN-based structural compressor;Pattern Recognition;2024-09

4. Deep label embedding learning for classification;Applied Soft Computing;2024-09

5. Research on the Application of Pruning Algorithm Based on Local Linear Embedding Method in Traffic Sign Recognition;Applied Sciences;2024-08-15