AdvSCOD: Bayesian-Based Out-Of-Distribution Detection via Curvature Sketching and Adversarial Sample Enrichment
-
Published:2023-01-29
Issue:3
Volume:11
Page:692
-
ISSN:2227-7390
-
Container-title:Mathematics
-
language:en
-
Short-container-title:Mathematics
Author:
Qiao Jiacheng1, Zhong Chengzhi1, Zhu Peican2ORCID, Tang Keke13
Affiliation:
1. Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou 510006, China 2. School of Artificial Intelligence, Optics, and Electronics (iOPEN), Northwestern Polytechnical University, Xi’an 710072, China 3. Department of New Networks, Peng Cheng Laboratory, Shenzhen 518066, China
Abstract
Detecting out-of-distribution (OOD) samples is critical for the deployment of deep neural networks (DNN) in real-world scenarios. An appealing direction in which to conduct OOD detection is to measure the epistemic uncertainty in DNNs using the Bayesian model, since it is much more explainable. SCOD sketches the curvature of DNN classifiers based on Bayesian posterior estimation and decomposes the OOD measurement into the uncertainty of the model parameters and the influence of input samples on the DNN models. However, since lots of approximation is applied, and the influence of the input samples on DNN models can be hardly measured stably, as demonstrated in adversarial attacks, the detection is not robust. In this paper, we propose a novel AdvSCOD framework that enriches the input sample with a small set of its neighborhoods generated by applying adversarial perturbation, which we believe can better reflect the influence on model predictions, and then we average their uncertainties, measured by SCOD. Extensive experiments with different settings of in-distribution and OOD datasets validate the effectiveness of AdvSCOD in OOD detection and its superiority to state-of-the-art Bayesian-based methods. We also evaluate the influence of different types of perturbation.
Funder
National Key Research and Development Project of China National Natural Science Foundation of China Science and Technology Program of Guangzhou Guangdong Basic and Applied Basic Research Foundation
Subject
General Mathematics,Engineering (miscellaneous),Computer Science (miscellaneous)
Reference50 articles.
1. Deep learning;LeCun;Nature,2015 2. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA. 3. Tang, K., Ma, Y., Miao, D., Song, P., Gu, Z., Tian, Z., and Wang, W. (2022). Decision fusion networks for image classification. IEEE Trans. Neural Netw. Learn. Syst. 4. Simonyan, K., and Zisserman, A. (2015, January 7–9). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA. 5. Bendale, A., and Boult, T. (2015, January 7–12). Towards open world recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Matching Words for Out-of-distribution Detection;2023 IEEE International Conference on Data Mining (ICDM);2023-12-01
|
|