A Large-Class Few-Shot Learning Method Based on High-Dimensional Features
-
Published:2023-11-30
Issue:23
Volume:13
Page:12843
-
ISSN:2076-3417
-
Container-title:Applied Sciences
-
language:en
-
Short-container-title:Applied Sciences
Author:
Dang Jiawei1, Zhou Yu1, Zheng Ruirui1, He Jianjun1ORCID
Affiliation:
1. College of Information and Communication Engineering, Dalian Minzu University, Dalian 116620, China
Abstract
Large-class few-shot learning has a wide range of applications in many fields, such as the medical, power, security, and remote sensing fields. At present, many few-shot learning methods for fewer-class scenarios have been proposed, but little research has been performed for large-class scenarios. In this paper, we propose a large-class few-shot learning method called HF-FSL, which is based on high-dimensional features. Recent theoretical research shows that if the distribution of samples in a high-dimensional feature space meets the conditions of compactness within the class and the dispersion between classes, the large-class few-shot learning method has a better generalization ability. Inspired by this theory, the basic idea is use a deep neural network to extract high-dimensional features and unitize them to project the samples onto a hypersphere. The global orthogonal regularization strategy can then be used to make samples of different classes on the hypersphere that are as orthogonal as possible, so as to achieve the goal of sample compactness within the class and the dispersion between classes in high-dimensional feature space. Experiments on Omniglot, Fungi, and ImageNet demonstrate that the proposed method can effectively improve the recognition accuracy in a large-class FSL problem.
Funder
the National Natural Science Foundation of China the Humanities and Social Science Research Project of Ministry of Education the Natural Science Foundation of Liaoning Province
Subject
Fluid Flow and Transfer Processes,Computer Science Applications,Process Chemistry and Technology,General Engineering,Instrumentation,General Materials Science
Reference35 articles.
1. Miller, E.G., Matsakis, N.E., and Viola, P.A. (2000, January 15). Learning from one example through shared densities on transforms. Proceedings of the Proceedings IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2000 (Cat. No. PR00662), Hilton Head Island, SC, USA. 2. Tran, T.O., Vo, T.H., and Le, N.Q.K. (2023). Omics-based deep learning approaches for lung cancer decision-making and therapeutics development. Briefings Funct. Genom., elad031. 3. Identifying SNARE proteins using an alignment-free method based on multiscan convolutional neural network and PSSM profiles;Kha;J. Chem. Inf. Model.,2022 4. Deep learning applications in surgery: Current uses and future directions;Morris;Am. Surg.,2023 5. Vinyals, O., Blundell, C., Lillicrap, T., Kavukcuoglu, K., and Wierstra, D. (2016, January 5–10). Matching networks for one shot learning. Proceedings of the 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain.
|
|