A review of fine-grained sketch image retrieval based on deep learning
-
Published:2023
Issue:12
Volume:20
Page:21186-21210
-
ISSN:1551-0018
-
Container-title:Mathematical Biosciences and Engineering
-
language:
-
Short-container-title:MBE
Author:
Luo Qing1, Gao Xiang1, Jiang Bo1, Yan Xueting1, Liu Wanyuan1, Ge Junchao2
Affiliation:
1. Yuxi Power Supply Bureau, Yunnan Power Grid Co., Ltd., Yuxi, China 2. Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
Abstract
<abstract>
<p>Sketch image retrieval is an important branch of the image retrieval field, mainly relying on sketch images as queries for content search. The acquisition process of sketch images is relatively simple and in some scenarios, such as when it is impossible to obtain photos of real objects, it demonstrates its unique practical application value, attracting the attention of many researchers. Furthermore, traditional generalized sketch image retrieval has its limitations when it comes to practical applications; merely retrieving images from the same category may not adequately identify the specific target that the user desires. Consequently, fine-grained sketch image retrieval merits further exploration and study. This approach offers the potential for more precise and targeted image retrieval, making it a valuable area of investigation compared to traditional sketch image retrieval. Therefore, we comprehensively review the fine-grained sketch image retrieval technology based on deep learning and its applications and conduct an in-depth analysis and summary of research literature in recent years. We also provide a detailed introduction to three fine-grained sketch image retrieval datasets: Queen Mary University of London (QMUL) ShoeV2, ChairV2 and PKU Sketch Re-ID, and list common evaluation metrics in the sketch image retrieval field, while showcasing the best performance achieved for these datasets. Finally, we discuss the existing challenges, unresolved issues and potential research directions in this field, aiming to provide guidance and inspiration for future research.</p>
</abstract>
Publisher
American Institute of Mathematical Sciences (AIMS)
Subject
Applied Mathematics,Computational Mathematics,General Agricultural and Biological Sciences,Modeling and Simulation,General Medicine
Reference61 articles.
1. P. Xu, T. M. Hospedales, Q. Yin, Y. Z. Song, T. Xiang, L. Wang, Deep learning for free-hand sketch: A survey, IEEE Trans. Pattern Anal. Mach. Intell., 45 (2022), 285–312. https://doi.org/10.1109/TPAMI.2022.3148853 2. A. K. Bhunia, P. N. Chowdhury, Y. Yang, T. M. Hospedales, T. Xiang, Y. Z. Song, Vectorization and rasterization: Self-supervised learning for sketch and handwriting, in Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR), (2021), 5668–5677. https://doi.org/10.1109/CVPR46437.2021.00562 3. A. Qi, Y. Gryaditskaya, J. Song, Y. Yang, Y. Qi, T. M. Hospedales, et al., Toward fine-grained sketch-based 3D shape retrieval, IEEE Trans. Image Process., 30 (2021), 8595–8606. https://doi.org/10.1109/TIP.2021.3118975 4. P. Sangkloy, N. Burnell, C. Ham, J. Hays, The sketchy database: Learning to retrieve badly drawn bunnies, ACM Trans. Graphics, 35 (2016), 1–12. https://doi.org/10.1145/2897824.2925954 5. Q. Yu, F. Liu, Y. Z. Song, T. Xiang, T. M. Hospedales, C. C. Loy, Sketch me that shoe, in Proceedings of the 2016 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2016), 799–807. https://doi.org/10.1109/CVPR.2016.93
|
|