Abstract
Recognizing texts in images plays an important role in many applications, such as industrial intelligence, robot vision, automatic driving, command assistance, and scene understanding. Although great progress has been achieved in various fields, research on complex systems modeling using text recognition technology requires further attention. To address this, we propose a new end-to-end multi-task learning method, which includes a super-resolution branch (SRB) and a recognition branch. To effectively learn the semantic information of images, we utilize the feature pyramid network (FPN) to fuse high- and low-level semantic information. The feature map generated by FPN is then delivered separately to the super-resolution branch and the recognition branch. We introduce a novel super-resolution branch, the SRB based on the proposed dual attention mechanism (DAM), designed to enhance the capability of learning low-resolution text features. The DAM incorporates the residual channel attention to enhance channel dependencies and the character attention module to focus on context information. For the recognition branch, the feature map generated by FPN is fed into an RNN sequence module, and an attention-based decoder is constructed to predict the results. To address the issue of low-resolution text recognition in numerous Chinese scenes, we propose the Chinese super-resolution datasets instead of relying on traditional down-sampling techniques to generate training datasets. Experiments demonstrate that the proposed method performs robustly on low-resolution text images and achieves competitive results on benchmark datasets.
Publisher
Public Library of Science (PLoS)
Reference48 articles.
1. Borisyuk F, Gordo A, Sivakumar V. Rosetta: Large Scale System for Text Detection and Recognition in Images. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. London, UK: ACM; 2018. p. 71–79.
2. Cheng Z, Bai F, Xu Y, Zheng G, Pu S, Zhou S. Focusing Attention: Towards Accurate Text Recognition in Natural Images. In: 2017 IEEE International Conference on Computer Vision (ICCV). Venice, Italy: IEEE; 2017. p. 5086–5094.
3. Lee CY, Osindero S. Recursive Recurrent Nets with Attention Modeling for OCR in the Wild. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Vegas, NV, USA: IEEE; 2016. p. 2231–2239.
4. Char-Net: A Character-Aware Neural Network for Distorted Scene Text Recognition;W Liu;Proceedings of the AAAI Conference on Artificial Intelligence,2018
5. Wang J, Hu X. Gated Recurrent Convolution Neural Network for OCR. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, et al., editors. Advances in Neural Information Processing Systems. vol. 30. Curran Associates, Inc.; 2017.