Abstract
AbstractEvery year manufacturers of household appliances improve their devices, trying to make everyday life easier for users. New smart devices have many useful features, but not all users can easily cope with the complexity of the devices. One of the main tasks of household appliance manufacturers is to ensure the convenience of using appliances, taking into account the increasing complexity. Therefore, any manufacturer supplies equipment with a short but useful instruction manual. Practice shows that no printed user manual can compare with a demonstration of the device operation by a professional consultant. Instructions for home appliances using augmented reality technology will allow users to get the necessary detailed information about the device in a short period of time. As part of this work, the task of developing an artificial intelligence-based module is being solved. This module consists of developed classification, matching, and tracking submodules that can provide simple and fast visual instructions to users of household appliances in real time. The identification of household appliances is performed with more than 0.9 accuracy, and the tracking inside an unidentified object using the camera of a mobile device is processed with the success score of about 0.68 and frames per second (FPS) about 7. Mobile applications based on the proposed intelligent modules for Android and iOS were developed.
Publisher
Springer Science and Business Media LLC
Reference33 articles.
1. Geng, C., Huang, S. J. & Chen, S. Recent advances in open set recognition: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 43, 3614–3631 (2020).
2. Wang, Y., Yao, Q., Kwok, J. T. & Ni, L. M. Generalizing from a few examples: A survey on few-shot learning. ACM Comput. Surv. (CSUR) 53, 1–34 (2020).
3. Gonzalez-Zapata, J., Reyes-Amezcua, I., Flores-Araiza, D., Mendez-Ruiz, M., Ochoa-Ruiz, G. & Mendez-Vazquez, A. Guided deep metric learning. In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 1481–1489 (2022).
4. DeTone, D., Malisiewicz, T. & Rabinovich, A. Superpoint: Self-supervised interest point detection and description. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops 224–236 (2018).
5. Sarlin, P. E., DeTone, D., Malisiewicz, T. & Rabinovich, A. Superglue: Learning feature matching with graph neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 4938–4947 (2020).