Predictive tracking of an object by a pan–tilt camera of a robot
-
Published:2023-02-16
Issue:9
Volume:111
Page:8383-8395
-
ISSN:0924-090X
-
Container-title:Nonlinear Dynamics
-
language:en
-
Short-container-title:Nonlinear Dyn
Author:
Nebeluk RobertORCID, Zarzycki Krzysztof, Seredyński Dawid, Chaber Patryk, Figat Maksym, Domański Paweł D., Zieliński Cezary
Abstract
AbstractMoving-object tracking using a pan–tilt camera setup is quite a well-known task in robotics. However, the presented research addresses specific properties of the tracked object and introduces novel features to the pan–tilt camera control strategy. Pan–tilt camera control does not operate in an isolated environment. It is a part of the visual servoing system with specific goals. The system has to fulfill certain purposes, which affect its configuration and functionality. The pan–tilt system aims at keeping the visually tracked object within the middle of the image. At the same time, the overall visual servoing efficiently recognizes and tracks the object enabling its grasping by the robot arm. It uses a predictive strategy utilizing specific second-order linear models for pan and tilt joints. Model predictive control (MPC) introduces into the system the ability to predict camera operation over the specific horizon according to the predefined tracking goals. As the system anticipates future positions over the horizon of operation, the setpoint prediction of the future tracked system positions is required. Visual object recognition and tracking system use particular strategies for preparing online tracked object extrapolation over MPC horizon. Therefore, the pan–tilt camera system is intrinsically coupled to camera-based recognition and tracking. Predictive pan–tilt positioning keeps the tracked system in the middle of the image, while the visual system extrapolation improves the tracking performance. The proposed approach is thoroughly tested in the dedicated Gazebo-based robot simulator. Finally, the system is implemented and validated on the Velma robot. The results and their comparison with other control strategies confirm the initial assumptions, allowing further visual servoing system development.
Funder
POB Research Centre for Artificial Intelligence and Robotics of Warsaw University of Technology within the Excellence Initiative Program - Research University
Publisher
Springer Science and Business Media LLC
Subject
Electrical and Electronic Engineering,Applied Mathematics,Mechanical Engineering,Ocean Engineering,Aerospace Engineering,Control and Systems Engineering
Reference44 articles.
1. Bemporad, A., Morari, M.: Robust model predictive control: a survey. In: Garulli, A., Tesi, A. (eds.) Robustness in Identification and Control, pp. 207–226. Springer, London, London (1999) 2. Chaumette, F.: Visual servoing. In: Ang, M.H., Khatib, O., Siciliano, B. (eds.) Encyclopedia of Robotics, pp. 1–9. Springer, Berlin, Heidelberg (2020) 3. Chaumette, F., Hutchinson, S.: Visual servo control. i. basic approaches. IEEE Robot. Autom. Mag. 13(4), 82–90 (2006) 4. Chaumette, F., Hutchinson, S.: Visual servo control. ii. advanced approaches [tutorial]. IEEE Robot. Autom. Mag. 14(1), 109–118 (2007) 5. Chen, H., Zhao, X., Tan, M.: A novel pan-tilt camera control approach for visual tracking. In: Proceeding of the 11th World Congress on Intelligent Control and Automation, pp. 2860–2865 (2014)
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Motion Detection Car using WiFi Cam and NodeMCU;International Journal of Advanced Research in Science, Communication and Technology;2023-12-26 2. Building a Robot to Identify Electric Vehicles from Infrared Images;2023 IEEE 14th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON);2023-10-12 3. Learning Template-Constraint Real-Time Siamese Tracker for Drone AI Devices via Concatenation;Drones;2023-09-20 4. A simple yet smart head module for mobile manipulators*;2023 IEEE 28th International Conference on Emerging Technologies and Factory Automation (ETFA);2023-09-12 5. Plenoptic Camera Viewpoints Rotation to Improve 3D Face Reconstruction;2023 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC);2023-04-26
|
|