Deep Learning Based Object Detection with Unmanned Aerial Vehicle Equipped with Embedded System

Abstract

This study aims to introduce an Unmanned Aerial Vehicle (UAV) platform capable of performing real-time object detection and classification tasks using computer vision techniques in the field of artificial intelligence. Previous scientific research reveals the utilization of two different methods for object detection and classification via UAVs. One of these methods involves transmitting the acquired UAV images to a ground control center for processing, whereafter the processed data is relayed back to the UAV. The other approach entails transferring images over the internet to a cloud system, where image processing is conducted, and the resultant data is subsequently sent back to the UAV. This allows the UAV to autonomously perform predefined tasks. Enabling the UAV with autonomous decision-making capabilities and the ability to perform object detection and classification from recorded images requires an embedded artificial intelligence module. The ability of the UAV to utilize image processing technologies through embedded systems significantly enhances its object detection and classification capabilities, providing it with a significant advantage. This enables the UAV to be used more effectively and reliably in various tasks. In the proposed approach, image processing was achieved by mounting a Raspberry Pi 4 and camera on the UAV. Additionally, a Raspberry Pi-compatible 4G/LTE modem kit was used to provide remote intervention capability, and the Coral Edge TPU auxiliary processor was used to increase object detection speed. The TensorFlow Library and the SSD MobilNetV2 convolutional neural network model were used for image processing. During test flights, accuracy values of approximately 96.3% for car detection and 96.2% for human detection were achieved.