Affiliation:
1. School of Computer Science and Technology, Harbin University of Science and Technology, No. 52 Xuefu Road, Nangang District, Harbin 150080, China
Abstract
Detecting pedestrians in low-light conditions is challenging, especially in the context of wearable platforms. Infrared cameras have been employed to enhance detection capabilities, whereas low-light cameras capture the more intricate features of pedestrians. With this in mind, we introduce a low-light pedestrian detection (called HRBUST-LLPED) dataset by capturing pedestrian data on campus using wearable low-light cameras. Most of the data were gathered under starlight-level illumination. Our dataset annotates 32,148 pedestrian instances in 4269 keyframes. The pedestrian density reaches high values with more than seven people per image. We provide four lightweight, low-light pedestrian detection models based on advanced YOLOv5 and YOLOv8. By training the models on public datasets and fine-tuning them on the HRBUST-LLPED dataset, our model obtained 69.90% in terms of AP@0.5:0.95 and 1.6 ms for the inference time. The experiments demonstrate that our research can assist in advancing pedestrian detection research by using low-light cameras in wearable devices.
Funder
Key Research and Development Project of Heilongjiang Province
2020 Heilongjiang Province Higher Education Teaching Reform Project
Subject
Electrical and Electronic Engineering,Mechanical Engineering,Control and Systems Engineering
Reference43 articles.
1. Adaptive Threshold Based ZUPT for Single IMU Enabled Wearable Pedestrian Localization;Li;IEEE Internet Things J.,2023
2. Wearable supernumerary robotic limb system using a hybrid control approach based on motor imagery and object detection;Tang;IEEE Trans. Neural Syst. Rehabil. Eng.,2022
3. Han, Y., Yarlagadda, S.K., Ghosh, T., Zhu, F., Sazonov, E., and Delp, E.J. (2023). Improving food detection for images from a wearable egocentric camera. arXiv.
4. Li, X., Holiday, S., Cribbet, M., Bharadwaj, A., White, S., Sazonov, E., and Gan, Y. (2022, January 11–15). Non-Invasive Screen Exposure Time Assessment Using Wearable Sensor and Object Detection. Proceedings of the 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Glasgow, UK.
5. Kim, J., and Moon, N. (2022). Dog behavior recognition based on multimodal data from a camera and wearable device. Appl. Sci., 12.