Flexible thermal camera solution for Smart city people detection and counting

Abstract

AbstractTourism management plays an important role in the context of Smart Cities. In this work, we have used thermal cameras for the development of an Object Detection solution in pedestrian areas. The solution can classify people, bikes, strollers, and count people in Real-Time by using telephoto and wide-angle thermal cameras, in hot squares where there is a relevant number of people passing by. This work has improved FASTER-R-CNN and YOLOv5 architectures with new data sets and fine-tuning approaches to enhance mean average precision and flexibility whether compared to state of the art solutions. Both top-down and bottom-up training adaptation approaches have been assessed in order to demonstrate that the proposed bottom-up approach can provide better results. Results have overcome the state-of-the-art in terms of mean Average Precision in counting (i) for relevant number of people in the scene (removing the limitation of previous state-of-the-art solutions that were set to provide good precision up to 10 people) and (ii) in terms of flexibility with respect to different kinds of camera and resolutions. The resulting model can produce results also when executed on thermal camera and in Real-Time on industrial PC of mid-level. The proposed solution has been developed and validated in the framework of the Herit-Data EC project and it has exploited the Snap4City platform for the final collection of data results, monitoring and their publication on real time dashboards.