The method to annotate buildings with images from CCTV cameras with an intersecting field of view

Abstract

Abstract Video surveillance and tracking systems help to increase the safety of human activity in a given area and improve detecting the geo-location of an observer (a swarm of drones, autopilot) in modern cities. This article proposes the method for determining the full or partial address (annotation) of buildings by using images from several CCTV cameras with an intersecting field of view. As input parameters, the method takes several images from surveillance cameras, their geographical coordinates and directions of the optical axes and the vector map of the area where the cameras are located. The outputs are annotations of buildings for the initial images. The proposed method allows solving the problem of georeferencing the video analytics system and improving the work of the surveillance and object tracking systems. The resulting annotations of buildings provide an opportunity to determine more accurately the situations with overlapping of the tracked objects with buildings and predict the probable paths of the objects. A lost object on one camera can be found by using annotations from other cameras, which field of view is not overlapped by this building. Besides, the proposed ap0070roach is sustainable to full or partial overlapping of buildings and allows solving to solve the problem in the absence of a detailed height map of the terrain and buildings. Also, the article researches the restrictions of the method. It is necessary to find an angle between two cameras, at which the best result can be achieved. That is, the method should return the correct addresses of all buildings visible in the image.