An investigation of camera movements and capture techniques on optical flow for real-time rendering and presentation
-
Published:2023-05-26
Issue:4
Volume:20
Page:
-
ISSN:1861-8200
-
Container-title:Journal of Real-Time Image Processing
-
language:en
-
Short-container-title:J Real-Time Image Proc
Author:
Modi Nishant,Ramakrishna M.
Abstract
AbstractNew and interesting uses for portable devices include the creation and viewing of 3D models and 360-degree photos of real landscapes. To provide a 3D model and a 360-degree view of a scenario, these apps search for real-time rendering and presentation. This study examines the impact of real-time image processing on movements in camera view and the application of optical flow algorithms. The optical flows are affected by how the objects involved motion. The way the image is recorded and the camera movements affect the relative motion. As a consequence, camera motions are responsive to optical flow algorithms. To record an image, the camera may pan around, move in a straight path, or move randomly. We have captured datasets of videos produced in different contexts to better replicate real-world scenarios. Each dataset was captured in a variety of illumination situations, camera movements, and indoor and outdoor recording sites. Here, to determine the most effective optical flow algorithms for use in near real-time applications, such as augmented reality and virtual reality, we compare results based on quality and processing delay for each video frame. We conducted a comparison study to better understand how random camera motion affects real-time video processing. These methods can be used to handle a variety of real-world issues, such as object tracking, video segmentation, structure from motion, gesture tracking, and so on.
Funder
Manipal Academy of Higher Education, Manipal
Publisher
Springer Science and Business Media LLC
Subject
Information Systems
Reference30 articles.
1. Alldieck, T., Kassubeck, M., Magnor, M.: Optical flow-based 3D human motion estimation from monocular video. arXiv:1703.00177 (2017) 2. Almeida, J., Minetto, R., Almeida, T.A., da Torres, S.R., Leite, N.J.: Robust estimation of camera motion using optical flow models. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Kuno, Y., Wang, J., Wang, J.X., Wang, J., Pajarola, R., Lindstrom, P., Hinkenjann, A., Encarnação, M.L., Silva, C.T., Coming, D. (eds.) Advances in Visual Computing, pp. 435–446. Springer, Berlin (2009) 3. Bouguet, J.Y., et al.: Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corpor. 5(1–10), 4 (2001) 4. Boulch, A., Marlet, R.: Deep learning for robust normal estimation in unstructured point clouds. Comput. Graph. Forum Wiley Online Lib. 35, 281–290 (2016) 5. Butler, D.J., Wulff, J., Stanley, G.B., Black, M.J.: A naturalistic open source movie for optical flow evaluation. In: European Conference on Computer Vision, pp. 611–625. Springer, Berlin (2012)
|
|