Abstract
We present a novel algorithm for view synthesis that utilizes a soft 3D reconstruction to improve quality, continuity and robustness. Our main contribution is the formulation of a soft 3D representation that preserves depth uncertainty through each stage of 3D reconstruction and rendering. We show that this representation is beneficial throughout the view synthesis pipeline. During view synthesis, it provides a soft model of scene geometry that provides continuity across synthesized views and robustness to depth uncertainty. During 3D reconstruction, the same robust estimates of scene visibility can be applied iteratively to improve depth estimation around object edges. Our algorithm is based entirely on O(1) filters, making it conducive to acceleration and it works with structured or unstructured sets of input views. We compare with recent classical and learning-based algorithms on plenoptic lightfields, wide baseline captures, and lightfield videos produced from camera arrays.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Graphics and Computer-Aided Design
Reference36 articles.
1. Jump
2. Unstructured lumigraph rendering
3. Brian K Cabral. 2016. Introducing Facebook Surround 360: An open high-quality 3D-360 video capture system. (2016). https://code.facebook.com/posts/1755691291326688 Brian K Cabral. 2016. Introducing Facebook Surround 360: An open high-quality 3D-360 video capture system. (2016). https://code.facebook.com/posts/1755691291326688
4. Depth synthesis and local warps for plausible image-based navigation
5. Gaurav Chaurasia Olga Sorkine-Hornung and George Drettakis. 2011. Silhouette-Aware Warping for Image-Based Rendering. Computer Graphics Forum 30 4 (2011). 10.1111/j.1467-8659.2011.01981.x Gaurav Chaurasia Olga Sorkine-Hornung and George Drettakis. 2011. Silhouette-Aware Warping for Image-Based Rendering. Computer Graphics Forum 30 4 (2011). 10.1111/j.1467-8659.2011.01981.x
Cited by
207 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献