Affiliation:
1. City University of Hong Kong
2. The Chinese University of Hong Kong Shenzhen
3. Beihang University
Abstract
AbstractSketch‐based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in reconstruction quality and multi‐view interaction friendliness, hindering their practical application. This paper proposes a faithful and user‐friendly iterative solution to tackle these limitations by learning geometry‐aligned deep implicit functions from one or multiple sketches. Our method lifts 2D sketches to volume‐based feature tensors, which align strongly with the output 3D shape, enabling accurate reconstruction and faithful editing. Such a geometry‐aligned feature encoding technique is well‐suited to iterative modeling since features from different viewpoints can be easily memorized or aggregated. Based on these advantages, we design a unified interactive system for sketch‐based shape modeling. It enables users to generate the desired geometry iteratively by drawing sketches from any number of viewpoints. In addition, it allows users to edit the generated surface by making a few local modifications. We demonstrate the effectiveness and practicality of our method with extensive experiments and user studies, where we found that our method outperformed existing methods in terms of accuracy, efficiency, and user satisfaction. The source code of this project is available at https://github.com/LordLiang/GA‐Sketching.
Funder
National Natural Science Foundation of China
Centre for Applied Computing and Interactive Media, City University of Hong Kong
Subject
Computer Graphics and Computer-Aided Design
Reference48 articles.
1. ChibaneJ. AlldieckT. Pons-MollG.: Implicit functions in feature space for 3d shape reconstruction and completion. InIEEE Conference on Computer Vision and Pattern Recognition (CVPR)(jun2020) IEEE. 2 5 6
2. ChangA. X. FunkhouserT. GuibasL. HanrahanP. HuangQ. LiZ. SavareseS. SavvaM. SongS. SuH. et al.: Shapenet: An information-rich 3d model repository.arXiv preprint arXiv:1512.03012(2015). 7
3. ChenD. Z. SiddiquiY. LeeH.-Y. TulyakovS. NiessnerM.: Text2tex: Text-driven texture synthesis via diffusion models.arXiv preprint arXiv:2303.11396(2023). 13
4. Garment Ideation: Iterative View-Aware Sketch-Based Garment Modeling
5. 3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction