Structure-consistent customized virtual mannequin reconstruction from 3D scans based on optimization

Abstract

The 3D virtual mannequin has been widely used in apparel industry, and its importance is also increasing. This work develops a new 3D virtual mannequin reconstruction system based on optimization. All the mannequins reconstructed by the proposed approach share the identical topology, that is, there is a point-to-point correspondence among the mannequins, which will significantly facilitate much subsequent processing in fashion design, made-to-measure, and virtual try-on. The inputs to the proposed system contain a template human body, a raw scan (represented in mesh), and a very sparse corresponding landmarks set. The proposed approach substantially utilizes the optimization technology to drive the template to deform into a real scan. There is no special requirement on the raw meshes. The raw meshes may have a different number of vertices and triangles or may even be incomplete. The proposed method only needs 21 landmarks as hard-constraints to reconstruct a mannequin with tens of thousands of vertices. These landmarks can be extracted automatically for standard mannequin reconstruction. Besides the standard mannequin, the proposed system can also be used to reconstruct display mannequins, that is, mannequins with various poses. The experiments visualize the optimization procedure and verify that the optimization is efficient and effective. Quantitative analysis also proves that the reconstruction error satisfies the requirements of fashion design and tailoring.