Journal article
TopoNet: Topology Learning for 3D Reconstruction of Objects of Arbitrary Genus
Computer Graphics Forum, Vol.41(6), pp.336-347
2022
Abstract
We propose a deep reinforcement learning-based solution for the 3D reconstruction of objects of complex topologies from a single RGB image. We use a template-based approach. However, unlike previous template-based methods, which are limited to the reconstruction of 3D objects of fixed topology, our approach learns simultaneously the geometry and topology of the target 3D shape in the input image. To this end, we propose a neural network that learns to deform a template to fit the geometry of the target object. Our key contribution is a novel reinforcement learning framework that enables the network to also learn how to adjust, using pruning operations, the topology of the template to best fit the topology of the target object. We train the network in a supervised manner using a loss function that enforces smoothness and penalizes long edges in order to ensure high visual plausibility of the reconstructed 3D meshes. We evaluate the proposed approach on standard benchmarks such as ShapeNet, and in-the-wild using unseen real-world images. We show that the proposed approach outperforms the state-of-the-art in terms of the visual quality of the reconstructed 3D meshes, and also generalizes well to out-of-category images.
Details
- Title
- TopoNet: Topology Learning for 3D Reconstruction of Objects of Arbitrary Genus
- Authors/Creators
- T. Ben Charrada (Author/Creator)H. Tabia (Author/Creator)A. Chetouani (Author/Creator)H. Laga (Author/Creator)
- Publication Details
- Computer Graphics Forum, Vol.41(6), pp.336-347
- Publisher
- Wiley-Blackwell
- Identifiers
- 991005544258707891
- Copyright
- © 2022 Eurographics - The European Association for Computer Graphics and John Wiley & Sons Ltd
- Murdoch Affiliation
- School of Information Technology
- Language
- English
- Resource Type
- Journal article
Metrics
70 Record Views
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Collaboration types
- Domestic collaboration
- International collaboration
- Citation topics
- 4 Electrical Engineering, Electronics & Computer Science
- 4.17 Computer Vision & Graphics
- 4.17.2798 Stereo Depth Estimation
- Web Of Science research areas
- Computer Science, Software Engineering
- ESI research areas
- Computer Science