Journal article
Learning shape retrieval from different modalities
Neurocomputing, Vol.253, pp.24-33
2017
Abstract
We propose in this paper a new framework for 3D shape retrieval using queries of different modalities, which can include 3D models, images and sketches. The main scientific challenge is that different modalities have different representations and thus lie in different spaces. Moreover, the features that can be extracted from 2D images or 2D sketches are often different from those that can be computed from 3D models. Our solution is a new method based on Convolutional Neural Networks (CNN) that embeds all these entities into a common space. We propose a novel 3D shape descriptor based on local CNN features encoded using vectors of locally aggregated descriptors instead of conventional global CNN. Using a kernel function computed from 3D shape similarity, we build a target space in which wild images and sketches can be projected via two different CNNs. With this construction, matching can be performed in the common target space between same entities (sketch–sketch, image–image and 3D shape–3D shape) and more importantly across different entities (sketch-image, sketch-3D shape and image-3D shape). We demonstrate the performance of the proposed framework using different benchmarks including large scale SHREC 3D datasets.
Details
- Title
- Learning shape retrieval from different modalities
- Authors/Creators
- H. Tabia (Author/Creator)H. Laga (Author/Creator)
- Publication Details
- Neurocomputing, Vol.253, pp.24-33
- Publisher
- Elsevier BV
- Identifiers
- 991005544738807891
- Copyright
- © 2017 Elsevier B.V.
- Murdoch Affiliation
- School of Engineering and Information Technology
- Language
- English
- Resource Type
- Journal article
Metrics
124 File views/ downloads
66 Record Views
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Collaboration types
- Domestic collaboration
- International collaboration
- Citation topics
- 4 Electrical Engineering, Electronics & Computer Science
- 4.17 Computer Vision & Graphics
- 4.17.245 3D Geometry Processing
- Web Of Science research areas
- Computer Science, Artificial Intelligence
- ESI research areas
- Computer Science