Cross-modal Content-based Retrieval for Digitized 2D and 3D Cultural Heritage Artifacts

Robert Gregor, Christof Mayrbrugger, Pavlos Mavridis, Benjamin Bustos, Tobias Schreck

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


Digitization of Cultural Heritage (CH) Objects is indispensable for many tasks including preservation, distributions and analysis of CH content. While digitization of 3D shape and appearance is progressing rapidly, much more digitized content is available in the form of 2D images, photographs, or sketches. A key functionality for exploring CH content is the ability to search for objects of interest. Search in CH repositories is often relying on meta-data of available objects. Also, methods for searching based on content in a given modality, e.g., using image or shape descriptors, are researched. To date, few works have addressed the problem of content-based cross-modal search in both 2D and 3D object space without the requirement of meta data annotations of similar format and quality. We propose a cross-modal search approach relying on content-based similarity between 3D and 2D CH objects. Our approach converts a 3D query object into a 2D query image and then executes content-based search relying on visual descriptors. We describe our concept and show first results of our approach that were obtained on a pottery dataset. We also outline directions of future work.
Original languageEnglish
Title of host publicationGCH 2017 - Eurographics Workshop on Graphics and Cultural Heritage
EditorsTobias Schreck, Tim Weyrich, Robert Sablatnig, Benjamin Stular
PublisherEurographics - European Association for Computer Graphics
Pages119 - 123
ISBN (Print)978-3-03868-037-6
Publication statusPublished - 2017
Event15th EUROGRAPHICS Workshop on Graphics and Cultural Heritage: GCH 2017 - Joanneumsviertel, Graz, Austria
Duration: 26 Sept 201729 Sept 2017
Conference number: 15th


Conference15th EUROGRAPHICS Workshop on Graphics and Cultural Heritage
Abbreviated titleGCH*2017
Internet address

Fields of Expertise

  • Information, Communication & Computing


Dive into the research topics of 'Cross-modal Content-based Retrieval for Digitized 2D and 3D Cultural Heritage Artifacts'. Together they form a unique fingerprint.

Cite this