Projekte pro Jahr
Abstract
Multi-layer images are currently the most prominent scene representation for viewing natural scenes under full-motion parallax in virtual reality. Layers ordered in diopter space contain color and transparency so that a complete image is formed when the layers are composited in a view-dependent manner. Once baked, the same limitations apply to multi-layer images as to conventional single-layer photography, making it challenging to remove obstructive objects or otherwise edit the content. Object removal before baking can benefit from filling disoccluded layers with pixels from background layers. However, if no such background pixels have been observed, an inpainting algorithm must fill the empty spots with fitting synthetic content. We present and study a multi-layer inpainting approach that addresses this problem in two stages: First, a volumetric area of interest specified by the user is classified with respect to whether the background pixels have been observed or not. Second, the unobserved pixels are filled with multi-layer inpainting. We report on experiments using multiple variants of multi-layer inpainting and compare our solution to conventional inpainting methods that consider each layer individually.
Originalsprache | englisch |
---|---|
Seiten (von - bis) | 4644-4654 |
Seitenumfang | 11 |
Fachzeitschrift | IEEE Transactions on Visualization and Computer Graphics |
Jahrgang | 29 |
Ausgabenummer | 11 |
DOIs | |
Publikationsstatus | Veröffentlicht - 1 Nov. 2023 |
ASJC Scopus subject areas
- Software
- Signalverarbeitung
- Maschinelles Sehen und Mustererkennung
- Computergrafik und computergestütztes Design
Fingerprint
Untersuchen Sie die Forschungsthemen von „Exemplar-Based Inpainting for 6DOF Virtual Reality Photos“. Zusammen bilden sie einen einzigartigen Fingerprint.Projekte
- 1 Laufend
-
FWF - 3DDR - Dreidimensionale Diminished Reality in Echtzeit
Schmalstieg, D. & Mori, S.
1/01/21 → 31/12/24
Projekt: Forschungsprojekt
Aktivitäten
-
Exemplar-Based Inpainting for 6DOF Virtual Reality Photos
Shohei Mori (Redner/in)
18 Okt. 2023Aktivität: Vortrag oder Präsentation › Vortrag bei Konferenz oder Fachtagung › Science to science
-
22nd IEEE International Symposium on Mixed and Augmented Reality
Shohei Mori (Teilnehmer/-in)
16 Okt. 2023 → 20 Okt. 2023Aktivität: Teilnahme an / Organisation von › Konferenz oder Fachtagung (Teilnahme an/Organisation von)
Auszeichnungen
-
Best Journal Paper Award Nominee, IEEE ISMAR 2023, Exemplar-Based Inpainting for 6DOF Virtual Reality Photos
Mori, Shohei (Empfänger/-in), Schmalstieg, Dieter (Empfänger/-in) & Kalkofen, Denis (Empfänger/-in), Okt. 2023
Auszeichnung: Preise / Medaillen / Ehrungen
Publikationen
- 1 Artikel
-
Multi-layer Scene Representation from Composed Focal Stacks
Ishikawa, R., Saito, H., Kalkofen, D. & Mori, S., 1 Nov. 2023, in: IEEE Transactions on Visualization and Computer Graphics. 29, 11, S. 4719-4729 11 S.Publikation: Beitrag in einer Fachzeitschrift › Artikel › Begutachtung
Open Access