Projekte pro Jahr
Abstract
State-of-the-art methods for diminished reality propagate pixel information from a keyframe to subsequent frames for real-time inpainting. However, these approaches produce artifacts, if the scene geometry is not sufficiently planar. In this article, we present InpaintFusion, a new real-time method that extends inpainting to non-planar scenes by considering both color and depth information in the inpainting process. We use an RGB-D sensor for simultaneous localization and mapping, in order to both track the camera and obtain a surfel map in addition to RGB images. We use the RGB-D information in a cost function for both the color and the geometric appearance to derive a global optimization for simultaneous inpainting of color and depth. The inpainted depth is merged in a global map by depth fusion. For the final rendering, we project the map model into image space, where we can use it for effects such as relighting and stereo rendering of otherwise hidden structures. We demonstrate the capabilities of our method by comparing it to inpainting results with methods using planar geometric proxies.
Originalsprache | englisch |
---|---|
Aufsatznummer | 9184389 |
Seiten (von - bis) | 2994 - 3007 |
Seitenumfang | 14 |
Fachzeitschrift | IEEE Transactions on Visualization and Computer Graphics |
Jahrgang | 26 |
Ausgabenummer | 10 |
DOIs | |
Publikationsstatus | Veröffentlicht - 1 Okt. 2020 |
ASJC Scopus subject areas
- Software
- Signalverarbeitung
- Maschinelles Sehen und Mustererkennung
- Computergrafik und computergestütztes Design
Fingerprint
Untersuchen Sie die Forschungsthemen von „InpaintFusion: Incremental RGB-D Inpainting for 3D Scenes“. Zusammen bilden sie einen einzigartigen Fingerprint.Projekte
- 1 Laufend
-
FWF - 3DDR - Dreidimensionale Diminished Reality in Echtzeit
1/01/21 → 31/12/24
Projekt: Forschungsprojekt
Aktivitäten
- 1 Invited talk bei Konferenz oder Fachtagung
-
How Far Can We Go for Diminished Reality Without Neural Networks?
Shohei Mori (Redner/in)
21 Okt. 2022Aktivität: Vortrag oder Präsentation › Invited talk bei Konferenz oder Fachtagung › Science to science