Good Keyframes to Inpaint

Publikation: Beitrag in einer FachzeitschriftArtikelBegutachtung

Abstract

Diminished Reality (DR) propagates pixels from a keyframe to subsequent frames for real-time inpainting. Keyframe selection has a significant impact on the inpainting quality, but untrained users struggle to identify good keyframes. Automatic selection is not straightforward either, since no previous work has formalized or verified what determines a good keyframe. We propose a novel metric to select good keyframes to inpaint. We examine the heuristics adopted in existing DR inpainting approaches and derive multiple simple criteria measurable from SLAM. To combine these criteria, we empirically analyze their effect on the quality using a novel representative test dataset. Our results demonstrate that the combined metric selects RGBD keyframes leading to high-quality inpainting results more often than a baseline approach in both color and depth domains. Also, we confirmed that our approach has a better ranking ability of distinguishing good and bad keyframes. Compared to random selections, our metric selects keyframes that would lead to higher-quality and more stably converging inpainting results. We present three DR examples, automatic keyframe selection, user navigation, and marker hiding.
Originalspracheenglisch
Seiten (von - bis)1
Seitenumfang1
FachzeitschriftIEEE Transactions on Visualization and Computer Graphics
DOIs
PublikationsstatusVeröffentlicht - 23 Mai 2022

ASJC Scopus subject areas

  • Software
  • Signalverarbeitung
  • Maschinelles Sehen und Mustererkennung
  • Computergrafik und computergestütztes Design

Fingerprint

Untersuchen Sie die Forschungsthemen von „Good Keyframes to Inpaint“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren