Multi-Label Learning based Semi-Global Matching Forest

Yuanxin Xia, Pablo d'Angelo, Jiaojiao Tian, Friedrich Fraundorfer, Peter Reinartz

Publikation: Beitrag in einer FachzeitschriftArtikelBegutachtung

Abstract

Semi-Global Matching (SGM) approximates a 2D Markov Random Field (MRF) via multiple 1D scanline optimizations, which serves as a good trade-off between accuracy and efficiency in dense matching. Nevertheless, the performance is limited due to the simple summation of the aggregated costs from all 1D scanline optimizations for the final disparity estimation. SGM-Forest improves the performance of SGM by training a random forest to predict the best scanline according to each scanline’s disparity proposal. The disparity estimated by the best scanline acts as reference to adaptively adopt close proposals for further post-processing. However, in many cases more than one scanline is capable of providing a good prediction. Training the random forest with only one scanline labeled may limit or even confuse the learning procedure when other scanlines can offer similar contributions. In this paper, we propose a multi-label classification strategy to further improve SGM-Forest. Each training sample is allowed to be described by multiple labels (or zero label) if more than one (or none) scanline gives a proper prediction. We test the proposed method on stereo matching datasets, from Middlebury, ETH3D, EuroSDR image matching benchmark, and the 2019 IEEE GRSS data fusion contest. The result indicates that under the framework of SGM-Forest, the multi-label strategy outperforms the single-label scheme consistently.
Originalspracheenglisch
Aufsatznummer1069
Seiten (von - bis)1069
FachzeitschriftRemote Sensing
Jahrgang12
Ausgabenummer7
DOIs
PublikationsstatusVeröffentlicht - 1 Apr. 2020

ASJC Scopus subject areas

  • Allgemeine Erdkunde und Planetologie

Dieses zitieren