Plane-based surface regularization for urban 3D reconstruction

Thomas Holzmann, Martin R. Oswald, Marc Pollefeys, Friedrich Fraundorfer, Horst Bischof

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


We propose a method for urban 3D reconstruction that is a hybrid between a volumetric 3D reconstruction approach and a plane fitting approach in order to obtain a denoised and compact representation of the scene. In our hybrid approach, a single global optimization, using visibility as main information, defines whether the final reconstructed surface should align with a detected plane or rather follow the details of the input data. Our method is based on an established tetrahedral occupancy labeling approach which we taylor for urban reconstruction by adding the possibility to favor an alignment of the surface with detected planes. We further add novel regularization terms that favor Manhattan-like structures and which allow to control the level of detail of the output model. A variety of experiments demonstrate state-of-the-art performance and show that our approach is suitable for both indoor and outdoor environments.
Original languageEnglish
Title of host publicationBritish Machine Vision Conference 2017, BMVC 2017
ISBN (Electronic)978-190172560-5
Publication statusPublished - 2017
Event28th British Machine Vision Conference: BMVC 2017 - London, United Kingdom
Duration: 4 Sept 20177 Apr 2018


Conference28th British Machine Vision Conference
Abbreviated titleBMVC 2017
Country/TerritoryUnited Kingdom

Cite this