Self-Supervised Convolutional Neural Networks for Plant Reconstruction Using Stereo Imagery

Yuanxin Xia, Pablo d'Angelo, Jiaojiao Tian, Friedrich Fraundorfer, Peter Reinartz

Research output: Contribution to journalArticlepeer-review


Stereo matching can provide complete and dense three-dimensional reconstruction to study plant growth. Recently, high-quality stereo matching results were achieved combining Semi-Global Matching (SGM) with deep learning. However, due to a lack of suitable training data, this technique is not readily applicable for plant reconstruction. We propose a self-supervised Matching Cost with a Convolutional Neural Network (MC-CNN) scheme to calculate matching cost and test it for plant reconstruction. The MC-CNN network is retrained using the initial matching results obtained from the standard MC-CNN weights. For the experiment, closerange photogrammetric imagery of an in-house plant is used. The results show that the performance of self-supervised MC-CNN is superior to the Census algorithm and comparable to MC-CNN trained by a Light Detection and Ranging point cloud. Another experiment is performed …
Original languageEnglish
Pages (from-to)389-399
Number of pages11
JournalPhotogrammetric engineering & remote sensing
Issue number5
Publication statusPublished - 2019


Dive into the research topics of 'Self-Supervised Convolutional Neural Networks for Plant Reconstruction Using Stereo Imagery'. Together they form a unique fingerprint.

Cite this