IRIS: interactive real-time feedback image segmentation with deep learning

Antonio Pepe, Richard Schussnig, Jianning Li, Christina Schwarz-Gsaxner, Xiaojun Chen, Thomas Peter Fries, Jan Egger

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


Volumetric examinations of the aorta are nowadays of crucial importance for the management of critical pathologies such as aortic dissection, aortic aneurism, and other pathologies, which affect the morphology of the artery. These examinations usually begin with the acquisition of a Computed Tomography Angiography (CTA) scan from the patient, which is later on postprocessed to reconstruct the 3D geometry of the aorta. The first postprocessing step is referred to as segmentation. Different algorithms have been suggested for the segmentation of the aorta; including interactive methods, as well as fully automatic methods. Interactive methods need to be fine-tuned on each single CTA scan and result in longer duration of the process, whereas fully automatic methods require the possession of a large amount of labeled training data. In this work, we introduce a hybrid approach by combining a deep learning method with a consolidated interaction technique. In particular, we trained a 2D and a 3D U-Net on a limited number of patches extracted from 25 labeled CTA scans. Afterwards, we use an interactive approach, which consists in defining a region of interest (ROI) by just placing a seed point. This seed point is later used as the center of a 2D or 3D patch to be fed to the 2D or 3D U-Net, respectively. Due to the low content variation of these patches, this method allows to correctly segment the ROIs without the need for parameter tuning for each dataset and with a smaller training dataset, requiring the same minimal interaction as state-of-the-art interactive methods. Later on, the new segmented CTA scans can be further used to train a convolutional network for a fully automatic approach.
Original languageEnglish
Title of host publicationSPIE Medical Imaging
Subtitle of host publicationBiomedical Applications in Molecular, Structural, and Functional Imaging
Place of PublicationHouston, Texas, USA
Publication statusPublished - 2020
EventSPIE MEDICAL IMAGING 2020 - Houston, United States
Duration: 15 Feb 202020 Feb 2020


Country/TerritoryUnited States

Fields of Expertise

  • Information, Communication & Computing

Cite this