AIRA-DA: Adversarial Image Reconstruction Alignments for Unsupervised Domain Adaptive Object Detection

Kunyang Sun, Wei Lin, Haoqin Shi, Yu Liu, Zhengming Zhang, Yongming Huang*, Horst Bischof

*Korrespondierende/r Autor/-in für diese Arbeit

Publikation: Beitrag in einer FachzeitschriftArtikelBegutachtung

Abstract

Unsupervised domain adaptive object detection is a challenging perception task where object detectors are adapted from a label-rich source domain to an unlabeled target domain, playing a vital role in autonomous driving and robot navigation. Since the camera settings, weather, and light conditions vary depending on the road, it is labor-intensive and impossible to manually annotate all the data to adapt to these scenarios. Recent advances demonstrate the effectiveness of adversarial-based domain alignment, where domain invariance in the feature space is produced by adversarial training between the feature extractor and domain discriminator. However, due to the domain shift, domain discrimination, especially on low-level features, is an easy task. This results in an imbalance of the adversarial training between the domain discriminator and the feature extractor. In this work, we achieve a better domain alignment by introducing an auxiliary regularization task to improve the training balance. Specifically, we propose Adversarial Image Reconstruction (AIR) as the regularizer to facilitate the adversarial training of the feature extractor. We further design a multi-level Feature Alignment(A) module to enhance the adaptation performance. We refer our work as AIRA-DA for ease of presentation. Our evaluations across several datasets of challenging domain shifts demonstrate that the proposed method outperforms all previous methods, of both one-and two-stage, in most settings. Extensive experiments shows that the proposed method is capable of handling weather variation, cross-camera adaptation and synthetic-to-real-world adaptation.

Originalspracheenglisch
Seiten (von - bis)3645-3652
Seitenumfang8
FachzeitschriftIEEE Robotics and Automation Letters
Jahrgang8
Ausgabenummer6
DOIs
PublikationsstatusVeröffentlicht - 1 Juni 2023

ASJC Scopus subject areas

  • Steuerungs- und Systemtechnik
  • Biomedizintechnik
  • Human-computer interaction
  • Maschinenbau
  • Maschinelles Sehen und Mustererkennung
  • Angewandte Informatik
  • Steuerung und Optimierung
  • Artificial intelligence

Fingerprint

Untersuchen Sie die Forschungsthemen von „AIRA-DA: Adversarial Image Reconstruction Alignments for Unsupervised Domain Adaptive Object Detection“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren