AIRA-DA: Adversarial Image Reconstruction Alignments for Unsupervised Domain Adaptive Object Detection

Kunyang Sun, Wei Lin, Haoqin Shi, Yu Liu, Zhengming Zhang, Yongming Huang*, Horst Bischof

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Unsupervised domain adaptive object detection is a challenging perception task where object detectors are adapted from a label-rich source domain to an unlabeled target domain, playing a vital role in autonomous driving and robot navigation. Since the camera settings, weather, and light conditions vary depending on the road, it is labor-intensive and impossible to manually annotate all the data to adapt to these scenarios. Recent advances demonstrate the effectiveness of adversarial-based domain alignment, where domain invariance in the feature space is produced by adversarial training between the feature extractor and domain discriminator. However, due to the domain shift, domain discrimination, especially on low-level features, is an easy task. This results in an imbalance of the adversarial training between the domain discriminator and the feature extractor. In this work, we achieve a better domain alignment by introducing an auxiliary regularization task to improve the training balance. Specifically, we propose Adversarial Image Reconstruction (AIR) as the regularizer to facilitate the adversarial training of the feature extractor. We further design a multi-level Feature Alignment(A) module to enhance the adaptation performance. We refer our work as AIRA-DA for ease of presentation. Our evaluations across several datasets of challenging domain shifts demonstrate that the proposed method outperforms all previous methods, of both one-and two-stage, in most settings. Extensive experiments shows that the proposed method is capable of handling weather variation, cross-camera adaptation and synthetic-to-real-world adaptation.

Original languageEnglish
Pages (from-to)3645-3652
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume8
Issue number6
DOIs
Publication statusPublished - 1 Jun 2023

Keywords

  • Computer vision for automation
  • deep learning methods

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Biomedical Engineering
  • Human-Computer Interaction
  • Mechanical Engineering
  • Computer Vision and Pattern Recognition
  • Computer Science Applications
  • Control and Optimization
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'AIRA-DA: Adversarial Image Reconstruction Alignments for Unsupervised Domain Adaptive Object Detection'. Together they form a unique fingerprint.

Cite this