Abstract
Video denoising is a fundamental problem in numerous computer vision applications. State-of-the-art attention-based denoising methods typically yield good results, but require vast amounts of GPU memory and usually suffer from very long computation times. Especially in the field of restoring digitized high-resolution historic films, these techniques are not applicable in practice. To overcome these issues, we introduce a lightweight video denoising network that combines efficient axial-coronal-sagittal (ACS) convolutions with a novel shifted window attention formulation (ASwin), which is based on the memory-efficient aggregation of self- and cross-attention across video frames. We numerically validate the performance and efficiency of our approach on synthetic Gaussian noise. Moreover, we train our network as a general-purpose blind denoising model for real-world videos, using a realistic noise synthesis pipeline to generate clean-noisy video pairs. A user study and non-reference quality assessment prove that our method outperforms the state-of-the-art on real-world historic videos in terms of denoising performance and temporal consistency.
Originalsprache | englisch |
---|---|
Titel | Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023 |
Herausgeber (Verlag) | Institute of Electrical and Electronics Engineers |
Seiten | 351-360 |
Seitenumfang | 10 |
ISBN (elektronisch) | 9781665493468 |
DOIs | |
Publikationsstatus | Veröffentlicht - 2023 |
Veranstaltung | IEEE/CVF Winter Conference on Applications of Computer Vision: WACV 2023 - Waikoloa, USA / Vereinigte Staaten Dauer: 3 Jan. 2023 → 7 Jan. 2023 https://wacv2023.thecvf.com/home |
Konferenz
Konferenz | IEEE/CVF Winter Conference on Applications of Computer Vision |
---|---|
Kurztitel | WACV 2023 |
Land/Gebiet | USA / Vereinigte Staaten |
Ort | Waikoloa |
Zeitraum | 3/01/23 → 7/01/23 |
Internetadresse |
ASJC Scopus subject areas
- Artificial intelligence
- Angewandte Informatik
- Maschinelles Sehen und Mustererkennung