CADnCNN: Improving DnCNN Denoising with Cross Attention
 



Huichao Sun, Mingzhu Zhang, Can Zhang, Qingliang Guo, Zhonggui Sun*

School of Mathematical Sciences, Liaocheng University, Liaocheng,252000, China
 

Abstract

In recent years, image denoising algorithms has witnessed remarkable advancements, largely driven by the speedy development of deep learning techniques. Among these advancements, Denoising Convolutional Neural Network (DnCNN) is a milestone, owing to its powerful performance. However, traditional DnCNN architecture heavily rely on local convolutional operations for feature extraction, which inherently limitation restricts its capacity to capture long-range dependencies, potentially leading to the loss of vital structural information within images. To handle with this limitation, we propose a solution dubbed Cross Attention block. The purpose of this specific block is to extract correlations among non-local features from various source inputs, thereby broadens the receptive field and augments the network's capacity to capture structural information. Furthermore, we integrate the Cross Attention block into DnCNN named CADnCNN, which significantly improves the ability to preserve image details and structural integrity in denoising tasks. Experiments have affirmed the effectiveness of our proposed metho

 

Paper

H. Sun, M. Zhang, C. Zhang, Q. Guo, Z. Sun*. CADnCNN: Improving DnCNN Denoising with Cross Attention. 2023 The International Conference on Machine Learning, Cloud Computing and Intelligent Mining (MLCCIM 2023), pp. 245-249, IEEE, 2023.

 

Architecture

 

 

Results

 

 

 

 

Theories

 

 

---------------------------------------------------------------------------------------------------

 

---------------------------------------------------------------------------------------------------