Frequency disentangled residual network
Satya Rajendra Singha, Roshan Reddy Yedlaa b, Shiv Ram Dubeya c✉, Rakesh Kumar Sanodiyaa, Wei-Ta Chud
- aComputer Science and Engineering Group, Indian Institute of Information Technology, Sri City, Andhra Pradesh, India
- bStony Brook University, Stony Brook, NY, USA
- cComputer Vision and Biometrics Lab, Indian Institute of Information Technology, Allahabad, Uttar Pradesh, India
- dDepartment of Computer Science and Information Engineering, National Cheng Kung University, Tainan, Taiwan
- ✉Corresponding author
Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.
Abstract
Residual networks (ResNets) have been utilized for various computer vision and image processing applications. The residual connection improves the training of the network with better gradient flow. A residual block consists of a few convolutional layers having trainable parameters, which leads to overfitting. Moreover, the present residual networks are not able to utilize the high- and low-frequency information suitably, which also challenges the generalization capability of the network. In this paper, a frequency-disentangled residual network (FDResNet) is proposed to tackle these issues. Specifically, FDResNet includes separate connections in the residual block for low- and high-frequency components, respectively. Basically, the proposed model disentangles the low- and high-frequency components to increase the generalization ability. Moreover, the computation of low- and high-frequency components using fixed filters further avoids the overfitting. The proposed model is tested on benchmark CIFAR-10/100, Caltech, and TinyImageNet datasets for image classification. The performance of the proposed model is also tested in the image retrieval framework. It is noticed that the proposed model outperforms its counterpart residual model. The effect of kernel size and standard deviation is also evaluated. The impact of the frequency disentangling is also analyzed using a saliency map.
TL;DRA frequency-disentangled residual network (FDResNet) is proposed, which includes separate connections in the residual block for low- and high-frequency components to increase the generalization ability of the network. (Semantic Scholar)