Efficient Multi-Scale Attention Module with Cross-Spatial Learning

Daliang Ouyang; Su He; Guozhong Zhang; Mingzhu Luo; Huaiyong Guo; Jianming Zhan; Zhijie Huang

doi:10.1109/icassp49357.2023.10096516

Abstract

Remarkable effectiveness of the channel or spatial attention mechanisms for producing more discernible feature representation are illustrated in various computer vision tasks. However, modeling the cross-channel relationships with channel dimensionality reduction may bring side effect in extracting deep visual representations. In this paper, a novel efficient multi-scale attention (EMA) module is proposed. Focusing on retaining the information on per channel and decreasing the computational overhead, we reshape the partly channels into the batch dimensions and group the channel dimensions into multiple sub-features which make the spatial semantic features well-distributed inside each feature group. Specifically, apart from encoding the global information to re-calibrate the channel-wise weight in each parallel branch, the output features of the two parallel branches are further aggregated by a cross-dimension interaction for capturing pixel-level pairwise relationship. We conduct extensive ablation studies and experiments on image classification and object detection tasks with popular benchmarks (e.g., CIFAR-100, ImageNet-1k, MS COCO and VisDrone2019) for evaluating its performance.

Keywords

Computer scienceChannel (broadcasting)Overhead (engineering)Artificial intelligenceFeature (linguistics)Pairwise comparisonEncoding (memory)Pattern recognition (psychology)Feature extractionCurse of dimensionalityDimension (graph theory)Feature learningScale (ratio)Dimensionality reductionRepresentation (politics)Mathematics

Related Publications

Dual Attention Network for Scene Segmentation

Jun Fu , Jing Liu , Haijie Tian +4 more

In this paper, we address the scene segmentation task by capturing rich contextual dependencies based on the self-attention mechanism. Unlike previous works that capture context...

2019 6497 citations

ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks

Qilong Wang , Banggu Wu , Pengfei Zhu +3 more

Recently, channel attention mechanism has demonstrated to offer great potential in improving the performance of deep convolutional neural networks (CNNs). However, most existing...

2020 6942 citations

ResNeSt: Split-Attention Networks

Hang Zhang , Chongruo Wu , Zhongyue Zhang +9 more

The ability to learn richer network representations generally boosts the performance of deep learning models. To improve representation-learning in convolutional neural networks...

2022 2022 IEEE/CVF Conference on Computer ... 1177 citations

Coordinate Attention for Efficient Mobile Network Design

Qibin Hou , Daquan Zhou , Jiashi Feng

Recent studies on mobile network design have demonstrated the remarkable effectiveness of channel attention (e.g., the Squeeze-and-Excitation attention) for lifting model perfor...

2021 4986 citations

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Xiaoyi Dong , Jianmin Bao , Dongdong Chen +5 more

We present CSWin Transformer, an efficient and effective Transformer-based backbone for general-purpose vision tasks. A challenging issue in Transformer design is that global se...

2022 2022 IEEE/CVF Conference on Computer ... 1121 citations

Publication Info

Year: 2023
Type: article
Pages: 1-5
Citations: 1181
Access: Closed

External Links

View on DOI.org

Social Impact

Altmetric

Efficient Multi-Scale Attention Module with Cross-Spatial Learning

PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

1181

OpenAlex

Cite This

APA Style

                            
                                    Daliang Ouyang, 
                                
                                    Su He, 
                                
                                    Guozhong Zhang
                                
                                et al.
                            
                            (2023). 
                            Efficient Multi-Scale Attention Module with Cross-Spatial Learning. 
                            
                            , 1-5.
                            https://doi.org/10.1109/icassp49357.2023.10096516

Identifiers

DOI: 10.1109/icassp49357.2023.10096516