Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

S2PW-Mamba: Pinwheel and Wavelet-based Spatial-Spectral Mamba for Hyperspectral Image Classification

View through CrossRef
Recently, the selective structured state space model (S6) built upon the Mamba architecture has attracted widespread attention for its outstanding performance in long-range modeling. However, existing Mamba-based hyperspectral image (HSI) classification methods suffer from certain limitations in extracting edge information. To address this problem, a new HSI classification framework called Pinwheel and Wavelet-based Spatial-Spectral Mamba (S 2 PW-Mamba) is proposed in this paper. The input to our S 2 PW-Mamba is the complete, unsegmented image, which preserves the correlation between pixels in the HSI while leveraging convolution to enhance the extraction of local information. Specifically, two S6 modules are employed along different scanning directions to extract the spatial-spectral features from the HSI, acting on the spectral and spatial domains, respectively. Meanwhile, a GateFusion module is designed to adaptively guide the fusion of spatial and spectral features by discerning their relative importance. More precisely, our S 2 PW-Mamba first extracts both edge and central spatial features using a Pinwheel-shaped convolution and a four-directional spatial scanning module, effectively capturing spatial-contextual relationships. Subsequently, by integrating the wavelet transform with the S6 architecture, the model is capable of capturing both global contextual dependencies and local texture details within the spectral domain. Comprehensive experiments on three benchmark HSI datasets show that our approach outperforms existing state-of-the-art methods.
Title: S2PW-Mamba: Pinwheel and Wavelet-based Spatial-Spectral Mamba for Hyperspectral Image Classification
Description:
Recently, the selective structured state space model (S6) built upon the Mamba architecture has attracted widespread attention for its outstanding performance in long-range modeling.
However, existing Mamba-based hyperspectral image (HSI) classification methods suffer from certain limitations in extracting edge information.
To address this problem, a new HSI classification framework called Pinwheel and Wavelet-based Spatial-Spectral Mamba (S 2 PW-Mamba) is proposed in this paper.
The input to our S 2 PW-Mamba is the complete, unsegmented image, which preserves the correlation between pixels in the HSI while leveraging convolution to enhance the extraction of local information.
Specifically, two S6 modules are employed along different scanning directions to extract the spatial-spectral features from the HSI, acting on the spectral and spatial domains, respectively.
Meanwhile, a GateFusion module is designed to adaptively guide the fusion of spatial and spectral features by discerning their relative importance.
More precisely, our S 2 PW-Mamba first extracts both edge and central spatial features using a Pinwheel-shaped convolution and a four-directional spatial scanning module, effectively capturing spatial-contextual relationships.
Subsequently, by integrating the wavelet transform with the S6 architecture, the model is capable of capturing both global contextual dependencies and local texture details within the spectral domain.
Comprehensive experiments on three benchmark HSI datasets show that our approach outperforms existing state-of-the-art methods.

Related Results

Mapping Mineralogical Distributions on Mars with Unsupervised Machine Learning
Mapping Mineralogical Distributions on Mars with Unsupervised Machine Learning
Abstract Knowledge of the constituents of the Martian surface and their distributions over the planet informs us about Mars’ geomorphological formation and evolutionary h...
Deep Feature Learning And Classification Of Remote Sensing Images
Deep Feature Learning And Classification Of Remote Sensing Images
Hyperspectral imaging has been largely utilized in applications involving remote sensing to describe the composition of thousands of spectral bands in a single scene. Hyperspectral...
HL-Mamba: A High–Low Frequency Interaction Mamba Network for Hyperspectral Image Classification
HL-Mamba: A High–Low Frequency Interaction Mamba Network for Hyperspectral Image Classification
Deep-learning-based methods have achieved remarkable success in hyperspectral image (HSI) classification tasks due to their promising ability. However, the high dimensionality and ...
DESDA-Mamba: Diagonal-Enabled Strided Scanning and Direction-Adaptive Mamba for Hyperspectral Image Classiffcation
DESDA-Mamba: Diagonal-Enabled Strided Scanning and Direction-Adaptive Mamba for Hyperspectral Image Classiffcation
Recently, Mamba based on State Space Models (SSMs) has shown great potential for hyperspectral image (HSI) classification due to its long-range modeling capability and linear compl...
Learned Hyperspectral Compression Using a Student’s T Hyperprior
Learned Hyperspectral Compression Using a Student’s T Hyperprior
Hyperspectral compression is one of the most common techniques in hyperspectral image processing. Most recent learned image compression methods have exhibited excellent rate-distor...
Spectral-Spatial Residual Network for Fusing Hyperspectral and Panchromatic Remote Sensing Images
Spectral-Spatial Residual Network for Fusing Hyperspectral and Panchromatic Remote Sensing Images
Fusing hyperspectral and panchromatic remote sensing images can obtain the images with high resolution in both spectral and spatial domains. In addition, it can complement the defi...
SSANet: An Adaptive Spectral–Spatial Attention Autoencoder Network for Hyperspectral Unmixing
SSANet: An Adaptive Spectral–Spatial Attention Autoencoder Network for Hyperspectral Unmixing
Convolutional neural-network-based autoencoders, which can integrate the spatial correlation between pixels well, have been broadly used for hyperspectral unmixing and obtained exc...
I3D: An Improved Three-Dimensional CNN Model on Hyperspectral Remote Sensing Image Classification
I3D: An Improved Three-Dimensional CNN Model on Hyperspectral Remote Sensing Image Classification
Hyperspectral image data are widely used in real life because it contains rich spectral and spatial information. Hyperspectral image classification is to distinguish different func...

Back to Top