Javascript must be enabled to continue!
Mamba-Based Infrared and Visible Images Fusion Method
View through CrossRef
Visible-infrared image fusion is crucial for applications like autonomous driving and nighttime surveillance, yet it remains challenging due to the inherent limitations of existing deep learning models. Convolutional Neural Networks (CNNs) are constrained by their local receptive fields, while Transformers suffer from quadratic computational complexity. To address these issues, this paper investigates the application of the Mamba model—a novel State Space Model (SSM) with linear-complexity global modeling and selective scanning capabilities—to the task of visible-infrared image fusion. Building upon Mamba, we propose a novel fusion framework featuring two key designs: (1) A Multi-Path Mamba (MPMamba) module that orchestrates parallel Mamba blocks with convolutional streams to extract multi-scale, modality-specific features; and (2) a Dual-path Mamba Attention Fusion (DMAF) module that explicitly decouples and processes shared and complementary features via dual Mamba paths, followed by dynamic calibration with a Convolutional Block Attention Module (CBAM). Extensive experiments on the MSRS benchmark demonstrate that our framework achieves state-of-the-art performance, outperforming strong baselines such as U2Fusion and SwinFusion across key metrics including Information Entropy (EN), Spatial Frequency (SF), Mutual Information (MI), and edge-based fusion quality (Qabf). Visual results confirm its ability to produce fused images that saliently preserve thermal targets while retaining rich texture details.
Title: Mamba-Based Infrared and Visible Images Fusion Method
Description:
Visible-infrared image fusion is crucial for applications like autonomous driving and nighttime surveillance, yet it remains challenging due to the inherent limitations of existing deep learning models.
Convolutional Neural Networks (CNNs) are constrained by their local receptive fields, while Transformers suffer from quadratic computational complexity.
To address these issues, this paper investigates the application of the Mamba model—a novel State Space Model (SSM) with linear-complexity global modeling and selective scanning capabilities—to the task of visible-infrared image fusion.
Building upon Mamba, we propose a novel fusion framework featuring two key designs: (1) A Multi-Path Mamba (MPMamba) module that orchestrates parallel Mamba blocks with convolutional streams to extract multi-scale, modality-specific features; and (2) a Dual-path Mamba Attention Fusion (DMAF) module that explicitly decouples and processes shared and complementary features via dual Mamba paths, followed by dynamic calibration with a Convolutional Block Attention Module (CBAM).
Extensive experiments on the MSRS benchmark demonstrate that our framework achieves state-of-the-art performance, outperforming strong baselines such as U2Fusion and SwinFusion across key metrics including Information Entropy (EN), Spatial Frequency (SF), Mutual Information (MI), and edge-based fusion quality (Qabf).
Visual results confirm its ability to produce fused images that saliently preserve thermal targets while retaining rich texture details.
Related Results
The Nuclear Fusion Award
The Nuclear Fusion Award
The Nuclear Fusion Award ceremony for 2009 and 2010 award winners was held during the 23rd IAEA Fusion Energy Conference in Daejeon. This time, both 2009 and 2010 award winners w...
Design of high transparent infrared stealth thin films based on FTO/Ag/FTO structure
Design of high transparent infrared stealth thin films based on FTO/Ag/FTO structure
Multi-spectral compatible stealth materials have become an imperative development trend, especially visible and infrared compatible stealth materials have become the most important...
Infrared image super-resolution reconstruction based on visible light image guidance and recursive fusion
Infrared image super-resolution reconstruction based on visible light image guidance and recursive fusion
Due to the limitations of hardware equipment, infrared images generally have problems such as low resolution, blurred details and poor visual quality during acquisition. Using visi...
Enhancement Infrared-Visible Image Fusion Using the Integration of Stationary Wavelet Transform and Fuzzy Histogram Equalization
Enhancement Infrared-Visible Image Fusion Using the Integration of Stationary Wavelet Transform and Fuzzy Histogram Equalization
Image fusion is the process of merging two or more images to obtain complementary features from source images. Imaging techniques in real-world applications provide images with a d...
Mamba Snake Venom
Mamba Snake Venom
Abstract
Mamba snake venom (Dendroaspis angusticeps, polylepis, viridis, jamesoni) contains a mixture of neurotoxic compounds including postsynaptic a-neurotoxins...
Nonproliferation and fusion power plants
Nonproliferation and fusion power plants
Abstract
The world now appears to be on the brink of realizing commercial fusion. As fusion energy progresses towards near-term commercial deployment, the question arises a...
Pseudo-color infrared and visible image fusion based on attention-dense network
Pseudo-color infrared and visible image fusion based on attention-dense network
Abstract
In the existing infrared and visible image fusion algorithms, the texture details of the fused image are not clear, and the display of infrared information and tex...
Colorization of Day-Night Aerial Infrared Images Using Online GIS Imagery
Colorization of Day-Night Aerial Infrared Images Using Online GIS Imagery
Humans find it difficult to recognize scenes within infrared images, which lack color and contrast. A common workaround is to convert infrared images into visible color images. Rec...

