Original Article

A Study on the Fusion of Infrared and Visible Images Using Edge Convolution with Transformer in a Dual-Branch Structure

Volume 26 Publish Date: October 30, 2026
Full Text PDF
DOI
Feng Xin ORCID
Xin, F. (2026). A Study on the Fusion of Infrared and Visible Images Using Edge Convolution with Transformer in a Dual-Branch Structure. ELECTRICA, 26. https://doi.org/10.5152/electrica.2026.26413
Full Text Full-Text PDF

Abstract

Currently, most deep learning-based methods for infrared and visible image fusion focus on feature extraction from source images and the design of fusion network loss functions while neglecting the inherent differences between infrared and visible images. In this study, the author examined the characteristics of infrared and visible images, explored their shared and cross-modal features, and proposed a dual-branch fusion method for these two modalities. Specifically, the feature encoding of the fusion network was divided into two branches: a cross-modal feature extraction branch and a shared feature extraction branch. Edge convolution and transformer modules were introduced on different branches to extract cross-modal and shared information, thereby separating complementary cross-modal features and redundant shared features. A convolutional attention module was introduced in the cross-modal feature branch for feature selection and local enhancement. Finally, different loss functions were designed for the proposed dual-branch encoder–decoder network. Extensive experiments demonstrated that proposed fusion method outperformed representative methods in terms of both subjective visual quality and objective metrics.

Article Info
Published In
Journal ELECTRICA
Volume / Issue Volume 26
History
Published Online October 30, 2026
Affiliations
Feng Xin ORCID
Cite this Article
Xin, F. (2026). A Study on the Fusion of Infrared and Visible Images Using Edge Convolution with Transformer in a Dual-Branch Structure. ELECTRICA, 26. https://doi.org/10.5152/electrica.2026.26413
Share
Outlines