基于DLatLRR与VGG Net的红外与可见光图像融合

针对红外与可见光图像融合中特征损失严重、显著目标不突出的问题，提出了一种低秩表示分解与深度神经网络相结合的图像融合算法。首先，对源图像进行潜在低秩表示分解（DLatLRR），得到相应的低秩部分、显著部分及稀疏噪声。然后，分别采用16层的VGG Net模型和联合特征加权算法对低秩部分与显著部分进行融合，舍弃二者的稀疏噪声。最后，对融合得到的低秩部分和显著部分进行图像重建，得到最终的融合图像。实验结果表明:与其他算法进行比较，所提算法能够对图像的深层次细节特征进行融合，突出场景中的感兴趣区域，且融合图像的相关差异和、结构相似性、线性相关度等多种客观指标均有所提升，提升最大值分别为0.73、0.15、0.11，噪声产生率的最大缩减值为0.041 2。 

Infrared and visible image fusion based on latent low-rank representation decomposition and VGG Net

An image fusion algorithm combining low-rank representation decomposition and deep neural network is proposed to solve the problem of serious feature loss and non-prominent target in infrared and visible image fusion. First, Latent Low-Rank Representation Decomposition (DLatLRR) was performed on the source image to obtain the corresponding low-rank part, saliency part and sparse noise. Then, the VGG Net model and the joint feature weighting algorithm were used to fuse the low-rank part and the saliency part respectively, and the sparse noise of two parts were discarded. Finally, image reconstruction was carried out on the low-rank part and saliency part of the fusion to obtain the final fusion image. Compared with other methods, the experimental results show that the algorithm can fuse the deep details of the image and highlight the "interested" area in the scene. The objective indexes of the fused image including the sum of the correlations of differences, structure similarity index measure, correlation coefficient all improve, with the maximum values of 0.73, 0.15 and 0.11 respectively, and the maximum reduction value of noise generation rate is 0.041 2.