FusionGAN swMATH ID: 42579 Software Authors: Ma, J.; Yu, W.; Liang, P.; Li, C.; Jiang, J. Description: FusionGAN: A generative adversarial network for infrared and visible image fusion. nfrared images can distinguish targets from their backgrounds on the basis of difference in thermal radiation, which works well at all day/night time and under all weather conditions. By contrast, visible images can provide texture details with high spatial resolution and definition in a manner consistent with the human visual system. This paper proposes a novel method to fuse these two types of information using a generative adversarial network, termed as FusionGAN. Our method establishes an adversarial game between a generator and a discriminator, where the generator aims to generate a fused image with major infrared intensities together with additional visible gradients, and the discriminator aims to force the fused image to have more details existing in visible images. This enables that the final fused image simultaneously keeps the thermal radiation in an infrared image and the textures in a visible image. In addition, our FusionGAN is an end-to-end model, avoiding manually designing complicated activity level measurements and fusion rules as in traditional methods. Experiments on public datasets demonstrate the superiority of our strategy over state-of-the-arts, where our results look like sharpened infrared images with clear highlighted targets and abundant details. Moreover, we also generalize our FusionGAN to fuse images with different resolutions, say a low-resolution infrared image and a high-resolution visible image. Extensive results demonstrate that our strategy can generate clear and clean fused images which do not suffer from noise caused by upsampling of infrared information. Homepage: https://www.sciencedirect.com/science/article/abs/pii/S1566253518301143 Source Code: https://github.com/jiayi-ma/FusionGAN Dependencies: Python Related Software: Adam; pix2pix; CycleGAN; U-Net; NSCT toolbox; SOSNet; L2-Net; Theia; R2D2; BinGAN; MAGSAC++; USAC; D2-Net; GMS; ContextDesc; ASLFeat; SuperGlue; YFCC100M; Quicksilver; ApolloScape Cited in: 8 Publications all top 5 Cited by 33 Authors 1 Chen, Xun 1 Cheng, Juan 1 Fan, Aoxiang 1 Gao, Wanlin 1 Guo, Shaoyan 1 Huang, Yongdong 1 Jiang, Junjun 1 Jiang, Xingyu 1 Li, Deguang 1 Li, Qiufu 1 Lin, Judy Yangjun 1 Liu, Yu 1 Ma, Jiayi 1 Ma, Xu 1 Peng, Hu 1 Su, Weijian 1 Tang, Wei 1 Tian, Yanshan 1 Wang, Minjuan 1 Xie, Longhan 1 Xu, Gu 1 Yan, Junchi 1 Yao, Rui 1 Zhang, Chao 1 Zhang, Di 1 Zhang, Hui 1 Zhang, Yongxin 1 Zhao, Jiaqi 1 Zheng, Lihua 1 Zhong, Zhen 1 Zhou, Ziyuan 1 Zhu, WenPeng 1 Zuo, Fengyuan all top 5 Cited in 6 Serials 2 Mathematical Problems in Engineering 2 International Journal of Wavelets, Multiresolution and Information Processing 1 Neural Networks 1 Multidimensional Systems and Signal Processing 1 International Journal of Computer Vision 1 Computational & Mathematical Methods in Medicine all top 5 Cited in 6 Fields 7 Computer science (68-XX) 4 Information and communication theory, circuits (94-XX) 1 Harmonic analysis on Euclidean spaces (42-XX) 1 Statistics (62-XX) 1 Biology and other natural sciences (92-XX) 1 Systems theory; control (93-XX) Citations by Year