噪声稳健性的卡方生成对抗网络

李洪均; 李超波; 张士兵

doi:10.11959/j.issn.1000-436x.2020041

您当前的位置：

首页 >

文章列表页 >

噪声稳健性的卡方生成对抗网络

学术论文 | 更新时间：2024-06-05

- 噪声稳健性的卡方生成对抗网络
- Noise robust chi-square generative adversarial network
- 通信学报 2020年41卷第3期页码：33-44
- 作者机构：
  
  1. 南通大学信息科学技术学院，江苏南通 226019
  2. 计算机软件新技术国家重点实验室（南京大学），江苏南京 210093
  3. 南通大学智能信息技术研究中心，江苏南通 226019
  4. 南通大学通科微电子学院，江苏南通 226019
- 作者简介：
  
  [ "李洪均（1981- ），男，江苏南通人，博士，南通大学副教授、硕士生导师，主要研究方向为图像处理、模式识别和人工智能" ]
  [ "李超波（1995- ），女，山西大同人，南通大学硕士生，主要研究方向为计算机视觉和深度学习" ]
  [ "张士兵（1962- ），男，江苏南通人，博士，南通大学教授、博士生导师，主要研究方向为无线通信、智能信号处理、机器学习和认知无线电" ]
- 基金信息：
  
  国家自然科学基金资助项目(61871241);教育部产学研合作协同育人基金资助项目(201802302115);中国交通教育研究会教育科学研究课题基金资助项目(交教研1802-118);南通市科技计划资基金助项目(JC2018025);南通市科技计划资基金助项目(JC2018129);南通大学-南通智能信息技术联合研究中心基金资助项目(KFKT2017B04);南京大学计算机软件新技术国家重点实验室基金资助项目(KFKT2019B15);江苏省研究生科研与实践创新计划基金资助项目(KYCX19_2056)
- DOI：10.11959/j.issn.1000-436x.2020041
  中图分类号： TP391.41
- 网络出版日期：2020-03，
  
  纸质出版日期：2020-03-25
- 稿件说明：
移动端阅览
李洪均, 李超波, 张士兵. 噪声稳健性的卡方生成对抗网络[J]. 通信学报, 2020,41(3):33-44.

Hongjun LI, Chaobo LI, Shibing ZHANG. Noise robust chi-square generative adversarial network[J]. Journal on communications, 2020, 41(3): 33-44.
李洪均, 李超波, 张士兵. 噪声稳健性的卡方生成对抗网络[J]. 通信学报, 2020,41(3):33-44. DOI： 10.11959/j.issn.1000-436x.2020041.

Hongjun LI, Chaobo LI, Shibing ZHANG. Noise robust chi-square generative adversarial network[J]. Journal on communications, 2020, 41(3): 33-44. DOI： 10.11959/j.issn.1000-436x.2020041.

摘要

针对不同分布噪声下生成对抗网络生成样本质量差异明显的问题，提出了一种噪声稳健性的卡方生成对抗网络。所提网络结合了卡方散度量化敏感性和稀疏不变性的优势，引入卡方散度计算生成样本分布和真实样本分布的距离，减小不同噪声对生成样本的影响且降低对真实样本的质量要求；搭建了网络架构，构建全局优化目标函数，促进网络不断优化并增强博弈的有效性。实验结果表明，所提网络在不同噪声下的生成样本质量和稳健性优于目前几种主流网络，且图像质量差异较小。卡方散度的引入不仅提高了生成样本质量，而且提升了网络在不同噪声下的稳健性。

Abstract

Aiming at the obvious difference of image quality generated by generative adversarial network under different noises

a chi-square generative adversarial network (CSGAN) was proposed.Combing the advantages of quantification sensitivity and sparse invariance

the chi-square divergence was introduced to calculate the distance between the generated samples and the original samples

which could reduce the influence of different noises on the generated samples and the quality requirement of original samples.Meanwhile

the network architecture was built and the global optimization objective function was constructed to enhance the adversarial performance.Experimental results show that the quality of the images generated by the proposed algorithm has little difference

and the network is more robust to different noises than the state-of-the-art networks.The application of chi-square divergence not only improves the quality of generated images

but also increases the robustness of the network under different noises.

关键词

Keywords

references

CHOI H Y . Deep learning in nuclear medicine and molecular imaging:current perspectives and future directions [J ] . Nuclear Medicine and Molecular Imaging , 2017 , 52 ( 2 ): 109 - 118 .

XING F Y , XIE Y P , SU H , et al . Deep learning in microscopy image analysis:a survey [J ] . IEEE Transactions on Neural Networks and Learning Systems , 2018 , 29 ( 10 ): 4550 - 4568 .

王珠珠 . 基于 U 型检测网络的图像篡改检测算法 [J ] . 通信学报 , 2019 , 40 ( 4 ): 171 - 178 .

WANG Z Z . Image forgery detection algorithm based on U-shaped de-tection network [J ] . Journal on Communications , 2019 , 40 ( 4 ): 171 - 178 .

NARDELLI P , JIMENEZ-CARRETERO D , BERMEJO-PELAEZ D , et al . Pulmonary artery-vein classification in CT images using deep learning [J ] . IEEE Transactions on Medical Imaging , 2018 , 37 ( 11 ): 2428 - 2440 .

WU B , LI K H , GE F P , et al . An end-to-end deep learning approach to simultaneous speech dereverberation and acoustic modeling for robust speech recognition [J ] . IEEE Journal of Selected Topics in Signal Processing , 2017 , 11 ( 8 ): 1289 - 1300 .

WANG D L , CHEN J T . Supervised speech separation based on deep learning:an overview [J ] . IEEE Transactions on Audio,Speech,and Language Processing , 2018 , 26 ( 10 ): 1702 - 1726 .

TOM Y , DEVAMANYU H , SOUJANYA P , et al . Recent trends in deep learning based natural language processing [J ] . IEEE Computational Intelligence Magazine , 2018 , 13 ( 3 ): 55 - 75 .

LI H . Deep learning for natural language processing:advantages and challenges [J ] . National Science Review , 2018 , 5 ( 1 ): 28 - 30 .

ZHANG Q C , YANG L T , CHEN Z K . Privacy preserving deep computation model on cloud for big data feature learning [J ] . IEEE Transactions on Computers , 2016 , 65 ( 5 ): 1351 - 1362 .

PENG L , PENG M M , LIAO B , et al . The advances and challenges of deep learning application in biological big data processing [J ] . Current Bioinformatics , 2018 , 13 ( 4 ): 352 - 359 .

ROUX N L , BENGIO Y . Representational power of restricted boltzmann machines and deep belief networks [J ] . Neural Computation , 2008 , 20 ( 6 ): 1631 - 1649 .

HINTON G E , OSINDERO S , TEH Y W . A faster learning algorithm for deep belief nets [J ] . Neural Computation , 2014 , 18 ( 7 ): 1527 - 1554 .

HOCHREITER S , SCHMIDHUBER J . Feature extraction through lococode [J ] . Neural Computation , 1999 , 11 ( 3 ): 679 - 714 .

GOODFELLOW I J , POUGET-ABADIE J , MIRZA M , et al . Generative adversarial nets [C ] // International Conference on Neural Information Processing Systems . Berlin:Springer , 2014 : 2672 - 2680 .

PHILIP C , JONG L H . Face sketch synthesis using conditional adversarial networks [C ] // IEEE 2017 International Conference on Information and Communication Technology Convergency . Piscataway:IEEE Press , 2017 : 373 - 378 .

GALDRAN A , MEYER M I , COSTA P , et al . End-to-end adversarial retinal image synthesis [J ] . IEEE Transactions on Medical Imaging , 2018 , 37 ( 3 ): 781 - 791 .

HUANG Q , JACKSON P J B , PLUMBLEY M D , et al . Synthesis of images by two-stage generative adversarial networks [C ] // 2018 IEEE International Conference on Acoustics,Speech and Signal Processing . Piscataway:IEEE Press , 2018 : 1593 - 1597 .

QIN X , CHEN W , SHEN Q , et al . Image inpainting:a contextual consistent and deep generative adversarial training approach [C ] // Asian Conference on Pattern Recognition . Nanjing , 2017 : 588 - 593 .

CHEN Y , CHEN W , WEI C , et al . Occlusion-aware face inpainting via generative adversarial networks [C ] // IEEE International Conference on Image Processing . Piscataway:IEEE Press , 2017 : 1202 - 1206 .

WANG W , HUANG Q , YOU S , et al . Shape inpainting using 3D generative adversarial network and recurrent convolutional networks [C ] // 2017 IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 2017 : 2317 - 2325 .

GONG M , YANG Y , ZHAN T , et al . A generative discriminatory classified network for change detection in multispectral imagery [J ] . IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2019 , 12 ( 1 ): 321 - 333 .

ZHU L , CHEN Y , GHAMISI P , et al . Generative adversarial networks for hyperspectral image classification [J ] . IEEE Transactions on Geoscience and Remote Sensing , 2018 , 56 ( 9 ): 5046 - 5063 .

ZHAN Y , HU D , WANG Y , et al . Semisupervised hyperspectral image classification based on generative adversarial networks [J ] . IEEE Geoscience and Remote Sensing Letters , 2018 , 15 ( 2 ): 212 - 216 .

CHEN X , XU C , YANG X , et al . Gated-GAN:adversarial gated networks for multi-collection style transfer [J ] . IEEE Transactions on Image Processing , 2019 , 28 ( 2 ): 546 - 560 .

KIM T , CHA M , KIM H , et al . Learning to discover cross-domain relations with generative adversarial networks [J ] . arXiv Preprint,arXiv:arXiv 1703.05192v1 , 2017

ZHU J Y , PARK T , ISOLA P , et al . Unpaired image-to-image translation using cycle-consistent adversarial networks [J ] . arXiv Preprint,arXiv:arXiv 1703.10593v6 , 2017

ADIGA S , ATTIA M A , CHANG W , et al . On the tradeoff between mode collapse and sample quality in generative adversarial networks [C ] // IEEE Global Conference on Signal and Information Processing . Piscataway:IEEE Press , 2018 : 1184 - 1188 .

王万良 , 李卓蓉 . 生成式对抗网络研究进展 [J ] . 通信学报 , 2018 , 39 ( 2 ): 135 - 148 .

WANG W L , LI Z R . Advances in generative adversarial network [J ] . Journal on Communications , 2018 , 39 ( 2 ): 135 - 148 .

VITORIA P , SINTES J , BALLESTER C . Semantic image inpainting through improved Wasserstein generative adversarial networks [J ] . arXiv Preprint,arXiv:arXiv 1812.01071v1 , 2018

FU Y C , LIU Y . BubGAN:bubble generative adversarial networks for synthesizing realistic bubbly flow images [J ] . arXiv Preprint,arXiv:arXiv 1809.02266v1 , 2018

RADFORD A , METZ L , CHINTALA S . Unsupervised representation learning with deep convolutional generative adversarial networks [J ] . arXiv Preprint,arXiv:arXiv 1611.02163 , 2015

SALIMANS T , GOODFELLOW I , ZAREMBA W , et al . Improved techniques for training GANs [C ] // Advances in Neural Information Processing Systems . Barcelona:NIPS , 2016 : 2234 - 2242 .

ARJOVSKY M , BOTTOU L . Towards principled methods for training generative adversarial networks [J ] . arXiv Preprint,arXiv:arXiv 1701.04862 , 2017

ARJOVSKY M , CHINTALA S , BOTTOU L . Wasserstein GAN [J ] . arXiv:arXiv 1701.07875 , 2017

GHOSH A , KULHARIA V , NAMBOODIRI V P , et al . Multi-agent diverse generative adversarial networks [C ] // 2018 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 8513 - 8521 .

MAO X , LI Q , XIE H , et al . Least squares generative adversarial networks [J ] . arXiv Preprint,arXiv:arXiv 1611.04076v3 , 2017

CHEN B , LIU T , LIU K , et al . Image super-resolution using complex dense block on generative adversarial networks [C ] // 2019 IEEE International Conference on Image Processing . Piscataway:IEEE Press , 2019 : 2866 - 2870 .

TAN W R , CHAN C S , AGUIRRE H , et al . Improved ArtGAN for conditional synthesis of natural image and artwork [J ] . IEEE Transactions on Image Processing , 2019 , 28 ( 1 ): 394 - 409 .

KANCHARLA P , CHANNAPPAYYA S S . Improving the visual quality of generative adversarial network (GAN)-generated images using the multi-scale structural similarity index [C ] // 25th IEEE International Conference on Image Processing . Piscataway:IEEE Press , 2018 : 3908 - 3912 .

MASCIALINO B , PFEIFFER A , PIA M G , et al . Evaluation of the power of goodness-of-fit tests for the comparison of data distributions [C ] // IEEE Nuclear Science Symposium Conference Record . Piscataway:IEEE Press , 2006 : 101 - 103 .

PELE O , WERMAN M . The quadratic-chi histogram distance family [C ] // European Conference on Computer Vision . Berlin:Sringer , 2010 : 749 - 762 .

MIRZA M , OSINDERO S . Conditional generative adversarial nets [J ] . arXiv Preprint,arXiv:1411.1784v1 , 2014

RADFORD A , METZ L , CHINTALA S . Unsupervised representation learning with deep convolutional generative adversarial networks [J ] . arXiv Preprint,arXiv:arXiv 1511.06434v2 , 2016

ZHAO J , MATHIEU M , LECUN Y . Energy-based generative adversarial network [J ] . arXiv Preprint,arXiv:arXiv 1609.03126v4 , 2017

乔韡韡 , 吴成茂 . 基于卡方散度阈值方法的图像分割研究与实现 [J ] . 计算机应用与软件 , 2008 , 25 ( 10 ): 78 - 81 .

QIAO W W , WU C M . Study on image segmentation of image thre-sholding method based on chi-square divergence and its realization [J ] . Computer Applications and Software , 2008 , 25 ( 10 ): 78 - 81 .

LECUN Y , BOTTOU L , BENGIO Y , et al . Gradient based learning applied to document recognition [J ] . Proceedings of the IEEE , 1998 , 86 ( 11 ): 2278 - 2324 .

XU Q , HUANG G , YUAN Y , et al . An empirical study on evaluation metrics of generative adversarial networks [J ] . arXiv Preprint,arXiv:1806.07755v2 , 2018

浏览量

635

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于安全联邦蒸馏GAN的工业CPS协作入侵检测系统

基于三方生成对抗网络的隐蔽通信方法

基于GAN的联邦学习成员推理攻击与防御方法

基于多鉴别器生成对抗网络的时间序列生成模型

基于生成模型的视频图像重建方法综述