基于空间感知的多级损失目标跟踪对抗攻击方法

程旭; 王莹莹; 张年杰; 付章杰; 陈北京; 赵国英

doi:10.11959/j.issn.1000-436x.2021208

您当前的位置：

首页 >

文章列表页 >

基于空间感知的多级损失目标跟踪对抗攻击方法

学术通信 | 更新时间：2024-06-05

- 基于空间感知的多级损失目标跟踪对抗攻击方法
- Multi-level loss object tracking adversarial attack method based on spatial perception
- 通信学报 2021年42卷第11期页码：242-254
- 作者机构：
  
  1. 南京信息工程大学计算机学院、软件学院、网络空间安全学院，江苏南京 210044
  2. 南京信息工程大学数字取证教育部工程研究中心，江苏南京 210044
  3. 奥卢大学机器视觉与信号分析研究中心，奥卢 FI-90014
- 作者简介：
  
  [ "程旭（1983− ），男，山西太原人，博士，南京信息工程大学副教授、硕士生导师，主要研究方向为目标检测与跟踪、图像理解、对抗攻击等" ]
  [ "王莹莹（1999− ），女，江苏盐城人，南京信息工程大学硕士生，主要研究方向为目标跟踪系统的对抗攻击" ]
  [ "张年杰（1997− ），男，江苏泰州人，南京信息工程大学硕士生，主要研究方向为目标跟踪" ]
  [ "付章杰（1983− ），男，河南南阳人，博士，南京信息工程大学教授、博士生导师，主要研究方向为人工智能安全、区块链安全、数字取证等" ]
  [ "陈北京（1981− ），男，江西赣州人，博士，南京信息工程大学教授、博士生导师，主要研究方向为多媒体内容安全、彩色图像处理、模式识别等" ]
  [ "赵国英（1977− ），女，山东聊城人，博士，奥卢大学终身教授、博士生导师，主要研究方向为视频图像处理、模式识别、智能人机交互等" ]
- 基金信息：
  
  国家自然科学基金资助项目(61802058);国家自然科学基金资助项目(61911530397);国家留学基金资助项目(201908320175);中国博士后科学基金资助项目(2019M651650);江苏省自然科学基金资助项目(BK20201267);江苏省自然科学基金资助项目(BK20200039)
- DOI：10.11959/j.issn.1000-436x.2021208
  中图分类号： TP391
- 网络首发：2021-11，
  
  纸质出版：2021-11-25
- 稿件说明：
移动端阅览
程旭, 王莹莹, 张年杰, 等. 基于空间感知的多级损失目标跟踪对抗攻击方法[J]. 通信学报, 2021,42(11):242-254.

Xu CHENG, Yingying WANG, Nianjie ZHANG, et al. Multi-level loss object tracking adversarial attack method based on spatial perception[J]. Journal on Communications, 2021, 42(11): 242-254.
程旭, 王莹莹, 张年杰, 等. 基于空间感知的多级损失目标跟踪对抗攻击方法[J]. 通信学报, 2021,42(11):242-254. DOI： 10.11959/j.issn.1000-436x.2021208.

Xu CHENG, Yingying WANG, Nianjie ZHANG, et al. Multi-level loss object tracking adversarial attack method based on spatial perception[J]. Journal on Communications, 2021, 42(11): 242-254. DOI： 10.11959/j.issn.1000-436x.2021208.

摘要

针对现有的对抗扰动技术难以有效地降低跟踪器的判别能力使运动轨迹发生快速偏移的问题，提出一种高效的攻击目标跟踪器方法。首先，所提方法从高层类别和底层特征考虑设计了欺骗损失、漂移损失和基于注意力机制的特征损失来联合训练生成器；然后，将干净图像送入该生成器中，生成对抗样本；最后，利用对抗样本干扰目标跟踪器，导致目标运动轨迹发生偏移，降低跟踪精度。实验结果表明，所提方法在 OTB 数据集上达到了54%的成功率下降和70%的精确度下降，实现了复杂场景下对目标快速有效的攻击。

Abstract

In order to solve the problem that it is difficult for the existing adversarial disturbance techniques to effectively reduce the discrimination ability of the trackers and make the trajectory deviation rapidly

an effective object tracking adversarial attack method was proposed.First

deception loss

drift loss and attention mechanism-based loss was designed to jointly train generator based on the consideration of the high-level categories and the low-level features.Then

the clean image was sent to the trained generator to generate the adversarial samples that were used to interfere with the object trackers

which made the object trajectory deviation and reduced the tracking accuracy.Experimental results show that the proposed method achieves 54% reduction in success rate and 70% reduction in accuracy on OTB dataset

which can attack the object of tracking quickly in complex scenes.

关键词

Keywords

references

BOLME D S , BEVERIDGE J R , DRAPER B A , et al . Visual object tracking using adaptive correlation filters [C ] // Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2010 : 2544 - 2550 .

HENRIQUES J F , CASEIRO R , MARTINS P , et al . High-speed tracking with kernelized correlation filters [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2015 , 37 ( 3 ): 583 - 596 .

DANELLJAN M , HÄGER G , SHAHBAZ K F , et al . Accurate scale estimation for robust visual tracking [C ] // Proceedings of Proceedings of the British Machine Vision Conference 2014 .[S.n.:s.l. ] , 2014 : 1 - 11 .

LI Y , ZHU J K , HOI S C H . Reliable patch trackers:robust visual tracking by exploiting reliable patches [C ] // Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2015 : 353 - 361 .

DANELLJAN M , HÄGER G , KHAN F S , et al . Learning spatially regularized correlation filters for visual tracking [C ] // Proceedings of 2015 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2015 : 4310 - 4318 .

DANELLJAN M , ROBINSON A , SHAHBAZ K , et al . Beyond correlation filters:learning continuous convolution operators for visual tracking [C ] // Proceedings of the European Conference on Computer Vision . Berlin:Springer , 2016 : 472 - 488 .

WANG N , YEUNG D Y . Learning a deep compact image representation for visual tracking [C ] // Proceedings of the Annual Conference on Neural Information Processing Systems . New York:Curran Associates , 2013 : 809 - 817 .

HONG S , YOU T , KWAK S , et al . Online tracking by learning discriminative saliency map with convolutional neural network [C ] // Proceedings of the International Conference on Machine Learning . New York:ACM Press , 2015 : 597 - 606 .

WANG L J , OUYANG W L , WANG X G , et al . Visual tracking with fully convolutional networks [C ] // Proceedings of 2015 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2015 : 3119 - 3127 .

MA C , HUANG J B , YANG X K , et al . Hierarchical convolutional features for visual tracking [C ] // Proceedings of 2015 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2015 : 3074 - 3082 .

SONG Y B , MA C , WU X H , et al . VITAL:Visual tracking via adversarial learning [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 8990 - 8999 .

NAM H , HAN B . Learning multi-domain convolutional neural networks for visual tracking [C ] // Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2016 : 4293 - 4302 .

BERTINETTO L , VALMADRE J , HENRIQUES J F , et al . Fully-convolutional Siamese networks for object tracking [C ] // Proceedings of the European Conference on Computer Vision . Berlin:Springer , 2016 : 850 - 865 .

LI B , YAN J J , WU W , et al . High performance visual tracking with Siamese region proposal network [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 8971 - 8980 .

LI B , WU W , WANG Q , et al . SiamRPN++:evolution of Siamese visual tracking with very deep networks [C ] // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2019 : 4282 - 4291 .

ZHU Z , WANG Q , LI B , et al . Distractor-aware Siamese networks for visual object tracking [C ] // Proceedings of the European Conference on Computer Vision . Berlin:Springer , 2018 : 101 - 117 .

VOIGTLAENDER P , LUITEN J , TORR P H S , et al . Siam R-CNN:visual tracking by Re-detection [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2020 : 6577 - 6587 .

GOODFELLOW I J , SHLENS J , SZEGEDY C . Explaining and harnessing adversarial examples [C ] // Proceedings of the third International Conference on Learning Representations . Piscataway:IEEE Press , 2015 : 1 - 11 .

SEYED M , MOOSAVI D , ALHUSSEIN F , et al . Deepfool:a simple and accurate method to fool deep neural networks [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2016 : 2574 - 2582 .

XIE C H , WANG J Y , ZHANG Z S , et al . Adversarial examples for semantic segmentation and object detection [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2017 : 1369 - 1378 .

MADRY A , MAKELOV A , SCHMIDT L , et al . Towards deep learning models resistant to adversarial attacks [C ] // Proceedings of the Sixth International Conference on Learning Representations . Piscataway:IEEE Press , 2018 : 1 - 28 .

ALEXEY K , IAN G , SAMY B . Adversarial machine learning at scale [J ] . arXiv Preprint,arXiv:1611.01236 , 2016 .

司念文 , 张文林 , 屈丹 , 等 . 基于对抗补丁的可泛化的 Grad-CAM攻击方法 [J ] . 通信学报 , 2021 , 42 ( 3 ): 23 - 35 .

SI N W , ZHANG W L , QU D , et al . Generalized Grad-CAM attacking method based on adversarial patch [J ] . Journal on Communications , 2021 , 42 ( 3 ): 23 - 35 .

SU J W , VARGAS D V , SAKURAI K . One pixel attack for fooling deep neural networks [J ] . IEEE Transactions on Evolutionary Computation , 2019 , 23 ( 5 ): 828 - 841 .

ZHONG Y Y , DENG W H . Towards transferable adversarial attack against deep face recognition [J ] . IEEE Transactions on Information Forensics and Security , 2021 , 16 : 1452 - 1466 .

CHEN X S , YAN X Y , ZHENG F , et al . One-shot adversarial attacks on visual tracking with dual attention [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2020 : 10176 - 10185 .

JIA S , MA C , SONG Y B , et al . Robust tracking against adversarial attacks [C ] // Proceedings of the European Conference on Computer Vision . Berlin:Springer , 2020 : 69 - 84 .

XIAO C W , LI B , ZHU J Y , et al . Generating adversarial examples with adversarial networks [C ] // Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence .[S.l.:s.n. ] , 2018 : 835 - 857 .

WEI X X , LIANG S Y , CHEN N , et al . Transferable adversarial attacks for image and video object detection [C ] // Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence .[S.l.:s.n. ] , 2019 : 1 - 8 .

JANDIAL S , MANGLA P , VARSHNEY S , et al . AdvGAN++:harnessing latent layers for adversary generation [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) . Piscataway:IEEE Press , 2019 : 2045 - 2048 .

DEB D , ZHANG J B , JAIN A K . AdvFaces:adversarial face synthesis [C ] // Proceedings of 2020 IEEE International Joint Conference on Biometrics (IJCB) . Piscataway:IEEE Press , 2020 : 1 - 10 .

BALUJA S , FISCHER I . Adversarial transformation networks:learning to generate adversarial examples [J ] . arXiv Preprint,arXiv:1703.09387 , 2017 .

YAN B , WANG D , LU H C , et al . Cooling-shrinking attack:blinding the tracker with imperceptible noises [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2020 : 990 - 999 .

SHARIF M , BHAGAVATULA S , BAUER L , et al . A general framework for adversarial examples with objectives [J ] . ACM Transactions on Privacy and Security , 2019 , 22 ( 3 ): 1 - 30 .

CARLINI N , WAGNER D . Towards evaluating the robustness of neural networks [C ] // Proceedings of 2017 IEEE Symposium on Security and Privacy (SP) . Piscataway:IEEE Press , 2017 : 39 - 57 .

MOOSAVI-DEZFOOLI S M , FAWZI A , FAWZI O , et al . Universal adversarial perturbations [C ] // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2017 : 1765 - 1773 .

DIN S U , AKHTAR N , YOUNIS S , et al . Steganographic universal adversarial perturbations [J ] . Pattern Recognition Letters , 2020 , 135 : 146 - 152 .

WU Y , LIM J , YANG M H . Object tracking benchmark [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2015 , 37 ( 9 ): 1834 - 1848 .

FAN H , LIN L T , YANG F , et al . LaSOT:a high-quality benchmark for large-scale single object tracking [C ] // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2019 : 5374 - 5383 .

LI P X , CHEN B Y , OUYANG W L , et al . GradNet:gradient-guided network for visual object tracking [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2019 : 6162 - 6171 .

GUO Q , XIE X F , JUEFEI-XU F , et al . SPARK:spatial-aware online incremental attack against visual tracking [C ] // Proceedings of the Conference on European Conference on Computer Vision . Berlin:Springer , 2020 : 202 - 219 .

LIANG S Y , WEI X X , YAO S Y , et al . Efficient adversarial attacks for visual object tracking [C ] // Proceedings of the Conference on European Conference on Computer Vision . Berlin:Springer , 2020 : 34 - 50 .

浏览量

1529

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

医学影像无监督异常检测技术综述

基于成本敏感CNN-BiLSTM网络的目标可见性预测方法

工业雾霾环境下多模态语义辅助的毫米波波束预测方法

基于Stackelberg博弈和DQN的多类型蜜罐部署方案

基于置信度差异与熵最小化的跨时间鲁棒射频指纹识别方法