语义引导的遮挡行人再识别注意力网络

任雪娜; 张冬明; 包秀国; 李冰

doi:10.11959/j.issn.1000-436x.2021184

您当前的位置：

首页 >

文章列表页 >

语义引导的遮挡行人再识别注意力网络

学术论文 | 更新时间：2024-06-05

- 语义引导的遮挡行人再识别注意力网络
- Semantic guidance attention network for occluded person re-identification
- 通信学报 2021年42卷第10期页码：106-116
- 作者机构：
  
  1. 中国科学院信息工程研究所，北京 100093
  2. 中国科学院大学网络空间安全学院，北京 100093
  3. 国家计算机网络应急技术处理协调中心，北京 100029
  4. 北京航空航天大学自动化学院，北京 100191
- 作者简介：
  
  [ "任雪娜（1989- ），女，河北石家庄人，中国科学院信息工程研究所博士生，主要研究方向为行人重识别（遮挡行人识别、变装行人识别等）" ]
  [ "张冬明（1977- ），男，江苏盐城人，博士，国家计算机网络应急技术处理协调中心研究员、博士生导师，主要研究方向为多媒体内容检索、模式识别、视频编码等" ]
  [ "包秀国（1963- ），男，江苏如皋人，博士，国家计算机网络应急技术处理协调中心教授级高级工程师、博士生导师，主要研究方向为网络与信息安全" ]
  [ "李冰（1990- ），男，辽宁沈阳人，北京航空航天大学博士生，主要研究方向为压缩视频行为识别" ]
- 基金信息：
  
  国家重点研发计划基金资助项目(2018YFB0804704);国家自然科学基金资助项目(61672495);国家自然科学基金资助项目(U1736218)
- DOI：10.11959/j.issn.1000-436x.2021184
  中图分类号： TN92
- 网络首发：2021-10，
  
  纸质出版：2021-10-25
- 稿件说明：
移动端阅览
任雪娜, 张冬明, 包秀国, 等. 语义引导的遮挡行人再识别注意力网络[J]. 通信学报, 2021,42(10):106-116.

Xuena REN, Dongming ZHANG, Xiuguo BAO, et al. Semantic guidance attention network for occluded person re-identification[J]. Journal on Communications, 2021, 42(10): 106-116.
任雪娜, 张冬明, 包秀国, 等. 语义引导的遮挡行人再识别注意力网络[J]. 通信学报, 2021,42(10):106-116. DOI： 10.11959/j.issn.1000-436x.2021184.

Xuena REN, Dongming ZHANG, Xiuguo BAO, et al. Semantic guidance attention network for occluded person re-identification[J]. Journal on Communications, 2021, 42(10): 106-116. DOI： 10.11959/j.issn.1000-436x.2021184.

摘要

为了解决遮挡场景下行人再识别的特征不对齐、错误匹配的问题，提出了一种语义引导对齐的注意力网络（SGAN）对齐行人的不同部分。SGAN 以行人的语义掩膜作为监督信息，通过全局语义引导和局部语义引导提取行人的全身和局部特征，并根据人体不同部分的可见性动态调整模型训练。在推理阶段，依据注意力模型获得局部区块的可见性，利用共享可见的人体部分的匹配策略自适应地对特征进行相似度的计算。实验结果表明， SGAN能够容忍一定的遮挡，它的准确率不仅在全身数据集上优于大多数先进模型，在2个较大规模的复杂遮挡数据集Occluded-DukeMTMC和P-DukeMTMC-reID上也优于现有的行人再识别方法。

Abstract

To solve the problem of misalignment and mismatch in occluded person Re-ID

SGAN (semantic guided attention network) was proposed.In SGAN

the semantic masks of pedestrians were used as supervision to learn the global and local features through the attention modules

and the training process was dynamically adjusted according to the visibility of local regions.In the inference stage

the part-to-part matching strategy was adopted to adaptively measure visible features based on the feature visibility

which was obtained based on the learned masks from the attention modules.Experimental results show that the average accuracy of SGAN on the holistic datasets is better than most advanced models.Additionally

it is tolerant of occlusions and largely outperforms existing person Re-ID methods on two larger-scale complex occlusion datasets (Occluded-DukeMTMC and P-DukeMTMC-reID).

关键词

Keywords

references

GHEISSARI N , SEBASTIAN T B , HARTLEY R . Person reidentification using spatiotemporal appearance [C ] // Proceedings of 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06) . Piscataway:IEEE Press , 2006 : 1528 - 1535 .

GRAY D , TAO H . Viewpoint invariant pedestrian recognition with an ensemble of localized features [M ] . Berlin : Springer , 2008 .

LOWE D G , . Object recognition from local scale-invariant features [C ] // Proceedings of the Seventh IEEE International Conference on Computer Vision . Piscataway:IEEE Press , 1999 : 1150 - 1157 .

RISTANI E , SOLERA F , ZOU R , et al . Performance measures and a data set for multi-target,multi-camera tracking [C ] // European Conference on Computer Vision . Berlin:Springer , 2016 : 17 - 35 .

罗浩 , 姜伟 , 范星 , 等 . 基于深度学习的行人重识别研究进展 [J ] . 自动化学报 , 2019 , 45 ( 11 ): 2032 - 2049 .

LUO H , JIANG W , FAN X , et al . A survey on deep learning based person Re-identification [J ] . Acta Automatica Sinica , 2019 , 45 ( 11 ): 2032 - 2049 .

宋婉茹 , 赵晴晴 , 陈昌红 , 等 . 行人重识别研究综述 [J ] . 智能系统学报 , 2017 , 12 ( 6 ): 770 - 780 .

SONG W R , ZHAO Q Q , CHEN C H , et al . Survey on pedestrian re-identification research [J ] . CAAI Transactions on Intelligent Systems , 2017 , 12 ( 6 ): 770 - 780 .

ZHENG L , YANG Y , HAUPTMANN A G . Person re-identification:past,present and future [J ] . arXiv Preprint,arXiv:1610.02984 , 2016 .

ZHENG L , SHEN L Y , TIAN L , et al . Scalable person Re-identification:a benchmark [C ] // Proceedings of 2015 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2015 : 1116 - 1124 .

ZHENG Z D , ZHENG L , YANG Y . Unlabeled samples generated by GAN improve the person Re-identification baseline in vitro [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2017 : 3774 - 3782 .

MIAO J X , WU Y , LIU P , et al . Pose-guided feature alignment for occluded person re-identification [C ] // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2019 : 542 - 551 .

ZHUO J X , CHEN Z Y , LAI J H , et al . Occluded person Re-identification [C ] // Proceedings of 2018 IEEE International Conference on Multimedia and Expo (ICME) . Piscataway:IEEE Press , 2018 : 1 - 6 .

WU L , SHEN C , HENGEL AV . PersonNet:person re-identification with deep convolutional neural networks [J ] . arXiv Preprint,arXiv:1601.0725 , 2016 .

QIAN X L , FU Y W , JIANG Y G , et al . Multi-scale deep learning architectures for person re-identification [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2017 : 5409 - 5418 .

VARIOR R R , SHUAI B , LU J W , et al . A siamese long short-term memory architecture for human Re-identification [M ] . Cham : Springer International Publishing , 2016 : 135 - 153 .

SUN Y F , ZHENG L , YANG Y , et al . Beyond part models:person retrieval with refined part pooling (and a strong convolutional baseline) [C ] // European Conference on Computer Vision . Berlin:Springer , 2018 : 501 - 518 .

ZHANG X , LUO H , FAN X , et al . AlignedReID:surpassing human-level performance in person re-identiflcation [J ] . arXiv Preprint,arXiv:1711.08184 , 2017 .

ZHAO H Y , TIAN M Q , SUN S Y , et al . Spindle net:person re-identification with human body region guided feature decomposition and fusion [C ] // Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2017 : 907 - 915 .

ZHENG L , HUANG Y J , LU H C , et al . Pose-invariant embedding for deep person re-identification [J ] . IEEE Transactions on Image Processing , 2019 , 28 ( 9 ): 4500 - 4509 .

HE L X , LIANG J , LI H Q , et al . Deep spatial feature reconstruction for partial person re-identification:alignment-free approach [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 7073 - 7082 .

HE L , SUN Z , ZHU Y , WANG Y . Recognizing partial biometric patterns [J ] . arXiv Preprint,arXiv:1810.07399 , 2018 .

ZHUO J , LAI J , CHEN P . A novel teacher-student learning framework for occluded person re-Identification [J ] . arXiv Preprint,arXiv:1907.03253 , 2019 .

ZHENG W S , LI X , XIANG T , et al . Partial person Re-identification [C ] // Proceedings of 2015 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2015 : 4678 - 4686 .

SUN Y F , XU Q , LI Y L , et al . Perceive where to focus:learning visibility-aware part-level features for partial person re-identification [C ] // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2019 : 393 - 402 .

GAO S , WANG J Y , LU H C , et al . Pose-guided visible part matching for occluded person ReID [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2020 : 11741 - 11749 .

WANG G A , YANG S , LIU H Y , et al . High-order information matters:learning relation and topology for occluded person re-identification [C ] // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2020 : 6448 - 6457 .

KALAYEH M M , BASARAN E , GÖKMEN M , et al . Human semantic parsing for person Re-identification [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 1062 - 1071 .

HE K M , ZHANG X Y , REN S Q , et al . Deep residual learning for image recognition [C ] // Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2016 : 770 - 778 .

HERMANS A , BEYER L , LEIBE B . In defense of the triplet loss for person re-identification [J ] . arXiv Preprint,arXiv:1703.07737 , 2017 .

DENG J , DONG W , SOCHER R , et al . ImageNet:a large-scale hierarchical image database [C ] // Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2009 : 248 - 255 .

YU Q , CHANG X , SONG Y Z , et al . The devil is in the middle:exploiting mid-level representations for cross-domain instance matching [J ] . arXiv Preprint,arXiv:1711.08106 , 2017 .

LIAO S C , HU Y , ZHU X Y , et al . Person re-identification by local maximal occurrence representation and metric learning [C ] // Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway:IEEE Press , 2015 : 2197 - 2206 .

ZHONG Z , ZHENG L , KANG G L , et al . Random erasing data augmentation [J ] . Proceedings of the AAAI Conference on Artificial Intelligence , 2020 , 34 ( 7 ): 13001 - 13008 .

LI W , ZHU X T , GONG S G . Harmonious attention network for person Re-identification [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 2285 - 2294 .

ZHAO L M , LI X , ZHUANG Y T , et al . Deeply-learned part-aligned representations for person Re-identification [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2017 : 3239 - 3248 .

GE Y X , LI Z W , ZHAO H Y , et al . FD-GAN:pose-guided feature distilling GAN for robust person Re-identification [J ] . arXiv Preprint,arXiv:1810.02936 , 2018 .

HUANG H J , LI D W , ZHANG Z , et al . Adversarially occluded samples for person Re-identification [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 5098 - 5107 .

SUH Y , WANG J D , TANG S Y , et al . Part-aligned bilinear representations for person Re-identification [C ] // European Conference on Computer Vision . Berlin:Springer , 2018 : 418 - 437 .

YANG Q , WANG P Z , FANG Z H , et al . Focus on the visible regions:semantic-guided alignment model for occluded person Re-identification [J ] . Sensors (Basel,Switzerland) , 2020 , 20 ( 16 ): 4431 .

SUN Y F , ZHENG L , DENG W J , et al . SVDNet for pedestrian retrieval [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV) . Piscataway:IEEE Press , 2017 : 3820 - 3828 .

ZHENG Z D , ZHENG L , YANG Y . Pedestrian alignment network for large-scale person re-identification [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2019 , 29 ( 10 ): 3037 - 3045 .

LI W , ZHU X , GONG S . Person re-identification by deep joint learning of multi-loss classification [J ] . arXiv Preprint,arXiv:1705.04724 , 2017 .

LIN Y T , ZHENG L , ZHENG Z D , et al . Improving person re-identification by attribute and identity learning [J ] . Pattern Recognition , 2019 , 95 : 151 - 161 .

CHEN Y B , ZHU X T , GONG S G . Person Re-identification by deep learning multi-scale representations [C ] // Proceedings of 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) . Piscataway:IEEE Press , 2017 : 2590 - 2600 .

CHANG X B , HOSPEDALES T M , XIANG T . Multi-level factorisation net for person Re-identification [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 2109 - 2118 .

SELVARAJU R R , COGSWELL M , DAS A , et al . Grad-CAM:visual explanations from deep networks via gradient-based localization [J ] . International Journal of Computer Vision , 2020 , 128 ( 2 ): 336 - 359 .

浏览量

2393

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

医学影像无监督异常检测技术综述

基于成本敏感CNN-BiLSTM网络的目标可见性预测方法

工业雾霾环境下多模态语义辅助的毫米波波束预测方法

基于置信度差异与熵最小化的跨时间鲁棒射频指纹识别方法

基于API时序关系图的恶意软件检测方法