视频主观观测实验启发的HEVC感知帧内码率控制

公衍超; 王玲; 刘颖; 杨楷芳; 林庆帆; 王富平

doi:10.11959/j.issn.1000-436x.2021146

您当前的位置：

首页 >

文章列表页 >

视频主观观测实验启发的HEVC感知帧内码率控制

学术论文 | 更新时间：2024-06-05

- 视频主观观测实验启发的HEVC感知帧内码率控制
- HEVC perceptual intra-frame rate control inspired by video subjective observation experiment
- 通信学报 2021年42卷第8期页码：90-102
- 作者机构：
  
  1. 西安邮电大学通信与信息工程学院，陕西西安 710121
  2. 无线通信与信息处理技术国际联合研究中心，陕西西安 710121
  3. 陕西师范大学计算机科学学院，陕西西安 710119
  4. 新加坡Maschine Technology有限公司，新加坡 787820
- 作者简介：
  
  [ "公衍超（1986- ），男，山东蒙阴人，博士，西安邮电大学讲师、硕士生导师，主要研究方向为视频编码、视频质量评价" ]
  [ "王玲（1994- ），女，河南光山人，西安邮电大学硕士生，主要研究方向为视频编码" ]
  [ "刘颖（1972- ），女，陕西户县人，博士，西安邮电大学教授、博士生导师，主要研究方向为图像检索、图像识别与理解" ]
  [ "杨楷芳（1987- ），女，山西阳泉人，博士，陕西师范大学副教授、硕士生导师，主要研究方向为视频编码、视频质量评价" ]
  [ "林庆帆（1969- ），男，福建晋江人，博士，西安邮电大学特聘教授，主要研究方向为视频编码、图像清晰化及人工智能" ]
  [ "王富平（1987- ），男，陕西咸阳人，博士，西安邮电大学讲师、硕士生导师，主要研究方向为图像特征提取" ]
- 基金信息：
  
  国家自然科学基金资助项目(61801381);国家自然科学基金资助项目(61801282);陕西省自然科学基础研究基金资助项目(2020JQ-426);陕西省国际科技合作与交流计划基金资助项目(2018KW-003);陕西省教育厅科研计划基金资助项目(18JK0708);西安邮电大学研究生联合培养工作站重点基金资助项目(YJGJ201902)
- DOI：10.11959/j.issn.1000-436x.2021146
  中图分类号： TN911.7
- 网络首发：2021-08，
  
  纸质出版：2021-08-25
- 稿件说明：
移动端阅览
公衍超, 王玲, 刘颖, 等. 视频主观观测实验启发的HEVC感知帧内码率控制[J]. 通信学报, 2021,42(8):90-102.

Yanchao GONG, Ling WANG, Ying LIU, et al. HEVC perceptual intra-frame rate control inspired by video subjective observation experiment[J]. Journal on Communications, 2021, 42(8): 90-102.
公衍超, 王玲, 刘颖, 等. 视频主观观测实验启发的HEVC感知帧内码率控制[J]. 通信学报, 2021,42(8):90-102. DOI： 10.11959/j.issn.1000-436x.2021146.

Yanchao GONG, Ling WANG, Ying LIU, et al. HEVC perceptual intra-frame rate control inspired by video subjective observation experiment[J]. Journal on Communications, 2021, 42(8): 90-102. DOI： 10.11959/j.issn.1000-436x.2021146.

摘要

针对高效视频编码（HEVC）采用的码率控制方法感知率失真性能较低的问题，提出了一种有效提高视频感知率失真性能的帧内码率控制算法。首先，度量视频的空时域复杂度，并结合空时域复杂度设计视频主观观测实验。其次，基于视频主观观测实验结果，结合人类视觉系统相关感知特性，构建能够有效衡量人眼对视频不同区域感知差异性的视频内容空时域感知敏感因子。最后，将空时域感知敏感因子运用到帧内图像最大编码单元层目标比特分配中，实现感知帧内码率控制。实验结果表明，在比特估计准确度和感知率失真性能2个核心指标上，所提算法均明显优于HEVC采用的码率控制算法。

Abstract

In view of the low perceptual rate-distortion performance of the rate control method used in high efficiency video coding (HEVC)

an intra-frame rate control algorithm to effectively improve the perceptual rate-distortion performance of video was proposed.First

the spatiotemporal complexity of videos was measured

and the video subjective observation experiment was designed combined with the spatiotemporal complexity.Secondly

based on the experimental results of video subjective observation

combined with the relevant human vision system perception characteristics

the spatiotemporal perceptual sensitivity factors of video content which could effectively measure the perception difference of human eyes for different regions of video were constructed.Finally

the spatiotemporal perceptual sensitivity factors were applied to the target bit allocation of the largest coding unit layer in the intra-frame image

then the perceptual intra-frame rate control was realized.Experimental results show that the proposed algorithm is superior to the rate control algorithm adopted by HEVC in terms of the bit estimation accuracy and the perceptual rate-distortion performance.

关键词

Keywords

references

LI B , LI H Q , LI L , et al . λ domain rate control algorithm for high efficiency video coding [J ] . IEEE Transactions on Image Processing , 2014 , 23 ( 9 ): 3841 - 3854 .

SULLIVAN G J , OHM J R , HAN W J , et al . Overview of the high efficiency video coding (HEVC) standard [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2012 , 22 ( 12 ): 1649 - 1668 .

GONG Y C , WAN S , YANG K F , et al . [J ] . Temporal-layer-motivated lambda domain picture level rate control for random-access configuration in H.265/HEVC , 2019 , 29 ( 1 ): 156 - 170 .

ZHAO F , KU C W , XIANG G , et al . A novel quality enhanced low complexity rate control algorithm for HEVC [C ] // 2020 IEEE International Conference on Visual Communications and Image Processing . Piscataway:IEEE Press , 2020 : 278 - 280 .

LI B , LI H Q , LI L , et al . Rate control by R-lambda model for HEVC:JCTVC-K0103 [C ] // Proceedings of the 11th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2012 : 1 - 11 .

WANG X , KARCZEWICZ M . Intra frame rate control based SATD:JCT-VC M0257 [C ] // Proceedings of the 13th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2013 : 1 - 5 .

LI B , LI H Q , LI L , et al . Adaptive bit allocation for R-lambda model rate control in HM:JCTVC-M0036 [C ] // Proceedings of the 13th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2013 : 1 - 7 .

LI L , LI B , LI H Q , et al . λ-domain optimal bit allocation algorithm for high efficiency video coding [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2018 , 28 ( 1 ): 130 - 142 .

李维 , 赵凡 , 张二虎 , 等 . 基于SATD的H.265/HEVC拉格朗日因子选择算法 [J ] . 通信学报 , 2017 , 38 ( 6 ): 68 - 74 .

LI W , ZHAO F , ZHANG E H , et al . Lagrange multiplier selection based on SATD for H.265/HEVC [J ] . Journal on Communications , 2017 , 38 ( 6 ): 68 - 74 .

MCCANN K , ROSEWARNE C , BROSS B , et al . High efficiency video coding (HEVC) test model 16 (HM 16) encoder description:JCTVC-R1002 [C ] // Proceedings of the 18th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2014 : 1 - 59 .

LI X J , ABUDOULIKEMU Y . Background-foreground information based bit allocation algorithm for surveillance video on high efficiency video coding (HEVC) [C ] // 2016 IEEE International Conference on Visual Communications and Image Processing . Piscataway:IEEE Press , 2016 : 1 - 4 .

ZHANG Z W , JING T , HAN J N , et al . A new rate control scheme for video coding based on region of interest [J ] . IEEE Access , 2017 , 5 : 13677 - 13688 .

WANG M H , NGAN K N , LI H L . An efficient frame-content based intra frame rate control for high efficiency video coding [J ] . IEEE Signal Processing Letters , 2015 , 22 ( 7 ): 896 - 900 .

GAO W , KWONG S , ZHOU Y , et al . SSIM-based game theory approach for rate-distortion optimized intra frame CTU-level bit allocation [J ] . IEEE Transactions on Multimedia , 2016 , 18 ( 6 ): 988 - 999 .

ZHAO H L , XIE W , ZHANG Y C , et al . An SSIM-motivated LCU-level rate control algorithm for HEVC [C ] // 2013 Picture Coding Symposium . Piscataway:IEEE Press , 2013 : 85 - 88 .

LIU X Y , ZHANG Y , ZHU L W , et al . Perception-based CTU level bit allocation for intra high efficiency video coding [J ] . IEEE Access , 2019 , 7 : 154959 - 154970 .

ZENG H Q , YANG A S , NGAN K N , et al . Perceptual sensitivity-based rate control method for high efficiency video coding [J ] . Multimedia Tools and Applications , 2016 , 75 ( 17 ): 10383 - 10396 .

ZHOU M L , WEI X K , KWONG S , et al . Just noticeable distortion-based perceptual rate control in HEVC [J ] . IEEE Transactions on Image Processing , 2020 , 29 ( 6 ): 7603 - 7614 .

CHOU C H , LI Y C . A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 1995 , 5 ( 6 ): 467 - 476 .

WU H R , REIBMAN A R , LIN W S , et al . Perceptual visual signal compression and transmission [J ] . Proceedings of the IEEE , 2013 , 101 ( 9 ): 2025 - 2043 .

YANG K F , WAN S , WU H R , et al . Detection and estimation of supra-threshold distortion levels of pictures based on just-noticeable difference [C ] // 2016 IEEE International Conference on Visual Communications and Image Processing . Piscataway:IEEE Press , 2016 : 1 - 4 .

WU H R , LIN W S , NGAN K N . Rate-perceptual-distortion optimization (RpDO) based picture coding-issues and challenges [C ] // 2014 International Conference on Digital Signal Processing . Piscataway:IEEE Press , 2014 : 777 - 782 .

WANG H Q , KATSAVOUNIDIS I , ZHOU J T , et al . VideoSet:a large-scale compressed video quality dataset based on JND measurement [J ] . Journal of Visual Communication and Image Representation , 2017 , 46 ( 7 ): 292 - 302 .

WU J J , LI L D , DONG W S , et al . Enhanced just noticeable difference model for images with pattern complexity [J ] . IEEE Transactions on Image Processing , 2017 , 26 ( 6 ): 2682 - 2693 .

WANG S Q , MA L , FANG Y M , et al . Just noticeable difference estimation for screen content images [J ] . IEEE Transactions on Image Processing , 2016 , 25 ( 8 ): 3838 - 3851 .

张尧尧 . 基于视频结构化的侦查应用 [J ] . 法制与社会 , 2020 , 19 : 75 - 76 .

ZHAGN Y Y . Investigation application based on video structure [J ] . Legal System and Society , 2020 , 19 : 75 - 76 .

孙展明 , 尹伟中 . 论视频侦查的几个基本问题 [J ] . 公安教育 , 2015 , 12 : 32 - 36 .

SUN Z M , YIN W Z . On several basic issues of video investigation [J ] . Public Security Education , 2015 , 12 : 32 - 36 .

ITU-R . ITU-R BT.500-13-2012:Methodology for the subjective assessment of the quality of television pictures [S ] . 2012 .

GONG Y C , WAN S , YANG K F , et al . Rate-distortion- optimization-based quantization parameter cascading technique for random-access configuration in H.265/HEVC [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2017 , 27 ( 6 ): 1304 - 1312 .

LEE J S , EBRAHIMI T . Perceptual video compression:a survey [J ] . IEEE Journal of Selected Topics in Signal Processing , 2012 , 6 ( 6 ): 684 - 697 .

YANG X K , LIN W S , LU Z K , et al . Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2005 , 15 ( 6 ): 742 - 752 .

YAMADA K E . Some structural features of the fovea centralis in the human retina [J ] . Arch Ophthalmol , 1969 , 82 ( 2 ): 151 - 159 .

ONG P E , YANG X K , LIN W S , et al . Perceptual quality and objective quality measurements of compressed videos [J ] . Journal of Visual Communication and Image Representation , 2006 , 17 ( 4 ): 717 - 737 .

LI B , ZHANG D , LI H Q , et al . QP determination by lambda value JCTVC-I0426 [C ] // Proceedings of the 9th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2012 : 1 - 10 .

BOSSEN F , . Common test conditions and software reference configurations [C ] // Proceedings of the 11th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2012 : 1 - 4 .

李维 , 杨付正 , 任鹏 . 考虑视频内容的 H.265/HEVC 帧层码率分配算法 [J ] . 通信学报 , 2015 , 36 ( 9 ): 76 - 81 .

LI W , YANG F Z , REN P . H.265/HEVC frame layer rate allocation algorithm considering video content [J ] . Journal on Communications , 2015 , 36 ( 9 ): 76 - 81 .

PATEUXS B , JUNG J . An excel add-in for computing Bjøntegaard metric and its evolution:VCEG-AE07 [C ] // Proceedings of the Video Coding Experts Group Meeting . New York:ACM Press , 2007 : 1 - 10 .

DABEER O , CHAUDHURI S . Analysis of an adaptive sampler based on weber's law [J ] . IEEE Transactions on Signal Processing , 2011 , 59 ( 4 ): 1868 - 1878 .

浏览量

1114

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于Q-learning的HTTP自适应流码率控制方法研究

H.264中一种基于R-Q模型的自适应码率控制算法研究

结合视觉感知的对象基嵌入式图像编码中的码率控制方法

Na⁺离子掺杂Gd₂O₃ ∶ Sm³⁺纳米晶的发光增强

Si基CeO₂薄膜的发光特性