HEVC perceptual intra-frame rate control inspired by video subjective observation experiment

Yanchao GONG; Ling WANG; Ying LIU; Kaifang YANG; Qingfan LIN; Fuping WANG

doi:10.11959/j.issn.1000-436x.2021146

您当前的位置：

首页 >

文章列表页 >

HEVC perceptual intra-frame rate control inspired by video subjective observation experiment

Papers | 更新时间：2024-06-05

- HEVC perceptual intra-frame rate control inspired by video subjective observation experiment
- Journal on Communications Vol. 42, Issue 8, Pages: 90-102(2021)
- 作者机构：
  
  1. 西安邮电大学通信与信息工程学院，陕西西安 710121
  2. 无线通信与信息处理技术国际联合研究中心，陕西西安 710121
  3. 陕西师范大学计算机科学学院，陕西西安 710119
  4. 新加坡Maschine Technology有限公司，新加坡 787820
- 作者简介：
- 基金信息：
  
  The National Natural Science Foundation of China(61801381);The National Natural Science Foundation of China(61801282);The Project of Natural Science Basic Research in Shaanxi Province(2020JQ-426);The Project of International Scientific and Technological Cooperation and Exchange in Shaanxi Province(2018KW-003);The Project of Education Department of Shaanxi Province(18JK0708);The Key Project of Postgraduate Joint Training Workstation of Xi’an University of Posts and Telecommunications(YJGJ201902)
- DOI：10.11959/j.issn.1000-436x.2021146
  CLC： TN911.7
- Online First：2021-08，
  
  Published：25 August 2021
- 稿件说明：
移动端阅览
Yanchao GONG, Ling WANG, Ying LIU, et al. HEVC perceptual intra-frame rate control inspired by video subjective observation experiment[J]. Journal on Communications, 2021, 42(8): 90-102.
DOI：

Yanchao GONG, Ling WANG, Ying LIU, et al. HEVC perceptual intra-frame rate control inspired by video subjective observation experiment[J]. Journal on Communications, 2021, 42(8): 90-102. DOI： 10.11959/j.issn.1000-436x.2021146.

摘要

针对高效视频编码（HEVC）采用的码率控制方法感知率失真性能较低的问题，提出了一种有效提高视频感知率失真性能的帧内码率控制算法。首先，度量视频的空时域复杂度，并结合空时域复杂度设计视频主观观测实验。其次，基于视频主观观测实验结果，结合人类视觉系统相关感知特性，构建能够有效衡量人眼对视频不同区域感知差异性的视频内容空时域感知敏感因子。最后，将空时域感知敏感因子运用到帧内图像最大编码单元层目标比特分配中，实现感知帧内码率控制。实验结果表明，在比特估计准确度和感知率失真性能2个核心指标上，所提算法均明显优于HEVC采用的码率控制算法。

Abstract

In view of the low perceptual rate-distortion performance of the rate control method used in high efficiency video coding (HEVC)

an intra-frame rate control algorithm to effectively improve the perceptual rate-distortion performance of video was proposed.First

the spatiotemporal complexity of videos was measured

and the video subjective observation experiment was designed combined with the spatiotemporal complexity.Secondly

based on the experimental results of video subjective observation

combined with the relevant human vision system perception characteristics

the spatiotemporal perceptual sensitivity factors of video content which could effectively measure the perception difference of human eyes for different regions of video were constructed.Finally

the spatiotemporal perceptual sensitivity factors were applied to the target bit allocation of the largest coding unit layer in the intra-frame image

then the perceptual intra-frame rate control was realized.Experimental results show that the proposed algorithm is superior to the rate control algorithm adopted by HEVC in terms of the bit estimation accuracy and the perceptual rate-distortion performance.

关键词

Keywords

references

LI B , LI H Q , LI L , et al . λ domain rate control algorithm for high efficiency video coding [J ] . IEEE Transactions on Image Processing , 2014 , 23 ( 9 ): 3841 - 3854 .

SULLIVAN G J , OHM J R , HAN W J , et al . Overview of the high efficiency video coding (HEVC) standard [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2012 , 22 ( 12 ): 1649 - 1668 .

GONG Y C , WAN S , YANG K F , et al . [J ] . Temporal-layer-motivated lambda domain picture level rate control for random-access configuration in H.265/HEVC , 2019 , 29 ( 1 ): 156 - 170 .

ZHAO F , KU C W , XIANG G , et al . A novel quality enhanced low complexity rate control algorithm for HEVC [C ] // 2020 IEEE International Conference on Visual Communications and Image Processing . Piscataway:IEEE Press , 2020 : 278 - 280 .

LI B , LI H Q , LI L , et al . Rate control by R-lambda model for HEVC:JCTVC-K0103 [C ] // Proceedings of the 11th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2012 : 1 - 11 .

WANG X , KARCZEWICZ M . Intra frame rate control based SATD:JCT-VC M0257 [C ] // Proceedings of the 13th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2013 : 1 - 5 .

LI B , LI H Q , LI L , et al . Adaptive bit allocation for R-lambda model rate control in HM:JCTVC-M0036 [C ] // Proceedings of the 13th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2013 : 1 - 7 .

LI L , LI B , LI H Q , et al . λ-domain optimal bit allocation algorithm for high efficiency video coding [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2018 , 28 ( 1 ): 130 - 142 .

李维 , 赵凡 , 张二虎 , 等 . 基于SATD的H.265/HEVC拉格朗日因子选择算法 [J ] . 通信学报 , 2017 , 38 ( 6 ): 68 - 74 .

LI W , ZHAO F , ZHANG E H , et al . Lagrange multiplier selection based on SATD for H.265/HEVC [J ] . Journal on Communications , 2017 , 38 ( 6 ): 68 - 74 .

MCCANN K , ROSEWARNE C , BROSS B , et al . High efficiency video coding (HEVC) test model 16 (HM 16) encoder description:JCTVC-R1002 [C ] // Proceedings of the 18th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2014 : 1 - 59 .

LI X J , ABUDOULIKEMU Y . Background-foreground information based bit allocation algorithm for surveillance video on high efficiency video coding (HEVC) [C ] // 2016 IEEE International Conference on Visual Communications and Image Processing . Piscataway:IEEE Press , 2016 : 1 - 4 .

ZHANG Z W , JING T , HAN J N , et al . A new rate control scheme for video coding based on region of interest [J ] . IEEE Access , 2017 , 5 : 13677 - 13688 .

WANG M H , NGAN K N , LI H L . An efficient frame-content based intra frame rate control for high efficiency video coding [J ] . IEEE Signal Processing Letters , 2015 , 22 ( 7 ): 896 - 900 .

GAO W , KWONG S , ZHOU Y , et al . SSIM-based game theory approach for rate-distortion optimized intra frame CTU-level bit allocation [J ] . IEEE Transactions on Multimedia , 2016 , 18 ( 6 ): 988 - 999 .

ZHAO H L , XIE W , ZHANG Y C , et al . An SSIM-motivated LCU-level rate control algorithm for HEVC [C ] // 2013 Picture Coding Symposium . Piscataway:IEEE Press , 2013 : 85 - 88 .

LIU X Y , ZHANG Y , ZHU L W , et al . Perception-based CTU level bit allocation for intra high efficiency video coding [J ] . IEEE Access , 2019 , 7 : 154959 - 154970 .

ZENG H Q , YANG A S , NGAN K N , et al . Perceptual sensitivity-based rate control method for high efficiency video coding [J ] . Multimedia Tools and Applications , 2016 , 75 ( 17 ): 10383 - 10396 .

ZHOU M L , WEI X K , KWONG S , et al . Just noticeable distortion-based perceptual rate control in HEVC [J ] . IEEE Transactions on Image Processing , 2020 , 29 ( 6 ): 7603 - 7614 .

CHOU C H , LI Y C . A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 1995 , 5 ( 6 ): 467 - 476 .

WU H R , REIBMAN A R , LIN W S , et al . Perceptual visual signal compression and transmission [J ] . Proceedings of the IEEE , 2013 , 101 ( 9 ): 2025 - 2043 .

YANG K F , WAN S , WU H R , et al . Detection and estimation of supra-threshold distortion levels of pictures based on just-noticeable difference [C ] // 2016 IEEE International Conference on Visual Communications and Image Processing . Piscataway:IEEE Press , 2016 : 1 - 4 .

WU H R , LIN W S , NGAN K N . Rate-perceptual-distortion optimization (RpDO) based picture coding-issues and challenges [C ] // 2014 International Conference on Digital Signal Processing . Piscataway:IEEE Press , 2014 : 777 - 782 .

WANG H Q , KATSAVOUNIDIS I , ZHOU J T , et al . VideoSet:a large-scale compressed video quality dataset based on JND measurement [J ] . Journal of Visual Communication and Image Representation , 2017 , 46 ( 7 ): 292 - 302 .

WU J J , LI L D , DONG W S , et al . Enhanced just noticeable difference model for images with pattern complexity [J ] . IEEE Transactions on Image Processing , 2017 , 26 ( 6 ): 2682 - 2693 .

WANG S Q , MA L , FANG Y M , et al . Just noticeable difference estimation for screen content images [J ] . IEEE Transactions on Image Processing , 2016 , 25 ( 8 ): 3838 - 3851 .

张尧尧 . 基于视频结构化的侦查应用 [J ] . 法制与社会 , 2020 , 19 : 75 - 76 .

ZHAGN Y Y . Investigation application based on video structure [J ] . Legal System and Society , 2020 , 19 : 75 - 76 .

孙展明 , 尹伟中 . 论视频侦查的几个基本问题 [J ] . 公安教育 , 2015 , 12 : 32 - 36 .

SUN Z M , YIN W Z . On several basic issues of video investigation [J ] . Public Security Education , 2015 , 12 : 32 - 36 .

ITU-R . ITU-R BT.500-13-2012:Methodology for the subjective assessment of the quality of television pictures [S ] . 2012 .

GONG Y C , WAN S , YANG K F , et al . Rate-distortion- optimization-based quantization parameter cascading technique for random-access configuration in H.265/HEVC [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2017 , 27 ( 6 ): 1304 - 1312 .

LEE J S , EBRAHIMI T . Perceptual video compression:a survey [J ] . IEEE Journal of Selected Topics in Signal Processing , 2012 , 6 ( 6 ): 684 - 697 .

YANG X K , LIN W S , LU Z K , et al . Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2005 , 15 ( 6 ): 742 - 752 .

YAMADA K E . Some structural features of the fovea centralis in the human retina [J ] . Arch Ophthalmol , 1969 , 82 ( 2 ): 151 - 159 .

ONG P E , YANG X K , LIN W S , et al . Perceptual quality and objective quality measurements of compressed videos [J ] . Journal of Visual Communication and Image Representation , 2006 , 17 ( 4 ): 717 - 737 .

LI B , ZHANG D , LI H Q , et al . QP determination by lambda value JCTVC-I0426 [C ] // Proceedings of the 9th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2012 : 1 - 10 .

BOSSEN F , . Common test conditions and software reference configurations [C ] // Proceedings of the 11th Joint Collaborative Team on Video Coding Meeting . New York:ACM Press , 2012 : 1 - 4 .

李维 , 杨付正 , 任鹏 . 考虑视频内容的 H.265/HEVC 帧层码率分配算法 [J ] . 通信学报 , 2015 , 36 ( 9 ): 76 - 81 .

LI W , YANG F Z , REN P . H.265/HEVC frame layer rate allocation algorithm considering video content [J ] . Journal on Communications , 2015 , 36 ( 9 ): 76 - 81 .

PATEUXS B , JUNG J . An excel add-in for computing Bjøntegaard metric and its evolution:VCEG-AE07 [C ] // Proceedings of the Video Coding Experts Group Meeting . New York:ACM Press , 2007 : 1 - 10 .

DABEER O , CHAUDHURI S . Analysis of an adaptive sampler based on weber's law [J ] . IEEE Transactions on Signal Processing , 2011 , 59 ( 4 ): 1868 - 1878 .

Views

1212

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on Q-learning based rate control approach for HTTP adaptive streaming

Research on adaptive rate control algorithm for H.264 based on R-Q model

HVS-based rate-control scheme for object-based embedded image coding

Related Author

Li-rong XIONG

Jing-zhi LEI

Xin JIN

Xin-zi ZHENG

Bing-qing LUO

Zhi-xin SUN

Dong-jie LI

Zhong-jie ZHU

Related Institution

College of Computer Science and Technology, Zhejiang University of Technology

College of Internet of Things,Nanjing University of Posts and Telecommunications

Ningbo Key Lab. of DSP, Zhejiang Wanli University

Physical Engineering College,Zhengzhou University

AI问答

⁰