基于学习模型的3D-HEVC提前Merge模式终止算法

李跃; 杨高波; 丁湘陵; 朱亚培

doi:10.11959/j.issn.1000-436x.2019165

您当前的位置：

首页 >

文章列表页 >

基于学习模型的3D-HEVC提前Merge模式终止算法

学术论文 | 更新时间：2024-06-05

- 基于学习模型的3D-HEVC提前Merge模式终止算法
- Early Merge mode decision algorithm for 3D-HEVC based on learning model
- 通信学报 2019年40卷第7期页码：104-113
- 作者机构：
  
  1. 南华大学计算机学院，湖南衡阳 421001
  2. 湖南大学信息科学与工程学院，湖南长沙 410082
  3. 湖南科技大学计算机科学与工程学院，湖南湘潭 411201
  4. 衡阳师范学院物理与电子学院，湖南衡阳 421002
- 作者简介：
  
  [ "李跃（1988- ），男，湖南衡阳人，博士，南华大学讲师，主要研究方向为 HEVC、3D-HEVC、VVC编码优化等。" ]
  [ "杨高波（1974- ），男，湖南岳阳人，博士，湖南大学教授、博士生导师，主要研究方向为图像/视频信号处理、多媒体通信、数字媒体内容安全等。" ]
  [ "丁湘陵（1981- ），男，湖南株洲人，博士，湖南科技大学副教授，主要研究方向为视频信息安全、图像处理等。" ]
  [ "朱亚培（1988- ），女，河南驻马店人，衡阳师范学院讲师，主要研究方向为图像/视频压缩等。" ]
- 基金信息：
  
  国家重点研发计划基金资助项目(2018YFB1003205);国家自然科学基金资助项目(61572183)
- DOI：10.11959/j.issn.1000-436x.2019165
  中图分类号： TN919.8
- 网络首发：2019-07，
  
  纸质出版：2019-07-25
- 稿件说明：
移动端阅览
李跃, 杨高波, 丁湘陵, 等. 基于学习模型的3D-HEVC提前Merge模式终止算法[J]. 通信学报, 2019,40(7):104-113.

Yue LI, Gaobo YANG, Xiangling DING, et al. Early Merge mode decision algorithm for 3D-HEVC based on learning model[J]. Journal on Communications, 2019, 40(7): 104-113.
李跃, 杨高波, 丁湘陵, 等. 基于学习模型的3D-HEVC提前Merge模式终止算法[J]. 通信学报, 2019,40(7):104-113. DOI： 10.11959/j.issn.1000-436x.2019165.

Yue LI, Gaobo YANG, Xiangling DING, et al. Early Merge mode decision algorithm for 3D-HEVC based on learning model[J]. Journal on Communications, 2019, 40(7): 104-113. DOI： 10.11959/j.issn.1000-436x.2019165.

摘要

作为高效视频编码（HEVC）的扩展，3D-HEVC标准有效地提高了3D视频的压缩效率，但是也带来了很高的编码计算复杂度。为了显著地降低3D-HEVC编码复杂度，提出了一种提前Merge模式终止算法。首先，提取 Merge 模式编码后的残差信号作为特征信息；然后，根据当前编码帧内已经编码的编码单元（CU）的最优Merge模式残差信号建立学习模型；最后，提取当前CU的Merge模式的残差信号，并且利用学习模型预测Merge模式是否为最优模式。实验结果表明，提出的提前Merge模式终止算法分别将3D-HEVC纹理视点和深度图编码的时间降低了41.9%和24.3%，且编码性能的降低几乎可忽略不计。相较于现有的提前Merge模式算法，提出的提前Merge模式终止算法能进一步降低3D-HEVC的编码时间，并且设计简单，易于集成到3D-HEVC测试模型。

Abstract

3D-high efficiency video coding (3D-HEVC) standard is an extension of HEVC.Though 3D-HEVC effectively improves the compression efficiency of 3D video

it also brings huge computational complexity.To greatly reduce the 3D-HEVC coding complexity

an early Merge mode decision approach was proposed.The residual signal that encoded by the Merge mode was firstly extracted as feature information.A learning model was established in terms of the residual signals of the coding unit (CU) in current frame that used early Merge mode as the optimal mode.Finally

the residual signal was extracted for the Merge mode of current CU

and the learning model was used to predict whether the Merge mode was the optimal mode or not.Experimental results show that the proposed early Merge mode decision approach reduces the coding times of 3D-HEVC texture views and depth maps about 41.9% and 24.3%

respectively

and the coding performance degradation is almost negligible.Compared with existing early Merge mode decision approaches

the proposed approach further reduces the coding time

and can be easily integrated into the 3D-HEVC test model due to its design simplicity.

关键词

Keywords

references

陈亮 , 顾翔 , 王进 . 多速率多节点 IEEE 802.11 网络的视频传输策略 [J ] . 通信学报 , 2017 , 38 ( 3 ): 34 - 44 .

CHEN L , GU X , WANG J. . Video transmission strategy in multi-rate and multi-node IEEE 802.11 networks [J ] . Journal on Communications , 2017 , 38 ( 3 ): 34 - 44 .

SULLIVAN G J , OHM J , HAN W , et al . Overview of the high efficiency video coding (HEVC) standard [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2012 , 22 ( 12 ): 1649 - 1668 .

MULLER K , SCHWARZ H , MARPE D , et al . 3D high-efficiency video coding for multi-view video and depth data [J ] . IEEE Transactions on Image Processing , 2013 , 22 ( 9 ): 3366 - 3378 .

MERKLE P , MLLER K , ZHAO X , et al . CE6.H results on simplified wedgelet search for DMM Modes 1 and 3 [C ] // JCT3V Meeting,JCT3V-B0039 . 2012 : 1 - 4 .

LEE J Y , PARK M W , KIM C . 3D-CE1:depth intra skip (DIS) mode [C ] // JCT3V meeting,JCT3V-K0033 . 2005 : 1 - 5 .

LIU H , CHEN Y . Generic segment-wise DC for 3D-HEVC depth intra coding [C ] // 2014 IEEE International Conference on Image Processing (ICIP) . IEEE , 2014 : 3219 - 3222 .

SHEN L , LI K , FENG G , et al . Efficient intra mode selection for depth-map coding utilizing spatiotemporal,inter-component and inter-view correlations in 3D-HEVC [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 9 ): 4195 - 4206 .

SALDANHA M , SANCHEZ G , MARCON C , et al . Fast 3D-HEVC depth map encoding using machine learning [J ] . IEEE Transactions on Circuits and Systems for Video Technology,doi:10.1109/TCSVT.2019.2898122 , 2019 .

GWEON R H , LEE Y L . Early termination of CU encoding to reduce HEVC complexity [C ] // JCTVC Meeting,JCTVC-F045 . 2011 : 1 - 4 .

SHEN L , AN P , ZHANG Z , et al . A 3D-HEVC fast mode decision algorithm for real-time applications [J ] . ACM Transactions on Multimedia Computing Communications and Applications , 2015 , 11 ( 3 ): 1 - 23 .

ZHANG Q , HUANG K , WANG X , et al . Efficient multiview video plus depth coding for 3D-HEVC based on complexity classification of the treeblock [J ] . Journal of Real-Time Image Processing,doi:10.1007/S11554-017-0692-5 , 2017 .

TOHIDYPOUR H R , POURAZAD M T , NASIOPOULOS P . Online-learning based complexity reduction scheme for 3D-HEVC [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2016 , 26 ( 10 ): 1870 - 1883 .

ZHANG Q , WEI S , SU R . Low-complexity texture video coding based on motion homogeneity for 3D-HEVC [J ] . Scientific Programming , 2019 : 1 - 13 .

LI Y , YANG G , ZHU Y , et al . Hybrid stopping model-based fast PU and CU decision for 3D-HEVC texture coding [J ] . Journal of Re-al-Time Image Processing,doi:10.1007/ s11554-019-00876-9 , 2019 .

CHEN J , WANG B , LIAO J , et al . Fast 3D-HEVC inter mode decision algorithm based on the texture correlation of viewpoints [J ] . Multime-dia Tools and Applications,doi:10.1007/ s11042-018-6832-5 , 2018 .

LEI J , DUAN J , WU F , et al . Fast mode decision based on grayscale similarity and inter-view correlation for depth map coding in 3D-HEVC [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2018 , 28 ( 3 ): 706 - 718 .

LIAO Y , CHEN M , YEH C , et al . Efficient inter-prediction depth coding algorithm based on depth map segmentation for 3D-HEVC [J ] . Multimedia Tools and Applications , 2019 , 78 ( 8 ): 10181 - 10205 .

PAN Z , LEI J , ZHANG Y , et al . Adaptive fractional-pixel motion estimation skipped algorithm for efficient HEVC motion estimation [J ] . ACM Transactions on Multimedia Computing Communications and Applications , 2018 , 14 ( 1 ): 1 - 19 .

YANG J , KIM J , WON K , et al . Early SKIP detection for HEVC [C ] // JCTVC Meeting,JCTVC-G543 . 2011 : 1 - 6 .

LI Y , YANG G , ZHU Y , et al . Unimodal stopping model based early SKIP mode decision for high efficiency video coding [J ] . IEEE Transactions Multimedia , 2017 , 19 ( 7 ): 1431 - 1441 .

PAN Z , KWONG S , SUN M T , et al . Early merge mode decision based on motion estimation and hierarchical depth correlation for HEVC [J ] . IEEE Transactions on Broadcasting , 2014 , 60 ( 2 ): 405 - 412 .

ZHANG N , ZHAO D , CHEN Y , et al . Fast encoder decision for texture coding in 3D-HEVC [J ] . Signal Processing:Image Communication , 2014 , 29 ( 9 ): 951 - 961 .

ZHANG Q , WU Q , WANG X , et al . Early SKIP mode decision for three dimensional high efficiency video coding using spatial and interview correlations [J ] . Journal of Electronic Imaging , 2014 , 23 ( 5 ): 1 - 8 .

SONG Y , JIA K . Early merge mode decision for texture coding in 3D-HEVC [J ] . Journal of Visual Communication and Image Representation , 2015 , 23 : 60 - 68 .

CHEN H , FU C H , ZHANG Y , et al . Early merge mode decision for depth maps in 3D-HEVC [C ] // 22nd International Conference on Digital Signal Processing (DSP) . 2017 : 1 - 5 .

LI Y , YANG G , ZHU Y , et al . Probability model-based early merge mode decision for dependent views coding in 3D-HEVC [J ] . ACM Transactions on Multimedia Computing Communications and Applications , 2018 , 14 ( 4 ): 1 - 15 .

MULLER K , VETRO A . Common test conditions of 3DV core experiments [C ] // JCT3V Meeting,JCT3V-G1100 . 2014 : 1 - 7 .

BJONTEGAARD G . Calculation of average PSNR differences between RD curves [R ] . VCEG-M33,Austin:Video Coding Experts Group , 2001 .

浏览量

830

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

暂无数据