基于H.264的码率控制算法研究
|
摘要
数字视频技术在通信和广播领域获得了日益广泛的应用,特别是90年代以来,随着Internet和移动通信的迅猛发展,视频信息和多媒体信息在Internet网络和移动网络中的处理和传输成为了当前我国信息化中的热点技术。
2003年3月,ITU-T/ISO正式公布了H.264视频压缩标准,由于其相比以往标准的出色的性能,被人们称为新一代视频编码标准。具体讲,与H.263或MPEG-4相比,在同样质量下,其数码率能降低一半左右;或者说在同样码率下,其信噪比明显提高。H.264出色的性能得到了广大研究学者的肯定,也渐渐成为目前的主流编码标准,并且有逐渐取代MPEG4的趋势,而MPEG2目前也已经开始渐渐淡化出市场。
码率控制算法是视频压缩的重要部分,用来控制视频压缩的压缩比特率,不管在哪一种视频编码标准中,码率控制算法的好坏,将直接影响到视频的质量和传输能力。在受实际传输和处理速度限制的条件下,控制视频编码过程是很重要的,这样才能获得最佳的压缩性能。
本文在基于对H.264标准深入研究的基础上,首先对所有的经典码率控制算法进行了研究,有应用在H.261压缩算法中的RM8码率控制算法,应用在H.263中的TMN8码率控制算法,应用在MPEG-2中的TM5码率控制算法,应用在MPEG-4中的VM8码率控制算法,应用在H.264中经典的F086和G012码率控制算法,通过对G012仿真实现,深刻认识峰值信噪比和比特率之间的关系。并且在此基础上提出了一种新的SPP帧类型,用来辅助通用码率控制算法,并以标准参考代码JM(Joint Model)为蓝本,研究并以软件实现这种新的编码帧,通过和G012的码率控制算法进行对比得到结论,同时还在基于H.264的FPGA平台上搭建外围的驱动,独立思考并解决了在搭建外围驱动的过程中所遇到的解码内存大小控制和显示解码并行实现,以此为基础对SPP帧进行解码验证,对自己的想法进行了可行性验证。
Digital video technology is ubiquitously used in telecommunication and broadcast. Processing and transmission of video and multimedia in Internet and mobile network has received more and more focuses in domestic Information Technology due to the rapid development of Internet and mobile telecommunication since 1990s.
ITU-T/ISO released H.264 video compression standard officially in March, 2003. It is thought as new generation video compression standard because of its outstanding performance. To be more detailed, its bit rate is half of H.263 or MPEG-4 given the same video quality; in another word, its signal-to-noise rate increases significantly given the same bit rate. H.264 is appreciated by researchers and becomes leading standard currently. It is very likely that H.264 will replace MPEG4 gradually while MPEG2 diminishes in market.
Rate control, which is an important part of video compression, controls bit rate of video compression. Quality and transmission of video is subject to rate control algorithm whatever the video coding standard is. It is very important to control video coding in order to obtain optimal compression under the constraint of transmission and computation power in real world.
This paper firstly reviews the classical bit rate control algorithm including RM8 in H.261, TMN8 in H.263, TM5 in MPEG-2 , VM8 in MPEG-4., F086 and G012 in H.264. From the Software implementation of G012, A relationship of YSNR and Bit rate has been reported. Subsequently a new SPP frame is proposed to make general rate control algorithm more efficiently. Software implementation is given based on standard reference code JM (Joint Model). And then test it on FPAG.. At last the idea is validated with conclusion.
2003年3月,ITU-T/ISO正式公布了H.264视频压缩标准,由于其相比以往标准的出色的性能,被人们称为新一代视频编码标准。具体讲,与H.263或MPEG-4相比,在同样质量下,其数码率能降低一半左右;或者说在同样码率下,其信噪比明显提高。H.264出色的性能得到了广大研究学者的肯定,也渐渐成为目前的主流编码标准,并且有逐渐取代MPEG4的趋势,而MPEG2目前也已经开始渐渐淡化出市场。
码率控制算法是视频压缩的重要部分,用来控制视频压缩的压缩比特率,不管在哪一种视频编码标准中,码率控制算法的好坏,将直接影响到视频的质量和传输能力。在受实际传输和处理速度限制的条件下,控制视频编码过程是很重要的,这样才能获得最佳的压缩性能。
本文在基于对H.264标准深入研究的基础上,首先对所有的经典码率控制算法进行了研究,有应用在H.261压缩算法中的RM8码率控制算法,应用在H.263中的TMN8码率控制算法,应用在MPEG-2中的TM5码率控制算法,应用在MPEG-4中的VM8码率控制算法,应用在H.264中经典的F086和G012码率控制算法,通过对G012仿真实现,深刻认识峰值信噪比和比特率之间的关系。并且在此基础上提出了一种新的SPP帧类型,用来辅助通用码率控制算法,并以标准参考代码JM(Joint Model)为蓝本,研究并以软件实现这种新的编码帧,通过和G012的码率控制算法进行对比得到结论,同时还在基于H.264的FPGA平台上搭建外围的驱动,独立思考并解决了在搭建外围驱动的过程中所遇到的解码内存大小控制和显示解码并行实现,以此为基础对SPP帧进行解码验证,对自己的想法进行了可行性验证。
Digital video technology is ubiquitously used in telecommunication and broadcast. Processing and transmission of video and multimedia in Internet and mobile network has received more and more focuses in domestic Information Technology due to the rapid development of Internet and mobile telecommunication since 1990s.
ITU-T/ISO released H.264 video compression standard officially in March, 2003. It is thought as new generation video compression standard because of its outstanding performance. To be more detailed, its bit rate is half of H.263 or MPEG-4 given the same video quality; in another word, its signal-to-noise rate increases significantly given the same bit rate. H.264 is appreciated by researchers and becomes leading standard currently. It is very likely that H.264 will replace MPEG4 gradually while MPEG2 diminishes in market.
Rate control, which is an important part of video compression, controls bit rate of video compression. Quality and transmission of video is subject to rate control algorithm whatever the video coding standard is. It is very important to control video coding in order to obtain optimal compression under the constraint of transmission and computation power in real world.
This paper firstly reviews the classical bit rate control algorithm including RM8 in H.261, TMN8 in H.263, TM5 in MPEG-2 , VM8 in MPEG-4., F086 and G012 in H.264. From the Software implementation of G012, A relationship of YSNR and Bit rate has been reported. Subsequently a new SPP frame is proposed to make general rate control algorithm more efficiently. Software implementation is given based on standard reference code JM (Joint Model). And then test it on FPAG.. At last the idea is validated with conclusion.
引文
[1]毕厚杰,新一代视频压缩编码标准--H.264/AVC,人民邮电出版社,2005.5
[2]Iain E.G.Riehardson著,欧阳合,韩军译,视频编解码器设计,国防科技大学出版社,2005.1
[3]周正,周惠林等,《多媒体通讯技术分册》,北京邮电大学出版社,,2002.6
[4]C.Po ynton,Digital Video and HDTV,Elsevier Science 2003,pp,491-492
[5]G.Sullivan,T.Wiegand and K.P.Lim." Joint Model Reference Encoding Methods and Decoding Concealment Methods;Section2.6:Rate Control".JVT-1049,Sa n Diego September 2003
[6]王玉林,英国伦敦大学电子工程系《Internet 上多媒体的实时传输》,China Data Communication,2003,5.
[7]UB Video Inc."Emerging H.26L Standard:Overview and TMS320C64x Digital Media Platform Implementation".White paper,Feb 2002
[8]"DraflI TU-T recommendation and final draft in ternational standard of joint video specification(ITU-T)Rec.H.264/ISO/IEC14496-10AVC".in Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG.JVT-GO50.2003
[9]H.Hang and J.Chen."Source model for transform video coder and its ap plication".IEEE Trans.CircuitsS yst.VideoT echnol.,vol.7(2),pp.287-298,Apr.1997
[10]T.Chiang,H.J.Lee and H.Sun."An Overview of the Encoding Tools
[11]in the MPEG-4 Reference Software".IEEE Int.Symp.Circuit Sys.(ISCAS2000),vol.1,2000,pp.295-298
[12]JM Reference Software 6.1e.ITU-T.March 2003
[13]ISO/IEC 14496-10 and ITU-T Rec.H.264.Advanced Video Coding,2003
[14]裴长亮,孙吉贵,基于新一代视频压缩编码标准H.264的关键性技术研究,吉林大学优秀硕士学位论文。
[15]Iain.E.G.Richardson,H.264 and MPEG-4 Video Compression.The Robert Gordon University Aberdeen,UK
[16]ISO/IEC JTC1/SC29 WG11 Document 93/457,MPEG-2 Video Test Model 5,Sydney,April 1993
[17]King.N.Nagn,Thomas Meierand,Zhenzhong Chen,Improved Single Video Object Rate Control,'IEEE Trans.Circuits Syst.VideoTechnol.,May.2003,vol.13,pp.385-393
[18]Video Group,"Text of ISO/IEC 14496-2 MPEG-4 video VM - Version 8.0,"ISO/IECJTC1/SC29/WG11 Coding of Moving Pictures and Associated Audio MPEG97/W 1796,Stockholm,Sweden,July1997.
[19]ITU-TStandardization Sector,Study Group6,Video Coding Experts Group,Video Codec Test Model,Version 8(TMN8),ISO/IECJTC1/SC29/WG11,Portland,OR,June1997,pp.24-27.
[20]Joint Video Team(JVT)JVT- F086,Dec.2002.
[21]Joint Video Team(JVT)JVT- GO12,Dec.2002
[22]Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG Document JVT- H014,May.2003.
[23]HTYu,F Pan,Z P Lin.A New Bit Estimation Scheme for H.264 Rate Control[J].Proceedings of 2004,IEEE International Symposium on Consumer Electronics,2004,1(9):396-399
[24]Hongtao Yu,Zhiping Lin.An Improved Rate Control Algorithm for H.264[J].IEEE International Symposium on Circuits and Systerm.2005,1(5):312-315
[25]Minqiang Jiang,Xiaoquan YI,Nam Ling.On Enhancing H.264 Rate Control by PSNR-Based Frame Complexity Estimation[J].IEEE International Conf.on Consumer Electronics(ICCE),2005,8(1):231-232
[26]王昭顺,张平.基于H.264/AVC的一种新的帧一层码率控制算法[J].计算机应用,2005,25(12):2801-280
[27]陈川.无线H.264AVC视频通信的研究[D].上海交通大学博士学位论文,2003
[28]熊红凯.实时视频传输中基于QoS的资源分配技术[D].上海交通大学博士学位论文,2003
[29]A.Ortega and K.Ramchandram,Rate-distortion methods for image and video compression,IEEE Signal Processing Magazine,November 1998
[30]孙化,H.264视频编码标准的分层设计与功能,广播与电视技术,第4期,2004年,31-33
[31]T.Wiegand,G.Sullivan,G.Bjontegaard and A.Luthra,Overviewof the H.264/AVC Video Coding Standard,IEEE Transactions on Circuits and Systems for Video Technology,to be published in 2003.
[32]G.Bjφntegaard and K.Lillevold,Context-adaptive VLC coding of coefficients,JVT documentJVT-C028,Fairfax,May 2002.
[33]M.Karczewicz and R.Kurceren,The SP and SI Frames Design for H.264/AVC,IEEE Transactions on Circuits and Systems for Video Technology,to be published in 2003.
[34]L-J Lin and A.Ortega,Bit rate control using piecewise approximated rate-distortion characteristics,IEEE Trans,CSVT,8,August 1998
[35]J.Ribas-Corbera and S.Lei,Rate control for low-delay video communications,ITU-T Q6/SG 16 Document Q15-A-20,June 1997
[36]郑翔,叶志远,周秉锋,JVT草案中的核心技术综述,软件学报,2004,15:58-68
[37]毕厚杰,王珊琪,H.264视频压缩编码的新发展,通讯世界网,2003年10月。
[38]麻晓园,H.264/AVC视频编码新技术,现代有线传输,2003年第3期
[39]钟玉琢,蔡莲红,李树青,多媒体计算机技术基础及应用。高等教育出版社,2000
[40]Yue Wang,Songyu Yu,Joinit source-channel decoding for H.264 coded video stream.Consumer Electronics,2005
[41]汤磊,软硬件协同设计方法学研究现状及分析,固体电子学研究与进展,2003(5)
[42]任艳颖,IC设计基础[M],西安电子科技大学出版社,2003(5)
[2]Iain E.G.Riehardson著,欧阳合,韩军译,视频编解码器设计,国防科技大学出版社,2005.1
[3]周正,周惠林等,《多媒体通讯技术分册》,北京邮电大学出版社,,2002.6
[4]C.Po ynton,Digital Video and HDTV,Elsevier Science 2003,pp,491-492
[5]G.Sullivan,T.Wiegand and K.P.Lim." Joint Model Reference Encoding Methods and Decoding Concealment Methods;Section2.6:Rate Control".JVT-1049,Sa n Diego September 2003
[6]王玉林,英国伦敦大学电子工程系《Internet 上多媒体的实时传输》,China Data Communication,2003,5.
[7]UB Video Inc."Emerging H.26L Standard:Overview and TMS320C64x Digital Media Platform Implementation".White paper,Feb 2002
[8]"DraflI TU-T recommendation and final draft in ternational standard of joint video specification(ITU-T)Rec.H.264/ISO/IEC14496-10AVC".in Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG.JVT-GO50.2003
[9]H.Hang and J.Chen."Source model for transform video coder and its ap plication".IEEE Trans.CircuitsS yst.VideoT echnol.,vol.7(2),pp.287-298,Apr.1997
[10]T.Chiang,H.J.Lee and H.Sun."An Overview of the Encoding Tools
[11]in the MPEG-4 Reference Software".IEEE Int.Symp.Circuit Sys.(ISCAS2000),vol.1,2000,pp.295-298
[12]JM Reference Software 6.1e.ITU-T.March 2003
[13]ISO/IEC 14496-10 and ITU-T Rec.H.264.Advanced Video Coding,2003
[14]裴长亮,孙吉贵,基于新一代视频压缩编码标准H.264的关键性技术研究,吉林大学优秀硕士学位论文。
[15]Iain.E.G.Richardson,H.264 and MPEG-4 Video Compression.The Robert Gordon University Aberdeen,UK
[16]ISO/IEC JTC1/SC29 WG11 Document 93/457,MPEG-2 Video Test Model 5,Sydney,April 1993
[17]King.N.Nagn,Thomas Meierand,Zhenzhong Chen,Improved Single Video Object Rate Control,'IEEE Trans.Circuits Syst.VideoTechnol.,May.2003,vol.13,pp.385-393
[18]Video Group,"Text of ISO/IEC 14496-2 MPEG-4 video VM - Version 8.0,"ISO/IECJTC1/SC29/WG11 Coding of Moving Pictures and Associated Audio MPEG97/W 1796,Stockholm,Sweden,July1997.
[19]ITU-TStandardization Sector,Study Group6,Video Coding Experts Group,Video Codec Test Model,Version 8(TMN8),ISO/IECJTC1/SC29/WG11,Portland,OR,June1997,pp.24-27.
[20]Joint Video Team(JVT)JVT- F086,Dec.2002.
[21]Joint Video Team(JVT)JVT- GO12,Dec.2002
[22]Joint Video Team(JVT)of ISO/IEC MPEG and ITU-T VCEG Document JVT- H014,May.2003.
[23]HTYu,F Pan,Z P Lin.A New Bit Estimation Scheme for H.264 Rate Control[J].Proceedings of 2004,IEEE International Symposium on Consumer Electronics,2004,1(9):396-399
[24]Hongtao Yu,Zhiping Lin.An Improved Rate Control Algorithm for H.264[J].IEEE International Symposium on Circuits and Systerm.2005,1(5):312-315
[25]Minqiang Jiang,Xiaoquan YI,Nam Ling.On Enhancing H.264 Rate Control by PSNR-Based Frame Complexity Estimation[J].IEEE International Conf.on Consumer Electronics(ICCE),2005,8(1):231-232
[26]王昭顺,张平.基于H.264/AVC的一种新的帧一层码率控制算法[J].计算机应用,2005,25(12):2801-280
[27]陈川.无线H.264AVC视频通信的研究[D].上海交通大学博士学位论文,2003
[28]熊红凯.实时视频传输中基于QoS的资源分配技术[D].上海交通大学博士学位论文,2003
[29]A.Ortega and K.Ramchandram,Rate-distortion methods for image and video compression,IEEE Signal Processing Magazine,November 1998
[30]孙化,H.264视频编码标准的分层设计与功能,广播与电视技术,第4期,2004年,31-33
[31]T.Wiegand,G.Sullivan,G.Bjontegaard and A.Luthra,Overviewof the H.264/AVC Video Coding Standard,IEEE Transactions on Circuits and Systems for Video Technology,to be published in 2003.
[32]G.Bjφntegaard and K.Lillevold,Context-adaptive VLC coding of coefficients,JVT documentJVT-C028,Fairfax,May 2002.
[33]M.Karczewicz and R.Kurceren,The SP and SI Frames Design for H.264/AVC,IEEE Transactions on Circuits and Systems for Video Technology,to be published in 2003.
[34]L-J Lin and A.Ortega,Bit rate control using piecewise approximated rate-distortion characteristics,IEEE Trans,CSVT,8,August 1998
[35]J.Ribas-Corbera and S.Lei,Rate control for low-delay video communications,ITU-T Q6/SG 16 Document Q15-A-20,June 1997
[36]郑翔,叶志远,周秉锋,JVT草案中的核心技术综述,软件学报,2004,15:58-68
[37]毕厚杰,王珊琪,H.264视频压缩编码的新发展,通讯世界网,2003年10月。
[38]麻晓园,H.264/AVC视频编码新技术,现代有线传输,2003年第3期
[39]钟玉琢,蔡莲红,李树青,多媒体计算机技术基础及应用。高等教育出版社,2000
[40]Yue Wang,Songyu Yu,Joinit source-channel decoding for H.264 coded video stream.Consumer Electronics,2005
[41]汤磊,软硬件协同设计方法学研究现状及分析,固体电子学研究与进展,2003(5)
[42]任艳颖,IC设计基础[M],西安电子科技大学出版社,2003(5)