AVS视频编码器性能优化及DSP实现研究
|
摘要
随着信息时代的来临,多媒体技术已经渗透到生活的每个角落。视频图像是多媒体信息的重要组成部分,但是数字化的视频信号的数据量之大是非常惊人的,这使得在开发多媒体应用系统时,对包含巨大数据量的视频图像数据的采集、存储、传输成为最大的瓶颈。因此,视频数据的高效压缩意义重大,是降低网络传输带宽、节省存储容量的关键技术。但视频压缩算法运算量大,实时处理对通用处理器的要求高,因而各种专用高速数字信号处理器(DSP)得到广泛应用。
AVS标准作为数字音视频产业的共性基础标准,可以应用于高清晰度和标准清晰度数字电视广播、激光视盘机、移动多媒体通信、视频会议与视频监控、宽带网络流媒体、数字电影等产业群。与其他类似标准相比,AVS有两大优势:基于自主技术和部分开放技术构建的开放标准,妥善解决专利许可问题;中国日渐强大的产业化实力和市场提供了良好土壤。在这两大翅膀的助推下,AVS已成为全球范围内最有可能成为事实标准的第二代音视频编码标准。目前AVS标准组已经发布了企业版参考软件,不过其编码器部分时间效率低并且在关闭RDO的情况下图像质量也相对较差。因此进一步提高AVS编码器的时间效率以及图像质量是很有必要的。现在国内已经有很多企业希望将AVS标准应用于实际产品中(比如数字电视或监控领域应用),这就进一步要求AVS编码器在保证编码性能具有竞争力的同时,还必须可以实现实时编解码。在这种环境下,选择对AVS编码器进行性能上的优化以及提高时间效率是很有意义的。TI的DM642开发板专门针对多媒体应用,其特有的优化器可以让开发者以线性汇编代码的形式书写汇编程序,从而缩短开发周期。同时其软件流水操作将大大提高程序执行效率,并且它提供了许多数据打包指令,以便开发者实现对一块内存的访问。
本课题研究在TI的DM642平台上实现AVS编码器,包括AVS编码器性能提升;根据DSP的结构特点、内存限制生成合理的C代码;C代码从PC平台到DSP平台的移植研究;在DSP平台上的代码优化研究。最终实现一个可产生能被AVS参考软件解码器正常解码的AVS码流的AVS编码器,并且实现CIF格式视频流的实时编码。
With the advent of the information age, multi-media technology has infiltrated every corner of life. Video and image are important components of the multimedia information, however, the digitized video signals in the large volume of data is very alarming, which led, the huge volume of video and image data acquisition, storage,and transmission become the biggest bottleneck in the development of multimedia applications. Therefore, the video data compression efficiency is the key technologies to reduce the network bandwidth,and save storage capacity. But video compression algorithm has great complexity of computing,and real-time processing demands on general processors have become very strict, so the various dedicated high-speed digital signal processor (DSP) was widely used.
As a common basis of the digital audio and video industry standard,AVS standard is widely used in high-definition and standard-definition digital television,laser disc,multimedia communications of mobile,video conferencing and surveillance,broadband network streaming media, and digital film industries. Compared with other similar standard,AVS has two main advantages: Based on the partial opening and autonomous technology,it has constructed an open standard, which properly resolves the licensing issues;China's increasingly powerful industrial strength and the market provides a good soil. With these two wings, AVS is most likely to become the standard for the second-generation audio-video coding standard in the world. Currently AVS standard group has provided the reference software for enterprise,but the time efficiency of encoder is low and when the RDO function is closed,the image quality is relatively poor. Therefore,further improvement of AVS encoder's time efficiency and image quality is very necessary. Now many enterprises of China hope that the AVS standard applied to the actual products (such as digital television or monitor areas),which would further request that the image quality of AVS encoder is competitive, and real-time encoding can be achieved. Under such circumstances,the performance optimization for AVS encoder and improvement of the time efficiency is of great significance. TI's DM642 development board is specifically for multimedia applications,and its optimizer allows developers to compile code in the form of linear assembler,so as to shorten the development cycle. At the same time its software pipelining operations will greatly enhance the efficiency of the implementation process. It provides a lot of data packing instructions,in order to process more data with one memory visit.
The research in TI's DM642 platform to achieve AVS encoder,including the improvement of AVS encoder's performance;With the structural characteristics of DSP and memory limit,to generate a reasonable C code;The transplantation of C code from PC platform to DSP platform; the Optimization of the code on DSP platform. Finally we can produce a AVS encoder which can generate the bit stream decoded by the decoder of AVS reference software successfully, and can achieve the real-time encoding with video of CIF format.
AVS标准作为数字音视频产业的共性基础标准,可以应用于高清晰度和标准清晰度数字电视广播、激光视盘机、移动多媒体通信、视频会议与视频监控、宽带网络流媒体、数字电影等产业群。与其他类似标准相比,AVS有两大优势:基于自主技术和部分开放技术构建的开放标准,妥善解决专利许可问题;中国日渐强大的产业化实力和市场提供了良好土壤。在这两大翅膀的助推下,AVS已成为全球范围内最有可能成为事实标准的第二代音视频编码标准。目前AVS标准组已经发布了企业版参考软件,不过其编码器部分时间效率低并且在关闭RDO的情况下图像质量也相对较差。因此进一步提高AVS编码器的时间效率以及图像质量是很有必要的。现在国内已经有很多企业希望将AVS标准应用于实际产品中(比如数字电视或监控领域应用),这就进一步要求AVS编码器在保证编码性能具有竞争力的同时,还必须可以实现实时编解码。在这种环境下,选择对AVS编码器进行性能上的优化以及提高时间效率是很有意义的。TI的DM642开发板专门针对多媒体应用,其特有的优化器可以让开发者以线性汇编代码的形式书写汇编程序,从而缩短开发周期。同时其软件流水操作将大大提高程序执行效率,并且它提供了许多数据打包指令,以便开发者实现对一块内存的访问。
本课题研究在TI的DM642平台上实现AVS编码器,包括AVS编码器性能提升;根据DSP的结构特点、内存限制生成合理的C代码;C代码从PC平台到DSP平台的移植研究;在DSP平台上的代码优化研究。最终实现一个可产生能被AVS参考软件解码器正常解码的AVS码流的AVS编码器,并且实现CIF格式视频流的实时编码。
With the advent of the information age, multi-media technology has infiltrated every corner of life. Video and image are important components of the multimedia information, however, the digitized video signals in the large volume of data is very alarming, which led, the huge volume of video and image data acquisition, storage,and transmission become the biggest bottleneck in the development of multimedia applications. Therefore, the video data compression efficiency is the key technologies to reduce the network bandwidth,and save storage capacity. But video compression algorithm has great complexity of computing,and real-time processing demands on general processors have become very strict, so the various dedicated high-speed digital signal processor (DSP) was widely used.
As a common basis of the digital audio and video industry standard,AVS standard is widely used in high-definition and standard-definition digital television,laser disc,multimedia communications of mobile,video conferencing and surveillance,broadband network streaming media, and digital film industries. Compared with other similar standard,AVS has two main advantages: Based on the partial opening and autonomous technology,it has constructed an open standard, which properly resolves the licensing issues;China's increasingly powerful industrial strength and the market provides a good soil. With these two wings, AVS is most likely to become the standard for the second-generation audio-video coding standard in the world. Currently AVS standard group has provided the reference software for enterprise,but the time efficiency of encoder is low and when the RDO function is closed,the image quality is relatively poor. Therefore,further improvement of AVS encoder's time efficiency and image quality is very necessary. Now many enterprises of China hope that the AVS standard applied to the actual products (such as digital television or monitor areas),which would further request that the image quality of AVS encoder is competitive, and real-time encoding can be achieved. Under such circumstances,the performance optimization for AVS encoder and improvement of the time efficiency is of great significance. TI's DM642 development board is specifically for multimedia applications,and its optimizer allows developers to compile code in the form of linear assembler,so as to shorten the development cycle. At the same time its software pipelining operations will greatly enhance the efficiency of the implementation process. It provides a lot of data packing instructions,in order to process more data with one memory visit.
The research in TI's DM642 platform to achieve AVS encoder,including the improvement of AVS encoder's performance;With the structural characteristics of DSP and memory limit,to generate a reasonable C code;The transplantation of C code from PC platform to DSP platform; the Optimization of the code on DSP platform. Finally we can produce a AVS encoder which can generate the bit stream decoded by the decoder of AVS reference software successfully, and can achieve the real-time encoding with video of CIF format.
引文
[1]胡兴军,AVS:数字电视音视频解码技术,有线电视技术,2004年第10期(总第154期
[2]崔海燕,AVS推动中国标准产业化,IT时代周刊.2004(06X),P51-52
[3]《AVS视频(报批稿)》信息技术,先进音视频编码,第2部分:视频
[4]K.R.Rao,Zoran S.Bojkovic,Dragorad A.Milovanovic,Multimediacommunication Systems,北京:清华大学出版社,2003年8月。
[5]T.Sikora,"MPEG digital video coding standards," IEEE Signal Processing Magazine,Sept.1997,P82-100
[6]Erol,B.;Gallant,M.;Cote,G.;Kossentini,F,"The H.263+ video coding standard:complexity and performance",Data Compression Conference,1998,Page(s):259-268
[7]ThomasWiegand,Gary J.Sullivan,Gisle Bjntegaard,Ajay Luthra.,"Overview of the H.264/AVC video coding standard",Circuits and Systems for Video Technology,IEEE Transactions,Volume 13,Issue 7,July 2003,P560-576
[8]AVS专家组.GB/T 20090.2-2006.信息技术.先进音视频编码.第二部分:视频[S].2006.
[9]虞露,胡倩,易峰,AVS视频的技术特征,电视技术,2005年第7期。
[10]数字音视频编解码技术标准工作组,http://www.avs.org.cn/,2002-2006
[11]王明伟,AVS中的音视频编码压缩技术,电视技术,2006.6
[12]TI,TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor,SPRS200J,JULY 2002.
[13]黄辉,曹铁勇,张雄伟.AVS1-P2视频标准中的关键技术研究,电子质量,2006第05期
[14]黄勇坚,王亚丽,王洪君,H.264/AVC视频编码器的DSP实现,电子技术.2006.09
[15]Kim Y H,Yoo J W,Lee S W,et al.Adaptive mode decision for H.264encoder[J].Electronics Letters,2004,40(19):1172-1173
[16]Joint video team(JVT)of ISO/IEC MPEG and ITU-T VCEG.JVT Reference Software unoficial version JM8.4[CP/OL].http://iphome,hhi.de/suehring/tml/download/.
[17]朱向军,朱善安,H.264/AVC中计算复杂度可调的快速模式选择算法,中国图象图形学报,2006年9月,第11卷第9期
[18]ELEFTHERIADIS A,JACQUIN A.Model-assisted coding of video teleconferencing sequences at low bit rates[C]// IEEE International Symposium on Circuits and Systems,1994.ISCAS' 94.London,UK:[IEEE],1994:177-180.
[19]ELEFTHERIADIS A,JACQUIN A.Low bit rate model-assisted n.261-compatible coding of video[C]// Proceedings of IEEE International Conference on Image Processing,1995.Washington,DC,USA:[IEEE],1995:418-421.
[20]KIM G,ELEFTHERIADIS A.Motion Vector Field Analysis in Motion-Assisted Rate Control for H.264[C]// IEEE International Conference on Image Processing,2006.[IEEE],2006:61-64.
[21]KIM G,ELEFTHERIADIS A,YANG Y.Motion-Assisted Rate Control for ME/MC-based Codecs[C]//IEEE International Symposium on Circuits and Systems,2005.ISCAS 2005.[IEEE],2005:4377-4380.
[22]Joint Video Team of ITU-T,ISO/IEC JTC 1.Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec.H.264|ISO/IEC 14496-10 AVE).
[23]张明,毕笃彦,许悦雷.基于H.264的模式选择和运动估计快速算法[J].计算机工程与应用,2005,(33):71-73.
[24]毕厚杰.新一代视频压缩编码标准-H.264/AVC[M].北京:人民邮电出版社,2005.
[25]JUN Shi,YU Song-yu.Efficient method for early detection of allzero DCT coefficients[J].Electronies Letters,2001 37(3):160-161.
[26]CHEUNG Chun-Ho,PO Lai-Man.A novel cross-diamond search algorithm for fast block motion estimation[J].IEEE Transactions on Circuits and Systems for Video Technology,2002:12(12):1168-1177.
[27]李方慧等,TMS320C6000系列DSPs原理与应用(第2版)[M].北京:电子工业,2003
[28]TMS320C6000 Optimizing Compiler User's Guide.TI Literature Number:SPRU187K.October 2002.
[29]TMS320C6000 Programmer's Guide.TI Literature Number:SPRU1981Revised:March 2006.
[30]王明伟,AVS中的音视频编码压缩技术,电视技术,2006.6
[31]TI,TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor,SPRS2OOJ,JULY 2002.
[32]TI,TMS320DM6446 Digital Media System on-Chip,SPRS283,DECEMBER 2005.
[33]What's New in Code Composer Studio Development Tools v 3.3,TI,Application Report SPRAA07C-October 2006.
[34]鹿宝生,陈启美,H.264高性能视频编码器的DSP实现,计算机应用,2005年12月。
[35]安向阳,沈庭芝,基于DSP TMS320DM642的H.264视频编码的实现和优化,微计算机信息,2005年第21卷第7-2期。
[36]吴参毅,唐慧明,基于TMS320DM642的MPEG-4视频编码算法优化,江南大学学报(自然科学版),2005.12。
[37]张彤宇,苏睿,刘宝兰,H.264/AVC视频编码器在DM642平台上的实现与优化,微电子学与计算机,2005年第22卷第12期。
[38]TMS320C6000 Chip Support Library API Reference Guide.TI Literature Number SPRU401I May 2004.December 2005.
[39]TI,TMS320C6000 DSP Cache User's Guide,Literature Number:SPRU656A,May 2003.
[40]TMS320C6000 Optimizing Compiler User's Guide.TI Literature Number:SPRU187K.October 2002.
[41]TMS320C6000 CPU and Instruction Set Reference Guide.TI Literature Number:SPRU189F.October
[42]TMS320C6000 Assembly Language Tools User's Guide,TI,Literature Number:SPRU186N,April 2004.
[43]侯金亭,董胜富,呼大明,杨长水,魏勇刚,并行AVS实时编解码器设计与实现,电视技术,2006年第5期。
[44]王晓慧,周东辉,基于AVS编码的帧间宏块模式选择快速算法,微计算机信息,2006年第22卷第7-1期。
[45]Hung-Chih Lin;Yu-Jen Wang;Kai-Ting Cheng;Shang-Yu Yeh;Wei-Nien Chen;Chia-Yang Tsai;Tian-Sheuan Chang;Hsueh-Ming Hang."Algorithms and DSP Implementation of H.264/AVC",Design Automation,2006.Asia and South Pacific Conference on 24-27 Jan.2006 Page(s):8 pp.
[46]黄健,张琳.“H.264视频编码技术研究”,计算机与数字工程,第34卷第7期,2006.
[47]楼剑,陆亮,虞露,董洁.“H.264变换和量化的分析”,浙江大学学报(工学版),第38卷第5期,2004年5月.
[2]崔海燕,AVS推动中国标准产业化,IT时代周刊.2004(06X),P51-52
[3]《AVS视频(报批稿)》信息技术,先进音视频编码,第2部分:视频
[4]K.R.Rao,Zoran S.Bojkovic,Dragorad A.Milovanovic,Multimediacommunication Systems,北京:清华大学出版社,2003年8月。
[5]T.Sikora,"MPEG digital video coding standards," IEEE Signal Processing Magazine,Sept.1997,P82-100
[6]Erol,B.;Gallant,M.;Cote,G.;Kossentini,F,"The H.263+ video coding standard:complexity and performance",Data Compression Conference,1998,Page(s):259-268
[7]ThomasWiegand,Gary J.Sullivan,Gisle Bjntegaard,Ajay Luthra.,"Overview of the H.264/AVC video coding standard",Circuits and Systems for Video Technology,IEEE Transactions,Volume 13,Issue 7,July 2003,P560-576
[8]AVS专家组.GB/T 20090.2-2006.信息技术.先进音视频编码.第二部分:视频[S].2006.
[9]虞露,胡倩,易峰,AVS视频的技术特征,电视技术,2005年第7期。
[10]数字音视频编解码技术标准工作组,http://www.avs.org.cn/,2002-2006
[11]王明伟,AVS中的音视频编码压缩技术,电视技术,2006.6
[12]TI,TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor,SPRS200J,JULY 2002.
[13]黄辉,曹铁勇,张雄伟.AVS1-P2视频标准中的关键技术研究,电子质量,2006第05期
[14]黄勇坚,王亚丽,王洪君,H.264/AVC视频编码器的DSP实现,电子技术.2006.09
[15]Kim Y H,Yoo J W,Lee S W,et al.Adaptive mode decision for H.264encoder[J].Electronics Letters,2004,40(19):1172-1173
[16]Joint video team(JVT)of ISO/IEC MPEG and ITU-T VCEG.JVT Reference Software unoficial version JM8.4[CP/OL].http://iphome,hhi.de/suehring/tml/download/.
[17]朱向军,朱善安,H.264/AVC中计算复杂度可调的快速模式选择算法,中国图象图形学报,2006年9月,第11卷第9期
[18]ELEFTHERIADIS A,JACQUIN A.Model-assisted coding of video teleconferencing sequences at low bit rates[C]// IEEE International Symposium on Circuits and Systems,1994.ISCAS' 94.London,UK:[IEEE],1994:177-180.
[19]ELEFTHERIADIS A,JACQUIN A.Low bit rate model-assisted n.261-compatible coding of video[C]// Proceedings of IEEE International Conference on Image Processing,1995.Washington,DC,USA:[IEEE],1995:418-421.
[20]KIM G,ELEFTHERIADIS A.Motion Vector Field Analysis in Motion-Assisted Rate Control for H.264[C]// IEEE International Conference on Image Processing,2006.[IEEE],2006:61-64.
[21]KIM G,ELEFTHERIADIS A,YANG Y.Motion-Assisted Rate Control for ME/MC-based Codecs[C]//IEEE International Symposium on Circuits and Systems,2005.ISCAS 2005.[IEEE],2005:4377-4380.
[22]Joint Video Team of ITU-T,ISO/IEC JTC 1.Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec.H.264|ISO/IEC 14496-10 AVE).
[23]张明,毕笃彦,许悦雷.基于H.264的模式选择和运动估计快速算法[J].计算机工程与应用,2005,(33):71-73.
[24]毕厚杰.新一代视频压缩编码标准-H.264/AVC[M].北京:人民邮电出版社,2005.
[25]JUN Shi,YU Song-yu.Efficient method for early detection of allzero DCT coefficients[J].Electronies Letters,2001 37(3):160-161.
[26]CHEUNG Chun-Ho,PO Lai-Man.A novel cross-diamond search algorithm for fast block motion estimation[J].IEEE Transactions on Circuits and Systems for Video Technology,2002:12(12):1168-1177.
[27]李方慧等,TMS320C6000系列DSPs原理与应用(第2版)[M].北京:电子工业,2003
[28]TMS320C6000 Optimizing Compiler User's Guide.TI Literature Number:SPRU187K.October 2002.
[29]TMS320C6000 Programmer's Guide.TI Literature Number:SPRU1981Revised:March 2006.
[30]王明伟,AVS中的音视频编码压缩技术,电视技术,2006.6
[31]TI,TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor,SPRS2OOJ,JULY 2002.
[32]TI,TMS320DM6446 Digital Media System on-Chip,SPRS283,DECEMBER 2005.
[33]What's New in Code Composer Studio Development Tools v 3.3,TI,Application Report SPRAA07C-October 2006.
[34]鹿宝生,陈启美,H.264高性能视频编码器的DSP实现,计算机应用,2005年12月。
[35]安向阳,沈庭芝,基于DSP TMS320DM642的H.264视频编码的实现和优化,微计算机信息,2005年第21卷第7-2期。
[36]吴参毅,唐慧明,基于TMS320DM642的MPEG-4视频编码算法优化,江南大学学报(自然科学版),2005.12。
[37]张彤宇,苏睿,刘宝兰,H.264/AVC视频编码器在DM642平台上的实现与优化,微电子学与计算机,2005年第22卷第12期。
[38]TMS320C6000 Chip Support Library API Reference Guide.TI Literature Number SPRU401I May 2004.December 2005.
[39]TI,TMS320C6000 DSP Cache User's Guide,Literature Number:SPRU656A,May 2003.
[40]TMS320C6000 Optimizing Compiler User's Guide.TI Literature Number:SPRU187K.October 2002.
[41]TMS320C6000 CPU and Instruction Set Reference Guide.TI Literature Number:SPRU189F.October
[42]TMS320C6000 Assembly Language Tools User's Guide,TI,Literature Number:SPRU186N,April 2004.
[43]侯金亭,董胜富,呼大明,杨长水,魏勇刚,并行AVS实时编解码器设计与实现,电视技术,2006年第5期。
[44]王晓慧,周东辉,基于AVS编码的帧间宏块模式选择快速算法,微计算机信息,2006年第22卷第7-1期。
[45]Hung-Chih Lin;Yu-Jen Wang;Kai-Ting Cheng;Shang-Yu Yeh;Wei-Nien Chen;Chia-Yang Tsai;Tian-Sheuan Chang;Hsueh-Ming Hang."Algorithms and DSP Implementation of H.264/AVC",Design Automation,2006.Asia and South Pacific Conference on 24-27 Jan.2006 Page(s):8 pp.
[46]黄健,张琳.“H.264视频编码技术研究”,计算机与数字工程,第34卷第7期,2006.
[47]楼剑,陆亮,虞露,董洁.“H.264变换和量化的分析”,浙江大学学报(工学版),第38卷第5期,2004年5月.