H.264解码器在BF561上的实现及优化
|
摘要
随着互联网在全球范围逐渐普及,移动通信飞速发展,网络传输以及各种各样的多媒体业务的出现,对视频编解码技术更是提出了许多新的要求。如何提供更加优秀的视频传输成为信息科学与技术的研究热点。本论文主要是在JM86解码器参考模型的基础上,对其代码进行裁剪和优化,以实现在DSP平台上能实时解码的H.264解码器。
本文主要是针对H.264/AVC和Blackfin561嵌入式系统的应用进行研究。首先对H.264/AVC标准的基本原理进行了介绍,并对帧内预测、帧间预测、整数变换和熵编码等关键技术进行了深入的研究,对H.264/AVC的语法进行了细致的分析,给出了关键模块的详细解码流程。接着介绍Blackfin561的芯片结构、总线、存储器管理原理、缓存机制和Blackfin561的指令集,以及它的编程结构和视频指令。最后以ADI公司的ADSP-BF561处理器为核心构建H.264解码器。针对ADSP-BF561的特点,对H.264 Baseline Profile的解码算法进行了优化,编写了链接描述文件,并对Cache使能进行了优化配置。在此基础上,规范数据类型,修改语法,实现了H.264的解码算法从PC平台到DSP平台的移植。
针对实时应用的要求,本文针对解码器的核心组成模块做了分析,给出了H.264解码器的软件及汇编级优化方法。最后,在ADSP-BF561EZ-KIT LITE开发板上进行了测试,测试数据表明,该解码器达到了对QCIF(176×144)格式的实时解码。
Along with Internet's daily popularization in global scope,swift and violent development of mobile communication,the network transmission as well as each kind of emerging multimedia service all unexpectedly appears.Many new requests have been set arranged to the encoding and decoding technology of video.How to provide the higher transmission quality becomes hot spot in information science and the technical research.This paper realizes the real-time decoder of H.264 based on DSP,referring to the JM86 code.
The author's sutdy is mainly in the application of H.264/AVC and the embedded system based on the Blackfin561.First,the author learns the basic thought and theory,studies the inter and intra prediction,the integer transform,the entropy coding,and so on,analyzes the detail of the standard,learns the syntax and semantics of the H.264/AVC.Second,the author learns the structure,the bus,the management of memory, management of the cache of the Blackfin561,studies the Instruction Set of the Blackfin561.The structure of program and video instruction is learned.Finally,at the core to ADSP-BF561 processor produced by ADI Company,paper constructs the decoder of the H.264.According to the characteristic of ADSP-BF561,it optimizes the Algorithm of H.264 Baseline Profile Decoder,prepares link description file,does Optimal allocation to Cache using conversion operations,and finishs the decoder on PC platform.On this basis,it standardizes data type,changes grammars,and realizes the transplantation of H.264 decoder from PC platform to DSP platform.
Against the request of real-time application,the paper analyzes the core components of the decoder.It gives the optimization software series of decoder based on reference model JM86,and the execution can be improved greatly.
Finally,the decoder has been tested on the development board ADSP-BF561 EZ-KIT LITE.The test data shows the decoder real-time decoding results of QCIF format has achieved.
本文主要是针对H.264/AVC和Blackfin561嵌入式系统的应用进行研究。首先对H.264/AVC标准的基本原理进行了介绍,并对帧内预测、帧间预测、整数变换和熵编码等关键技术进行了深入的研究,对H.264/AVC的语法进行了细致的分析,给出了关键模块的详细解码流程。接着介绍Blackfin561的芯片结构、总线、存储器管理原理、缓存机制和Blackfin561的指令集,以及它的编程结构和视频指令。最后以ADI公司的ADSP-BF561处理器为核心构建H.264解码器。针对ADSP-BF561的特点,对H.264 Baseline Profile的解码算法进行了优化,编写了链接描述文件,并对Cache使能进行了优化配置。在此基础上,规范数据类型,修改语法,实现了H.264的解码算法从PC平台到DSP平台的移植。
针对实时应用的要求,本文针对解码器的核心组成模块做了分析,给出了H.264解码器的软件及汇编级优化方法。最后,在ADSP-BF561EZ-KIT LITE开发板上进行了测试,测试数据表明,该解码器达到了对QCIF(176×144)格式的实时解码。
Along with Internet's daily popularization in global scope,swift and violent development of mobile communication,the network transmission as well as each kind of emerging multimedia service all unexpectedly appears.Many new requests have been set arranged to the encoding and decoding technology of video.How to provide the higher transmission quality becomes hot spot in information science and the technical research.This paper realizes the real-time decoder of H.264 based on DSP,referring to the JM86 code.
The author's sutdy is mainly in the application of H.264/AVC and the embedded system based on the Blackfin561.First,the author learns the basic thought and theory,studies the inter and intra prediction,the integer transform,the entropy coding,and so on,analyzes the detail of the standard,learns the syntax and semantics of the H.264/AVC.Second,the author learns the structure,the bus,the management of memory, management of the cache of the Blackfin561,studies the Instruction Set of the Blackfin561.The structure of program and video instruction is learned.Finally,at the core to ADSP-BF561 processor produced by ADI Company,paper constructs the decoder of the H.264.According to the characteristic of ADSP-BF561,it optimizes the Algorithm of H.264 Baseline Profile Decoder,prepares link description file,does Optimal allocation to Cache using conversion operations,and finishs the decoder on PC platform.On this basis,it standardizes data type,changes grammars,and realizes the transplantation of H.264 decoder from PC platform to DSP platform.
Against the request of real-time application,the paper analyzes the core components of the decoder.It gives the optimization software series of decoder based on reference model JM86,and the execution can be improved greatly.
Finally,the decoder has been tested on the development board ADSP-BF561 EZ-KIT LITE.The test data shows the decoder real-time decoding results of QCIF format has achieved.
引文
[1]刘峰.视频图像编码技术及国际标准.北京:北京邮电大学出版社,2005
[2]余兆明.图像编码标准H.264技术.北京:人民邮电出版社,2006
[3]K.R.RAO and P.Yip,Discrete Cosine Transform,Academic Press,1990
[4]ITU Telecom.Standardization Sector of ITU,Video Codec for Audiovisual Services at p64 kbits.ITU-T Recommendation H.261,1993(3)
[5]毕厚杰.新一代视频压缩编码标准-H.264/AVC.人民邮电出版社,2005
[6]ISO/IEC International Standard 13818,Generic Coding of Moving Pictures and Associated Audio,1995
[7]Generic Coding of Moving Pictures and Associated Audio Information Part2:Video,ITU-T and ISO/IEC JTC1,ITU-T Recommendation H.262and ISO/IEC 13 818-2(MPEG-2),1994:68-69
[8]ITU-T Recommendation H.263,Video Coding for Low Bit rate Communication,1995:78-80
[9]ISO/IEC International standard 14496,Coding of Moving Pictures and Audio,1999
[10]ITU Telecom.Standardization Sector of ITU,Advanced video coding for generic audiovisual services.ITU-T Recommendation H.264,2005(3)
[11]Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG,Draft ITU-T recommendation and final draft international standard of joint video specification(ITU-T Rec.H.264/ISO/IEC 14496 AVC),JVTG050,2003
[12]Argyriou,A.Madisetti,V.Streaming H.264/AVC video over the Internet.Consumer Communications and Networking Conference,2004.CCNC 2004.First IEEE,5-8 Jan.2004:169-174
[13]孙华.H.264视频编码标准的分层设计与功能.广播与电视技术.2004(4):31-33
[14]裴世保,李厚强,俞能海.H.264/AVC帧内预测模式选择算法研究[J].计算机应用.2005,25(8):1807-1810
[15]ITU Telecom.Standardization Sector of ITU,Advaneed video coding for generic audio visual services[C].ITU-T Recommendation H.264,2005(3)
[16]Panos Nasiopoulos,Anthony Joch,Faouzi Kossentini.Overview And Performance Evaluation Of The ITU-T draft H.26L Video Coding Standard.Proeeedings Of SPIE Of Digital Image Processing,2001
[16]Panos Nasiopoulos,Anthony Joch,Faouzi Kossentini.Overview And Performance Evaluation Of The ITU-T draft H.26L Video Coding Standard.Proeeedings Of SPIE Of Digital Image Processing,2001
[17]T.Wedi.Motion Compensation in H.264/AVC.IEEE Transactions on Circuits and Systems for Video Technology,July 2003
[18]Joint Video Team of ITU-T and ISO/IEC JTC 1.Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification(ITU-T Rec.H.264|ISO/IEC 14496-10 AVC).Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG,JVT-GOSO.March 2003
[19]Thomas Wiegand,Xiaozheng Zhang,and Bernd Girod,Long-Term Memory Motion- Compensated Prediction,IEEE Transactions on Circuits and Systems for Video Technology,September 1998:74-75
[20]A.Joch,F.kossentini,P.Nasiopoulos,A Performance Analysis of the ITU-T Draft,H.26L Video Coding Standard,1998:41-42
[21]徐永军.基于视频压缩新标准H.264的软件编码器及其性能优化的研究.电信技术研究.2004(2):75-80
[22]杜雍.基于PC的H.264视频编码器优化设计.浙江大学硕上论文.2006:45-78
[23]尹长川译.工程应用编码与信息理论.北京:机械工业出版社.2003:33-34
[24]陆亮,楼剑,虞露.H.264编码中的去块效应滤波系统.数字电视与数字视频.2004(2)
[25]马宇峰,魏维.视频通信中的错误隐藏技术.北京:国防工业出版社,2007:64-65
[26]陈峰.Blackfin系列DSP原理与系统设计.北京:电子工业出版社,2004:5-6
[27]"Blackfin Proeessor Instruetion Set Reference",Revision 2.0Analog Devices,Inc.,May 2003
[28]陈渝,李明,杨晔等.源码开放的嵌入式系统软件分析与实践-基于SkyEye和ARM开发平台.北京:北京航空航天大学出版社,2004
[29]Engineer To Engineer Note/EE-192 Using C To Create Interrupt Driven Systems On Blackfin@Proeessors http://www.analog.com/processors/resources/technicalLibrary/m anuals,2005.1
[30]Engineer To Engineer Note/EE-68 Analog Devices JTAG Emulation Technical Reference.http://www.analog.com/processors/resources/technicalLibrary/m anuals,2005.1
[31]王田苗.嵌入式系统设计与实例开发--基于ARM微处理器与uC/OS-Ⅱ实时操作系统.北京:清华大学出版社,2002
[32]李驹光.ARM应用系统开发详解--基于S3C4510B的系统设计.北京:清华大学出版社,2004
[33]马忠梅,马广云,徐英慧,田泽.ARM嵌入式处理器结构与应用基础.北京:航空航天大学出版社,2002
[34]桑楠.嵌入式系统原理及应用开发技术.北京:北京航空航天大学出版社,2002
[35]胡国荣.数字视频压缩及其标准.北京:北京广播学院出版社,1999
[36]钟玉琢,王琪,贺玉文.基于对象的多媒体数据压缩编码国际标准MPEG-4及其校验模型.北京:科学出版社,2000
[37]RichardsonIain E.G,欧阳合,韩军.视频编解码器设计--开发图像与视频压缩系统.长沙:国防科技大学出版社,2005
[38]李玉山.数字视觉视频技术.西安:西安电子科技大学出版社,2006
[39]黎洪松.数字视频技术及其应用.北京:清华大学出版社,1997
[40]全子一.数字视频图像处理.北京:电子工业出版社,2005
[41]刘富强,王新红.数字视频信息处理与传输教程.北京:机械工业出版社,2004
[42]郑红.DSP应用系统设计实践.北京:北京航空航天大学出版社,2006
[43]EKICIE,AKYILDIZF,BENDER D.A multicast routing algorithm for LEO satellite IP networks[J].IEEE & ACM Transactions on Networking.2002,10(2):183-192
[44]卡斯佩尔斯基.代码优化:有效使用内存.谭明金译.北京:电子工业出版社,2004
[45]王颖,陈乃海.H.264视频编码器基本档次实现方案的研究[J].记录媒体技术.2006,(Z2)
[46]范学海,胡佼,金炜东.基于G07007SB的嵌入式MPEG-4远程视频监控系统[J].黑龙江科技学院学报.2005,2(15):126-128
[47]苏辉,孔德佳,余松煜.基于ADSP-BF533的实时图像编码关键技术[J].计算机工程与应用.2005,4:88-90
[48]罗龙智,黄晓革,甘涛.定点ADSP-Blackfin533的混合编程技术[J].电声技术.2006,1:33-35
[49]Analog Devices,Inc.Visual DSP++4.0 C/C++ Compiler and Library Manual for Blackfin Processors.http://www.analog.com/processors/resources/technicalLibrary/ma nuals,2005.1
[50]Analog Devices,Inc.Visual DSP++4.0 Assembler and Preprocessor Manual.http://www.analog.com/processors/resources/technicalLibrary/ma nuals,2005.1
[51]Analog Devices,Inc.Visual DSP++4.0 Linker and Utilities Manual.http://www.analog.com/processors/resources/technicalLibrary/ma nuals,2005.1
[52]Jukan,A.,Hoang Nam Nguyen,Franzl,G..QoS-based Routing Methods for Multi-hop LEO Satellite Networks.Proceedings.IEEE International Conference on Networks,2000.9,399-405
[53]嵌入式操作系统一览.http://www.gkong.com/learn/
[54]C程序优化.http://creativesoft.home.shangdu.net
[2]余兆明.图像编码标准H.264技术.北京:人民邮电出版社,2006
[3]K.R.RAO and P.Yip,Discrete Cosine Transform,Academic Press,1990
[4]ITU Telecom.Standardization Sector of ITU,Video Codec for Audiovisual Services at p64 kbits.ITU-T Recommendation H.261,1993(3)
[5]毕厚杰.新一代视频压缩编码标准-H.264/AVC.人民邮电出版社,2005
[6]ISO/IEC International Standard 13818,Generic Coding of Moving Pictures and Associated Audio,1995
[7]Generic Coding of Moving Pictures and Associated Audio Information Part2:Video,ITU-T and ISO/IEC JTC1,ITU-T Recommendation H.262and ISO/IEC 13 818-2(MPEG-2),1994:68-69
[8]ITU-T Recommendation H.263,Video Coding for Low Bit rate Communication,1995:78-80
[9]ISO/IEC International standard 14496,Coding of Moving Pictures and Audio,1999
[10]ITU Telecom.Standardization Sector of ITU,Advanced video coding for generic audiovisual services.ITU-T Recommendation H.264,2005(3)
[11]Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG,Draft ITU-T recommendation and final draft international standard of joint video specification(ITU-T Rec.H.264/ISO/IEC 14496 AVC),JVTG050,2003
[12]Argyriou,A.Madisetti,V.Streaming H.264/AVC video over the Internet.Consumer Communications and Networking Conference,2004.CCNC 2004.First IEEE,5-8 Jan.2004:169-174
[13]孙华.H.264视频编码标准的分层设计与功能.广播与电视技术.2004(4):31-33
[14]裴世保,李厚强,俞能海.H.264/AVC帧内预测模式选择算法研究[J].计算机应用.2005,25(8):1807-1810
[15]ITU Telecom.Standardization Sector of ITU,Advaneed video coding for generic audio visual services[C].ITU-T Recommendation H.264,2005(3)
[16]Panos Nasiopoulos,Anthony Joch,Faouzi Kossentini.Overview And Performance Evaluation Of The ITU-T draft H.26L Video Coding Standard.Proeeedings Of SPIE Of Digital Image Processing,2001
[16]Panos Nasiopoulos,Anthony Joch,Faouzi Kossentini.Overview And Performance Evaluation Of The ITU-T draft H.26L Video Coding Standard.Proeeedings Of SPIE Of Digital Image Processing,2001
[17]T.Wedi.Motion Compensation in H.264/AVC.IEEE Transactions on Circuits and Systems for Video Technology,July 2003
[18]Joint Video Team of ITU-T and ISO/IEC JTC 1.Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification(ITU-T Rec.H.264|ISO/IEC 14496-10 AVC).Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG,JVT-GOSO.March 2003
[19]Thomas Wiegand,Xiaozheng Zhang,and Bernd Girod,Long-Term Memory Motion- Compensated Prediction,IEEE Transactions on Circuits and Systems for Video Technology,September 1998:74-75
[20]A.Joch,F.kossentini,P.Nasiopoulos,A Performance Analysis of the ITU-T Draft,H.26L Video Coding Standard,1998:41-42
[21]徐永军.基于视频压缩新标准H.264的软件编码器及其性能优化的研究.电信技术研究.2004(2):75-80
[22]杜雍.基于PC的H.264视频编码器优化设计.浙江大学硕上论文.2006:45-78
[23]尹长川译.工程应用编码与信息理论.北京:机械工业出版社.2003:33-34
[24]陆亮,楼剑,虞露.H.264编码中的去块效应滤波系统.数字电视与数字视频.2004(2)
[25]马宇峰,魏维.视频通信中的错误隐藏技术.北京:国防工业出版社,2007:64-65
[26]陈峰.Blackfin系列DSP原理与系统设计.北京:电子工业出版社,2004:5-6
[27]"Blackfin Proeessor Instruetion Set Reference",Revision 2.0Analog Devices,Inc.,May 2003
[28]陈渝,李明,杨晔等.源码开放的嵌入式系统软件分析与实践-基于SkyEye和ARM开发平台.北京:北京航空航天大学出版社,2004
[29]Engineer To Engineer Note/EE-192 Using C To Create Interrupt Driven Systems On Blackfin@Proeessors http://www.analog.com/processors/resources/technicalLibrary/m anuals,2005.1
[30]Engineer To Engineer Note/EE-68 Analog Devices JTAG Emulation Technical Reference.http://www.analog.com/processors/resources/technicalLibrary/m anuals,2005.1
[31]王田苗.嵌入式系统设计与实例开发--基于ARM微处理器与uC/OS-Ⅱ实时操作系统.北京:清华大学出版社,2002
[32]李驹光.ARM应用系统开发详解--基于S3C4510B的系统设计.北京:清华大学出版社,2004
[33]马忠梅,马广云,徐英慧,田泽.ARM嵌入式处理器结构与应用基础.北京:航空航天大学出版社,2002
[34]桑楠.嵌入式系统原理及应用开发技术.北京:北京航空航天大学出版社,2002
[35]胡国荣.数字视频压缩及其标准.北京:北京广播学院出版社,1999
[36]钟玉琢,王琪,贺玉文.基于对象的多媒体数据压缩编码国际标准MPEG-4及其校验模型.北京:科学出版社,2000
[37]RichardsonIain E.G,欧阳合,韩军.视频编解码器设计--开发图像与视频压缩系统.长沙:国防科技大学出版社,2005
[38]李玉山.数字视觉视频技术.西安:西安电子科技大学出版社,2006
[39]黎洪松.数字视频技术及其应用.北京:清华大学出版社,1997
[40]全子一.数字视频图像处理.北京:电子工业出版社,2005
[41]刘富强,王新红.数字视频信息处理与传输教程.北京:机械工业出版社,2004
[42]郑红.DSP应用系统设计实践.北京:北京航空航天大学出版社,2006
[43]EKICIE,AKYILDIZF,BENDER D.A multicast routing algorithm for LEO satellite IP networks[J].IEEE & ACM Transactions on Networking.2002,10(2):183-192
[44]卡斯佩尔斯基.代码优化:有效使用内存.谭明金译.北京:电子工业出版社,2004
[45]王颖,陈乃海.H.264视频编码器基本档次实现方案的研究[J].记录媒体技术.2006,(Z2)
[46]范学海,胡佼,金炜东.基于G07007SB的嵌入式MPEG-4远程视频监控系统[J].黑龙江科技学院学报.2005,2(15):126-128
[47]苏辉,孔德佳,余松煜.基于ADSP-BF533的实时图像编码关键技术[J].计算机工程与应用.2005,4:88-90
[48]罗龙智,黄晓革,甘涛.定点ADSP-Blackfin533的混合编程技术[J].电声技术.2006,1:33-35
[49]Analog Devices,Inc.Visual DSP++4.0 C/C++ Compiler and Library Manual for Blackfin Processors.http://www.analog.com/processors/resources/technicalLibrary/ma nuals,2005.1
[50]Analog Devices,Inc.Visual DSP++4.0 Assembler and Preprocessor Manual.http://www.analog.com/processors/resources/technicalLibrary/ma nuals,2005.1
[51]Analog Devices,Inc.Visual DSP++4.0 Linker and Utilities Manual.http://www.analog.com/processors/resources/technicalLibrary/ma nuals,2005.1
[52]Jukan,A.,Hoang Nam Nguyen,Franzl,G..QoS-based Routing Methods for Multi-hop LEO Satellite Networks.Proceedings.IEEE International Conference on Networks,2000.9,399-405
[53]嵌入式操作系统一览.http://www.gkong.com/learn/
[54]C程序优化.http://creativesoft.home.shangdu.net
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |