基于MSC8144的H.264高清视频解码软件设计
摘要
随着视频在无线领域的应用和高清视频越来越受欢迎,能提供更高视频质量和更高压缩效率的H.264/AVC应运而生。本文开发了H.264高清视频解码器。在MSC8144平台上,Smart OS调用4个1GHz的Core并行解码从上位机接收的1920x1080高清压缩码流,并传送到相关模块显示。本文论述了整个系统的设计方案和成果,着重论述了解码器主要模块的开发和优化,以及利用MSC8144平台提供的多种优化措施和内存分层特性提高解码器性能。
第一章,介绍了相关背景,包括视频压缩原理,对当前主流的几个视频编码国际标准和DSP的发展状况进行了概述。
第二章,讨论了多核MSC8144的结构特点和应用,包括MSC8144的核架构、存储系统、Cache和DMA访问模型、汇编指令集以及开发环境。
第三章,详细介绍了H.264的关键技术,包括NAL设计的主要思想,VCL层的帧内预测、运动补偿、整数变换、上下文自适应的熵编码、环路滤波模块,另外还简要介绍了各个Profile的工具子集。
第四章,本文的重点。针对MSC8144设计了系统方案和各模块方案。具体阐述了高清视频解码软件设计,包括Smart OS调用、码流接收模块、图像数据发送模块和解码模块,以及解码器主要模块插值、去块滤波、熵解码的开发,并设计了一定的优化措施。
第五章,本文的总结。
Emerging applications like video over wireless channels and the increasing popularity of High Definition (HD) are requiring higher video quality and, at the same time, higher compression efficiency which H.264/AVC is capable to provide. In this paper, an implementation of H.264 high definition video decoder is presented. Based on MSC8144, the Smart OS calls 4 Cores, up to 1 GHz each, to parallel decode the high definition compressed bitstream with a resolution of 1920x1080, which is received from the host, and then the decoded video data is sent to display.
Chapter 1 gives an overview of the background, including the principles of video compression, a short description of the exiting video coding standards and an introduction of the DSP development.
Chapter 2 discusses the multicore architecture characteristics and applications of MSC8144 processor. It covers the core subsystem, memory hierarchy, cache and DMA data models, instruction set and the IDE CodeWarrior.
Chapter 3 explains detailedly the H.264 video coding key techniques. The concept of NAL is defined. The intra prediction, motion compensation, integer transform, context adaptive entropy decoding and in-loop deblocking filtering are presented. In addition, different tool set for different Profile is described briefly.
Chapter 4 is devoted to the most important part of this paper. System scheme and module design is given based on MSC8144. The software design of HD video decoder is focused. These include different modules: Smart OS scheduler, bitstream receiving, video data sending and decoding. Special interest is paid to interpolation process, deblocking filtering and entropy decoding, which are the kernels of decoder. Methods of improving the decoder are designed.
Chapter 5 is the conclusion.
第一章,介绍了相关背景,包括视频压缩原理,对当前主流的几个视频编码国际标准和DSP的发展状况进行了概述。
第二章,讨论了多核MSC8144的结构特点和应用,包括MSC8144的核架构、存储系统、Cache和DMA访问模型、汇编指令集以及开发环境。
第三章,详细介绍了H.264的关键技术,包括NAL设计的主要思想,VCL层的帧内预测、运动补偿、整数变换、上下文自适应的熵编码、环路滤波模块,另外还简要介绍了各个Profile的工具子集。
第四章,本文的重点。针对MSC8144设计了系统方案和各模块方案。具体阐述了高清视频解码软件设计,包括Smart OS调用、码流接收模块、图像数据发送模块和解码模块,以及解码器主要模块插值、去块滤波、熵解码的开发,并设计了一定的优化措施。
第五章,本文的总结。
Emerging applications like video over wireless channels and the increasing popularity of High Definition (HD) are requiring higher video quality and, at the same time, higher compression efficiency which H.264/AVC is capable to provide. In this paper, an implementation of H.264 high definition video decoder is presented. Based on MSC8144, the Smart OS calls 4 Cores, up to 1 GHz each, to parallel decode the high definition compressed bitstream with a resolution of 1920x1080, which is received from the host, and then the decoded video data is sent to display.
Chapter 1 gives an overview of the background, including the principles of video compression, a short description of the exiting video coding standards and an introduction of the DSP development.
Chapter 2 discusses the multicore architecture characteristics and applications of MSC8144 processor. It covers the core subsystem, memory hierarchy, cache and DMA data models, instruction set and the IDE CodeWarrior.
Chapter 3 explains detailedly the H.264 video coding key techniques. The concept of NAL is defined. The intra prediction, motion compensation, integer transform, context adaptive entropy decoding and in-loop deblocking filtering are presented. In addition, different tool set for different Profile is described briefly.
Chapter 4 is devoted to the most important part of this paper. System scheme and module design is given based on MSC8144. The software design of HD video decoder is focused. These include different modules: Smart OS scheduler, bitstream receiving, video data sending and decoding. Special interest is paid to interpolation process, deblocking filtering and entropy decoding, which are the kernels of decoder. Methods of improving the decoder are designed.
Chapter 5 is the conclusion.
引文
[1]Mauricio Alvarez,Esther Salami,Alex Ramirez,Mateo Valero.A performance characterization of high definition digital video decoding using H.264/AVC(M).Workload Characterization Symposium,2005.Proceedings of the IEEE International.6-8 Oct.2005 Page(s):24-33.
[2]魏芳.H.264视频编解码算法和并行优化的研究[D].北京:北京邮电大学.2004.
[3]郭晓强,门爱东.视频编码标准的发展:从H.261到H.264[J].世界广播电视,2004,18(9):22-25,61.
[4]Mohammed Ghanbari,Standard Codecs:Image Compression to Advanced Video Coding.The Institution of Electrical Engineers.2003.
[5]薛全.H.264/AVC中运动估计、变换与解码器优化[D].杭州:浙江大学.2004.
[6]滕国伟.H.264/AVC实时编码系统及其相关算法的研究[D].上海:上海大学.2005.
[7]Ralf Schafer,Thomas Wiegand and Heiko Schwarz.The Emerging H.264/AVC Standard.EBU TECHINICAL REVIEW.200301.
[8]杨静.H.264低码率实时视频传输中的比特优化分配问题研究[D].上海:上海交通大学.2006.
[9]鲁争焱.DSP技术发展与应用综述(J).集成电路通讯.2001,3:11-15.
[10]中华视频网.视频处理平台DSP的横向测评.http://www.360doc.com/showweb/0/0/351479.aspx.2006-01-09.
[11]应翔.基于DaVinci处理器的H.264视频编码器软件设计和优化实现[D].杭州:浙江大学.2007.
[12]ADSP-BF561 Blackfin(R)Processor Hardware Reference.Preliminary Edition.Analog Devices,Inc.October 2003.
[13]代君利.通信、数字家庭应用市场驱动DSP技术发展[J].中国电子商情:基础电子.2007,3:46-48.
[14]Freescale.基于下一代SC3400 StarCore(tm)技术的第三代多核DSP—MSC8144.http://www.21ic.com/news/n13398c102.aspx.2006-06-14.
[15]MSC8144 Digital Signal Processor.Freescale Semiconductor,Inc.MSC8144FS Rev 2.2007.
[16] MSC8144 Data Sheet: Product Preview. Freescale Semiconductor, Inc. MSC8144 Rev.0.200702.
[17] MSC8144 SC3400 DSP Subsystem Reference Manual. Freescale Semiconductor, Inc. SC3400SUBRM Rev.B. 200703.
[18] SC3400 DSP Core Reference Manual. Freescale Semiconductor, Inc. SC3400RM Rev.A. 200703.
[19] MSC8144 Reference Manual Quad Core Media Signal Processor. Freescale Semiconductor, Inc. MSC8144RM Rev 1. June 2007.
[20] MSC8144 DMA vs. Cache Data Models. Freescale Semiconductor, Inc. AN319. June 2007.
[21] DMA and Cache Data Models for MSC8144 DSP. Freescale Semiconductor, Inc. AN3358 Rev.0.200612.
[22] Italy Peled. SC3400 Core Workshop. DSPP Freescale Israel. January 2007.
[23] StarCore(?) Assembler User Guide (ver 22.03) for CodeWarrior? Development Studio. Freescale Semiconductor, Inc. '30 August 2007.
[24] StarCore(?) C Compiler User Guide (ver 22.03) for CodeWarrior? Development Studio. Freescale Semiconductor, Inc. 30 August 2007.
[25] StarCore(?) Linker User Guide (ver 22.03) for CodeWarrior? Development Studio. Freescale Semiconductor, Inc. 30 August 2007.
[26] Bogong Su. Jian Wang. Erh-Wen Hu. Joseph Manzano. De-pipeline a software pipelined loop. Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). 2003 IEEE International Conference on. Volume 2, 6-10 April 2003 Page(s):II - 237-40 vol.2.
[27] Erez Kinarti, Norman Goldshtein, and Dov Levenglick. SC3400 Core Platform Cache Optimization in the MSC8144 DSP Includes the L1 ICache, L1 DCache, and L2 ICache. Freescale Semiconductor, Inc. Rev.4, AN3356. 5/2007.
[28] Thomas Wiegand, Gary J. Sullivan, Gisle Bj(?)ntegaard, Ajay Luthra.. Overview of the H.264/AVC Video Coding Standard. Circuits and Systems for Video Technology, IEEE Transactions. Volume 13, Issue 7, July 2003 Page(s): 560 - 576.
[29]Stephan Wenger.H.264/AVC over IP.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,No.7,July 2003.
[30]ITU-T."H.264-Advanced video coding for generic audiovisual services".SERIES H:AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services-Coding of moving video.03/2005.
[31]Thomas Stockhammer,Misha.M.Hannuksela,Steohan Wenger.H.26L/JVT Coding Network Abstraction Layer and IP-based Transport.Image Processing.2002.Proceedings.2002 International Conference.Volume 2,2002.On page(s):Ⅱ-485-Ⅱ-488 Vol.2.
[32]Atul Puri,Xuemin Chen,Ajay Luthra.Video Coding Using the H.264/MPEG-4 AVC Compression Standard.Signal Processing:Image Communication.Volume 9,Issue 9.October 2004.Pages793-849.
[33]Iain E.G.Richardson.H.264 and MPEG-4 Video Compression Video Coding for Next-generation Multimedia.John Wiley & Sons Ltd.2003.Pages 160-162.
[34]毕厚杰.新一代视频压缩编码标准——H.264/AVC(M).北京:人民邮电出版社.2005:92.
[35]H.264/MPEG-4 Part 10 White Paper:Prediction of Intra Macroblock.www.vcodex.com.
[36]赵向坡,刘新.下一代视频标准H.264中的图像的变换和量化(J).通信技术.2003.10:10-12.
[37]Henrique S.Malvar,Antti Hallapuro,Marta Karczewicz,and Louis Kerofsky.Low-Complexity Transform and Quantization in H.264/AVC.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,Issue 7.July 2003.Pages598-603.
[38]Steve Gordon,Detlev Marpe,and Thomas Wiegand."Simplified Use of 8x8Transforms-Updated Proposal & Results" ISO/IEC MPEG and ITU-T VCEG,JVT-K028,Munich,Germany,Mar.2004.
[39]Iain E.G.Richardson.H.264 and MPEG-4 Video Compression Video Coding for Next-generation Multimedia.John Wiley & Sons Ltd.2003.Pages 201-207.
[40]于培松,郭宝龙.H.264/AVC标准中的CABAC应用研究(J).现代电子技术.2005,28(7):5-8.
[41]Detlev Marpe,Heiko Schwarz,and Thomas Wiegand.Contex-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,Issue 7.July 2003.Pages 620-636.
[42]Peter List,Anthony Joch,Jani Lainema,Gisle Bjφntegaard,Marta Karczewicz.Adaptive Deblocking Filter.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,Issue 7.July 2003.Pages 614-619.
[43]Detlev Marpe,Thomas Wiegand,Gary J.Sullivan.The H.264/MPEG4 Advanced Video Coding Standard and its Applications.Communications Magazine,IEEE Volume 44,Issue 8,Aug.2006 Page(s):134-143.
[44]Detlev Marpe,Thomas Wiegand,Stephen Gordon.H.264/MPEG4-AVC fidelity range extensions:tools,profiles,performance,and application areas.Image Processing,2005.ICIP 2005.IEEE International Conference.Volume 1,11-14 Sept.2005 Page(s):Ⅰ-593-6.
[45]Joint Video Team of lTU-T and ISO/IEC:"Draft Text of H.264/AVC Fidelity Range Extensions Amendment",Doc.JVT-L047,Sept.2004.
[46]Itay Peled.Titanium Platform Workshop DSPP Freescale Israel.January 2007.
[47]Tsu-Ming Liu,Ting-An Lin,Sheng-Zen Wang,Wen-Ping Lee,Kang-Cheng Hou,Jiun-Yan Yang and Chen-Yi Lee.An 865-μW H.264/AVC Video Decoder for Mobile Applications.Asian Solid-State Circuits Conference.2005.Nov.2005 Page(s):301-304.
[48]陆亮,楼剑,虞露.H.264编码环中的去块效应滤波系统(J).电视技术,2003,7:12-14.
[49]Tsu-Ming Liu,Wen-Ping Lee,Ting-An Lin and Chen-Yi Lee.A memory-efficient deblocking filter for H.264/AVC video coding.Circuits and Systems,2005.ISCAS 2005.IEEE International Symposium.23-26 May 2005 Page(s):2140-2143 Vol.3.
[50]张杰,童胜.H.264/AVC中二进制算术编码的分析与研究(J).电子科技.2003,24:28-31.
[51] Yongseok Yi, In-Cheol Park. High-Speed H.264/AVC CABAC Decoding.Circuits and Systems for Video Technology, IEEE Transactions. Volume 17, Issue 4, April 2007 Page(s):490-494.
[52] Yong Ho Moon, Gyu Yeong Kim, and Jae Ho Kim. An Efficient Decoding of CAVLC in H.264/AVC Video Coding Standard. Consumer Electronics, IEEE Transactions. Volume 51, Issue 3, August 2005. Pages 933-938.
[53] Aureus Shum. Starcore Programming Training: Optimization. Freescale Semiconductor, Inc. 2005 Oct. 10.
[2]魏芳.H.264视频编解码算法和并行优化的研究[D].北京:北京邮电大学.2004.
[3]郭晓强,门爱东.视频编码标准的发展:从H.261到H.264[J].世界广播电视,2004,18(9):22-25,61.
[4]Mohammed Ghanbari,Standard Codecs:Image Compression to Advanced Video Coding.The Institution of Electrical Engineers.2003.
[5]薛全.H.264/AVC中运动估计、变换与解码器优化[D].杭州:浙江大学.2004.
[6]滕国伟.H.264/AVC实时编码系统及其相关算法的研究[D].上海:上海大学.2005.
[7]Ralf Schafer,Thomas Wiegand and Heiko Schwarz.The Emerging H.264/AVC Standard.EBU TECHINICAL REVIEW.200301.
[8]杨静.H.264低码率实时视频传输中的比特优化分配问题研究[D].上海:上海交通大学.2006.
[9]鲁争焱.DSP技术发展与应用综述(J).集成电路通讯.2001,3:11-15.
[10]中华视频网.视频处理平台DSP的横向测评.http://www.360doc.com/showweb/0/0/351479.aspx.2006-01-09.
[11]应翔.基于DaVinci处理器的H.264视频编码器软件设计和优化实现[D].杭州:浙江大学.2007.
[12]ADSP-BF561 Blackfin(R)Processor Hardware Reference.Preliminary Edition.Analog Devices,Inc.October 2003.
[13]代君利.通信、数字家庭应用市场驱动DSP技术发展[J].中国电子商情:基础电子.2007,3:46-48.
[14]Freescale.基于下一代SC3400 StarCore(tm)技术的第三代多核DSP—MSC8144.http://www.21ic.com/news/n13398c102.aspx.2006-06-14.
[15]MSC8144 Digital Signal Processor.Freescale Semiconductor,Inc.MSC8144FS Rev 2.2007.
[16] MSC8144 Data Sheet: Product Preview. Freescale Semiconductor, Inc. MSC8144 Rev.0.200702.
[17] MSC8144 SC3400 DSP Subsystem Reference Manual. Freescale Semiconductor, Inc. SC3400SUBRM Rev.B. 200703.
[18] SC3400 DSP Core Reference Manual. Freescale Semiconductor, Inc. SC3400RM Rev.A. 200703.
[19] MSC8144 Reference Manual Quad Core Media Signal Processor. Freescale Semiconductor, Inc. MSC8144RM Rev 1. June 2007.
[20] MSC8144 DMA vs. Cache Data Models. Freescale Semiconductor, Inc. AN319. June 2007.
[21] DMA and Cache Data Models for MSC8144 DSP. Freescale Semiconductor, Inc. AN3358 Rev.0.200612.
[22] Italy Peled. SC3400 Core Workshop. DSPP Freescale Israel. January 2007.
[23] StarCore(?) Assembler User Guide (ver 22.03) for CodeWarrior? Development Studio. Freescale Semiconductor, Inc. '30 August 2007.
[24] StarCore(?) C Compiler User Guide (ver 22.03) for CodeWarrior? Development Studio. Freescale Semiconductor, Inc. 30 August 2007.
[25] StarCore(?) Linker User Guide (ver 22.03) for CodeWarrior? Development Studio. Freescale Semiconductor, Inc. 30 August 2007.
[26] Bogong Su. Jian Wang. Erh-Wen Hu. Joseph Manzano. De-pipeline a software pipelined loop. Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). 2003 IEEE International Conference on. Volume 2, 6-10 April 2003 Page(s):II - 237-40 vol.2.
[27] Erez Kinarti, Norman Goldshtein, and Dov Levenglick. SC3400 Core Platform Cache Optimization in the MSC8144 DSP Includes the L1 ICache, L1 DCache, and L2 ICache. Freescale Semiconductor, Inc. Rev.4, AN3356. 5/2007.
[28] Thomas Wiegand, Gary J. Sullivan, Gisle Bj(?)ntegaard, Ajay Luthra.. Overview of the H.264/AVC Video Coding Standard. Circuits and Systems for Video Technology, IEEE Transactions. Volume 13, Issue 7, July 2003 Page(s): 560 - 576.
[29]Stephan Wenger.H.264/AVC over IP.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,No.7,July 2003.
[30]ITU-T."H.264-Advanced video coding for generic audiovisual services".SERIES H:AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services-Coding of moving video.03/2005.
[31]Thomas Stockhammer,Misha.M.Hannuksela,Steohan Wenger.H.26L/JVT Coding Network Abstraction Layer and IP-based Transport.Image Processing.2002.Proceedings.2002 International Conference.Volume 2,2002.On page(s):Ⅱ-485-Ⅱ-488 Vol.2.
[32]Atul Puri,Xuemin Chen,Ajay Luthra.Video Coding Using the H.264/MPEG-4 AVC Compression Standard.Signal Processing:Image Communication.Volume 9,Issue 9.October 2004.Pages793-849.
[33]Iain E.G.Richardson.H.264 and MPEG-4 Video Compression Video Coding for Next-generation Multimedia.John Wiley & Sons Ltd.2003.Pages 160-162.
[34]毕厚杰.新一代视频压缩编码标准——H.264/AVC(M).北京:人民邮电出版社.2005:92.
[35]H.264/MPEG-4 Part 10 White Paper:Prediction of Intra Macroblock.www.vcodex.com.
[36]赵向坡,刘新.下一代视频标准H.264中的图像的变换和量化(J).通信技术.2003.10:10-12.
[37]Henrique S.Malvar,Antti Hallapuro,Marta Karczewicz,and Louis Kerofsky.Low-Complexity Transform and Quantization in H.264/AVC.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,Issue 7.July 2003.Pages598-603.
[38]Steve Gordon,Detlev Marpe,and Thomas Wiegand."Simplified Use of 8x8Transforms-Updated Proposal & Results" ISO/IEC MPEG and ITU-T VCEG,JVT-K028,Munich,Germany,Mar.2004.
[39]Iain E.G.Richardson.H.264 and MPEG-4 Video Compression Video Coding for Next-generation Multimedia.John Wiley & Sons Ltd.2003.Pages 201-207.
[40]于培松,郭宝龙.H.264/AVC标准中的CABAC应用研究(J).现代电子技术.2005,28(7):5-8.
[41]Detlev Marpe,Heiko Schwarz,and Thomas Wiegand.Contex-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,Issue 7.July 2003.Pages 620-636.
[42]Peter List,Anthony Joch,Jani Lainema,Gisle Bjφntegaard,Marta Karczewicz.Adaptive Deblocking Filter.Circuits and Systems for Video Technology,IEEE Transactions.Volume 13,Issue 7.July 2003.Pages 614-619.
[43]Detlev Marpe,Thomas Wiegand,Gary J.Sullivan.The H.264/MPEG4 Advanced Video Coding Standard and its Applications.Communications Magazine,IEEE Volume 44,Issue 8,Aug.2006 Page(s):134-143.
[44]Detlev Marpe,Thomas Wiegand,Stephen Gordon.H.264/MPEG4-AVC fidelity range extensions:tools,profiles,performance,and application areas.Image Processing,2005.ICIP 2005.IEEE International Conference.Volume 1,11-14 Sept.2005 Page(s):Ⅰ-593-6.
[45]Joint Video Team of lTU-T and ISO/IEC:"Draft Text of H.264/AVC Fidelity Range Extensions Amendment",Doc.JVT-L047,Sept.2004.
[46]Itay Peled.Titanium Platform Workshop DSPP Freescale Israel.January 2007.
[47]Tsu-Ming Liu,Ting-An Lin,Sheng-Zen Wang,Wen-Ping Lee,Kang-Cheng Hou,Jiun-Yan Yang and Chen-Yi Lee.An 865-μW H.264/AVC Video Decoder for Mobile Applications.Asian Solid-State Circuits Conference.2005.Nov.2005 Page(s):301-304.
[48]陆亮,楼剑,虞露.H.264编码环中的去块效应滤波系统(J).电视技术,2003,7:12-14.
[49]Tsu-Ming Liu,Wen-Ping Lee,Ting-An Lin and Chen-Yi Lee.A memory-efficient deblocking filter for H.264/AVC video coding.Circuits and Systems,2005.ISCAS 2005.IEEE International Symposium.23-26 May 2005 Page(s):2140-2143 Vol.3.
[50]张杰,童胜.H.264/AVC中二进制算术编码的分析与研究(J).电子科技.2003,24:28-31.
[51] Yongseok Yi, In-Cheol Park. High-Speed H.264/AVC CABAC Decoding.Circuits and Systems for Video Technology, IEEE Transactions. Volume 17, Issue 4, April 2007 Page(s):490-494.
[52] Yong Ho Moon, Gyu Yeong Kim, and Jae Ho Kim. An Efficient Decoding of CAVLC in H.264/AVC Video Coding Standard. Consumer Electronics, IEEE Transactions. Volume 51, Issue 3, August 2005. Pages 933-938.
[53] Aureus Shum. Starcore Programming Training: Optimization. Freescale Semiconductor, Inc. 2005 Oct. 10.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |