基于MPEG2的运动补偿模块的设计和验证
|
摘要
MPEG(Motion Picture Expert Group,运动图像专家组)定义了诸多的音视频标准和规范,MPEG2视频解码器是MPEG-2标准中的关键环节,而运动补偿技术MC(Motion Compensation)则是视频解码器中最重要的部分。运动补偿技术就是在动态序列图像实时编码中运用图像信息以及像素的位移矢量进行图像高效编码的一种方法。运动补偿技术能在有限带宽的情形下,实现视频数据的传送,这为现阶段的图像设备提供了技术支持。
本论文对MPEG2标准做了详细的剖析,在参考了部分优秀设计的基础上,完成了运动补偿模块的RTL代码设计。设计的重点在于通过深层次剖析数据流和各种预测方式,得到相关的运动向量并依据不同补偿方法,将算法转化成高效的RTL级硬件代码。同时,因为本设计是MPEG2视频解码器的一部分,所以在设计的过程中,运动补偿模块与可变长解码模块,仲裁模块,反离散余弦变换模块及相关存储器之间的协调工作就变得异常重要。
为确保将MC设计集成到完整的MPEG2解码器中后整体功能的正确性。本文在完成上述工作的基础上,借助实验室其它资源将MC设计集成到一个完整MPEG2视频解码器设计之中并为此视频解码器搭建了一个完善的、具有可重用参考价值的验证平台。验证过程中,通过状态机验证了运动补偿的各种预测方式,并调用几种仿真工具和X-Window显示函数来完成验证。考虑视频解码过程是非常复杂的,本论文主要采用脚本来完成整个自动化验证过程。
MPEG(Motion Picture Expert Group) has defined many Audio/Video standard and specification. MPEG-2 video decoder is the key factor of MPEG-2 standard, and Motion Compensation technology is the foremost section of MPEG-2 video decoder. Motion compensation is a highly efficient technology which uses sequence image information and image pixels vector to encode in the dynamic real-time image.The MC can memory a lot of data and can transfers the data at the limited bandwidth, which provides the support for modern image devices.
This dissertation has accomplished the particular analysis of MPEG2 video criterion, especially the MC. On the basis of some excellent reference designs, this dissertation completes RTL coding of MC module. The focus of the design is through the deep-level analysis of data flow and prediction methods to calculate the motion vector and to make the algorithm as the efficient RTL-level hardware code on the basis of motion compensation. At the same time, because the design is part of the MPEG2 video decoder, in the process of design it is important to ensure the motion compensation module, variable length decoding module, arbitration module, anti-discrete cosine transform module to work harmonily.
To ensure functional validity of the entire video decoder when MC module is integrated into MPEG2 decoder, this dissertation implements MC integration into a MPEG2 video decoder design on the basis of completing MC design. Then a perfect and reusable verification platform is constructed for the former MPEG2 video decoder design. In the process of verification, the dissertation adopts state machine to verify the diverse prediction methods, and different simulation tools and X-Window display function are invoked to verify the MPEG2 video decoder design. Considering the complication of the video decoding process, the dissertation uses the script to implement the automation of the verification process.
本论文对MPEG2标准做了详细的剖析,在参考了部分优秀设计的基础上,完成了运动补偿模块的RTL代码设计。设计的重点在于通过深层次剖析数据流和各种预测方式,得到相关的运动向量并依据不同补偿方法,将算法转化成高效的RTL级硬件代码。同时,因为本设计是MPEG2视频解码器的一部分,所以在设计的过程中,运动补偿模块与可变长解码模块,仲裁模块,反离散余弦变换模块及相关存储器之间的协调工作就变得异常重要。
为确保将MC设计集成到完整的MPEG2解码器中后整体功能的正确性。本文在完成上述工作的基础上,借助实验室其它资源将MC设计集成到一个完整MPEG2视频解码器设计之中并为此视频解码器搭建了一个完善的、具有可重用参考价值的验证平台。验证过程中,通过状态机验证了运动补偿的各种预测方式,并调用几种仿真工具和X-Window显示函数来完成验证。考虑视频解码过程是非常复杂的,本论文主要采用脚本来完成整个自动化验证过程。
MPEG(Motion Picture Expert Group) has defined many Audio/Video standard and specification. MPEG-2 video decoder is the key factor of MPEG-2 standard, and Motion Compensation technology is the foremost section of MPEG-2 video decoder. Motion compensation is a highly efficient technology which uses sequence image information and image pixels vector to encode in the dynamic real-time image.The MC can memory a lot of data and can transfers the data at the limited bandwidth, which provides the support for modern image devices.
This dissertation has accomplished the particular analysis of MPEG2 video criterion, especially the MC. On the basis of some excellent reference designs, this dissertation completes RTL coding of MC module. The focus of the design is through the deep-level analysis of data flow and prediction methods to calculate the motion vector and to make the algorithm as the efficient RTL-level hardware code on the basis of motion compensation. At the same time, because the design is part of the MPEG2 video decoder, in the process of design it is important to ensure the motion compensation module, variable length decoding module, arbitration module, anti-discrete cosine transform module to work harmonily.
To ensure functional validity of the entire video decoder when MC module is integrated into MPEG2 decoder, this dissertation implements MC integration into a MPEG2 video decoder design on the basis of completing MC design. Then a perfect and reusable verification platform is constructed for the former MPEG2 video decoder design. In the process of verification, the dissertation adopts state machine to verify the diverse prediction methods, and different simulation tools and X-Window display function are invoked to verify the MPEG2 video decoder design. Considering the complication of the video decoding process, the dissertation uses the script to implement the automation of the verification process.
引文
1钟玉琢,王琪,赵黎,杨小勤等. MPEG2运动图像压缩编码国际标准及MPEG的新发展.清华大学出版社, 2002:92~96
2小野定康,铃木纯司. JPEG/MPEG2技术.科学出版社, 2004:134~201
3刘文红. MPEG的运动补偿技术.中国有线电视. 2003:38~39
4 IEEE Computer Society Design Automation Standars Committee.IEEE Standard Verilog Hardware Description Language.IEEE std. 2000:361~517
5宋永胜,蒋国平. MPEG的关键技术-运动补偿综述.山西电子技术. 2003, (1):21~25
6胡国荣.字视频压缩及其标准.北京广播学院学报. 1999, (12):57~178
7余兆明,李晓飞,陈来春. MPEG标准及其应用.北京邮电大学学报. 2002, (11):31~79
8贺玉文等.一种快速全局运动补偿方法.电子学报. 2001, (2):56~60
9李鹏,戎蒙恬,董威,吴钰炎. MPEG2视频芯片MC的一种VLSI实现方案.计算机工程Computer Engineering. 2004, 48(9):28~37
10李煜晖等.多媒体数字压缩与标准.电子工业大学学报. 2000:105~110
11 CAS standards committee of the IEEE Circuits and Systems Society.IEEE Standard Specifications for the Implementations of 8×8 Inverse Discrete Cosine Transform.IEEE Standards Board. December 6. 1990: 22~92
12惠新标等. MPEG2运动补偿的VLSI设计.上海交通大学学报. 2000, (7):112~116
13赵存刚,陈光化,邹国良,赵波,舒海军.一种新的MPEG2的运动补偿VLSI设计.上海大学学报. 2004, (12):556~560
14叶波,俞颖,章倩苓.适用于MPEG2标准的两种VLSI模块设计.半导体学报. 2007, (12):920~926
15 Byung Cheol Song, Kang-Wook Chun. Multi-Resolution Block Matching Algorithm and Its VLSI Architecture for Fast Motion Estimation in an MPEG-2 Video Encoder. IEEE Transaction on Circuits and System for Vidio Technology. 2004, 14(9): 1119~1137
16熊艳苗等. MPEG家族新成果.多媒体技术. 2001, (2):2~6
17阮象华. MPEG1到MPEG-7.通讯世界. 2004, (7):4~10
18周宁,姜昱明. MPEG节目流到传输流的转化.计算机工程与设计. 2003, 24(3):15~17
19饶海潮,郭立,黄征.MCIP核的VLSI设计.微电子学与计算机. 2004, (8):6~12
20 Li, J. H. and Ling, N. An Efficient Video Decoder Design for MPEG2MP@ML, IEEE International Conference on Application-Specific Systems. Architectures and Processors. 1997: 10~14
21舒海军,陈光华,邹国良.双口RAM在MPEG-2运动补偿的FPGA实现中的应用.电子技术. 2003, (6):28~32
22赵珑等.运动图像中运动补偿帧间内插的研究.通信学报. 2006, (16):4~9
23陈旭昀,郑金山,周汀,章倩苓. MPEG专用MC处理器的优化设计.半导体学报. 2006,21(8):222~255
24吴肖浦.数字电视系统中MPEG2编码器的设计研究.浙江大学学报. 2003:15~50
25惠新标,郑志航,叶楠. MPEG_2视频反量化和MC的VLSI设计.上海交通大学学报. 2007, 19(7):12~19
26 ISO/IEC 13818-2, Information Technology-Generic Coding of Moving Picture and Associated Audio Information,Part2. 2005: 20~27
27 Yuhuang Ye, Yuanjiu Li, Kaixiong Su. Architecture and Software Implementation of HDTV Decoder on a siglechip,MPEG Decoder. Computer Graphics, Imaging and Visualisation 2006 Internation Conference. 2006: 97~98
28 IEEE Std 1180-1990. IEEE Standard Specifications for the Implementations of 8x8 Inverse Discrete Cosine Transform. 2006, (6): 72~74
29于宝东,邹雪城.一种新型面积优化的二维MC处理器.微处理机MICRO PROCESSORS. 2005, 89(5):78~90
30 Cheng Yuan Peng, Artur Lugmayr, Petri Vuorimaa. A Digital Television Navigator. Multimedia Tools and Applications. 2002, 17: 121~141
31 Clenn A. Rettmeier. The U.S.Digital Television Standard and its Impact on VLSI. Journal of VLSI Signal Processing. 1997, 17: 281~290
32 Markus Flierl , Bernd Girod. A NEW BIDIRECTIONALLY MOTION-COMPENSATED ORTHOGONAL TRANSFORM FOR VIDEO CODING , Max Planck Center for Visual Computing and Communication. 2006:124~126
33 Richard P. Kleihorst, Rene J. Van Der Vleuten. DCT-Domain Embedded Memory Compression for Hybrid Video Coders. Journal of VLSI Signal Processing Systems. 2006, 24, 31~41
34 Jos T.J.van Eijndhoven, Kees A.Vissers. Pel Reconstruction on FPGA-Augmented TriMedia. IEEE Transactions on Very Large Scale Integration (VLSI) Systems. 2004, 12(6): 622~635
35 Nobutaro Shibata, Patrick Corlay, Marc Georges Gazalet, Francois-Xavier Coudoux, etc. Impact of local coding efficiency on the modelling of flows derived from VBR MPEG2 video coding. European Transactions on Telecommunications. 2004, 15: 55~62
36 Nobutaro Shibata, Hiroki Morimura. Size-Configurable 200-MHz Low-Power SRAM Macrocells for MPEG2 Video-Encoding LSIs:PerformanceEnhancement with Embedded Registers. Electronics and Communications in Japan. 1999, 82(1): 1~6
37李绪诚,刘宇红,杨鲁平. MPEG视频解码中离散余弦逆变换的FPGA实现.中国集成电路. 2006,81(2):98~104
38 Jeff Bier.An introduction to video compression. Electronic Engineering Times. 2007:19~21
39 Shanawaz Basith.MPEG.Standards.technology and Applications. Information Systems Engineering Department of Computing and Department of Electrical and Electronic Engineering. 1996, (6): 16~20
40杨宇红,董威,张文军,凌阳,邱琳. MPEG_2 MP@HL高清实时解码器的VLSI设计实现.高技术通讯. 2005, (9):8~13
41 Sundararajan Sriram, Ching-YuHung.MPEG2 Video Decoding on the TMS320C6×DSP Architecture. DSPSR & DCenter, Texas Instruments, DallasTX75265. 2005: 98~102
42 Dr. T. Tran. MPEG Video Architecture. 2005: 39~55
43黎文. MPEG2集成电路解码芯片的EDA设计和FPGA验证.电子科技大学博士论文,2000,(4):20~110
44 Dr.S.R.Ely. MPEG video coding A simple introduction. EBU Technical Review. 2005:62~66
45 Janick Bergeron.Writing Testbenches. Kluwer Academic Publishers. 2000:50~55
2小野定康,铃木纯司. JPEG/MPEG2技术.科学出版社, 2004:134~201
3刘文红. MPEG的运动补偿技术.中国有线电视. 2003:38~39
4 IEEE Computer Society Design Automation Standars Committee.IEEE Standard Verilog Hardware Description Language.IEEE std. 2000:361~517
5宋永胜,蒋国平. MPEG的关键技术-运动补偿综述.山西电子技术. 2003, (1):21~25
6胡国荣.字视频压缩及其标准.北京广播学院学报. 1999, (12):57~178
7余兆明,李晓飞,陈来春. MPEG标准及其应用.北京邮电大学学报. 2002, (11):31~79
8贺玉文等.一种快速全局运动补偿方法.电子学报. 2001, (2):56~60
9李鹏,戎蒙恬,董威,吴钰炎. MPEG2视频芯片MC的一种VLSI实现方案.计算机工程Computer Engineering. 2004, 48(9):28~37
10李煜晖等.多媒体数字压缩与标准.电子工业大学学报. 2000:105~110
11 CAS standards committee of the IEEE Circuits and Systems Society.IEEE Standard Specifications for the Implementations of 8×8 Inverse Discrete Cosine Transform.IEEE Standards Board. December 6. 1990: 22~92
12惠新标等. MPEG2运动补偿的VLSI设计.上海交通大学学报. 2000, (7):112~116
13赵存刚,陈光化,邹国良,赵波,舒海军.一种新的MPEG2的运动补偿VLSI设计.上海大学学报. 2004, (12):556~560
14叶波,俞颖,章倩苓.适用于MPEG2标准的两种VLSI模块设计.半导体学报. 2007, (12):920~926
15 Byung Cheol Song, Kang-Wook Chun. Multi-Resolution Block Matching Algorithm and Its VLSI Architecture for Fast Motion Estimation in an MPEG-2 Video Encoder. IEEE Transaction on Circuits and System for Vidio Technology. 2004, 14(9): 1119~1137
16熊艳苗等. MPEG家族新成果.多媒体技术. 2001, (2):2~6
17阮象华. MPEG1到MPEG-7.通讯世界. 2004, (7):4~10
18周宁,姜昱明. MPEG节目流到传输流的转化.计算机工程与设计. 2003, 24(3):15~17
19饶海潮,郭立,黄征.MCIP核的VLSI设计.微电子学与计算机. 2004, (8):6~12
20 Li, J. H. and Ling, N. An Efficient Video Decoder Design for MPEG2MP@ML, IEEE International Conference on Application-Specific Systems. Architectures and Processors. 1997: 10~14
21舒海军,陈光华,邹国良.双口RAM在MPEG-2运动补偿的FPGA实现中的应用.电子技术. 2003, (6):28~32
22赵珑等.运动图像中运动补偿帧间内插的研究.通信学报. 2006, (16):4~9
23陈旭昀,郑金山,周汀,章倩苓. MPEG专用MC处理器的优化设计.半导体学报. 2006,21(8):222~255
24吴肖浦.数字电视系统中MPEG2编码器的设计研究.浙江大学学报. 2003:15~50
25惠新标,郑志航,叶楠. MPEG_2视频反量化和MC的VLSI设计.上海交通大学学报. 2007, 19(7):12~19
26 ISO/IEC 13818-2, Information Technology-Generic Coding of Moving Picture and Associated Audio Information,Part2. 2005: 20~27
27 Yuhuang Ye, Yuanjiu Li, Kaixiong Su. Architecture and Software Implementation of HDTV Decoder on a siglechip,MPEG Decoder. Computer Graphics, Imaging and Visualisation 2006 Internation Conference. 2006: 97~98
28 IEEE Std 1180-1990. IEEE Standard Specifications for the Implementations of 8x8 Inverse Discrete Cosine Transform. 2006, (6): 72~74
29于宝东,邹雪城.一种新型面积优化的二维MC处理器.微处理机MICRO PROCESSORS. 2005, 89(5):78~90
30 Cheng Yuan Peng, Artur Lugmayr, Petri Vuorimaa. A Digital Television Navigator. Multimedia Tools and Applications. 2002, 17: 121~141
31 Clenn A. Rettmeier. The U.S.Digital Television Standard and its Impact on VLSI. Journal of VLSI Signal Processing. 1997, 17: 281~290
32 Markus Flierl , Bernd Girod. A NEW BIDIRECTIONALLY MOTION-COMPENSATED ORTHOGONAL TRANSFORM FOR VIDEO CODING , Max Planck Center for Visual Computing and Communication. 2006:124~126
33 Richard P. Kleihorst, Rene J. Van Der Vleuten. DCT-Domain Embedded Memory Compression for Hybrid Video Coders. Journal of VLSI Signal Processing Systems. 2006, 24, 31~41
34 Jos T.J.van Eijndhoven, Kees A.Vissers. Pel Reconstruction on FPGA-Augmented TriMedia. IEEE Transactions on Very Large Scale Integration (VLSI) Systems. 2004, 12(6): 622~635
35 Nobutaro Shibata, Patrick Corlay, Marc Georges Gazalet, Francois-Xavier Coudoux, etc. Impact of local coding efficiency on the modelling of flows derived from VBR MPEG2 video coding. European Transactions on Telecommunications. 2004, 15: 55~62
36 Nobutaro Shibata, Hiroki Morimura. Size-Configurable 200-MHz Low-Power SRAM Macrocells for MPEG2 Video-Encoding LSIs:PerformanceEnhancement with Embedded Registers. Electronics and Communications in Japan. 1999, 82(1): 1~6
37李绪诚,刘宇红,杨鲁平. MPEG视频解码中离散余弦逆变换的FPGA实现.中国集成电路. 2006,81(2):98~104
38 Jeff Bier.An introduction to video compression. Electronic Engineering Times. 2007:19~21
39 Shanawaz Basith.MPEG.Standards.technology and Applications. Information Systems Engineering Department of Computing and Department of Electrical and Electronic Engineering. 1996, (6): 16~20
40杨宇红,董威,张文军,凌阳,邱琳. MPEG_2 MP@HL高清实时解码器的VLSI设计实现.高技术通讯. 2005, (9):8~13
41 Sundararajan Sriram, Ching-YuHung.MPEG2 Video Decoding on the TMS320C6×DSP Architecture. DSPSR & DCenter, Texas Instruments, DallasTX75265. 2005: 98~102
42 Dr. T. Tran. MPEG Video Architecture. 2005: 39~55
43黎文. MPEG2集成电路解码芯片的EDA设计和FPGA验证.电子科技大学博士论文,2000,(4):20~110
44 Dr.S.R.Ely. MPEG video coding A simple introduction. EBU Technical Review. 2005:62~66
45 Janick Bergeron.Writing Testbenches. Kluwer Academic Publishers. 2000:50~55