基于VQ的视频压缩的关键技术研究
|
摘要
视频压缩技术一直是视频处理领域的一门关键技术,也一直是研究的热点。随着多媒体技术和网络的发展,人们对于视频压缩及实时传输的要求也不断提高。矢量量化(VQ)是一种简单高效的图像压缩算法,同时其算法结构简单,适合于硬件实现。同时,运动估计作为一种常用的视频编码技术,可以用于消除视频序列中的时间冗余。因此,如果将矢量量化和运动估计相结合,即在视频编码中,静态帧编码策略为矢量量化,而动态预测帧的编码策略为运动估计,就可以将两者的优势相结合,在保持图像质量的基础上进一步提高压缩率。
首先,在视频编码的静态帧方面,提出了一种基于旋转压缩码书的矢量量化算法(VQ),并设计了硬件结构。该算法充分利用了码书之间方向上的相关性,将各个码书旋转后进行压缩存储,编码时将旋转压缩码书恢复后进行编码,从而大幅降低了需要存储的码书数量。在硬件实现时相较于典型的矢量量化算法减少了75%的存储空间和75%的输入带宽,而PSNR平均只降低0.28dB。
其次,在视频编码的帧间预测编码方面,文章设计了一个全搜索运动估计模块结构,并讨论了其低功耗实现。之后又继续分析讨论了一些快速运动估计算法,如对角线匹配策略的运动估计算法和菱形搜索运动估计算法,并针对这些算法设计了相应的硬件结构。
最后,由于课题组已经在传统矢量量化算法的基础上,开发了一种快速矢量量化算法PDVQ算法,并且设计完成了PDVQ芯片。因此,在已有的成果基础上,设计了一个基于PDVQ的视频编码系统的实现方案,该结构采用了前面提出的全搜索运动估计结构,在提高计算速度的同时极大的减少了输入数据带宽,最终的系统性能良好,在提高压缩率的同时基本保持了图像的编码质量。
最终,本文使用硬件描述语言Verilog对提出的结构进行RTL级代码编写,并基于Charter标准单元库的0.35um CMOS工艺实现,采用Synopsis Design Compiler进行综合,后仿功能正确。为了进一步验证其功能,将所有设计下载到FPGA中,最终的实际测试结果正确。
Video compression always is the key technology in the video processing field. As the development of multimedia and network, the requirement for the real-time video compression enhances at the same time. Vector Quantization (VQ) is a simple and effective algorithm which has simple architecture and easy implementation, and it also has high processing speed, therefore, it is very appropriate for real-time video compression application. Motion Estimation (ME) is another video coding technology which attempts to effectively use the temporal redundancy between successive frames. Therefore, if VQ and ME are combined in video coding algorithm, it will keeps the image performance and also has high compression ratio in implementation.
Firstly, in the infra-frame coding, a vector quantization (VQ) algorithm based on rotating compressed codebook and its implementation is proposed. The algorithm compresses the original codebook by taking advantage of the original codebook directional correlation, and resumes the original codebook by rotating in the encoding. Compare with the typical vector quantization algorithm, the algorithm decreases 75% memory room and 75% I/O bandwidth but lost only 0.28dB PSNR.
Secondly, in motion estimation algorithms, a low-power full search motion estimation unit is proposed. And some fast motion estimation algorithms, such as diagonal matching and diamond search algorithm, are disused in the paper, and the implementations also are designed.
Thirdly, the project team has developed a PDVQ chip with PDVQ algorithm, therefore, based on the existent research foundation, a PDVQ based video coding system is proposed. The system can increase the speed and reduce the I/O bandwidth, and also can increase the compression ratio while keeping the reconstructed image quality.
Finally, the architecture presented in this paper has been described in Verilog RTL code and synthesized by Synopsys Design Compiler with Charter 0.35um standard cell library, and the result of gate-level simulation is correct. For verify the function, all the designs are downloaded into FPGA, and the waveform in the logic analyzer also is right.
首先,在视频编码的静态帧方面,提出了一种基于旋转压缩码书的矢量量化算法(VQ),并设计了硬件结构。该算法充分利用了码书之间方向上的相关性,将各个码书旋转后进行压缩存储,编码时将旋转压缩码书恢复后进行编码,从而大幅降低了需要存储的码书数量。在硬件实现时相较于典型的矢量量化算法减少了75%的存储空间和75%的输入带宽,而PSNR平均只降低0.28dB。
其次,在视频编码的帧间预测编码方面,文章设计了一个全搜索运动估计模块结构,并讨论了其低功耗实现。之后又继续分析讨论了一些快速运动估计算法,如对角线匹配策略的运动估计算法和菱形搜索运动估计算法,并针对这些算法设计了相应的硬件结构。
最后,由于课题组已经在传统矢量量化算法的基础上,开发了一种快速矢量量化算法PDVQ算法,并且设计完成了PDVQ芯片。因此,在已有的成果基础上,设计了一个基于PDVQ的视频编码系统的实现方案,该结构采用了前面提出的全搜索运动估计结构,在提高计算速度的同时极大的减少了输入数据带宽,最终的系统性能良好,在提高压缩率的同时基本保持了图像的编码质量。
最终,本文使用硬件描述语言Verilog对提出的结构进行RTL级代码编写,并基于Charter标准单元库的0.35um CMOS工艺实现,采用Synopsis Design Compiler进行综合,后仿功能正确。为了进一步验证其功能,将所有设计下载到FPGA中,最终的实际测试结果正确。
Video compression always is the key technology in the video processing field. As the development of multimedia and network, the requirement for the real-time video compression enhances at the same time. Vector Quantization (VQ) is a simple and effective algorithm which has simple architecture and easy implementation, and it also has high processing speed, therefore, it is very appropriate for real-time video compression application. Motion Estimation (ME) is another video coding technology which attempts to effectively use the temporal redundancy between successive frames. Therefore, if VQ and ME are combined in video coding algorithm, it will keeps the image performance and also has high compression ratio in implementation.
Firstly, in the infra-frame coding, a vector quantization (VQ) algorithm based on rotating compressed codebook and its implementation is proposed. The algorithm compresses the original codebook by taking advantage of the original codebook directional correlation, and resumes the original codebook by rotating in the encoding. Compare with the typical vector quantization algorithm, the algorithm decreases 75% memory room and 75% I/O bandwidth but lost only 0.28dB PSNR.
Secondly, in motion estimation algorithms, a low-power full search motion estimation unit is proposed. And some fast motion estimation algorithms, such as diagonal matching and diamond search algorithm, are disused in the paper, and the implementations also are designed.
Thirdly, the project team has developed a PDVQ chip with PDVQ algorithm, therefore, based on the existent research foundation, a PDVQ based video coding system is proposed. The system can increase the speed and reduce the I/O bandwidth, and also can increase the compression ratio while keeping the reconstructed image quality.
Finally, the architecture presented in this paper has been described in Verilog RTL code and synthesized by Synopsys Design Compiler with Charter 0.35um standard cell library, and the result of gate-level simulation is correct. For verify the function, all the designs are downloaded into FPGA, and the waveform in the logic analyzer also is right.
引文
[1]BOLIEK M,CHRISTOPOULOS C,MAJANI E.ISO/IEC JTC 1/SC 29/WG 1 N1646R,16.JPEG2000 Part Ⅰ Final Committee Draft Version 1.0[S].2000.
[2]LIU Lei- bo,CHEN Ning,MENG Hon- ying.A VLSI Architecture of JPEG2000Encoder[J].IEEE Journal of Solid- State Circuits,2004,39(11):2032-2040.
[3]刘雷波.JPEG2000静止图像压缩关键技术研究及VLSI实现[D].北京:清华大学,2004.
[4]"Information Technology-Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbit/s-Part 2:Video," JTC1/SC29/WG11,ISO/IEC 11172-2(MPEG-1 Video),1993.
[5]"Generic Coding of Moving Pictures and Associated Audio Information-Part 2:Video,"ITU-T and ISO/IEC JTC 1,ITU Rec.H.262-ISO/IEC 13 818-2(MPEG-2 Video),1994.
[6]"Information Technology-Coding of Audio Visual Objects-Part 2Visual,"JTC1/SC29/WG11,ISO/IEC 14 469-2(MPEG-4 Visual),2000.
[7]"Video Codec for Audiovisual Services at p_64 kbit=s,"ITU-TSG15,ITU-TRec.H.261,2ed.,1993.
[8]"Video Coding for Low Bit Rate Communication," ITU-TSG16,ITU-TRec.H.263,3rd ed.,2000.
[9]Draft ITU-T Recommendation and Final Draft Inter-national Standard of Joint Video Specification,Joint Video Team,May 2003.
[10]C.Chakrabarti,M.Vishwanath,"Efficient realization of the discrete and continuous wavelet transforms:from single chip implementations to mappings on SIMD array computers",IEEE Trans.Signal Processing,1995,43:759-771.
[11]Linde Y,Buzo A,Gray R M.An algorithm for vector quantizer design.IEEE Trans Communication,Jan 1980,COM-28:84-95.
[12]J Shanbehzadeh,On the computational complexity of the LBG and PNN algorithms,IEEE Transactions on IP,1997.6.04,614-616
[13]Effros M,Chou P A,Riskin E A.etal.A progressive universal noiseless coder[J].IEEE Transactions on Information Theory,1994,40(1):108-117
[14]Jianping Pan,Fischer T R.Two-stage vector quantization-lattice vector quantization[J].IEEE Transactions on Information Theory,1995,41(1):155-163
[15]Hwang Wenjyi,Huang Yuchun.Multistage motion vector quantization for video coding [J].Optical Engineering,2000,39(7):1994-2002
[16]Kuo Chungming,Hsieh Chaurheh,Weng Shiuhku.Predictive search algorithm for vector quantization of images[J].Optical Engineering,2002,41(5):1104-1114
[17]沈兰荪,卓力,田 栋,等,视频编码与低速率传输[M].北京:电子工业出版社,2002,1 28-29
[18]银磊,余宁梅,马文龙,王冬芳.基于方向性的VQ编码算法[J].计算机工程与应用.2005,41(14):44-45
[19]Iinuma K,Hirano A,Baik H,et al.Motion compensated inter-frame coding for video conferencing[A].In:National Telecommunications Conference[C],New Orleans,LA,USA,1981.
[20]ZHU Shan,MA Kai2kuang.A new diamond search algorithm for fast block matching motion estimation[J].IEEE Transactions on Image Processing,2000,9(2):287-290.
[21]LI Ren-xiang,ZENG Bing,LIOU Ming.A new three step search algorithm for block motion estimation[J].IEEE Transactions on Circuits System Video Technology,1994,4(4):438-442.
[22]Jehng Yeu-Shen,Chen Liang-Gee,Chiueh Tzi-Dar.An efficient and simple VLSI tree architectures formotion estimation algorithms[J].IEEE Transactions on Signal Processing,1993,41(2):889-900
[23]H.T.Kung,"why systolic architecture?",IEEE comput,pp.37-46,January 1984.
[24]Chaur-Hen Hsieh and Ting-Pang Lin,"VLSI Architecture for Block- Matching Motion Estimation Algorithm",IEEE Trans.Circuits and Systems,,1992,Vol.2,No.2.
[25]Lam CW,Po LM,Cheung CH.A novel kite-cross- diamond search algorithm for fast block matching motion estimation,2004 IEEE International symposium on circuits and systems,VOL 3,2004,proceedings:729-732.
[26]S.Kappagantula,K.R.Rao,Motion compensated predictive coding,SPIE 27th Proc.1985,G4-70.
[27]T.Koyat,K.limuma,A.Hirano et al,Motion compensated inter-frame coding for videw conferencing,Proc.NTC81,New Orleans,LA,Now 1981,C9.6.1-9.6.5
[28]马文龙,基于矢量量化技术的图像编码[D].西安:西安理工大学,2005
[29]简宏伦,精通Verilog HDL:IC设计核心技术实例详解[M].第一版.北京:电子工业出版社,2005
[30]徐睿,专用集成电路设计分析[J].微电子技术,2003,(06)
[31]任艳颖,王彬.IC设计基础[M].第一版.西安:西安电子科技大学出版社,2003
[32]夏宇闻.Verilog数字系统设计教程[M].第一版.北京:北京航空航天大学出版社,2003
[33]梅魁志,郑南宁,刘跃虎等.一种高效流水低存储的JPEG2000编码芯片设计 [J].电子与信息学报,2006,28(4):741-746.
[34]徐志军,徐光辉.CPLD/FPGA的开发与应用[M].北京:电子工业出版社,2002:12-16.
[35]Cyclone Ⅱ Device Handbook,Volume 1 101 Innovation Drive San Jose,CA 95134(408)544-7000,http://www.altera.com.
[2]LIU Lei- bo,CHEN Ning,MENG Hon- ying.A VLSI Architecture of JPEG2000Encoder[J].IEEE Journal of Solid- State Circuits,2004,39(11):2032-2040.
[3]刘雷波.JPEG2000静止图像压缩关键技术研究及VLSI实现[D].北京:清华大学,2004.
[4]"Information Technology-Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbit/s-Part 2:Video," JTC1/SC29/WG11,ISO/IEC 11172-2(MPEG-1 Video),1993.
[5]"Generic Coding of Moving Pictures and Associated Audio Information-Part 2:Video,"ITU-T and ISO/IEC JTC 1,ITU Rec.H.262-ISO/IEC 13 818-2(MPEG-2 Video),1994.
[6]"Information Technology-Coding of Audio Visual Objects-Part 2Visual,"JTC1/SC29/WG11,ISO/IEC 14 469-2(MPEG-4 Visual),2000.
[7]"Video Codec for Audiovisual Services at p_64 kbit=s,"ITU-TSG15,ITU-TRec.H.261,2ed.,1993.
[8]"Video Coding for Low Bit Rate Communication," ITU-TSG16,ITU-TRec.H.263,3rd ed.,2000.
[9]Draft ITU-T Recommendation and Final Draft Inter-national Standard of Joint Video Specification,Joint Video Team,May 2003.
[10]C.Chakrabarti,M.Vishwanath,"Efficient realization of the discrete and continuous wavelet transforms:from single chip implementations to mappings on SIMD array computers",IEEE Trans.Signal Processing,1995,43:759-771.
[11]Linde Y,Buzo A,Gray R M.An algorithm for vector quantizer design.IEEE Trans Communication,Jan 1980,COM-28:84-95.
[12]J Shanbehzadeh,On the computational complexity of the LBG and PNN algorithms,IEEE Transactions on IP,1997.6.04,614-616
[13]Effros M,Chou P A,Riskin E A.etal.A progressive universal noiseless coder[J].IEEE Transactions on Information Theory,1994,40(1):108-117
[14]Jianping Pan,Fischer T R.Two-stage vector quantization-lattice vector quantization[J].IEEE Transactions on Information Theory,1995,41(1):155-163
[15]Hwang Wenjyi,Huang Yuchun.Multistage motion vector quantization for video coding [J].Optical Engineering,2000,39(7):1994-2002
[16]Kuo Chungming,Hsieh Chaurheh,Weng Shiuhku.Predictive search algorithm for vector quantization of images[J].Optical Engineering,2002,41(5):1104-1114
[17]沈兰荪,卓力,田 栋,等,视频编码与低速率传输[M].北京:电子工业出版社,2002,1 28-29
[18]银磊,余宁梅,马文龙,王冬芳.基于方向性的VQ编码算法[J].计算机工程与应用.2005,41(14):44-45
[19]Iinuma K,Hirano A,Baik H,et al.Motion compensated inter-frame coding for video conferencing[A].In:National Telecommunications Conference[C],New Orleans,LA,USA,1981.
[20]ZHU Shan,MA Kai2kuang.A new diamond search algorithm for fast block matching motion estimation[J].IEEE Transactions on Image Processing,2000,9(2):287-290.
[21]LI Ren-xiang,ZENG Bing,LIOU Ming.A new three step search algorithm for block motion estimation[J].IEEE Transactions on Circuits System Video Technology,1994,4(4):438-442.
[22]Jehng Yeu-Shen,Chen Liang-Gee,Chiueh Tzi-Dar.An efficient and simple VLSI tree architectures formotion estimation algorithms[J].IEEE Transactions on Signal Processing,1993,41(2):889-900
[23]H.T.Kung,"why systolic architecture?",IEEE comput,pp.37-46,January 1984.
[24]Chaur-Hen Hsieh and Ting-Pang Lin,"VLSI Architecture for Block- Matching Motion Estimation Algorithm",IEEE Trans.Circuits and Systems,,1992,Vol.2,No.2.
[25]Lam CW,Po LM,Cheung CH.A novel kite-cross- diamond search algorithm for fast block matching motion estimation,2004 IEEE International symposium on circuits and systems,VOL 3,2004,proceedings:729-732.
[26]S.Kappagantula,K.R.Rao,Motion compensated predictive coding,SPIE 27th Proc.1985,G4-70.
[27]T.Koyat,K.limuma,A.Hirano et al,Motion compensated inter-frame coding for videw conferencing,Proc.NTC81,New Orleans,LA,Now 1981,C9.6.1-9.6.5
[28]马文龙,基于矢量量化技术的图像编码[D].西安:西安理工大学,2005
[29]简宏伦,精通Verilog HDL:IC设计核心技术实例详解[M].第一版.北京:电子工业出版社,2005
[30]徐睿,专用集成电路设计分析[J].微电子技术,2003,(06)
[31]任艳颖,王彬.IC设计基础[M].第一版.西安:西安电子科技大学出版社,2003
[32]夏宇闻.Verilog数字系统设计教程[M].第一版.北京:北京航空航天大学出版社,2003
[33]梅魁志,郑南宁,刘跃虎等.一种高效流水低存储的JPEG2000编码芯片设计 [J].电子与信息学报,2006,28(4):741-746.
[34]徐志军,徐光辉.CPLD/FPGA的开发与应用[M].北京:电子工业出版社,2002:12-16.
[35]Cyclone Ⅱ Device Handbook,Volume 1 101 Innovation Drive San Jose,CA 95134(408)544-7000,http://www.altera.com.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |