多媒体文档管理系统中视频传输的差错控制技术研究
|
摘要
随着人类社会的信息化,多媒体应用已经渗透到人们生活的各个领域。20世纪90年代以来,Internet和移动通信的迅猛发展,使视频信息在Internet网络中的处理及传输技术成为多媒体文档管理中的热点。但是在IP网和各种无线网络中,误码的产生和数据的丢失是不能避免的,产生的误码还容易发生扩散,从而造成视频质量严重下降。由于传输效率和实时性等要求,过强的纠错编码和重传机制等差错控制方法并不适用于视频数据传输,因而研究视频传输的差错控制技术显得尤为重要。
本文研究了传统的视频编码模式,对MPEG和H.26x两大系列视频编码标准的发展做了简要介绍,分析了这些主要视频编码标准的关键技术和各自的特点。在研究各种视频编码标准和当前国内外关于视频编解码及传输的容错技术的基础上,主要针对视频解码端的错误隐藏技术做了一些工作。文中基于H.264视频压缩编码,研究了在IP网络下视频传输的差错控制和错误隐藏问题,介绍了一些较成熟研究成果的典型差错恢复技术,主要有分层编码、多描述编码等,详细阐述了它们的基本原理并分析了各自的优缺点。在文中还对H.264标准中的差错恢复工具进行了研究。
本文深入研究了空域隐藏和时域隐藏等解码端差错恢复技术,针对时域隐藏的运动矢量恢复问题,为了尽量减少解码器差错恢复的计算复杂度,结合时域错误隐藏算法和空域错误隐藏算法的优点,提出了一种时空域综合误码掩盖算法。初步测试表明,采用这种算法可获得更好的差错隐藏效果。
In recent years, with the development of electronic technology, computer science and network technology, video communication on the network was applied widely. A lot of network multimedia services appeared. Video information processing and transmission technology in the multimedia document management has become an important issue. With the wide application video communication, errors and losses of video data are inevitable in IP network or wireless network. The highly compressed video data are more sensitive for errors, and a bit errors can ultimately lead to uncountable errors, so it is necessary to add effective error control technology into the encoder and add error concealment into the decoder of a video communication system.
A brief introduction of traditional video compression technologies and the development of MPEG and H.26x are given. The paper analyzed the key technologies and characteristics of the video compression standards. This dissertation deals with the issues of video coding and transmission over unreliable channels. Based on the video coding standards and many error resilient technologies at present, the paper presented some schemes on error resilience emphasis on error concealment techniques. Some typical and mature error resilient technologies are introduced, for example layer coding and multiple description coding, and the principle and disadvantages of these technologies are analyzed too. Many characteristic error resilient tools in H.264 standard are researched.
Based on the in-depth study on temporal error concealment and spatial error concealment, adaptive spatial-temporal error concealment is proposed to satisfy the requirements on accuracy. Preliminary tests show that this algorithm takes better effects of error concealment.
本文研究了传统的视频编码模式,对MPEG和H.26x两大系列视频编码标准的发展做了简要介绍,分析了这些主要视频编码标准的关键技术和各自的特点。在研究各种视频编码标准和当前国内外关于视频编解码及传输的容错技术的基础上,主要针对视频解码端的错误隐藏技术做了一些工作。文中基于H.264视频压缩编码,研究了在IP网络下视频传输的差错控制和错误隐藏问题,介绍了一些较成熟研究成果的典型差错恢复技术,主要有分层编码、多描述编码等,详细阐述了它们的基本原理并分析了各自的优缺点。在文中还对H.264标准中的差错恢复工具进行了研究。
本文深入研究了空域隐藏和时域隐藏等解码端差错恢复技术,针对时域隐藏的运动矢量恢复问题,为了尽量减少解码器差错恢复的计算复杂度,结合时域错误隐藏算法和空域错误隐藏算法的优点,提出了一种时空域综合误码掩盖算法。初步测试表明,采用这种算法可获得更好的差错隐藏效果。
In recent years, with the development of electronic technology, computer science and network technology, video communication on the network was applied widely. A lot of network multimedia services appeared. Video information processing and transmission technology in the multimedia document management has become an important issue. With the wide application video communication, errors and losses of video data are inevitable in IP network or wireless network. The highly compressed video data are more sensitive for errors, and a bit errors can ultimately lead to uncountable errors, so it is necessary to add effective error control technology into the encoder and add error concealment into the decoder of a video communication system.
A brief introduction of traditional video compression technologies and the development of MPEG and H.26x are given. The paper analyzed the key technologies and characteristics of the video compression standards. This dissertation deals with the issues of video coding and transmission over unreliable channels. Based on the video coding standards and many error resilient technologies at present, the paper presented some schemes on error resilience emphasis on error concealment techniques. Some typical and mature error resilient technologies are introduced, for example layer coding and multiple description coding, and the principle and disadvantages of these technologies are analyzed too. Many characteristic error resilient tools in H.264 standard are researched.
Based on the in-depth study on temporal error concealment and spatial error concealment, adaptive spatial-temporal error concealment is proposed to satisfy the requirements on accuracy. Preliminary tests show that this algorithm takes better effects of error concealment.
引文
[1] ISO/JTC1/SC29/WG11, Information Technology——Coding of Audio-Visual Object[M], Dec. 1998.
[2] Steven Gringeri, Sami Iren, and Roman Egorov, Transmission of MPEG-4 Video over the Internet, IEEE, 2000:1767-1770.
[3]卓力,沈兰荪,朱青.视频流关键技术的研究进展[J].电子学报, vol.30, no.8, 2002:1213-1218.
[4]阮俊波,牛建伟,基于Internet的视频流技术研究[J].航空学报,2003,24(1):53-56.
[5] Jean-Chrysostome Bolot, Characterizing End-to-End Packet Delay and Loss in the Internet[J], Journal of High-Speed Networks, vol.2, no.3, 1993:305-323.
[6]王瑶等著,视频处理与通信[M].北京:电子工业出版社,2003.
[7]朱红,吴成柯,方勇等.面向Internet传输的多描述可分级视频编码[J],电子与信息学报,vol.27, no.1, 2005:112-115.
[8] (意)玛格赫丽塔·帕加尼著,多媒体与数字互动电视:把握数字融合所创造的机会[M].北京:人民邮电出版社, 2006.08.
[9]张朝鹏,倪江群,王春桃.分层多描述视频编码及其在差错网络环境下的仿真研究[J].通信学报, vol.26, no.7, 2005:129-135.
[10]孙学康,石方文,刘勇编著.多媒体通信技术[M].北京邮电大学出版社.2006.05.第一版.
[11]詹青龙主编.网络视频技术及应用[M].西安电子科技大学出版社. 2004.01.
[12]余兆明等编著,图像编码H.264标准与关键技术[M].人民邮电出版社. 2006.03.
[13]高文.多媒体数据压缩技术[M].北京:电子工业出版社.1999,4.
[14]李浩鹏,盛翊智.基于H.264标准的视频传输技术[J].计算机与数字工程,2005,34(2):44-46.
[15] Shigang Chen and Klara Nahrstedt,“An Overview of Quality-of-Service Routing for the Next Generation High-Speed Networks:Problems and Solutions”,IEEE Network, Special Issue on Transmission and Distribution of Digital Video, 1998, pp: 64-79.
[16] Ch. Bouras, A.Gkamas. Multimedia transmission with adaptive QoS based on real-time protocols. International Journal of Communication Systems, 2003,16:225-248.
[17]毕厚杰.新一代视频压缩编码标准——H.264[M].北京:人民邮电出版社,2005.
[18]姚庆栋,毕厚杰,王兆华等.图像编码技术(第3版).北京:清华大学出版社, 2006.
[19] Wang Y, Step han Wenger, Wen Jiangtao, et al. Error resilient coding techniques[J]. IEEE Signal Processing Magazine, 2000,61-82.
[20] Wenping Li. Overview of fine granularity scalability in MPEG-4 video standard[J]. IEEE Transactions on Circuits and Systems for Video Technology. 2001,11(3):301-317
[21] Dapeng Wu, Yiwei Thoms Hou, Ya-Qin Zhang. Transporting real-time video over the Internet: challenges and approaches[J]. Proceedings of the IEEE,2000,33(12):185-1877.
[22]徐林铃.基于H.264的视频压缩关键技术的研究.[硕士学位论文].长沙:国防科技大学研究生院,2003.
[23]李秋云,郝建国,陈鹏.流媒体业务及技术发展[J].数据通信.2004,21:27-29.
[24]李向阳,卞德森.流媒体及其应用技术[J].现代电视技术.2002,4:18-27.
[25]李睿,曾德贤.流媒体关键技术及面临的问题[J].现代电视技术.2005,5:92-95.
[26] Wiegand T,Sullivan G J, Bjntegaard G. et al. Overview of the H.264/AVC Coding Standard[J]. IEEE Trans. On Circuits and Systems for Video Technology.2003,13:560-576.
[27]刘梦娟.异构网络环境下流媒体传输机制的研究.[博士学位论文]合肥:中国科技大学,2007.
[28]穆爽.基于H.264视频传输的差错控制技术研究.[硕士学位论文].长春:长春理工大学, 2009.
[29] Baohua Zhang, Changcheng Huang, M. Devetsikiotis. Simulated Annealing Based Bandwidth Teservation for QoS Touting[J]. Proc. Of IEEE International Conference on Communications, 2006,932-937..
[30] M.Wada. Selective recovery of video packet loss using error concealment[J].IEEE Journal of Selected Areas on Communication, 1989,7(5):807-814.
[31]郭宝龙,倪伟,闫允一编著,通信中的视频信号处理[M].北京:电子工业出版社.2007.
[32]廖建新.流媒体系统的关键技术研究. [博士学位论文].北京:北京邮电大学.2006.
[33] Yuwen Wu, Yongying Gao, Ying Chen. Bit-depth scalability compatible to H.264/AVC-scalable extension[J]. Visual Communication and Image Representation. 2008,19:372-381.
[34] Catherine Holahan. Long Live the Net Video Revolution[J]. Business Week Online.2007,26:12-12.
[35] Rongfu Z, Yuanhua Z, Xiaodong H. Content-adaptive spatial error concealment for video communication[J]. IEEE Trans on Consumer Electronics, 2004,50(1):225-241.
[36]廖伟.基于H.264的网络视频传输差错控制技术的研究.[硕士学位论文].武汉:武汉理工大学,2008.
[37]蔡旻,宋建新.常用的多描述编码方法[J].电视技术,2005.(12):34-37.
[38]胡广.基于RUDP的可靠性传输系统.[硕士学位论文].武汉:武汉理工大学,?2006.
[39] Jong Won Kim. TCP-Friendly Internet video streaming employing variable frame-rate encoding and interpolation. IEEE Transactions on Circuits and Systems for Video Technology. 2000,10(7):1164-1177
[40] V Jacobson. Congestion Avoidance and Control. Proc. SIGCOMM. Stanford, CA, USA. 1988,314-319
[41] Dapeng Li. Streaming Video over the Internet: Approaches and Directions. IEEE Transactions on Circuits and Systems for Video Technology, 2001,11(1):1-20
[42] Jian Lu. Signal Processing for Internet Video Streaming: A review. Proceedings of SPIE Image and Video Communications and Processing, San Jose, CA USA, 2000.1-14.
[43]马宏兴.基于H.264/AVC帧间预测编码模式快速选择算法研究[硕士学位论文].成都:西南交通大学计算机学院,2006.
[44]马宇峰,蔡安妮.一种基于H.264 Intra帧的差错隐藏方法[J].北京邮电大学学报, 2006,29(01):119-123.
[45]戴虎.基于H.264/AVC的码率控制算法的研究.[硕士学位论文].武汉:武汉理工大学,2006.
[46]凌波,顾伟康,杜歆. H.264整帧丢失下的错误隐藏机制[J].浙江大学学报(工学版).2009,43(9):1732-1738.
[47] Xu Yanling, Zhou Yuanhua. H.264 video communication based refined error concealment schemed[J].Consumer Electronics, IEEE Transactions,2004,50(4):1135-1141.
[48]宋彬,常义林.视频通信抗误码方法研究的新进展[J].电子学报. 2002,30(10):1514-1518.
[49]安维嵘,张旭东.一种适用于H.264的时域差错掩盖改进算法[J].中国图像图形学报.2004,9:1125-1129.
[50]徐燕凌,周源华. H.264视频码流时域误码掩盖算法的改进[J].上海交通大学学报. 2005,39(9):1530-1533.
[51]高绍帅,涂国防.基于H.263视频解码的错误检测和掩盖[J].通信学报. 2001,22(12):82-87.
[52]冯镔,朱光喜,刘文予.基于H.264/AVC的时空域差错隐藏方案[J].通信学报. 2007,28(4):72-79.
[2] Steven Gringeri, Sami Iren, and Roman Egorov, Transmission of MPEG-4 Video over the Internet, IEEE, 2000:1767-1770.
[3]卓力,沈兰荪,朱青.视频流关键技术的研究进展[J].电子学报, vol.30, no.8, 2002:1213-1218.
[4]阮俊波,牛建伟,基于Internet的视频流技术研究[J].航空学报,2003,24(1):53-56.
[5] Jean-Chrysostome Bolot, Characterizing End-to-End Packet Delay and Loss in the Internet[J], Journal of High-Speed Networks, vol.2, no.3, 1993:305-323.
[6]王瑶等著,视频处理与通信[M].北京:电子工业出版社,2003.
[7]朱红,吴成柯,方勇等.面向Internet传输的多描述可分级视频编码[J],电子与信息学报,vol.27, no.1, 2005:112-115.
[8] (意)玛格赫丽塔·帕加尼著,多媒体与数字互动电视:把握数字融合所创造的机会[M].北京:人民邮电出版社, 2006.08.
[9]张朝鹏,倪江群,王春桃.分层多描述视频编码及其在差错网络环境下的仿真研究[J].通信学报, vol.26, no.7, 2005:129-135.
[10]孙学康,石方文,刘勇编著.多媒体通信技术[M].北京邮电大学出版社.2006.05.第一版.
[11]詹青龙主编.网络视频技术及应用[M].西安电子科技大学出版社. 2004.01.
[12]余兆明等编著,图像编码H.264标准与关键技术[M].人民邮电出版社. 2006.03.
[13]高文.多媒体数据压缩技术[M].北京:电子工业出版社.1999,4.
[14]李浩鹏,盛翊智.基于H.264标准的视频传输技术[J].计算机与数字工程,2005,34(2):44-46.
[15] Shigang Chen and Klara Nahrstedt,“An Overview of Quality-of-Service Routing for the Next Generation High-Speed Networks:Problems and Solutions”,IEEE Network, Special Issue on Transmission and Distribution of Digital Video, 1998, pp: 64-79.
[16] Ch. Bouras, A.Gkamas. Multimedia transmission with adaptive QoS based on real-time protocols. International Journal of Communication Systems, 2003,16:225-248.
[17]毕厚杰.新一代视频压缩编码标准——H.264[M].北京:人民邮电出版社,2005.
[18]姚庆栋,毕厚杰,王兆华等.图像编码技术(第3版).北京:清华大学出版社, 2006.
[19] Wang Y, Step han Wenger, Wen Jiangtao, et al. Error resilient coding techniques[J]. IEEE Signal Processing Magazine, 2000,61-82.
[20] Wenping Li. Overview of fine granularity scalability in MPEG-4 video standard[J]. IEEE Transactions on Circuits and Systems for Video Technology. 2001,11(3):301-317
[21] Dapeng Wu, Yiwei Thoms Hou, Ya-Qin Zhang. Transporting real-time video over the Internet: challenges and approaches[J]. Proceedings of the IEEE,2000,33(12):185-1877.
[22]徐林铃.基于H.264的视频压缩关键技术的研究.[硕士学位论文].长沙:国防科技大学研究生院,2003.
[23]李秋云,郝建国,陈鹏.流媒体业务及技术发展[J].数据通信.2004,21:27-29.
[24]李向阳,卞德森.流媒体及其应用技术[J].现代电视技术.2002,4:18-27.
[25]李睿,曾德贤.流媒体关键技术及面临的问题[J].现代电视技术.2005,5:92-95.
[26] Wiegand T,Sullivan G J, Bjntegaard G. et al. Overview of the H.264/AVC Coding Standard[J]. IEEE Trans. On Circuits and Systems for Video Technology.2003,13:560-576.
[27]刘梦娟.异构网络环境下流媒体传输机制的研究.[博士学位论文]合肥:中国科技大学,2007.
[28]穆爽.基于H.264视频传输的差错控制技术研究.[硕士学位论文].长春:长春理工大学, 2009.
[29] Baohua Zhang, Changcheng Huang, M. Devetsikiotis. Simulated Annealing Based Bandwidth Teservation for QoS Touting[J]. Proc. Of IEEE International Conference on Communications, 2006,932-937..
[30] M.Wada. Selective recovery of video packet loss using error concealment[J].IEEE Journal of Selected Areas on Communication, 1989,7(5):807-814.
[31]郭宝龙,倪伟,闫允一编著,通信中的视频信号处理[M].北京:电子工业出版社.2007.
[32]廖建新.流媒体系统的关键技术研究. [博士学位论文].北京:北京邮电大学.2006.
[33] Yuwen Wu, Yongying Gao, Ying Chen. Bit-depth scalability compatible to H.264/AVC-scalable extension[J]. Visual Communication and Image Representation. 2008,19:372-381.
[34] Catherine Holahan. Long Live the Net Video Revolution[J]. Business Week Online.2007,26:12-12.
[35] Rongfu Z, Yuanhua Z, Xiaodong H. Content-adaptive spatial error concealment for video communication[J]. IEEE Trans on Consumer Electronics, 2004,50(1):225-241.
[36]廖伟.基于H.264的网络视频传输差错控制技术的研究.[硕士学位论文].武汉:武汉理工大学,2008.
[37]蔡旻,宋建新.常用的多描述编码方法[J].电视技术,2005.(12):34-37.
[38]胡广.基于RUDP的可靠性传输系统.[硕士学位论文].武汉:武汉理工大学,?2006.
[39] Jong Won Kim. TCP-Friendly Internet video streaming employing variable frame-rate encoding and interpolation. IEEE Transactions on Circuits and Systems for Video Technology. 2000,10(7):1164-1177
[40] V Jacobson. Congestion Avoidance and Control. Proc. SIGCOMM. Stanford, CA, USA. 1988,314-319
[41] Dapeng Li. Streaming Video over the Internet: Approaches and Directions. IEEE Transactions on Circuits and Systems for Video Technology, 2001,11(1):1-20
[42] Jian Lu. Signal Processing for Internet Video Streaming: A review. Proceedings of SPIE Image and Video Communications and Processing, San Jose, CA USA, 2000.1-14.
[43]马宏兴.基于H.264/AVC帧间预测编码模式快速选择算法研究[硕士学位论文].成都:西南交通大学计算机学院,2006.
[44]马宇峰,蔡安妮.一种基于H.264 Intra帧的差错隐藏方法[J].北京邮电大学学报, 2006,29(01):119-123.
[45]戴虎.基于H.264/AVC的码率控制算法的研究.[硕士学位论文].武汉:武汉理工大学,2006.
[46]凌波,顾伟康,杜歆. H.264整帧丢失下的错误隐藏机制[J].浙江大学学报(工学版).2009,43(9):1732-1738.
[47] Xu Yanling, Zhou Yuanhua. H.264 video communication based refined error concealment schemed[J].Consumer Electronics, IEEE Transactions,2004,50(4):1135-1141.
[48]宋彬,常义林.视频通信抗误码方法研究的新进展[J].电子学报. 2002,30(10):1514-1518.
[49]安维嵘,张旭东.一种适用于H.264的时域差错掩盖改进算法[J].中国图像图形学报.2004,9:1125-1129.
[50]徐燕凌,周源华. H.264视频码流时域误码掩盖算法的改进[J].上海交通大学学报. 2005,39(9):1530-1533.
[51]高绍帅,涂国防.基于H.263视频解码的错误检测和掩盖[J].通信学报. 2001,22(12):82-87.
[52]冯镔,朱光喜,刘文予.基于H.264/AVC的时空域差错隐藏方案[J].通信学报. 2007,28(4):72-79.