H.264/AVC视频编码及其差错控制技术研究
|
摘要
H.264/AVC视频压缩标准是ITU-T视频编码专家组(VCEG)和ISO/IEC运动图像专家组(MPEG)共同制定的最新视频压缩国际标准。与先前的视频压缩标准相比,H.264/AVC在压缩性能上有了很大的提高,并具有较高的网络友好性,可以广泛应用于会话(视频电话)和非会话(存储、广播、流媒体)等视频领域。
在H.264/AVC视频编码过程中,编码时间受诸多因素的影响,如帧间/帧内模式选择、运动估计(ME)、率失真优化(RDO)等。为了以较快速度和较好质量进行编码,针对H.264/AVC帧内模式选择,本文提出了一种适用于H.264/AVC帧内4×4块预测的模式选择快速算法。该算法利用帧内4×4块最优预测模式与和它相邻的预测模式之间率失真代价(RD Cost)的高相关性,以及绝对变换误差和(SATD)与率失真(RD)性能之间的强相关性,有效地跳过一些不太可能的预测模式,从而使帧内4×4块预测模式选择过程只需进行4次率失真代价计算即可。实验结果显示,该算法在编码性能和编码速度之间取得了很好的折衷。
由于无线信道条件不稳定以及IP网络只提供“尽力而为”服务的原因,视频信号在无线网络和IP网络中传输极易产生包丢失等错误。本文针对I帧视频图像,提出了一种适用于H.264/AVC帧内宏块的空域错误隐藏算法。该算法利用相邻块边界的方向信息,在方向内插和线性内插(Bilinear Interpolation, BI)之间做出选择。其中,方向内插是为了确保图像边缘信息得到正确恢复,线性内插是为了避免产生错误的边缘信息。实验结果显示,该算法可以较准确地恢复出具有边缘纹理特性的区域,主客观质量均优于参考软件中使用的加权平均错误隐藏算法。
The H.264/MEPG-4 Advanced Video Coding standard (H.264/AVC) is the newest video coding standard jointly developed by the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). H.264/AVC has achieved a significant improvement in compression performance compared to prior standards, and it provides a network-friendly representation of the video that addresses both conversational (video telephony) and nonconversational (storage, broadcast, or streaming) application.
In the video-encoding process, the encoding time is greatly influenced by many factors, such as inter/intra mode decision, motion estimation (ME), etc. In order to encode the video with faster speed and better quality, this paper only focuses on the intra mode decision in H.264/AVC and presents a fast intra prediction mode decision algorithm for 4×4 blocks in H.264/AVC. The proposed algorithm uses: (i) high correlation of RD cost between best prediction mode and its neighborhood prediction mode, (ii) strong correlation between sums of absolute transform differences (SATD) and rate distortion (RD) performance, efficiently skipping some unlikely prediction modes. Thus, it can complete 4×4 intra prediction by only computing RD cost for four times. The experimental results show that the proposed algorithm is a good compromise between the coding performance and the encoding speed.
Video transmission over wireless network and IP network can suffer from errors, due to fluctuating channel conditions, which appear in the form of packet erasures. This paper only focuses on the intra frame and presents a highly effective spatial error concealment algorithm that can be used on intra macroblocks in H.264/AVC. It uses the direction information of neighboring edges for deciding between DI (ensuring edge preservation) and BI (avoiding the creation of false edges). The experimental results show that the proposed algorithm can preserves edges and textured areas without creating new false ones, and give better subjective (and objective) quality over the commonly used weighted pixel value averaging.
在H.264/AVC视频编码过程中,编码时间受诸多因素的影响,如帧间/帧内模式选择、运动估计(ME)、率失真优化(RDO)等。为了以较快速度和较好质量进行编码,针对H.264/AVC帧内模式选择,本文提出了一种适用于H.264/AVC帧内4×4块预测的模式选择快速算法。该算法利用帧内4×4块最优预测模式与和它相邻的预测模式之间率失真代价(RD Cost)的高相关性,以及绝对变换误差和(SATD)与率失真(RD)性能之间的强相关性,有效地跳过一些不太可能的预测模式,从而使帧内4×4块预测模式选择过程只需进行4次率失真代价计算即可。实验结果显示,该算法在编码性能和编码速度之间取得了很好的折衷。
由于无线信道条件不稳定以及IP网络只提供“尽力而为”服务的原因,视频信号在无线网络和IP网络中传输极易产生包丢失等错误。本文针对I帧视频图像,提出了一种适用于H.264/AVC帧内宏块的空域错误隐藏算法。该算法利用相邻块边界的方向信息,在方向内插和线性内插(Bilinear Interpolation, BI)之间做出选择。其中,方向内插是为了确保图像边缘信息得到正确恢复,线性内插是为了避免产生错误的边缘信息。实验结果显示,该算法可以较准确地恢复出具有边缘纹理特性的区域,主客观质量均优于参考软件中使用的加权平均错误隐藏算法。
The H.264/MEPG-4 Advanced Video Coding standard (H.264/AVC) is the newest video coding standard jointly developed by the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). H.264/AVC has achieved a significant improvement in compression performance compared to prior standards, and it provides a network-friendly representation of the video that addresses both conversational (video telephony) and nonconversational (storage, broadcast, or streaming) application.
In the video-encoding process, the encoding time is greatly influenced by many factors, such as inter/intra mode decision, motion estimation (ME), etc. In order to encode the video with faster speed and better quality, this paper only focuses on the intra mode decision in H.264/AVC and presents a fast intra prediction mode decision algorithm for 4×4 blocks in H.264/AVC. The proposed algorithm uses: (i) high correlation of RD cost between best prediction mode and its neighborhood prediction mode, (ii) strong correlation between sums of absolute transform differences (SATD) and rate distortion (RD) performance, efficiently skipping some unlikely prediction modes. Thus, it can complete 4×4 intra prediction by only computing RD cost for four times. The experimental results show that the proposed algorithm is a good compromise between the coding performance and the encoding speed.
Video transmission over wireless network and IP network can suffer from errors, due to fluctuating channel conditions, which appear in the form of packet erasures. This paper only focuses on the intra frame and presents a highly effective spatial error concealment algorithm that can be used on intra macroblocks in H.264/AVC. It uses the direction information of neighboring edges for deciding between DI (ensuring edge preservation) and BI (avoiding the creation of false edges). The experimental results show that the proposed algorithm can preserves edges and textured areas without creating new false ones, and give better subjective (and objective) quality over the commonly used weighted pixel value averaging.
引文
[1] Ye-Kui Wang, Miska M. Hannuksela, Viktor Varsa. The Error Concealment Feature in the H.26L Test Model. Proceedings. 2002 International Conference on Image Processing[C]. 2002, vol.2, no.2, pp.729-732.
[2] S. Wenger, T. Stockhammer. An Overview on the H.264 NAL Concept[S]. JVT-B028 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 2nd Meeting[C]. Geneva, Switzerland, 2002.
[3] Ralf Schafer, Thomas Wiegand, Heiko Schwarz. The Emerging H.264/AVC Standard. EBU Technical Review, Jan. 2003. http://www.ebu.ch/en/technical/trev/trev_293-schaefer.pdf
[4] Massimo Ravasi, Marco Mattavelli, Christophe Clere. A Computational Complexity Comparison of MPEG-4 and JVT Codecs[S]. JVT-D153r1-L in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 4th Meeting[C]. Klagenfurt, Austria, 2002.
[5] D. Agrafiotis, D. R. Bull, T. K. Chiew, et al. Enhanced Error Concealment for Video Transmission Over Wireless LANs. Proc. Int. Workshop Image Anal. Multimedia Interactive Services[C]. 2005, pp.435-442.
[6] D. Agrafiotis, T. K. Chiew, P. Ferre, et al. Seamless Wireless Networking for Video Surveillance Applications. Proc. SPIE Image Video Commun. Process.[C]. 2005, vol.5685, no.2, pp.39-53.
[7] Y. Wang, S. Wenger, J. Wen, et al. Error Resilient Video Coding Techniques-Real Time Video Communications over Unreliable Networks. IEEE Signal Process. Mag.[J]. 2000, vol.17, no.4, pp.61-82.
[8] Y. Wang and Q.-F. Zhu. Error Control and Concealment for Video Communication: A Review. Proc. IEEE[C]. 1998, vol.86, no.5, pp.974-997.
[9] 韩青,李莉,应骏. H.264 帧内 4×4 块预测模式选择快速算法研究. 中国图象图形学报[J]. 2007,12(10):1745-1748.
[10] ITU-T. Recommendation H.263: Video Coding for Low Bitrate Communication[S]. 1995.
[11] ITU-T Recommendation H.263 Version2: Video Coding for Low Bitrate Communication[S]. 1998.
[12] ITU-T Draft for H.263++. Annexes U, V, and W to Recommendation H.263[S]. 2000.
[13] ISO/IEC.IS 11172: Information Technology – Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbits/s[S]. 1993 (MPEG-1).
[14] ISO/IEC.IS 13818-1: Information Technology – Generic Coding of Moving Pictures and Associated Audio Information – Part7: Advanced Audio Coding (ACC)[S]. 1997 (MPEG-2 ACC)
[15] ISO/IEC.IS 14496-X: Information Technology – Coding of Audio-Visual Objects. 1999 (MPEG-4).
[16] Jose M. Martinez. ISO/IEC JTC1/SC29/WG11 N3752: Overview of the MPEG-7 Standard (v4.0)[S]. La Baule. 2000.
[17] ISO/IEC JTC1/SC29/WG11 MPEG/N 3002 : First Ideas on Defining A Multimedia Framework (v0.1)[S]. Melbourne. 1999.
[18] ITU-T TSG 16: Draft Call for Proposal for H.26L Video Coding[S]. ITU-T VCEG 16, 1998.
[19] Thomas Wiegand, Gary Sullivan, Ajay Luthra. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC)[S]. JVT-G050r1 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 8th Meeting[C]. Geneva, Switzerland, 2003.
[20] Jun Zhang, Xiaoquan Yi, Nam Ling, Weijia Shang. Context Adaptive Lagrange Multiplier (CALM) for Motion Estimation in JM – Improvement[S]. JVT-T046 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 20th Meeting[C]. Klagenfurt, Austria, 2006.
[21] Wiegand Thomas, Sullivan Gary J, Bjontegaard Gisle, et al. Overview of The H.264/AVC Video Coding Standard. IEEE Transaction on Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.560-576.
[22] GB/T 20090.2—2006 中华人民共和国国家标准 信息技术 先进音视频编码 第二部分:视频[S]. 国家质量监督检验检疫总局, 2006.
[23] Final Committee Draft of Joint Video Specification. ITU-T Recommendation H.264 and ISO/IEC 14496-10 Advanced Video Coding (AVC). 2002.
[24] Atul Puria, Xuemin Chenb, Ajay Luthra. Video Coding Using the H.264/MPEG-4 AVC Compression Standard. Signal Processing: Image Communication[J]. 2004.
[25] Thomas Stockhammer, Miska M. Hannuksela, Thomas Wiegand. H.264/AVC in Wireless Environments. IEEE Trans. Circuits Syst. Video Technol.[J]. 2003, vol.13, no.7, pp.657-673.
[26] Stephan Wenger. H.264/AVC Over IP. IEEE Trans. Circuits Syst. Video Technol.[J]. 2003, vol.13, no.7, pp.645-656.
[27] Tu-Chih Wang, Hung-Chi Fang, Liang-Gee Chen. Low-Delay and Error-Robust Wireless Video Transmission for Video Communications. IEEE Trans. Circuits Syst. Video Technol.[J]. 2002, vol.12, no.12, pp.1049-1058.
[28] Yan Lu, Wen Gao, Feng Wu. Sprite Generation for Frame-Based Video Coding. Proceedings. 2001 International Conference on Image Processing[C]. 2001, vol.1, pp.437-476.
[29] Yan Lu, Wen Gao, Feng Wu. High Efficient Sprite Coding With Directional Spatial Prediction. Proceedings. 2002 International Conference on Image Processing[C]. 2002, vol.1, no.1, pp.201-204.
[30] Wiegand T, Zhang X Z, Girod B. Long-Term Memory Motion-Compendated Prediction. IEEE Transaction on Circuits and Systems for Video Technology[J]. 1999, vol.9, no.1, pp.70-84.
[31] Henrique S. Malvar, Antti Hallapuro, Marta Karczewicz, et al. Low-Complexity Transform and Quantization in H.264/AVC. IEEE Trans. Circuits Syst. Video Technol[J]. 2003, vol.13, no.7, pp.598-603.
[32] Detlev Marpe, Heiko Schwarz, Thomas Wiegand. Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard. IEEE Trans. On Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.620-635.
[33] M.-C. Hong, H.-S. Hahn. A Loop/Post Filter to Suppress Blocking and Ringing Artifacts for H.26L Video Codec. Proceedings. 2002 International Conference on Image Processing[C]. 2002, vol.1, pp.940-947.
[34] Ce Zhu, Xiao Lin, Lap-Pui Chau, et al. A Novel Hexagon-Based Search Algorithm for Fast Block Motion Estimation. Processings. (ICASSP ’01). 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing[C]. 2001, vol.3, pp.1593-1596.
[35] A. M. Tourapis. Enhanced Predictive Zonal Search for Single and Multiple Frame Motion Estimation. Proc. SPIE Visual Communications and Image Processing[C]. 2002, vol.4671, no.2, pp.1069-1079.
[36] Libo Yang, Keman Yu, Jiang Li, Shipeng Li. An Effective Variable Block-Size Early Termination Algorithm for H.264 Video Coding. IEEE Transaction on Circuits and Systems for Video Technology[J]. 2005, vol.15, no.6, pp.784-788.
[37] Zhibo Chen, Peng Zhou, Yun He. Fast Iinteger Pel and Fractional Pel motion Estimation for JVT[S]. JVT-F017r1 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 6th meeting[C]. Awaji, Island, JP, 5-13, December 2002.
[38] H. C. Tourapis, P. Topiwala. Fast Motion Estimation within The JVT Codec[S]. JVT-E023 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 5th Meeting[C]. Geneva, Switzerland, October 2002.
[39] Hyungjoon Kim, Yucel Altunbasak. Low-Complexity Macroblock Mode Selection for H.264/AVC Encoders. Int. Conf. Image Processing[C]. Singapore, 2004, vol.2, pp.765-768.
[40] Peng PAN, Xiao LIN, et al. Fast Mode Decision for Intra Prediction[S]. JVT-G013r1 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 7th Meeting[C]. Pattaya II, Thailand, 7-14 March, 2003.
[41] Changsung Kim, Hsuan-Huei Shih and C. –C. Jay Kuo. Multistage Mode Decision for Intra Prediction in H.264 Codec. Proceedings of Visual Communications and Image Processing[C]. California, USA,2004, vol.5308, pp.355-363.
[42] K. P. Lim, S. Wu, D. J. Wu, S. Rahardja, X. Lin, F. Pan, Z. G. Li. Fast Inter Mode Selection[S]. JVT-I020 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 9th Meeting[C]. San Diego, US, 2-5 September, 2003.
[43] Byeungwoo Jeon, Jeyun Lee. Fast Mode Decision for H.264[S], JVT-J033 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 10th Meeting, Waikoloa, Hawaii, USA, 8-12 December, 2003.
[44] Ahmad I, Wei X H, Sun Y, et al. Video Transcoding : An Overview of Various Techniques and Research Issues. IEEE Transactions on Multimedia[J]. 2005, vol.7, no.5, pp.793-804.
[45] Su Y P, Xin J, Anthony V, Sun H F. Efficient MPEG-2 to H.264/AVC intra transcoding in transform domain. ISCAS 2005. IEEE International Symposium on Circuits and Systems[J]. 2005, vol.2, pp.1234-1237.
[46] Qian T J, Sun J, Li D, Yang X K, et al. Transform Domain Transcoding from MPEG-2 to H.264 with Interpolation Drift-Error Compensation. IEEE Transactions on Circuits and Systems for Video Technology[J]. 2006, vol.16, no.4, pp.523-534.
[47] Michael Horowitz, Anthony Joch, Faouzi Kossentini, et al. H.264/AVC Baseline Profile Decoder Complexity Analysis. IEEE Trans. On Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.704-716.
[48] Ville Lappalainen, Antti Hallapuro, Timo D. Hamalainen. Complexity of Optimized H.26L Decoder Implementation. IEEE Trans. On Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.717-725.
[49] A. Chang, C. A. Oscar, Y. M. Yeung. A Novel Approach to Fast Multi-Frame Selection for H.264 Video Coding. Proc. IEEE ICASSP’2003[C]. Hong Kong, 2003, vol.3, pp.413-416.
[50] Yu-Wen Huang, Bing-Yu Hsieh, Tu-Chih Wang, et al. Analysis and Reduction of Reference Frames for Motion Estimation in MPEG-4 AVC/JVT/H.264. Proc. IEEE ICASSP’2003[C]. Hong Kong, 2003, vol.3, pp.145-148.
[51] X. Zhou, E. Q. Li, Y.-K. Chen. Implementation of H.264 Decoder on General-Purpose Processors with Media Instructions. In Proc. Of SPIE Conf. On Image and Video Communication and Processing[C]. 2003, vol.5022, pp.224-235.
[52] Richarson and Y. Zhao. Video Encoder Complexity Reduction by Estimating Skip Mode. Int. Conf. Image Processing[C]. Singapore, 2004, vol.1, pp.103-106.
[53] Antonio Ortega, Kannan Ramchandran. Rate-Distortion Methods for Image and Video Compression. IEEE Signal Processing Magazine[J]. 1998, vol.15, no.11, pp.23-50.
[54] Ville Lappalainenl, Timo D. H. Unified Method for Optimization of Several Video Coding Algorithms on General-Purpose Processors. In Proc. 2002, IEEE Int. Conf. Information Technology[C]. 2002, vol.1, pp.431-439.
[55] Tseng Chao-Hsuing, Wang Hung-Ming, Yang Jar-Ferr. Improved and Fast Algorithms for Intra 4×4 Mode Decision in H.264/AVC. Proceedings of IEEE International Symposium on Circuits and Systems[C]. 2005, vol.3, pp.2128-2131.
[56] Zhang Jianning, He Yuwen, et al. A Fast Intra Prediction Method for H.264 Video Coding. G. Tescher Andrew. Proceedings of SPIE Applications of Digital Image Processing[C]. Bellingham, 2003, vol.5203, pp.753-761.
[57] Zhou Minhua. Scalable Intra Prediction[S]. JVT-C033 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 3rd Meeting[C].. Fairfax, Virginia, USA, 2002.
[58] Zhang Yong-dong, Dai Feng, Lin Shou-xun. Fast 4×4 Intra-Prediction Mode Selection for H.264. IEEE International Conference on Multimedia and Expo (ICME 2004)[C]. Taipei, Taiwan, 2004, TP1-4:1151-1154.
[59] Joint Video Team (JVT). Reference software JM8.6[S/OL].http://iphome.hhi.de/suehring/tml/download/
[60] H. Sun, K. Challapali, J. Zdepski. Error Concealment in Digital Simulcast AD-HDTV Decoder. IEEE Trans. Consumer Electron.[J]. 1992, vol.38, pp.108-117.
[61] W. B. Pennebaker, J. L. Mitchell, JPEG Still Image Data Compression Standard[S]. New York: Van Nostrand, 1992.
[62] J.-W. Suh, Y.-S. Ho. Error Concealment Techniques for Digital TV. IEEE Trans. Broadcast.[J]. 2004, vol.48, no.4, pp.299-306.
[63] G. Sullivan, T. Wiegand, K.-P. Lim, Joint Model Reference Encoding Methods and Decoding Concealment Methods[S]. JVT-I049 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 9th Meeting[C]. San Diego, USA, September, 2003.
[64] Zhang, J. F. Arnold, M. R. Frater. A Cell-Loss Concealment Technique for MPEG-2 Coded Video. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.659-665.
[65] T. S. Valente, C. Dufour, F.Groliere, et al. An Efficient Error Concealment Implementation for MPEG-4 Video Streams. IEEE Trans. Consum. Electron.[J]. 2001, vol.47, no.3, pp.568-578.
[66] S. Tsekeridou, I. Pitas. MPEG-2 Error Concealment Based on Block-Matching Principles. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.646-658.
[67] Zhang, J. F. Arnold, M. R. Frater. A Cell-Loss Concealment Technique for MPEG-2 Coded Video. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.659-665.
[68] S. Tsekeridou, I. Pitas. MPEG-2 Error Concealment Based on Block-Matching Principles. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.646-658.
[69] C.-T. Hsu, M.-J. Chen, W.-W. Liao, et al. High Performance Spatial and Temporal Error Concealment Algorithms for Block-Based Video Coding Techniques. Electronics and Telecommunication Research Institute Journal[J]. 2005, vol.27, no.1, pp.53-63.
[70] C. Hong, H. Scwab, L. kondi, A. K. Katsaggelos. Error Concealment Algorithms for Compressed Video. Signal Process.: Image Commun.[J]. 1999, vol.14, pp.473-492.
[71] B. Yan, K. W. Ng. A Novel Selective Motion Vector Matching Algorithm for Error Concealment in MPEG-4 Video Transmission Over Error-Prone Channels. IEEE Trans. Consum. Electron.[J]. 2003, vol.49, no.4, pp.1416-1423.
[72] L.-W. Kang, J.-J. Leou. A Hybrid Error Concealment Scheme for MPEG-2 Video Transmission Based on Best Neighborhood Matching Algorithm. J. Vis. Commun. Image Represent.[J]. 2005, vol.16, no.3, pp.288-310.
[73] Y. Xu, Y. Zhou. H.264 Video Communication Based Refined Error Concealment Schemes. IEEE Trans. Consum. Electron.[J]. 2004, vol.50, no.4, pp.1135-1141.
[74] Y.-C. Lee, Y. Altunbasak, R. Mersereau. Multiframe Error Concealment for MPEG-Coded Video Delivery over Error-Prone Networks. IEEE Trans. Image Process.[J]. 2002, vol.11, no.11, pp.1314-1331.
[75] K. Meisinger and A. Kaup. Spatial Error Concealment of Corrupted Image Data Using Frequency Selective Extrapolation. Proceedings. IEEE International Conference on Acoustics, Speech, and Signal Processing[C]. 2004, vol.3, no.3, pp.209-212.
[76] Y. Wang, Q.-F. Zhu, L. Shaw. Maximally smooth image recovery in transform coding. IEEE Trans. Commun.[J]. 1993, vol.41, no.10, pp.1544-1551.
[77] Z. Alkachouh, M. G. Bellanger. Fast DCT-Based Spatial Domain Interpolation of Blocks in Images. IEEE Transaction on Image Processing[J]. 2000, vol.9, no.4, pp.729-732.
[78] P. Salama, N. B. Shroff, E. J. Delp. Error Concealment in Encoded Video Streams[M]. In Signal Recovery Techniques for Image and Video Compression and Transmission, A. K. Katsaggelos and N. P. Galatsanos, Eds. Norwell, MA: Kluwer, 1998, ch.7.
[79] S.-C. Hsia. An Edge-Oriented Spatial Interpolation for Consecutive Block Error Concealment. IEEE Signal Processing Letters[J]. 2004, vol.11, no.6, pp.577-580.
[80] H. Sun, W. Kwok. Concealment of Damaged Block Transform Coded Images Using Projection onto Convex Set. IEEE Trans. Image Process.[J]. 1995, vol.4, pp.470-477.
[81] J.-W. Suh, Y.-S. Ho. Error Concealment Based on Directional Interpolation. IEEE Trans. Consum. Electron.[J]. 1997, vol.43, no.3, pp.295-302.
[82] W. Kwok, H. Sun. Multidirectional Interpolation for Spatial Error Concealment. IEEE Trans. Consum. Electron.[J]. 1993, vol.39, no.3, pp.455-460.
[83] Z. Wang, Y. Yu, D. Zhang. Best Neighborhood Matching: An Information Loss Restoration Technique for Block-Based Image Coding Systems. IEEE Trans. Image Process.[J]. 1998, vol.7, no.7, pp.1056-1061.
[84] Z. Rongfu, Z. Yuanhua, H. Xiaodong. Content-Adaptive Spatial Error Concealment for Video Communication. IEEE Trans. Consum. Electron.[J]. 2004, vol.50, no.1, pp.335-341.
[85] E. Ong, W. Lin, Z. Lu, et al. Visual Distortion Assessment with Emphasis on Spatially Transitional Regions. IEEE Trans. Circuits Syst. Video Technol.[J]. 2004, vol.14, no.4, pp.559-566.
[86] X. Ran, N. Farvardin. A Perceptually Motivated Three Component Image Model—Part I: Description of The Model. IEEE Trans. Image Process.[J]. 1995, vol.4, pp.401-415.
[87] Z. Alkachouh, M. G. Bellanger. Efficient Restoration Technique for Missing Blocks in Images. IEEE Transaction on Circuits and Systems for Video Technology[J]. 2003, vol.13, no.12, pp.1182-1186.
[88] J. W. Park, J. W. Kim, S. U. Lee. DCT Coefficients Recovery-Based Error Concealment Technique and Its Application to The MPEG-2 Bit Stream Error. IEEE Trans. Circuits Syst. Video Technol.[J]. 1997, vol.7, pp.845-854.
[2] S. Wenger, T. Stockhammer. An Overview on the H.264 NAL Concept[S]. JVT-B028 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 2nd Meeting[C]. Geneva, Switzerland, 2002.
[3] Ralf Schafer, Thomas Wiegand, Heiko Schwarz. The Emerging H.264/AVC Standard. EBU Technical Review, Jan. 2003. http://www.ebu.ch/en/technical/trev/trev_293-schaefer.pdf
[4] Massimo Ravasi, Marco Mattavelli, Christophe Clere. A Computational Complexity Comparison of MPEG-4 and JVT Codecs[S]. JVT-D153r1-L in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 4th Meeting[C]. Klagenfurt, Austria, 2002.
[5] D. Agrafiotis, D. R. Bull, T. K. Chiew, et al. Enhanced Error Concealment for Video Transmission Over Wireless LANs. Proc. Int. Workshop Image Anal. Multimedia Interactive Services[C]. 2005, pp.435-442.
[6] D. Agrafiotis, T. K. Chiew, P. Ferre, et al. Seamless Wireless Networking for Video Surveillance Applications. Proc. SPIE Image Video Commun. Process.[C]. 2005, vol.5685, no.2, pp.39-53.
[7] Y. Wang, S. Wenger, J. Wen, et al. Error Resilient Video Coding Techniques-Real Time Video Communications over Unreliable Networks. IEEE Signal Process. Mag.[J]. 2000, vol.17, no.4, pp.61-82.
[8] Y. Wang and Q.-F. Zhu. Error Control and Concealment for Video Communication: A Review. Proc. IEEE[C]. 1998, vol.86, no.5, pp.974-997.
[9] 韩青,李莉,应骏. H.264 帧内 4×4 块预测模式选择快速算法研究. 中国图象图形学报[J]. 2007,12(10):1745-1748.
[10] ITU-T. Recommendation H.263: Video Coding for Low Bitrate Communication[S]. 1995.
[11] ITU-T Recommendation H.263 Version2: Video Coding for Low Bitrate Communication[S]. 1998.
[12] ITU-T Draft for H.263++. Annexes U, V, and W to Recommendation H.263[S]. 2000.
[13] ISO/IEC.IS 11172: Information Technology – Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbits/s[S]. 1993 (MPEG-1).
[14] ISO/IEC.IS 13818-1: Information Technology – Generic Coding of Moving Pictures and Associated Audio Information – Part7: Advanced Audio Coding (ACC)[S]. 1997 (MPEG-2 ACC)
[15] ISO/IEC.IS 14496-X: Information Technology – Coding of Audio-Visual Objects. 1999 (MPEG-4).
[16] Jose M. Martinez. ISO/IEC JTC1/SC29/WG11 N3752: Overview of the MPEG-7 Standard (v4.0)[S]. La Baule. 2000.
[17] ISO/IEC JTC1/SC29/WG11 MPEG/N 3002 : First Ideas on Defining A Multimedia Framework (v0.1)[S]. Melbourne. 1999.
[18] ITU-T TSG 16: Draft Call for Proposal for H.26L Video Coding[S]. ITU-T VCEG 16, 1998.
[19] Thomas Wiegand, Gary Sullivan, Ajay Luthra. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC)[S]. JVT-G050r1 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 8th Meeting[C]. Geneva, Switzerland, 2003.
[20] Jun Zhang, Xiaoquan Yi, Nam Ling, Weijia Shang. Context Adaptive Lagrange Multiplier (CALM) for Motion Estimation in JM – Improvement[S]. JVT-T046 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 20th Meeting[C]. Klagenfurt, Austria, 2006.
[21] Wiegand Thomas, Sullivan Gary J, Bjontegaard Gisle, et al. Overview of The H.264/AVC Video Coding Standard. IEEE Transaction on Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.560-576.
[22] GB/T 20090.2—2006 中华人民共和国国家标准 信息技术 先进音视频编码 第二部分:视频[S]. 国家质量监督检验检疫总局, 2006.
[23] Final Committee Draft of Joint Video Specification. ITU-T Recommendation H.264 and ISO/IEC 14496-10 Advanced Video Coding (AVC). 2002.
[24] Atul Puria, Xuemin Chenb, Ajay Luthra. Video Coding Using the H.264/MPEG-4 AVC Compression Standard. Signal Processing: Image Communication[J]. 2004.
[25] Thomas Stockhammer, Miska M. Hannuksela, Thomas Wiegand. H.264/AVC in Wireless Environments. IEEE Trans. Circuits Syst. Video Technol.[J]. 2003, vol.13, no.7, pp.657-673.
[26] Stephan Wenger. H.264/AVC Over IP. IEEE Trans. Circuits Syst. Video Technol.[J]. 2003, vol.13, no.7, pp.645-656.
[27] Tu-Chih Wang, Hung-Chi Fang, Liang-Gee Chen. Low-Delay and Error-Robust Wireless Video Transmission for Video Communications. IEEE Trans. Circuits Syst. Video Technol.[J]. 2002, vol.12, no.12, pp.1049-1058.
[28] Yan Lu, Wen Gao, Feng Wu. Sprite Generation for Frame-Based Video Coding. Proceedings. 2001 International Conference on Image Processing[C]. 2001, vol.1, pp.437-476.
[29] Yan Lu, Wen Gao, Feng Wu. High Efficient Sprite Coding With Directional Spatial Prediction. Proceedings. 2002 International Conference on Image Processing[C]. 2002, vol.1, no.1, pp.201-204.
[30] Wiegand T, Zhang X Z, Girod B. Long-Term Memory Motion-Compendated Prediction. IEEE Transaction on Circuits and Systems for Video Technology[J]. 1999, vol.9, no.1, pp.70-84.
[31] Henrique S. Malvar, Antti Hallapuro, Marta Karczewicz, et al. Low-Complexity Transform and Quantization in H.264/AVC. IEEE Trans. Circuits Syst. Video Technol[J]. 2003, vol.13, no.7, pp.598-603.
[32] Detlev Marpe, Heiko Schwarz, Thomas Wiegand. Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard. IEEE Trans. On Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.620-635.
[33] M.-C. Hong, H.-S. Hahn. A Loop/Post Filter to Suppress Blocking and Ringing Artifacts for H.26L Video Codec. Proceedings. 2002 International Conference on Image Processing[C]. 2002, vol.1, pp.940-947.
[34] Ce Zhu, Xiao Lin, Lap-Pui Chau, et al. A Novel Hexagon-Based Search Algorithm for Fast Block Motion Estimation. Processings. (ICASSP ’01). 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing[C]. 2001, vol.3, pp.1593-1596.
[35] A. M. Tourapis. Enhanced Predictive Zonal Search for Single and Multiple Frame Motion Estimation. Proc. SPIE Visual Communications and Image Processing[C]. 2002, vol.4671, no.2, pp.1069-1079.
[36] Libo Yang, Keman Yu, Jiang Li, Shipeng Li. An Effective Variable Block-Size Early Termination Algorithm for H.264 Video Coding. IEEE Transaction on Circuits and Systems for Video Technology[J]. 2005, vol.15, no.6, pp.784-788.
[37] Zhibo Chen, Peng Zhou, Yun He. Fast Iinteger Pel and Fractional Pel motion Estimation for JVT[S]. JVT-F017r1 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 6th meeting[C]. Awaji, Island, JP, 5-13, December 2002.
[38] H. C. Tourapis, P. Topiwala. Fast Motion Estimation within The JVT Codec[S]. JVT-E023 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 5th Meeting[C]. Geneva, Switzerland, October 2002.
[39] Hyungjoon Kim, Yucel Altunbasak. Low-Complexity Macroblock Mode Selection for H.264/AVC Encoders. Int. Conf. Image Processing[C]. Singapore, 2004, vol.2, pp.765-768.
[40] Peng PAN, Xiao LIN, et al. Fast Mode Decision for Intra Prediction[S]. JVT-G013r1 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 7th Meeting[C]. Pattaya II, Thailand, 7-14 March, 2003.
[41] Changsung Kim, Hsuan-Huei Shih and C. –C. Jay Kuo. Multistage Mode Decision for Intra Prediction in H.264 Codec. Proceedings of Visual Communications and Image Processing[C]. California, USA,2004, vol.5308, pp.355-363.
[42] K. P. Lim, S. Wu, D. J. Wu, S. Rahardja, X. Lin, F. Pan, Z. G. Li. Fast Inter Mode Selection[S]. JVT-I020 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 9th Meeting[C]. San Diego, US, 2-5 September, 2003.
[43] Byeungwoo Jeon, Jeyun Lee. Fast Mode Decision for H.264[S], JVT-J033 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 10th Meeting, Waikoloa, Hawaii, USA, 8-12 December, 2003.
[44] Ahmad I, Wei X H, Sun Y, et al. Video Transcoding : An Overview of Various Techniques and Research Issues. IEEE Transactions on Multimedia[J]. 2005, vol.7, no.5, pp.793-804.
[45] Su Y P, Xin J, Anthony V, Sun H F. Efficient MPEG-2 to H.264/AVC intra transcoding in transform domain. ISCAS 2005. IEEE International Symposium on Circuits and Systems[J]. 2005, vol.2, pp.1234-1237.
[46] Qian T J, Sun J, Li D, Yang X K, et al. Transform Domain Transcoding from MPEG-2 to H.264 with Interpolation Drift-Error Compensation. IEEE Transactions on Circuits and Systems for Video Technology[J]. 2006, vol.16, no.4, pp.523-534.
[47] Michael Horowitz, Anthony Joch, Faouzi Kossentini, et al. H.264/AVC Baseline Profile Decoder Complexity Analysis. IEEE Trans. On Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.704-716.
[48] Ville Lappalainen, Antti Hallapuro, Timo D. Hamalainen. Complexity of Optimized H.26L Decoder Implementation. IEEE Trans. On Circuits and Systems for Video Technology[J]. 2003, vol.13, no.7, pp.717-725.
[49] A. Chang, C. A. Oscar, Y. M. Yeung. A Novel Approach to Fast Multi-Frame Selection for H.264 Video Coding. Proc. IEEE ICASSP’2003[C]. Hong Kong, 2003, vol.3, pp.413-416.
[50] Yu-Wen Huang, Bing-Yu Hsieh, Tu-Chih Wang, et al. Analysis and Reduction of Reference Frames for Motion Estimation in MPEG-4 AVC/JVT/H.264. Proc. IEEE ICASSP’2003[C]. Hong Kong, 2003, vol.3, pp.145-148.
[51] X. Zhou, E. Q. Li, Y.-K. Chen. Implementation of H.264 Decoder on General-Purpose Processors with Media Instructions. In Proc. Of SPIE Conf. On Image and Video Communication and Processing[C]. 2003, vol.5022, pp.224-235.
[52] Richarson and Y. Zhao. Video Encoder Complexity Reduction by Estimating Skip Mode. Int. Conf. Image Processing[C]. Singapore, 2004, vol.1, pp.103-106.
[53] Antonio Ortega, Kannan Ramchandran. Rate-Distortion Methods for Image and Video Compression. IEEE Signal Processing Magazine[J]. 1998, vol.15, no.11, pp.23-50.
[54] Ville Lappalainenl, Timo D. H. Unified Method for Optimization of Several Video Coding Algorithms on General-Purpose Processors. In Proc. 2002, IEEE Int. Conf. Information Technology[C]. 2002, vol.1, pp.431-439.
[55] Tseng Chao-Hsuing, Wang Hung-Ming, Yang Jar-Ferr. Improved and Fast Algorithms for Intra 4×4 Mode Decision in H.264/AVC. Proceedings of IEEE International Symposium on Circuits and Systems[C]. 2005, vol.3, pp.2128-2131.
[56] Zhang Jianning, He Yuwen, et al. A Fast Intra Prediction Method for H.264 Video Coding. G. Tescher Andrew. Proceedings of SPIE Applications of Digital Image Processing[C]. Bellingham, 2003, vol.5203, pp.753-761.
[57] Zhou Minhua. Scalable Intra Prediction[S]. JVT-C033 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 3rd Meeting[C].. Fairfax, Virginia, USA, 2002.
[58] Zhang Yong-dong, Dai Feng, Lin Shou-xun. Fast 4×4 Intra-Prediction Mode Selection for H.264. IEEE International Conference on Multimedia and Expo (ICME 2004)[C]. Taipei, Taiwan, 2004, TP1-4:1151-1154.
[59] Joint Video Team (JVT). Reference software JM8.6[S/OL].http://iphome.hhi.de/suehring/tml/download/
[60] H. Sun, K. Challapali, J. Zdepski. Error Concealment in Digital Simulcast AD-HDTV Decoder. IEEE Trans. Consumer Electron.[J]. 1992, vol.38, pp.108-117.
[61] W. B. Pennebaker, J. L. Mitchell, JPEG Still Image Data Compression Standard[S]. New York: Van Nostrand, 1992.
[62] J.-W. Suh, Y.-S. Ho. Error Concealment Techniques for Digital TV. IEEE Trans. Broadcast.[J]. 2004, vol.48, no.4, pp.299-306.
[63] G. Sullivan, T. Wiegand, K.-P. Lim, Joint Model Reference Encoding Methods and Decoding Concealment Methods[S]. JVT-I049 in ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, JVT 9th Meeting[C]. San Diego, USA, September, 2003.
[64] Zhang, J. F. Arnold, M. R. Frater. A Cell-Loss Concealment Technique for MPEG-2 Coded Video. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.659-665.
[65] T. S. Valente, C. Dufour, F.Groliere, et al. An Efficient Error Concealment Implementation for MPEG-4 Video Streams. IEEE Trans. Consum. Electron.[J]. 2001, vol.47, no.3, pp.568-578.
[66] S. Tsekeridou, I. Pitas. MPEG-2 Error Concealment Based on Block-Matching Principles. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.646-658.
[67] Zhang, J. F. Arnold, M. R. Frater. A Cell-Loss Concealment Technique for MPEG-2 Coded Video. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.659-665.
[68] S. Tsekeridou, I. Pitas. MPEG-2 Error Concealment Based on Block-Matching Principles. IEEE Trans. Circuits Syst. Video Technol.[J]. 2000, vol.10, no.4, pp.646-658.
[69] C.-T. Hsu, M.-J. Chen, W.-W. Liao, et al. High Performance Spatial and Temporal Error Concealment Algorithms for Block-Based Video Coding Techniques. Electronics and Telecommunication Research Institute Journal[J]. 2005, vol.27, no.1, pp.53-63.
[70] C. Hong, H. Scwab, L. kondi, A. K. Katsaggelos. Error Concealment Algorithms for Compressed Video. Signal Process.: Image Commun.[J]. 1999, vol.14, pp.473-492.
[71] B. Yan, K. W. Ng. A Novel Selective Motion Vector Matching Algorithm for Error Concealment in MPEG-4 Video Transmission Over Error-Prone Channels. IEEE Trans. Consum. Electron.[J]. 2003, vol.49, no.4, pp.1416-1423.
[72] L.-W. Kang, J.-J. Leou. A Hybrid Error Concealment Scheme for MPEG-2 Video Transmission Based on Best Neighborhood Matching Algorithm. J. Vis. Commun. Image Represent.[J]. 2005, vol.16, no.3, pp.288-310.
[73] Y. Xu, Y. Zhou. H.264 Video Communication Based Refined Error Concealment Schemes. IEEE Trans. Consum. Electron.[J]. 2004, vol.50, no.4, pp.1135-1141.
[74] Y.-C. Lee, Y. Altunbasak, R. Mersereau. Multiframe Error Concealment for MPEG-Coded Video Delivery over Error-Prone Networks. IEEE Trans. Image Process.[J]. 2002, vol.11, no.11, pp.1314-1331.
[75] K. Meisinger and A. Kaup. Spatial Error Concealment of Corrupted Image Data Using Frequency Selective Extrapolation. Proceedings. IEEE International Conference on Acoustics, Speech, and Signal Processing[C]. 2004, vol.3, no.3, pp.209-212.
[76] Y. Wang, Q.-F. Zhu, L. Shaw. Maximally smooth image recovery in transform coding. IEEE Trans. Commun.[J]. 1993, vol.41, no.10, pp.1544-1551.
[77] Z. Alkachouh, M. G. Bellanger. Fast DCT-Based Spatial Domain Interpolation of Blocks in Images. IEEE Transaction on Image Processing[J]. 2000, vol.9, no.4, pp.729-732.
[78] P. Salama, N. B. Shroff, E. J. Delp. Error Concealment in Encoded Video Streams[M]. In Signal Recovery Techniques for Image and Video Compression and Transmission, A. K. Katsaggelos and N. P. Galatsanos, Eds. Norwell, MA: Kluwer, 1998, ch.7.
[79] S.-C. Hsia. An Edge-Oriented Spatial Interpolation for Consecutive Block Error Concealment. IEEE Signal Processing Letters[J]. 2004, vol.11, no.6, pp.577-580.
[80] H. Sun, W. Kwok. Concealment of Damaged Block Transform Coded Images Using Projection onto Convex Set. IEEE Trans. Image Process.[J]. 1995, vol.4, pp.470-477.
[81] J.-W. Suh, Y.-S. Ho. Error Concealment Based on Directional Interpolation. IEEE Trans. Consum. Electron.[J]. 1997, vol.43, no.3, pp.295-302.
[82] W. Kwok, H. Sun. Multidirectional Interpolation for Spatial Error Concealment. IEEE Trans. Consum. Electron.[J]. 1993, vol.39, no.3, pp.455-460.
[83] Z. Wang, Y. Yu, D. Zhang. Best Neighborhood Matching: An Information Loss Restoration Technique for Block-Based Image Coding Systems. IEEE Trans. Image Process.[J]. 1998, vol.7, no.7, pp.1056-1061.
[84] Z. Rongfu, Z. Yuanhua, H. Xiaodong. Content-Adaptive Spatial Error Concealment for Video Communication. IEEE Trans. Consum. Electron.[J]. 2004, vol.50, no.1, pp.335-341.
[85] E. Ong, W. Lin, Z. Lu, et al. Visual Distortion Assessment with Emphasis on Spatially Transitional Regions. IEEE Trans. Circuits Syst. Video Technol.[J]. 2004, vol.14, no.4, pp.559-566.
[86] X. Ran, N. Farvardin. A Perceptually Motivated Three Component Image Model—Part I: Description of The Model. IEEE Trans. Image Process.[J]. 1995, vol.4, pp.401-415.
[87] Z. Alkachouh, M. G. Bellanger. Efficient Restoration Technique for Missing Blocks in Images. IEEE Transaction on Circuits and Systems for Video Technology[J]. 2003, vol.13, no.12, pp.1182-1186.
[88] J. W. Park, J. W. Kim, S. U. Lee. DCT Coefficients Recovery-Based Error Concealment Technique and Its Application to The MPEG-2 Bit Stream Error. IEEE Trans. Circuits Syst. Video Technol.[J]. 1997, vol.7, pp.845-854.