基于SIP协议的网络可视对讲系统的研究与实现
|
摘要
随着智能小区在我国的普及和发展,传统的相互独立和分离的小区各子系统渐渐暴露出种种弊端,已经不能满足人们日益增长的服务需求,人们寻求一种能够集传统小区中各子系统功能于一身的,为用户提供物业信息发布、可视对讲、视频监控、音视频点播、家居控制等众多服务的综合系统。
本文研究了该综合系统中各终端之间通信的信令控制和多媒体信息传输等关键技术,着重解决了以下几个关键问题：1、系统中各终端的在线注册和行为控制问题：基于标准的SIP协议,生成各终端之间通信的请求和消息,协调系统终端之间的行为；2、收发双方的同步控制问题：收发双方基于统一的时钟进行控制,根据接收和发送的数据包的速率来调整收发线程的行为；3、音视频同步问题：播放线程根据语音和视频包的时间戳控制语音和视频的播放速率,从而实现音视频的同步播放；4、语音和视频的延时和抖动问题：软件设计采用了模块化的思想,引进了管道机制来防止传输流水线的拥塞,减少了音视频的延时和抖动。
概括的来说,本文主要的工作内容为：根据系统及用户需求设计了综合系统的子系统----可视对讲系统的总体架构和通信模型,通过SIP信令控制实现了终端之间的路由呼叫和媒体协商,采用相关的标准和协议实现了音视频的编码压缩和实时传输,设计了音视频同步和收发同步的控制算法,保证了音视频传输的清晰流畅,并采用了管道机制提高了实时传输的效率。
系统测试结果表明,该系统完全实现了所需要的功能和性能,并且与传统的可视对讲系统相比,该系统更加安全稳定,布线方便,可扩展性更强,能为用户提供许多个性化的服务,满足用户的不同需求,且由于采用了NGN中的标准协议SIP,使得系统能够方便地与下一代的系统融合,集成更多的个性化服务。
With the popularization and development of Intelligent Community in China, the traditional independent and separated subsystems of communities gradually reveal many drawbacks, and can no longer satisfy people's increasing demand for services. People now is looking for a integrated system which incorporates all the features of the traditional subsystems and provides users with many features like property information release, video intercom, video surveillance, audio and video on demand and home control.
In this paper, we discussed some key technologies needed by the integrated system like signaling control between the communicating terminals and transmission of multimedia information and solved the following key issues:1. The online registration and behaviour control of the terminals in the system. Based on SIP protocol, we generate the request messages between terminals to coordinate their behaiviours.2. Synchronous control between send and receive parts:the two parts are both under the control of the unified clock and adjust the behavior of sending and receiving threads based on the packets'rate.3. audio and video synchronous problem: Play thread control the playback rate based on the time stamp of the packets, in order to achieve synchronization of audio and video playback; 4. voice and video latency and jitter issues:the software design introduces a modular thought and a pipe mechanism to prevent the transmission pipeline pipeline congestion, reducing the audio and video delay and jitter.
Generally speaking, this paper mainly made the following achieves:we designed the general architecture and communication model of its subsystem----video intercom system,, we achieved the routing of calls and media consultation between the terminals through the control of SIP signaling and encoding of audio and video compression and real-time transmission by adopting the relevant standards and protocols. Algorithms of audio and video synchronization and send and receive synchronization were designed to ensure the clear and smooth audio and video transmission, we also adopted the pipeline mechanism to improve the efficiency of real-time transmission. Test results show that the system fully realized the needed functions and performances, and comparing to the traditional video intercom systems, it is more secure and stable, easier to wired and more extensible, it can provide more personalized services to meet the various needs of the users. Moreover, thanks to the SIP standard protocol of NGN, it allows the system to easily integrate with next-generation systems and provides more personalized services.
本文研究了该综合系统中各终端之间通信的信令控制和多媒体信息传输等关键技术,着重解决了以下几个关键问题：1、系统中各终端的在线注册和行为控制问题：基于标准的SIP协议,生成各终端之间通信的请求和消息,协调系统终端之间的行为；2、收发双方的同步控制问题：收发双方基于统一的时钟进行控制,根据接收和发送的数据包的速率来调整收发线程的行为；3、音视频同步问题：播放线程根据语音和视频包的时间戳控制语音和视频的播放速率,从而实现音视频的同步播放；4、语音和视频的延时和抖动问题：软件设计采用了模块化的思想,引进了管道机制来防止传输流水线的拥塞,减少了音视频的延时和抖动。
概括的来说,本文主要的工作内容为：根据系统及用户需求设计了综合系统的子系统----可视对讲系统的总体架构和通信模型,通过SIP信令控制实现了终端之间的路由呼叫和媒体协商,采用相关的标准和协议实现了音视频的编码压缩和实时传输,设计了音视频同步和收发同步的控制算法,保证了音视频传输的清晰流畅,并采用了管道机制提高了实时传输的效率。
系统测试结果表明,该系统完全实现了所需要的功能和性能,并且与传统的可视对讲系统相比,该系统更加安全稳定,布线方便,可扩展性更强,能为用户提供许多个性化的服务,满足用户的不同需求,且由于采用了NGN中的标准协议SIP,使得系统能够方便地与下一代的系统融合,集成更多的个性化服务。
With the popularization and development of Intelligent Community in China, the traditional independent and separated subsystems of communities gradually reveal many drawbacks, and can no longer satisfy people's increasing demand for services. People now is looking for a integrated system which incorporates all the features of the traditional subsystems and provides users with many features like property information release, video intercom, video surveillance, audio and video on demand and home control.
In this paper, we discussed some key technologies needed by the integrated system like signaling control between the communicating terminals and transmission of multimedia information and solved the following key issues:1. The online registration and behaviour control of the terminals in the system. Based on SIP protocol, we generate the request messages between terminals to coordinate their behaiviours.2. Synchronous control between send and receive parts:the two parts are both under the control of the unified clock and adjust the behavior of sending and receiving threads based on the packets'rate.3. audio and video synchronous problem: Play thread control the playback rate based on the time stamp of the packets, in order to achieve synchronization of audio and video playback; 4. voice and video latency and jitter issues:the software design introduces a modular thought and a pipe mechanism to prevent the transmission pipeline pipeline congestion, reducing the audio and video delay and jitter.
Generally speaking, this paper mainly made the following achieves:we designed the general architecture and communication model of its subsystem----video intercom system,, we achieved the routing of calls and media consultation between the terminals through the control of SIP signaling and encoding of audio and video compression and real-time transmission by adopting the relevant standards and protocols. Algorithms of audio and video synchronization and send and receive synchronization were designed to ensure the clear and smooth audio and video transmission, we also adopted the pipeline mechanism to improve the efficiency of real-time transmission. Test results show that the system fully realized the needed functions and performances, and comparing to the traditional video intercom systems, it is more secure and stable, easier to wired and more extensible, it can provide more personalized services to meet the various needs of the users. Moreover, thanks to the SIP standard protocol of NGN, it allows the system to easily integrate with next-generation systems and provides more personalized services.
引文
[1]谢宇俊,杨士元.分布式智能家庭网络系统的研究：计算机工程与应用,2008.
[2]叶朝辉,杨士元.智能家庭网络研究综述：计算机应用研究.2009,10(9)：10
[3]Steven T, Bushby. BACnetTM-A Standard Communication Infrastructure Forlntelligent Buildings. Automation in Construction,2007,6 (5-6):529-540
[4]王飞跃,黄小池.基于网络的智能家居系统现状和发展趋势[J]：计算机研究与发展.2006.
[5]江月山.家居智能化现状及其发展趋势[J]：计算机工程,2008.7：59-64
[6]何晶,李仁发,喻飞.基于H.323协议的会议电视系统的设计与研究.中国计算机大会,2003.
[7]J.Rosenberg, H. Schulzrinne. SIP:Session Initiation Protocol. RFC3261,2002-06.
[8]司端锋,韩心慧,龙勤,潘爱民.SIP标准中的核心技术与研究进展.软件学报,2005年Vol.16，No.2
[9]徐鹏,廖建新,吴乃星.SIP协议控制多媒体会话的研究与应用.计算机工程,2006年7月第32卷第14期.
[10]曾鹭鹭,陈一民.基于SIP协议的IP电话服务器的设计与实现.计算机工程,2007年2月第33卷第3期
[11]韩跃峰,郑有才,杜军朝,张立勇.基于SIP协议的呼叫中心设计.计算机技术与发展,2007年5月,第17卷第5期.
[12]Berners-Lee and L. Masinter. Uniform Resource Identifiers (URI):Generic Syntax. RFC2396,1998.
[13]J. Rosenberg, H. Schulzrinne. An Offer/Answer Model with the Session Description Protocol (SDP). RFC3264,2002-06.
[14]H. Schulzrinne, S. Casner, R. Frederick, V. Jacobson. RTP:A Transport Protocol for Real-Time Applications. RFC3550,2003-07.
[15]H. Schulzrinne, S. Casner. RTP Profile for Audio and Video Conferences with Minimal Control. RFC3351, July 2003.
[16]L. Berc, W. Fenner, S.McCanne, P.Stewart. RTP Payload Format for JPEG-compressed Video. RFC2435, October 1998.
[17]S. Donovan. The SIP INFO Method. RFC2976, October 2000.
[18]B. Campbell, Ed. J. Rosenberg, H. Schulzrinne. Session Initiation Protocol (SIP) Extension for Instant Messaging. RFC3428,2002-12
[19]王昕.软交换通信协议SIP的研究与实现：[学位论文]成都：电子科技大学,2006.
[20]顾晓光,史红周,何哲,罗海勇.嵌入式IP可视电话软件系统架构研究与设计.计算机技术与发展,2006年10月,第16卷.
[21]荀兆勇,廖建新,曹予飞,王纯,朱晓民.基于IMS的早期媒体类业务.计算机工程,2008年5月第34卷第9期.
[22]曹丽菲,温向明.基于SIP协议的嵌入式视频监控系统的研究.中国科技论文在线,2008年03月21日.
[23]钱龙华,吕强,杨季文,钱培德.基于SIP的嵌入式视频监控系统.计算机应用,2007年7月,第27卷第7期.
[24]高丽平.基于SIP的IP电话软件设计与实现：[学位论文]西安：西安电子科技大学,2006.
[25]A. B. Roach. Session Initiation Protocol (SIP)-Specific Event Notification. RFC3265,2002-06
[26]J. Rosenberg, H. Schulzrinne. Reliability of Provisional Responses in the Session Initiation Protocol (SIP). RFC3262,2002-06.
[27]巨琨.IP多媒体子系统(IMS)信令系统的研究与实现：[学位论文]北京：北京邮电大学,2006.
[28]S.Sae-Wong, T. Kamolphiwong, S. Kamolphiwong, and N. Wittayasirikul. Interactive Distance Learning based on SIP. Third International Conference on eLearning for Knowledge-Based Society, August 3-4,2006, Bangkok, Thailand.
[29]Ramiro Liscano, Kaining Wang. A SIP-based Architecture model for Contextual Coalition Access Control for Ubiquitous Computing. Proceedings of the Second Annual International Conference on Mobile and Ubiquitous Systems:Networking and Services (MobiQuitous'05),2005 IEEE.
[30]潘璐伽,陈前斌,胡海龙.一种新的基于SIP的VHE网络构架.计算机工程,2007年11月第33卷第21期
[31]Jorg Ott, Lu Xiaojun.Disconnection tolerance for SIP-based real-time media sessions. ACM International Conference Proceeding Series, Vol.284, Proceedings of the 6th international conference on Mobile and ubiquitous multimedia,2007 ISBN:978-1-59593-916-6
[32]Jorg Ott. DELAY TOLERANCE AND THE FUTURE INTERNE. The 11th International Symposium on Wireless Personal Multimedia Communications (WPMC 08).
[33]QI WANG AND MOSA ALI ABU-RGHEFF. MOBILITY MANAGEMENT ARCHITECTURES BASED ON JOINT MOBILE IP AND SIP PROTOCOLS. IEEE Wireless Communications, December 2006.
[34]张大陆,沈斌,胡治国,侯翠平.丢包对音频流体验质量的影响分析.计算机应用,2009年1月第29卷第1期.
[35]Alfredsson, S. Brunstrom, A. Sternad, M. Impact of 4G wireless link configurations on VoIP network performance. Wireless Communication Systems.2008. ISWCS'08. IEEE International Symposium on,21-24 Oct.2008 On page(s):708-712.
[36]Bruining, N. Hendriks, B. Boelhouwer, ed. Teleteaching and teleguiding using an intranetwork:A feasibility study. Computers in Cardiology,2002,22-25 Sept.2002 On page(s):277-280.
[37]Christianson, L. Brown, K. Rate adaptation for improved audio quality in wireless networks. Mobile Multimedia Communications,1999. (MoMuC'99) 1999 IEEE International Workshop on,1999 On page(s):363-367.
[38]P Lieverse, T Stefanov, P van der Wolf, Ed Deprettere. System level design with spade:an M-JPEG case study. Proceedings of the 2001 IEEE/ACM international conference on Computer-aided design,2001,31-38.
[39]Das,S.K.Lee,E. Basu, K. Sen, S. K. Performance optimization of VoIP calls over wireless links using H.323 protocol. Computers, IEEE Transactions on, June 2003 Volume:52, Issue:6 On page(s):742-752.
[40]陈皓,付中华,赵荣椿.基于G.729编码参数的语音特征及其应用.西北大学学报(自然科学版),2005年6月,第35卷第3期.
[41]Bo-Chao Cheng, Huan Chen and Ryh-Yuh Tseng. A Context Aware Gateway for SIP-based Services in Ubiquitous Smart Homes. International Journal of Smart Home, Vol.2, No.1, January,2008.
[42]杜世星,陈鸿昶,于洪涛.针对SIP解析器的攻击与防范.计算机工程,2008年12月第34卷第23期.
[43]王剑.NGN/SIP下电话会议的设计和实现：[学位论文]成都：电子科技大学,2006.
[44]赵胜颖,金心宇.基于Intel IXP425的家庭综合接入网关的设计.计算机工程,2007年6第33卷第12期.
[2]叶朝辉,杨士元.智能家庭网络研究综述：计算机应用研究.2009,10(9)：10
[3]Steven T, Bushby. BACnetTM-A Standard Communication Infrastructure Forlntelligent Buildings. Automation in Construction,2007,6 (5-6):529-540
[4]王飞跃,黄小池.基于网络的智能家居系统现状和发展趋势[J]：计算机研究与发展.2006.
[5]江月山.家居智能化现状及其发展趋势[J]：计算机工程,2008.7：59-64
[6]何晶,李仁发,喻飞.基于H.323协议的会议电视系统的设计与研究.中国计算机大会,2003.
[7]J.Rosenberg, H. Schulzrinne. SIP:Session Initiation Protocol. RFC3261,2002-06.
[8]司端锋,韩心慧,龙勤,潘爱民.SIP标准中的核心技术与研究进展.软件学报,2005年Vol.16，No.2
[9]徐鹏,廖建新,吴乃星.SIP协议控制多媒体会话的研究与应用.计算机工程,2006年7月第32卷第14期.
[10]曾鹭鹭,陈一民.基于SIP协议的IP电话服务器的设计与实现.计算机工程,2007年2月第33卷第3期
[11]韩跃峰,郑有才,杜军朝,张立勇.基于SIP协议的呼叫中心设计.计算机技术与发展,2007年5月,第17卷第5期.
[12]Berners-Lee and L. Masinter. Uniform Resource Identifiers (URI):Generic Syntax. RFC2396,1998.
[13]J. Rosenberg, H. Schulzrinne. An Offer/Answer Model with the Session Description Protocol (SDP). RFC3264,2002-06.
[14]H. Schulzrinne, S. Casner, R. Frederick, V. Jacobson. RTP:A Transport Protocol for Real-Time Applications. RFC3550,2003-07.
[15]H. Schulzrinne, S. Casner. RTP Profile for Audio and Video Conferences with Minimal Control. RFC3351, July 2003.
[16]L. Berc, W. Fenner, S.McCanne, P.Stewart. RTP Payload Format for JPEG-compressed Video. RFC2435, October 1998.
[17]S. Donovan. The SIP INFO Method. RFC2976, October 2000.
[18]B. Campbell, Ed. J. Rosenberg, H. Schulzrinne. Session Initiation Protocol (SIP) Extension for Instant Messaging. RFC3428,2002-12
[19]王昕.软交换通信协议SIP的研究与实现：[学位论文]成都：电子科技大学,2006.
[20]顾晓光,史红周,何哲,罗海勇.嵌入式IP可视电话软件系统架构研究与设计.计算机技术与发展,2006年10月,第16卷.
[21]荀兆勇,廖建新,曹予飞,王纯,朱晓民.基于IMS的早期媒体类业务.计算机工程,2008年5月第34卷第9期.
[22]曹丽菲,温向明.基于SIP协议的嵌入式视频监控系统的研究.中国科技论文在线,2008年03月21日.
[23]钱龙华,吕强,杨季文,钱培德.基于SIP的嵌入式视频监控系统.计算机应用,2007年7月,第27卷第7期.
[24]高丽平.基于SIP的IP电话软件设计与实现：[学位论文]西安：西安电子科技大学,2006.
[25]A. B. Roach. Session Initiation Protocol (SIP)-Specific Event Notification. RFC3265,2002-06
[26]J. Rosenberg, H. Schulzrinne. Reliability of Provisional Responses in the Session Initiation Protocol (SIP). RFC3262,2002-06.
[27]巨琨.IP多媒体子系统(IMS)信令系统的研究与实现：[学位论文]北京：北京邮电大学,2006.
[28]S.Sae-Wong, T. Kamolphiwong, S. Kamolphiwong, and N. Wittayasirikul. Interactive Distance Learning based on SIP. Third International Conference on eLearning for Knowledge-Based Society, August 3-4,2006, Bangkok, Thailand.
[29]Ramiro Liscano, Kaining Wang. A SIP-based Architecture model for Contextual Coalition Access Control for Ubiquitous Computing. Proceedings of the Second Annual International Conference on Mobile and Ubiquitous Systems:Networking and Services (MobiQuitous'05),2005 IEEE.
[30]潘璐伽,陈前斌,胡海龙.一种新的基于SIP的VHE网络构架.计算机工程,2007年11月第33卷第21期
[31]Jorg Ott, Lu Xiaojun.Disconnection tolerance for SIP-based real-time media sessions. ACM International Conference Proceeding Series, Vol.284, Proceedings of the 6th international conference on Mobile and ubiquitous multimedia,2007 ISBN:978-1-59593-916-6
[32]Jorg Ott. DELAY TOLERANCE AND THE FUTURE INTERNE. The 11th International Symposium on Wireless Personal Multimedia Communications (WPMC 08).
[33]QI WANG AND MOSA ALI ABU-RGHEFF. MOBILITY MANAGEMENT ARCHITECTURES BASED ON JOINT MOBILE IP AND SIP PROTOCOLS. IEEE Wireless Communications, December 2006.
[34]张大陆,沈斌,胡治国,侯翠平.丢包对音频流体验质量的影响分析.计算机应用,2009年1月第29卷第1期.
[35]Alfredsson, S. Brunstrom, A. Sternad, M. Impact of 4G wireless link configurations on VoIP network performance. Wireless Communication Systems.2008. ISWCS'08. IEEE International Symposium on,21-24 Oct.2008 On page(s):708-712.
[36]Bruining, N. Hendriks, B. Boelhouwer, ed. Teleteaching and teleguiding using an intranetwork:A feasibility study. Computers in Cardiology,2002,22-25 Sept.2002 On page(s):277-280.
[37]Christianson, L. Brown, K. Rate adaptation for improved audio quality in wireless networks. Mobile Multimedia Communications,1999. (MoMuC'99) 1999 IEEE International Workshop on,1999 On page(s):363-367.
[38]P Lieverse, T Stefanov, P van der Wolf, Ed Deprettere. System level design with spade:an M-JPEG case study. Proceedings of the 2001 IEEE/ACM international conference on Computer-aided design,2001,31-38.
[39]Das,S.K.Lee,E. Basu, K. Sen, S. K. Performance optimization of VoIP calls over wireless links using H.323 protocol. Computers, IEEE Transactions on, June 2003 Volume:52, Issue:6 On page(s):742-752.
[40]陈皓,付中华,赵荣椿.基于G.729编码参数的语音特征及其应用.西北大学学报(自然科学版),2005年6月,第35卷第3期.
[41]Bo-Chao Cheng, Huan Chen and Ryh-Yuh Tseng. A Context Aware Gateway for SIP-based Services in Ubiquitous Smart Homes. International Journal of Smart Home, Vol.2, No.1, January,2008.
[42]杜世星,陈鸿昶,于洪涛.针对SIP解析器的攻击与防范.计算机工程,2008年12月第34卷第23期.
[43]王剑.NGN/SIP下电话会议的设计和实现：[学位论文]成都：电子科技大学,2006.
[44]赵胜颖,金心宇.基于Intel IXP425的家庭综合接入网关的设计.计算机工程,2007年6第33卷第12期.