基于P2P技术的CDN系统的设计与实现
摘要
随着计算机技术、网络技术、多媒体技术等相关综合技术的发展,在线视频点播(VOD)应用逐渐成为互联网应用的主要方向之一。而VOD业务对系统资源、网络带宽占用很高；用户使用系统时,持续占用应用资源,VOD业务并发用户数少；Internet网络环境复杂,跨地区的VOD业务体验效果很难得到保证；随着时代发展,网络多媒体直播也逐渐成为媒体发布、各种新闻活动的一个实时展现方式,但网络多媒体直播的并发访问用户数无法估量,如：06年超女网络直播中,某运营商视频系统仅支撑了30分钟后瘫痪。如何建立一个功能完备、可运营、易管理的VOD业务平台是一个难题。北京联通流媒体平台是一个基于CDN架构的流媒体服务系统,已经投入建设多年,也正面临投资大、用户体验效果低的困境,升级现有CDN系统,支撑大用户直播,成为当前急需解决的问题。
在分析了北京联通流媒体平台系统需求的基础上,结合前期CDN系统架构和设备,我们建议升级CDN架构,改变原有四层设备引导的模式,融入软件CDN调度系统,在各地区节点增加软缓存服务,提升CDN并发能力。在大用户直播支持方面,有两种技术方向：组播技术和P2P技术。在Internet环境中,组播需要网络设备的大调整,有些较老的网络设备不支持组播设置,需要放开广播设置,可能会对城域网造成较大影响,经过慎重考虑本项目未采用组播技术。P2P直播技术利用Peer To Peer对等网络技术,通过客户端之间直接交换来共享计算机资源和服务,占用少量应用系统资源。由于数据交换是客户端之间完成,假定网络资源无瓶颈,P2P用户的并发数是无限的。但P2P技术不加控制会对Internet造成大量网络资源浪费。所以我们提出了基于P2P技术的CDN系统架构,即在一个地区节点内的P2P自治域,既提高用户的体验效果,也不会对骨干网造成过大压力。通过本项目的设计实施,全面提高了CDN的直播体验效果,降低了骨干网络带宽压力,并对P2P实现了有效的管理和利用,满足了北京联通流媒体平台升级扩容的要求。
With the development of computer technology, network technology, multimedia technology and other related technology, video on demand (VOD) applications has become one of the main internet applications. The occupying of VOD service on system resources, network bandwidth is high. Users continued to occupy the resources of the system, thus VOD business can't provide much number of concurrent users. Internet network environment is complex, and the service experience of inter-regional VOD system is difficult to be guaranteed. With the times past by, the online multi-media broadcast system has become a real-time platform of information distribution of some news liveshow. The user number of concurrent access to the media broadcast network is incalculable. Such as:2006 Super Girl webcast, the livecast system just paralyzed in 30 minutes. How to build a fully functional, operational, easily managed VOD service platform is a real problem. Beijing Unicom streaming media platform is CDN architecture based media service system.It already has been in construction for many years. And it is facing the problem with big investment and poor user experience. The urgent problem to solute is, how to upgrade the existing CDN systems, and support large number of concurrent livecast user.
After analysing the requirements of the Beijing Unicom streaming media platform, we suggest to upgrade the CDN architecture with combining with the original CDN system architecture and equipment, changing the original guide model of Level-4 devices, intergrating into the software CDN system, arranging software cache devices in various regions of nodes, and enhancing the CDN concurrency. There are two technical, routes in large number of concurrent livecast user:Multicast and P2P technology. Taking multicast mode into the Internet environment requires a major adjustment of network devices. Because some older network devices do not support multicast setting, also we need to release the radio set, may cause a greater impact to the backbone network. So we can't use this way. P2P broadcast technology use Peer To Peer network technology, through the direct exchange between the client computers to share resources and services, take a small amount of application of system resources. Since the data exchange i s done between the client, assuming there is no network resources bottleneck, thus P2P number of concurrent users is unlimited. However, uncontrolled P2P technology will result in a large number of Internet network resources waste. Therefore, we propose a technique based on P2P CDN system architecture, that is a regional node in the P2P autonomy within the field, both to improve the user experience results, nor will it cause too much pressure on the backbone network. With the designing and implementation of the project, the user experience of the CDN live cast has been improved, the pressure on the backbone network bandwidth has been reduced. With the effective management and utilization of P2P, it has meet the requirement of Beijing Unicom in integrating of these two technology.
在分析了北京联通流媒体平台系统需求的基础上,结合前期CDN系统架构和设备,我们建议升级CDN架构,改变原有四层设备引导的模式,融入软件CDN调度系统,在各地区节点增加软缓存服务,提升CDN并发能力。在大用户直播支持方面,有两种技术方向：组播技术和P2P技术。在Internet环境中,组播需要网络设备的大调整,有些较老的网络设备不支持组播设置,需要放开广播设置,可能会对城域网造成较大影响,经过慎重考虑本项目未采用组播技术。P2P直播技术利用Peer To Peer对等网络技术,通过客户端之间直接交换来共享计算机资源和服务,占用少量应用系统资源。由于数据交换是客户端之间完成,假定网络资源无瓶颈,P2P用户的并发数是无限的。但P2P技术不加控制会对Internet造成大量网络资源浪费。所以我们提出了基于P2P技术的CDN系统架构,即在一个地区节点内的P2P自治域,既提高用户的体验效果,也不会对骨干网造成过大压力。通过本项目的设计实施,全面提高了CDN的直播体验效果,降低了骨干网络带宽压力,并对P2P实现了有效的管理和利用,满足了北京联通流媒体平台升级扩容的要求。
With the development of computer technology, network technology, multimedia technology and other related technology, video on demand (VOD) applications has become one of the main internet applications. The occupying of VOD service on system resources, network bandwidth is high. Users continued to occupy the resources of the system, thus VOD business can't provide much number of concurrent users. Internet network environment is complex, and the service experience of inter-regional VOD system is difficult to be guaranteed. With the times past by, the online multi-media broadcast system has become a real-time platform of information distribution of some news liveshow. The user number of concurrent access to the media broadcast network is incalculable. Such as:2006 Super Girl webcast, the livecast system just paralyzed in 30 minutes. How to build a fully functional, operational, easily managed VOD service platform is a real problem. Beijing Unicom streaming media platform is CDN architecture based media service system.It already has been in construction for many years. And it is facing the problem with big investment and poor user experience. The urgent problem to solute is, how to upgrade the existing CDN systems, and support large number of concurrent livecast user.
After analysing the requirements of the Beijing Unicom streaming media platform, we suggest to upgrade the CDN architecture with combining with the original CDN system architecture and equipment, changing the original guide model of Level-4 devices, intergrating into the software CDN system, arranging software cache devices in various regions of nodes, and enhancing the CDN concurrency. There are two technical, routes in large number of concurrent livecast user:Multicast and P2P technology. Taking multicast mode into the Internet environment requires a major adjustment of network devices. Because some older network devices do not support multicast setting, also we need to release the radio set, may cause a greater impact to the backbone network. So we can't use this way. P2P broadcast technology use Peer To Peer network technology, through the direct exchange between the client computers to share resources and services, take a small amount of application of system resources. Since the data exchange i s done between the client, assuming there is no network resources bottleneck, thus P2P number of concurrent users is unlimited. However, uncontrolled P2P technology will result in a large number of Internet network resources waste. Therefore, we propose a technique based on P2P CDN system architecture, that is a regional node in the P2P autonomy within the field, both to improve the user experience results, nor will it cause too much pressure on the backbone network. With the designing and implementation of the project, the user experience of the CDN live cast has been improved, the pressure on the backbone network bandwidth has been reduced. With the effective management and utilization of P2P, it has meet the requirement of Beijing Unicom in integrating of these two technology.
引文
[1]冯玮,刘心松,付国为;基于P2P技术的CDN中内容路由算法的改进;成都信息工程学院学报;2006年12月第6期
[2]杨传栋,余镇危,王行刚;结合CDN与P2P技术的混合流媒体系统研究;计算机应用2005年第9期
[3]杨晓波;P2P技术在CDN网络中的应用研究;计算机系统应用2007年第3期
[4]杨杰,周建芳；浅谈基于P2P的流媒体服务技术武汉大学计算机学院,湖北武汉
[5]章勤,戴飞；Peer-to-Peer流媒体系统中容错机制的研究华中科技大学计算机科学与技术学院湖北武汉
[6]Chen Y, Edler J, Goldberg A, et al. A prototype implementation of archival intermemory [A]. In:Stanley Y W Su, ed. Proc. of IEEE ICDE[C]. New Orleans:IEEE Computer Society,1996.
[7]Dongyan Xu, Mohamed Hefeeda, Susanne Hambrusch, Bharat Bhargava, "On Peer-to-Peer Media Streaming", Proceedings of the 22 nd International Conference on Distributed Computing Systems (ICDCS'02), pages 363--371, Vienna, Austria, July 2002
[8]Kubiatowicz J, Bindel D, Chen Y, et al. Oceanstore:an architecture for global2scale persistent storage [A].In:Rudolph L ed. Proc. of the 9th International Con2 ference on Architectural Support for Programming Lan2 guages and Operating Systems (ASPLOS) [C]. Cambridge:ACM,2000.
[9]http://Gnutella.wego.com[EB/OL],2005.
[10]ADAR E, HUBERMAN BA. Free riding on Gnutella [J]. First Monday,2000,5 (10).
[11]CHU Y2H, CHUANG J, ZHANG H. A Case for Taxation in Peer to Peer Streaming Broadcast [A]. ACM SIGCOMM'04 Workshop on Practice and Theory of Incentives in Networked Systems (PINS) [C],2004.
[12]HABIBA, CHUANG J. lncentiveMechanism for Peer to Peer Media Streaming [A].12 th IEEE InternationalWorkshop on Quality of Service [C],2004.
[13]Dongyan Xu, Sunil Suresh Kulkarni, Catherine Rosenberg, Heung-Keung Chai; "Analysis of a CDN-P2P hybrid architecture for cost-effective streaming media distribution" Multimedia Systems (2006) 11(4):383-399
[14][2] Shoaib Khan, Rudiger Schollmeier; "A Performance Comparison of Multiple Description Video Streaming in Peer-to-Peer and Content Delivery Networks"; 2004 IEEE International Conference on Multimedia and Expo (ICME)
[15]Mohamed M. Hefeeda, Bharat K. Bhargava, David K. Y. Yau.A hybrid architecture for cost-effective on-demand media streaming Department of Computer Sciences, Purdue University, West Lafayette, IN 17907, USA,11 November 2002;
[16]杨薇薇,黄年松：一种P2P流媒体数据传输任务分派算法华中科技大学计算机科学与技术学院湖北武汉
[17]姚源,褚伟;P2P和CDN中MDC流媒体的性能对比：计算机技术与发展2007年第9期
[18]邓亮;P2P与CDN结合实现的IPVT点播业务;网络应用2007年第1期
[19]杨扬,王嵩,朱明;基于P2P的CDN系统的安全认证模型—DPKI;计算机应用2007年第3期
[20]罗彬,王宏远,景麟,郭跃：基于MDC的P2P方式视频直播方案 华中科技大学数字视频中心,湖北 武汉
[21]方建国,杨宇航,熊云凤;基于DRM和P2P技术的内容分发模式;通信技术
[22]王薇薇;基于CDN的流媒体分发技术研究；北京科技大学硕士学位论文
[23]李瀚；CDN网络中P2P内容分发机制的研究与实现；东北大学硕士学位论文
[24]侯自强.P2P拯救IPTV[N].通信产业报,2006,6(5)：41.
[25]Shoaib Khan, Rudiger Schollmeier,Eckehard Steinbach; A Performance Comparison of Multiple Description Video Streaming in peer-to-Peer and Content Delivery Networks; 2004 IEEE International Conference on Multimedia and Expo (ICME)
[2]杨传栋,余镇危,王行刚;结合CDN与P2P技术的混合流媒体系统研究;计算机应用2005年第9期
[3]杨晓波;P2P技术在CDN网络中的应用研究;计算机系统应用2007年第3期
[4]杨杰,周建芳；浅谈基于P2P的流媒体服务技术武汉大学计算机学院,湖北武汉
[5]章勤,戴飞；Peer-to-Peer流媒体系统中容错机制的研究华中科技大学计算机科学与技术学院湖北武汉
[6]Chen Y, Edler J, Goldberg A, et al. A prototype implementation of archival intermemory [A]. In:Stanley Y W Su, ed. Proc. of IEEE ICDE[C]. New Orleans:IEEE Computer Society,1996.
[7]Dongyan Xu, Mohamed Hefeeda, Susanne Hambrusch, Bharat Bhargava, "On Peer-to-Peer Media Streaming", Proceedings of the 22 nd International Conference on Distributed Computing Systems (ICDCS'02), pages 363--371, Vienna, Austria, July 2002
[8]Kubiatowicz J, Bindel D, Chen Y, et al. Oceanstore:an architecture for global2scale persistent storage [A].In:Rudolph L ed. Proc. of the 9th International Con2 ference on Architectural Support for Programming Lan2 guages and Operating Systems (ASPLOS) [C]. Cambridge:ACM,2000.
[9]http://Gnutella.wego.com[EB/OL],2005.
[10]ADAR E, HUBERMAN BA. Free riding on Gnutella [J]. First Monday,2000,5 (10).
[11]CHU Y2H, CHUANG J, ZHANG H. A Case for Taxation in Peer to Peer Streaming Broadcast [A]. ACM SIGCOMM'04 Workshop on Practice and Theory of Incentives in Networked Systems (PINS) [C],2004.
[12]HABIBA, CHUANG J. lncentiveMechanism for Peer to Peer Media Streaming [A].12 th IEEE InternationalWorkshop on Quality of Service [C],2004.
[13]Dongyan Xu, Sunil Suresh Kulkarni, Catherine Rosenberg, Heung-Keung Chai; "Analysis of a CDN-P2P hybrid architecture for cost-effective streaming media distribution" Multimedia Systems (2006) 11(4):383-399
[14][2] Shoaib Khan, Rudiger Schollmeier; "A Performance Comparison of Multiple Description Video Streaming in Peer-to-Peer and Content Delivery Networks"; 2004 IEEE International Conference on Multimedia and Expo (ICME)
[15]Mohamed M. Hefeeda, Bharat K. Bhargava, David K. Y. Yau.A hybrid architecture for cost-effective on-demand media streaming Department of Computer Sciences, Purdue University, West Lafayette, IN 17907, USA,11 November 2002;
[16]杨薇薇,黄年松：一种P2P流媒体数据传输任务分派算法华中科技大学计算机科学与技术学院湖北武汉
[17]姚源,褚伟;P2P和CDN中MDC流媒体的性能对比：计算机技术与发展2007年第9期
[18]邓亮;P2P与CDN结合实现的IPVT点播业务;网络应用2007年第1期
[19]杨扬,王嵩,朱明;基于P2P的CDN系统的安全认证模型—DPKI;计算机应用2007年第3期
[20]罗彬,王宏远,景麟,郭跃：基于MDC的P2P方式视频直播方案 华中科技大学数字视频中心,湖北 武汉
[21]方建国,杨宇航,熊云凤;基于DRM和P2P技术的内容分发模式;通信技术
[22]王薇薇;基于CDN的流媒体分发技术研究；北京科技大学硕士学位论文
[23]李瀚；CDN网络中P2P内容分发机制的研究与实现；东北大学硕士学位论文
[24]侯自强.P2P拯救IPTV[N].通信产业报,2006,6(5)：41.
[25]Shoaib Khan, Rudiger Schollmeier,Eckehard Steinbach; A Performance Comparison of Multiple Description Video Streaming in peer-to-Peer and Content Delivery Networks; 2004 IEEE International Conference on Multimedia and Expo (ICME)
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |