一种基于FSTP协议的手持设备音视频流媒体点播系统设计与实现
|
摘要
随着“信息高速公路”的兴起和发展以及音视频压缩技术的进步,音视频点播系统开始进入新的领域,并且能为行业用户提供多种解决方案,以满足用户的各种需求。基于嵌入式手持设备的点播系统是继互联网音视频点播系统之后新兴的一种传媒方式,它是嵌入式技术、无线网络通信技术、多媒体技术等多学科、多领域融合交叉的产物。
本文以音视频点播为研究对象,以基于Linux操作系统的嵌入式手持设备作为客户端设备,并通过与服务器端相结合实现一个完整的运行于无线局域网的点播系统。运行在手持终端上的客户端具有用户验证、浏览并播放视频等功能。服务器端以统一数据资源为核心,通过统一身份认证,将各应用系统中用户权限范围内的功能进行集中提供,用户可获得基于角色的个性化操作界面。客户端和服务器的通信基于无线WIFI网络,视频的压缩采用H.263或H.264视频压缩标准。
本文针对构建一个适合于手持式设备的点播系统的三个主要部分分别提出了高效的解决方案。在音视频的数据传输上,为了充分利用无线网络的带宽,提高音视频传输速率,本文在详细分析了传输层TCP协议和UDP协议的原理的基础上,设计并初步实现了一种基于UDP协议之上的文件流传输协议：FSTP(File Stream Transport Protocol)协议。其次,在MAGUS手持设备上,充分利用其提供的ARM9和DSP双核优势,实现了一个高效的流媒体播放客户端。最后,为了使流媒体服务器能同时支持尽可能多的客户端,设计并实现了一种Linux下的结合了线程池和I/O复用的高性能服务器模型,并应用在流媒体服务器中。
With the rapid development of "information superhighway" and the improvement of audio and video compression technology, VOD system has entered a new area, and can provide a variety of industry solutions to meet user needs. The VOD system based on embedded system is a new system of mass media after the internet VOD system and is a combination of multiple technologies which include embedded technology, wireless network communication technology and multimedia technology.
In this thesis, based on handheld devices which ported the embedded Linux operating system,a complete VOD system running on wireless LAN is impletementd. This VOD system consists of some client applications running on handheld devices and a server application running on PC server. The client application has many features such as user authentication, browsing and playing video and etc. By unifying the server side data resource and account authentication and providing centralized system functions within the user rights, user can access to personalized role-based user interface. Client and server communicates with each other based on wireless WIFI networks, video compression uses H.263 or H.264 video compression and coding standard.
In this paper, effective solutions for three main components of the VOD system were put forward respectively.In order to take full advantage of the wireless network bandwidth and improve the audio and video transmission rate, on the basis of analyzing the TCP protocol and UDP protocol's principle, FSTP (File Stream Transport Protocol) protocol which is a streaming media file transfer protocol on top of UDP is designed and implemented. Secondly, a high performance streaming media player which can fully utilize MAGUS plantform's dual-core of ARM and DSP's performance is implemented. Finally, in order to support multi-clients simultaneously, a new high-performance network servers model combining the thread pool and I/O multiplexing techonology is implemented and applied in streaming media server.
本文以音视频点播为研究对象,以基于Linux操作系统的嵌入式手持设备作为客户端设备,并通过与服务器端相结合实现一个完整的运行于无线局域网的点播系统。运行在手持终端上的客户端具有用户验证、浏览并播放视频等功能。服务器端以统一数据资源为核心,通过统一身份认证,将各应用系统中用户权限范围内的功能进行集中提供,用户可获得基于角色的个性化操作界面。客户端和服务器的通信基于无线WIFI网络,视频的压缩采用H.263或H.264视频压缩标准。
本文针对构建一个适合于手持式设备的点播系统的三个主要部分分别提出了高效的解决方案。在音视频的数据传输上,为了充分利用无线网络的带宽,提高音视频传输速率,本文在详细分析了传输层TCP协议和UDP协议的原理的基础上,设计并初步实现了一种基于UDP协议之上的文件流传输协议：FSTP(File Stream Transport Protocol)协议。其次,在MAGUS手持设备上,充分利用其提供的ARM9和DSP双核优势,实现了一个高效的流媒体播放客户端。最后,为了使流媒体服务器能同时支持尽可能多的客户端,设计并实现了一种Linux下的结合了线程池和I/O复用的高性能服务器模型,并应用在流媒体服务器中。
With the rapid development of "information superhighway" and the improvement of audio and video compression technology, VOD system has entered a new area, and can provide a variety of industry solutions to meet user needs. The VOD system based on embedded system is a new system of mass media after the internet VOD system and is a combination of multiple technologies which include embedded technology, wireless network communication technology and multimedia technology.
In this thesis, based on handheld devices which ported the embedded Linux operating system,a complete VOD system running on wireless LAN is impletementd. This VOD system consists of some client applications running on handheld devices and a server application running on PC server. The client application has many features such as user authentication, browsing and playing video and etc. By unifying the server side data resource and account authentication and providing centralized system functions within the user rights, user can access to personalized role-based user interface. Client and server communicates with each other based on wireless WIFI networks, video compression uses H.263 or H.264 video compression and coding standard.
In this paper, effective solutions for three main components of the VOD system were put forward respectively.In order to take full advantage of the wireless network bandwidth and improve the audio and video transmission rate, on the basis of analyzing the TCP protocol and UDP protocol's principle, FSTP (File Stream Transport Protocol) protocol which is a streaming media file transfer protocol on top of UDP is designed and implemented. Secondly, a high performance streaming media player which can fully utilize MAGUS plantform's dual-core of ARM and DSP's performance is implemented. Finally, in order to support multi-clients simultaneously, a new high-performance network servers model combining the thread pool and I/O multiplexing techonology is implemented and applied in streaming media server.
引文
[1]Matthew Gast.802.11 Wireless Networks: The Definitive Guide. Second Edition.O'Reilly Media, Inc. May 2,2005.
[2]怯肇乾编著.嵌入式系统硬件体系设计.第一版.北京航空航天大学出版社2007,7.
[3]Inchoon Choi, Jeyun Lee, Byeungwoo Jeon. Fast Coding Mode Selection With Rate-Distortion Optimization for MPEG-4 Part-10 AVC/H.264. IEEE Transactions on. Circuits and Systems for Video Technology. Dec,2006.
[4]张小燕,谢珺堂.最新视频编码标准H.264及其核心技术.现代电视技术.2004,11.
[5]高嵩,赵方,宋茂强.移动流媒体视频监控系统的研究与设计.计算机应用研究.2009,,3.第26卷,第3期.
[6]李太君,吴泽晖.流媒体传输协议及其应用开发.计算机工程与应用.2004年3月.
[7]Mplayer homepage.http://www.mplayerhq.hu/.
[8]LIVE555 Streaming Media homepage.http://www.live555.com/
[9]W.Richard Stevens著.TCP/IP详解(卷1：协议).第一版.机械工业出版社.2000,4.
[10][美]史蒂文斯等著.UNIX网络编程卷1：套接字联网API第三版[M].人民邮电出版社,2010,7.
[11]林朝龙.基于RTP的网络视频传输的应用研究.信息化研究.2009年.第35卷第12期.
[12]兰亚柱,高晶敏,柴哲丽.基于H.264算法的网络视频传输系统实现PLC&FA. 2009,9.
[13]古天龙,蔡国永,网络协议的形式化分析与设计.第一版.电子工业出版社.2003,6.
[14]黄远峰,宗平.基于UDP的滑动窗口协议的设计与实现.南京邮电大学学报.2007年.第27卷,第四期.
[15]王丹.基于嵌入式Linux的无线通信协议的设计和实现.西南民族大学学报·自然科学版.2008年.第34卷第6期.
[16]Nikolay Kakanakov, Ivan Stankov, Mitko Shopov, Grisha Spasov. Controller Network Data Extracting Protocol - Design and Implementation. International Conference on Computer Systems and Technologies.2006.
[17]曲柳莺.流媒体传输协议的研究.电子科技大学硕士学位论文.答辩时间:2005,3.
[18]冯时雨,王轶辰.实时网络通信协议的设计与实现.计算机工程与设计.2008,9.第29卷,第17期.
[19]李志淮,周晓玮.网络通信中自定义协议的一种指定方法.大连理工大学学报.2005,10.第45卷增刊.
[20]张立涓. 基于UDP的广播系统中应用层通信协议的设计与实现.计算机时代2010年.第3期.
[21]刘小虎,谢顺依.自定义协议在多机通讯中的实现.微处理机.2005,4.第2期.
[22]陈旭孟,张卫.一个面向实时传输的应用层组播协议的设计.计算机应用与软件.2008,9.第25卷,第9期.
[23]fltk homepage.http://fltk.org/.
[24]Solomon Systech.SSD1933/35 Multimedia Processor Reference Manual Rev.1.0.
[25]M.Tim Jones使用异步I/O大大提高应用程序的性能IBM developerworks Linux文档库.2006,9.
[26]李涛,房鼎益,陈晓江,冯健Linux系统中网络I/O性能改进方法的研究[J].计算机工程,2008,12.第34卷,第23期.
[27]王文武,赵卫东,王志成,陈悦,韩下林.高性能服务器底层网络通信模块的设计方法[J].计算机工程.2009,2.第35卷,第3期.
[28]吴炜荣,梁阿磊,吴刚.基于POSIX线程库的线程池反馈算法的设计与实现[J].微型电脑应用.2006年.第22卷,第5期.
[29]张南平,徐静.基于进程池的Linux并发服务器的研究[J].计算机与数字工程,2009,第1期.
[30]张复兴,曾新洲.扩展线程池模型及性能分析[J].计算技术与自动化.2007,12,第26卷,第4期.
[31]杨开杰,刘秋菊,徐汀荣.线程池的多线程并发控制技术研究[J].计算机应用与软件.2010,1.第1期,第27卷.
[32]胡萌,赵卫东,王志成,韩下林.线程池设计与动态优化[J].电脑知识与技术.2008,12.第4卷,第9期.
[33][美]Kay A.Robbins Steven Robbins著.陈涓,赵振平译.UNIX系统编程[M].机械工 业出版社.2005.5.
[34][德]莫尔勒著,郭旭译.深入Linux内核架构[M].人民邮电出版社.2010,6.
[35]Matt Welsh, Steven D. Gribble, Eric A. Brewer and David Culler. A Design Framework for Highly Concurrent Systems. EECS Department University of California, Berkeley Technical Report No. UCB/CSD-00-1108 2000.
[36]Banerjee Dwip N, Baratakke Kavitha Vittal Murthy, Jain Vinit,Venkatsubra Venkat. Monitoring thread usage to dynamically control a thread pool. US Patent 7568030. July 28, 2009.
[37]Louay Gammo, Tim Brecht, Amol Shukla. David Pariag. Comparing and Evaluating epoll, select, and poll Event Mechanisms. Proceedings of the Linux Symposium. July 21st-24th,2004.
[38]Suparna Bhattacharya, John Tran, Mike Sullivan,Chris Mason. Linux AIO Performance and Robustness for Enterprise Workloads. Proceedings of the Linux Symposium. July 21st-24th,2004.
[39]Charles Krasic, Ashvin Goel, Ludovic Martorell,Jonathan Walpole, Wu-chi Feng.Wu-chang Feng. System Support for High-Performance Application Overlays. OGI@OHSU techonology report.March,2003.
[40]张轶凡,卢正兴,王芙蓉Linux下高性能网络I/O解决方案分析MODERN COMPUTER.2006,11.
[41]epoll-Linux man page. http://www.kernel.org/doc/man-pages/online/pages/man4/epoll4.html
[42](美)史蒂文斯,(美)拉戈著,尤晋元,张亚英,戚正伟译.UNIX环境高级编程(第2版).人民邮电出版社.2006,5.
[43][美]Qing Qi著,王安生译.嵌入式系统的实时概念.第一版.北京航空航天大学出版社.2004,6.
[44]吴国伟,李庄,任广臣Linux内核分析及高级编程.电子工业出版社.2008,1.
[45]李实,刘乃琦,郭建东.多核架构下的多线程负载平衡.计算机应用.2008,12.第28卷.
[46]Robin sharp. Principles of Protocol Design. Springer-Verlag Berlin Heidelberg.2008.
[47]杜春雷 编著.ARM体系结构与编程.第一版.清华大学出版社.2003,02.
[48]Ulrich Drepper,Ingo Molnar. The Native POSIX Thread Library for Linux. Red Hat. Inc. February 21,2005.
[49]C10K problem. http://www.kegel.com/c10k.html.
[50]Mysql homepage.http://www.mysql.com.
[2]怯肇乾编著.嵌入式系统硬件体系设计.第一版.北京航空航天大学出版社2007,7.
[3]Inchoon Choi, Jeyun Lee, Byeungwoo Jeon. Fast Coding Mode Selection With Rate-Distortion Optimization for MPEG-4 Part-10 AVC/H.264. IEEE Transactions on. Circuits and Systems for Video Technology. Dec,2006.
[4]张小燕,谢珺堂.最新视频编码标准H.264及其核心技术.现代电视技术.2004,11.
[5]高嵩,赵方,宋茂强.移动流媒体视频监控系统的研究与设计.计算机应用研究.2009,,3.第26卷,第3期.
[6]李太君,吴泽晖.流媒体传输协议及其应用开发.计算机工程与应用.2004年3月.
[7]Mplayer homepage.http://www.mplayerhq.hu/.
[8]LIVE555 Streaming Media homepage.http://www.live555.com/
[9]W.Richard Stevens著.TCP/IP详解(卷1：协议).第一版.机械工业出版社.2000,4.
[10][美]史蒂文斯等著.UNIX网络编程卷1：套接字联网API第三版[M].人民邮电出版社,2010,7.
[11]林朝龙.基于RTP的网络视频传输的应用研究.信息化研究.2009年.第35卷第12期.
[12]兰亚柱,高晶敏,柴哲丽.基于H.264算法的网络视频传输系统实现PLC&FA. 2009,9.
[13]古天龙,蔡国永,网络协议的形式化分析与设计.第一版.电子工业出版社.2003,6.
[14]黄远峰,宗平.基于UDP的滑动窗口协议的设计与实现.南京邮电大学学报.2007年.第27卷,第四期.
[15]王丹.基于嵌入式Linux的无线通信协议的设计和实现.西南民族大学学报·自然科学版.2008年.第34卷第6期.
[16]Nikolay Kakanakov, Ivan Stankov, Mitko Shopov, Grisha Spasov. Controller Network Data Extracting Protocol - Design and Implementation. International Conference on Computer Systems and Technologies.2006.
[17]曲柳莺.流媒体传输协议的研究.电子科技大学硕士学位论文.答辩时间:2005,3.
[18]冯时雨,王轶辰.实时网络通信协议的设计与实现.计算机工程与设计.2008,9.第29卷,第17期.
[19]李志淮,周晓玮.网络通信中自定义协议的一种指定方法.大连理工大学学报.2005,10.第45卷增刊.
[20]张立涓. 基于UDP的广播系统中应用层通信协议的设计与实现.计算机时代2010年.第3期.
[21]刘小虎,谢顺依.自定义协议在多机通讯中的实现.微处理机.2005,4.第2期.
[22]陈旭孟,张卫.一个面向实时传输的应用层组播协议的设计.计算机应用与软件.2008,9.第25卷,第9期.
[23]fltk homepage.http://fltk.org/.
[24]Solomon Systech.SSD1933/35 Multimedia Processor Reference Manual Rev.1.0.
[25]M.Tim Jones使用异步I/O大大提高应用程序的性能IBM developerworks Linux文档库.2006,9.
[26]李涛,房鼎益,陈晓江,冯健Linux系统中网络I/O性能改进方法的研究[J].计算机工程,2008,12.第34卷,第23期.
[27]王文武,赵卫东,王志成,陈悦,韩下林.高性能服务器底层网络通信模块的设计方法[J].计算机工程.2009,2.第35卷,第3期.
[28]吴炜荣,梁阿磊,吴刚.基于POSIX线程库的线程池反馈算法的设计与实现[J].微型电脑应用.2006年.第22卷,第5期.
[29]张南平,徐静.基于进程池的Linux并发服务器的研究[J].计算机与数字工程,2009,第1期.
[30]张复兴,曾新洲.扩展线程池模型及性能分析[J].计算技术与自动化.2007,12,第26卷,第4期.
[31]杨开杰,刘秋菊,徐汀荣.线程池的多线程并发控制技术研究[J].计算机应用与软件.2010,1.第1期,第27卷.
[32]胡萌,赵卫东,王志成,韩下林.线程池设计与动态优化[J].电脑知识与技术.2008,12.第4卷,第9期.
[33][美]Kay A.Robbins Steven Robbins著.陈涓,赵振平译.UNIX系统编程[M].机械工 业出版社.2005.5.
[34][德]莫尔勒著,郭旭译.深入Linux内核架构[M].人民邮电出版社.2010,6.
[35]Matt Welsh, Steven D. Gribble, Eric A. Brewer and David Culler. A Design Framework for Highly Concurrent Systems. EECS Department University of California, Berkeley Technical Report No. UCB/CSD-00-1108 2000.
[36]Banerjee Dwip N, Baratakke Kavitha Vittal Murthy, Jain Vinit,Venkatsubra Venkat. Monitoring thread usage to dynamically control a thread pool. US Patent 7568030. July 28, 2009.
[37]Louay Gammo, Tim Brecht, Amol Shukla. David Pariag. Comparing and Evaluating epoll, select, and poll Event Mechanisms. Proceedings of the Linux Symposium. July 21st-24th,2004.
[38]Suparna Bhattacharya, John Tran, Mike Sullivan,Chris Mason. Linux AIO Performance and Robustness for Enterprise Workloads. Proceedings of the Linux Symposium. July 21st-24th,2004.
[39]Charles Krasic, Ashvin Goel, Ludovic Martorell,Jonathan Walpole, Wu-chi Feng.Wu-chang Feng. System Support for High-Performance Application Overlays. OGI@OHSU techonology report.March,2003.
[40]张轶凡,卢正兴,王芙蓉Linux下高性能网络I/O解决方案分析MODERN COMPUTER.2006,11.
[41]epoll-Linux man page. http://www.kernel.org/doc/man-pages/online/pages/man4/epoll4.html
[42](美)史蒂文斯,(美)拉戈著,尤晋元,张亚英,戚正伟译.UNIX环境高级编程(第2版).人民邮电出版社.2006,5.
[43][美]Qing Qi著,王安生译.嵌入式系统的实时概念.第一版.北京航空航天大学出版社.2004,6.
[44]吴国伟,李庄,任广臣Linux内核分析及高级编程.电子工业出版社.2008,1.
[45]李实,刘乃琦,郭建东.多核架构下的多线程负载平衡.计算机应用.2008,12.第28卷.
[46]Robin sharp. Principles of Protocol Design. Springer-Verlag Berlin Heidelberg.2008.
[47]杜春雷 编著.ARM体系结构与编程.第一版.清华大学出版社.2003,02.
[48]Ulrich Drepper,Ingo Molnar. The Native POSIX Thread Library for Linux. Red Hat. Inc. February 21,2005.
[49]C10K problem. http://www.kegel.com/c10k.html.
[50]Mysql homepage.http://www.mysql.com.