基于OMAP5912的语音识别系统的ARM端开发环境的建立
摘要
随着第三代移动通信技术的发展，消费者对无线通信所提供的服务提出了更高的要求，从单纯的话音服务到很多复杂的应用，如移动电子商务、实时因特网技术、语音识别、音频和视频等。这些应用的发展必然使移动通信和信号处理的复杂度大大提高，从而使硬件和软件的复杂度更高，能量消耗更大。对于消费者来说，在要求所使用的无线通信产品具有更多、更好功能的同时，还要求耗电量更低，体积更小，外观更精美。
为了实现这些看似矛盾的要求，德州仪器公司提供了一种很好的解决方案，即开放式多媒体应用平台——OMAP(Open Multimedia Application Platform)。OMAP是一种片上系统(SoC)，既能高效地处理多媒体信号，体积和功耗又很小。它的硬件和软件可以实时解码数据流，例如处理MP3格式的音频流和MPEG-4格式的视频流，所消耗的功耗比最好性能的RISC处理器还要小很多。
针对OMAP处理器对语音应用的特别支持，在OMAP平台上做语音处理的开发将大有可为。本文分析了OMAP的构架和用它做嵌入式语音识别开发的有利条件。
做一个功能丰富，人机交互友好的嵌入式语音识别系统一个功能强大的嵌入式操作系统必不可少。本文分析了嵌入式系统的现状和发展趋势，并选择了Linux操作系统。
将嵌入式操作系统移植到嵌入式开发平台并开发其设备驱动程序是嵌入式系统开发中的热点。本文根据OMAP开发平台的配置首先移植了U-boot作为开发板的Boot Loader。接着研究了嵌入式Linux的开发平台建立方法、内核的功能结构和源代码结构、内核移植方法、内核裁剪方法，分析了与平台相关的代码。研究了怎样在Linux中编写中断设备的驱动程序。
本文使用装有RedHat Linux的PC做开发主机。在其上安装交叉编译工具，构建交叉编译环境，配置minicom、TFTP、NFS等构建嵌入式软件平台。分析了U-boot的目录结构、启动流程和移植方法，结合具体的OMAP开发板成功的将U-boot移植到目标开发板；分析了嵌入式Linux的内核特点、目录结构、启动流程以及相关代码，通过修改内核源码中与硬件体系结构相关部分的代码，实现了Linux到OMAP的移植。文中给出了详细的移植实现过程，构建了JFFS2文件系统并将外围设备驱动移植到嵌入式OMAP平台。
Along with the third generation mobile communication technology, customers have a higher demand for the service provided by wireless communication. They are expecting more complicated functions, such as mobile electronic bussiness, real time internet; speech recognition, AV and so on. Such applications will of course make mobile communication and signal process more complicated. And hardware and software will be more complicated, power consumption will increase markedly as a result. For customers, they are looking for a terminal with stronger functions while it's minier, cuter, lower power consumed.
To resolve these problemes, TI provides a perfect development platform-OMAP (Open Multimedia Application Platform). As a SoC, OMAP can play a nice performance on multimedia signals with low power consumption. Its hardware and software can process real time data effectively, including MP3 and MPEG-4. Its power consumption is lower than a good RISC.
OMAP has a special assistant for speech signal processing. The market will have a fast grow. This thesis described the structure of OMAP and analysied why it's suitble for embedded speech recognition system.
An OS is needed. This paper analysis severial OSs and chose Linux for this system.
It's a hot point to implement embedded OS to embedded system and develop its drivers. This paper programmed a Boot Loader for the system firstly, to accomplish this, U-boot is implemented to the OMAP5912 board. Then I analyzed the the way to establish an embedded Linux development platform, the functional structure and source code structure of kernel, porting and tailoring methords. Analyzed the platform related codes.
In this article a PC with Red Hat9.0 was taken to be the host. A cross-compile tool chain was configured, also minicom, TFTP, NFS. The content structure, booting sequence of U-boot porting was analyzed and U-boot is successfully implemented to the embedded system. Embedded Linux kernel, content structure, start flow as well as some codes related are analyzed. Codes in Linux kernel which are related to the hardware platform are modified and the kernel was implemented successfully. The implementing procedure is listed in detail. JFFS2 system is constructed and the drivers of the related devices were implementd to the embedded system.
为了实现这些看似矛盾的要求，德州仪器公司提供了一种很好的解决方案，即开放式多媒体应用平台——OMAP(Open Multimedia Application Platform)。OMAP是一种片上系统(SoC)，既能高效地处理多媒体信号，体积和功耗又很小。它的硬件和软件可以实时解码数据流，例如处理MP3格式的音频流和MPEG-4格式的视频流，所消耗的功耗比最好性能的RISC处理器还要小很多。
针对OMAP处理器对语音应用的特别支持，在OMAP平台上做语音处理的开发将大有可为。本文分析了OMAP的构架和用它做嵌入式语音识别开发的有利条件。
做一个功能丰富，人机交互友好的嵌入式语音识别系统一个功能强大的嵌入式操作系统必不可少。本文分析了嵌入式系统的现状和发展趋势，并选择了Linux操作系统。
将嵌入式操作系统移植到嵌入式开发平台并开发其设备驱动程序是嵌入式系统开发中的热点。本文根据OMAP开发平台的配置首先移植了U-boot作为开发板的Boot Loader。接着研究了嵌入式Linux的开发平台建立方法、内核的功能结构和源代码结构、内核移植方法、内核裁剪方法，分析了与平台相关的代码。研究了怎样在Linux中编写中断设备的驱动程序。
本文使用装有RedHat Linux的PC做开发主机。在其上安装交叉编译工具，构建交叉编译环境，配置minicom、TFTP、NFS等构建嵌入式软件平台。分析了U-boot的目录结构、启动流程和移植方法，结合具体的OMAP开发板成功的将U-boot移植到目标开发板；分析了嵌入式Linux的内核特点、目录结构、启动流程以及相关代码，通过修改内核源码中与硬件体系结构相关部分的代码，实现了Linux到OMAP的移植。文中给出了详细的移植实现过程，构建了JFFS2文件系统并将外围设备驱动移植到嵌入式OMAP平台。
Along with the third generation mobile communication technology, customers have a higher demand for the service provided by wireless communication. They are expecting more complicated functions, such as mobile electronic bussiness, real time internet; speech recognition, AV and so on. Such applications will of course make mobile communication and signal process more complicated. And hardware and software will be more complicated, power consumption will increase markedly as a result. For customers, they are looking for a terminal with stronger functions while it's minier, cuter, lower power consumed.
To resolve these problemes, TI provides a perfect development platform-OMAP (Open Multimedia Application Platform). As a SoC, OMAP can play a nice performance on multimedia signals with low power consumption. Its hardware and software can process real time data effectively, including MP3 and MPEG-4. Its power consumption is lower than a good RISC.
OMAP has a special assistant for speech signal processing. The market will have a fast grow. This thesis described the structure of OMAP and analysied why it's suitble for embedded speech recognition system.
An OS is needed. This paper analysis severial OSs and chose Linux for this system.
It's a hot point to implement embedded OS to embedded system and develop its drivers. This paper programmed a Boot Loader for the system firstly, to accomplish this, U-boot is implemented to the OMAP5912 board. Then I analyzed the the way to establish an embedded Linux development platform, the functional structure and source code structure of kernel, porting and tailoring methords. Analyzed the platform related codes.
In this article a PC with Red Hat9.0 was taken to be the host. A cross-compile tool chain was configured, also minicom, TFTP, NFS. The content structure, booting sequence of U-boot porting was analyzed and U-boot is successfully implemented to the embedded system. Embedded Linux kernel, content structure, start flow as well as some codes related are analyzed. Codes in Linux kernel which are related to the hardware platform are modified and the kernel was implemented successfully. The implementing procedure is listed in detail. JFFS2 system is constructed and the drivers of the related devices were implementd to the embedded system.
引文
[01] Taxes Instruments, Bringing Streaming Video to Wireless Handheld Devices (SWPY005), May 2002
[02] 郭刚，AMBE-1000语音编码．解码器芯片及其应用，国外电子元器件，2001，3：18-21
[03] 张刚，张雪英，马建芬，语音处理与编码，北京，兵器工业出版社，2000．8
[04] Taxes Instruments, Multimedia Technologies on Terminal Based on the OMAP Platform (SWPY006), June 2002
[05] 陈文智等，嵌入式系统开发原理与实践，北京，清华大学出版社，2005．8
[06] 彭启琮，杨錬，潘晔，开放式多媒体应用平台—OMAP处理器的原理及应用，北京，电子工业出版社，2005．6
[07] Taxes Instruments, OMAP: Enabling Multimedia Application in Third Generation (3G) Wireless Terminals (swpa001), December 2000
[08] 袁爱平，杨万全，基于OMAP2的3G多媒体技术及应用，现代电子技术，2005
[09] 陈喆，开放式多媒体应用平台(OMAP)，杭州电子工业学院学报，2002，11：20-22
[10] Taxes Instruments, OMAP2 Architechure: OMAP2410 and OMAP2420 Processors (SWPT010), 2004
[11] Taxes Instruments, Resource Manager Server Design, 2000
[12] 杜春雷，ARM体系结构与编程，北京，清华大学出版社，2003．2
[13] Taxes Instruments, Enabling the Killer Application (SWPY004), April 2002
[14] Taxes Instruments, Interprocessor Communications with Multiple Signal processors, Developer Conference, 2004
[15] Taxes Instruments, OMAP5910 Data Manual (SPRS 197),2003
[16] 肖金锽，殷小贡，张淼，基于双核OMAP5910的嵌入式系统及其应用，电子设计应用，2004，10：106-108
[17] Taxes Instruments, OMAP Instruction Set Simulator Technical Overview (SPRU8018), May 2003
[18] Steve Fuber,ARM Soc 体系结构，北京，北京航空航天大学出版社，2003．7
[19] 苏绍璟，吕喜在，黄飞，开放式多媒体应用平台OMAP5910双核通讯，微计算机信息，2005，21(5)：66-69
[20] 唐林波，赵保军，韦海萍，DSP／BIOS在TMS320C6000编程中的应用及自举引导方法，测控技术，2004，23：284-286
[21] Taxes Instruments, Developing Core Software Technologies for TI's OMAP Platform (SWPY006),August 2002
[22] 唐闺臣，王萍，嵌入式实时操作系统μ C／OS-Π在ARM上的移植应用，河海大学常州分校学报，2003，17：77-80
[23] 孙天泽等，嵌入式设计及Linux驱动开发指南，北京，电子工业出版社，2005．2
[24] 范永开，杨爱林，Linux应用开发技术详解，北京，人民邮电出版社2006．2
[25] 马忠梅等，ARM嵌入式处理器结构与应用基础，北京，北京航空航天大学出版社，2002．1
[26] 金西，黄汪，嵌入式Linux及其关键技术，微型机与应用，2000，7：63-65
[27] Spectrumdigital,OSK5912 User Guide,2004
[28] Taxes Instruments, Configuring Code Composer Studio for OMAP Debugging (SPRA807),November 2001
[29] 赵炯，Linux内核完全注释，北京，机械工业出版社，2004．9
[30] 刘峥嵘，嵌入式Linux应用开发详解，北京，机械工业出版社，2005．1
[31] 曹计昌，余隽，关于提高Linux核心实时处理能力的讨论，计算机应用，2001，21(1)：75-78
[32] 李小群，赵慧斌，叶以民等，RFRTOS：基于Linux的实时操作系统，2003，软件学报，14(7)：12030-1212
[33] 魏平等，Linux体系结构及嵌入式Linux的移植方法，东南大学学报(自然科学版)，2004．11：94-97
[34] 曹程远，U-boot在S3C2410上的移植，微型电脑应用，2005．7，21：104-107
[35] 孙纪坤，张小全，嵌入式Linux系统开发技术详解—基于ARM，北京，人民邮电出版社，2006．8
[36] Taxes Instruments, OMAP5912 Multimedia Processor Memery Interfaces Refence Guide (SPRU756A), March 2004
[37] 张云蓉等，基于调用图的嵌入式Linux裁减技术研究，哈尔滨理工大学学报，2004，2：113-115
[38] 吴圣宁，吴海平，嵌入式操作系统规范化内核设计研究，计算机工程，2001，27(3)：154-156
[39] 杨延军，用busybox制作嵌入式Linux的文件系统，单片机与嵌入式系统，2005．4，20(5)：31-33
[40] 顾宝根，顾喜梅，日志结构的嵌入式文件系统研究，计算机工程与设计，25(6)：17-21
[41] Alessandro Ruibini(LISOLEG译)，Linux设备驱动程序，北京，中国电力出版社，2002，5
[42] David Woodhouse, JFFS: The Journal Flash File System, Red Hat Inc.
[43] Crag Hollabau曲，嵌入式Linux硬件、软件与接口，北京，电子工业出版社，2003．11
[02] 郭刚，AMBE-1000语音编码．解码器芯片及其应用，国外电子元器件，2001，3：18-21
[03] 张刚，张雪英，马建芬，语音处理与编码，北京，兵器工业出版社，2000．8
[04] Taxes Instruments, Multimedia Technologies on Terminal Based on the OMAP Platform (SWPY006), June 2002
[05] 陈文智等，嵌入式系统开发原理与实践，北京，清华大学出版社，2005．8
[06] 彭启琮，杨錬，潘晔，开放式多媒体应用平台—OMAP处理器的原理及应用，北京，电子工业出版社，2005．6
[07] Taxes Instruments, OMAP: Enabling Multimedia Application in Third Generation (3G) Wireless Terminals (swpa001), December 2000
[08] 袁爱平，杨万全，基于OMAP2的3G多媒体技术及应用，现代电子技术，2005
[09] 陈喆，开放式多媒体应用平台(OMAP)，杭州电子工业学院学报，2002，11：20-22
[10] Taxes Instruments, OMAP2 Architechure: OMAP2410 and OMAP2420 Processors (SWPT010), 2004
[11] Taxes Instruments, Resource Manager Server Design, 2000
[12] 杜春雷，ARM体系结构与编程，北京，清华大学出版社，2003．2
[13] Taxes Instruments, Enabling the Killer Application (SWPY004), April 2002
[14] Taxes Instruments, Interprocessor Communications with Multiple Signal processors, Developer Conference, 2004
[15] Taxes Instruments, OMAP5910 Data Manual (SPRS 197),2003
[16] 肖金锽，殷小贡，张淼，基于双核OMAP5910的嵌入式系统及其应用，电子设计应用，2004，10：106-108
[17] Taxes Instruments, OMAP Instruction Set Simulator Technical Overview (SPRU8018), May 2003
[18] Steve Fuber,ARM Soc 体系结构，北京，北京航空航天大学出版社，2003．7
[19] 苏绍璟，吕喜在，黄飞，开放式多媒体应用平台OMAP5910双核通讯，微计算机信息，2005，21(5)：66-69
[20] 唐林波，赵保军，韦海萍，DSP／BIOS在TMS320C6000编程中的应用及自举引导方法，测控技术，2004，23：284-286
[21] Taxes Instruments, Developing Core Software Technologies for TI's OMAP Platform (SWPY006),August 2002
[22] 唐闺臣，王萍，嵌入式实时操作系统μ C／OS-Π在ARM上的移植应用，河海大学常州分校学报，2003，17：77-80
[23] 孙天泽等，嵌入式设计及Linux驱动开发指南，北京，电子工业出版社，2005．2
[24] 范永开，杨爱林，Linux应用开发技术详解，北京，人民邮电出版社2006．2
[25] 马忠梅等，ARM嵌入式处理器结构与应用基础，北京，北京航空航天大学出版社，2002．1
[26] 金西，黄汪，嵌入式Linux及其关键技术，微型机与应用，2000，7：63-65
[27] Spectrumdigital,OSK5912 User Guide,2004
[28] Taxes Instruments, Configuring Code Composer Studio for OMAP Debugging (SPRA807),November 2001
[29] 赵炯，Linux内核完全注释，北京，机械工业出版社，2004．9
[30] 刘峥嵘，嵌入式Linux应用开发详解，北京，机械工业出版社，2005．1
[31] 曹计昌，余隽，关于提高Linux核心实时处理能力的讨论，计算机应用，2001，21(1)：75-78
[32] 李小群，赵慧斌，叶以民等，RFRTOS：基于Linux的实时操作系统，2003，软件学报，14(7)：12030-1212
[33] 魏平等，Linux体系结构及嵌入式Linux的移植方法，东南大学学报(自然科学版)，2004．11：94-97
[34] 曹程远，U-boot在S3C2410上的移植，微型电脑应用，2005．7，21：104-107
[35] 孙纪坤，张小全，嵌入式Linux系统开发技术详解—基于ARM，北京，人民邮电出版社，2006．8
[36] Taxes Instruments, OMAP5912 Multimedia Processor Memery Interfaces Refence Guide (SPRU756A), March 2004
[37] 张云蓉等，基于调用图的嵌入式Linux裁减技术研究，哈尔滨理工大学学报，2004，2：113-115
[38] 吴圣宁，吴海平，嵌入式操作系统规范化内核设计研究，计算机工程，2001，27(3)：154-156
[39] 杨延军，用busybox制作嵌入式Linux的文件系统，单片机与嵌入式系统，2005．4，20(5)：31-33
[40] 顾宝根，顾喜梅，日志结构的嵌入式文件系统研究，计算机工程与设计，25(6)：17-21
[41] Alessandro Ruibini(LISOLEG译)，Linux设备驱动程序，北京，中国电力出版社，2002，5
[42] David Woodhouse, JFFS: The Journal Flash File System, Red Hat Inc.
[43] Crag Hollabau曲，嵌入式Linux硬件、软件与接口，北京，电子工业出版社，2003．11