嵌入式窗口特效研究与实现
|
摘要
诸如手机、GPS、PDA等嵌入式移动设备已经成为目前运用最为广泛的具备显示功能的计算机系统,因此该类型的嵌入式移动设备已成为向用户提供先进图形交互技术体验的重要载体。随着嵌入式设备运算能力的迅速发展和三维图形技术的日益成熟,通过在图形系统中融入三维技术来为用户提供更加美观和人性化的图形用户界面已逐步成为图形系统和图形用户界面的重要发展趋势。
嵌入式窗口特效在基于X11协议的嵌入式图形系统ClearX之上进行设计开发。在保持ClearX内部结构和外部接口稳定不变的情况下,充分利用三星S3C6410处理器支持的多层屏幕及硬件双显示缓存等功能,实现窗口特效显示与图形系统显示之间的融合。根据模块化的分层结构设计方式,嵌入式窗口特效的总体设计依据功能划分为窗口特效层和三维图形处理层两层。
窗口特效层中最为核心的问题就是窗口的特效显示。解决方案是通过图形系统将参与特效显示的窗口绘制到一块内存屏幕中,然后把内存屏幕中的窗口图像通过三维图形技术中的纹理映射方法显示出来,从而达到窗口扭曲形变显示的目的。参与特效显示的窗口都被等同于二维纹理对待,所以在窗口特效设计中允许使用其它图像数据来代替窗口参与到窗口特效的显示之中,丰富了嵌入式窗口特效的显示内容和功能。
三维图形处理层主要功能是利用S3C6410所集成的三维图形加速模块向上层提供一个简单高效的三维图形加速库。在这一层中单独加入了本地显示接口和显示缓存管理模块用于处理窗口特效显示、纹理处理等相关问题。
The mobile embedded systems, such as mobile phone, GPS, PDA, etc, are by far the most widely available computer systems with rendering capabilities in the world, so, this kind of embedded systems become the new vehicle for bringing advance interactive graphics technologies to users. With the rapid increasing of computational power of embedded systems and growing maturity of 3D graphics technologies, there has been a definite tendency to apply 3D technique into embedded graphic system for providing more beautiful and user-friendly experience for clients.
Window effect of embedded graphic systems is developed upon ClearX, which is an embedded graphic system based on X11 protocol. Keeping the internal constructions and external interfaces of ClearX unchanged, overlay image windows and hardware double buffer technologies in Samsung processor, S3C6410, are fully used to make smooth switch between window effect rendering and graphic system. According to the modular hierarchical structure design pattern, the overall design of window effect is divided into two layers, window effect layer and 3D graphics processing layer, based on function.
An essential issue in window effect layer is the window effect rendering. The solution is using graphic system to draw the windows on a memory screen, and then display the windows’image into a stunning 3D style by texture mapping. All the windows participate in window effect are all been treated the same as 2D texture, so, any kind of image data is allowed to participate in window effect instead of windows to enrich the visual content and function.
The key function of 3D graphics processing layer is providing a simple and efficient 3D graphics library, based on a 3D graphics hardware accelerator integrated in S3C6410, for the upper layer. In this layer, a native display interface and a frame buffer management module are added to deal with window effect display, texture processing and other issues.
嵌入式窗口特效在基于X11协议的嵌入式图形系统ClearX之上进行设计开发。在保持ClearX内部结构和外部接口稳定不变的情况下,充分利用三星S3C6410处理器支持的多层屏幕及硬件双显示缓存等功能,实现窗口特效显示与图形系统显示之间的融合。根据模块化的分层结构设计方式,嵌入式窗口特效的总体设计依据功能划分为窗口特效层和三维图形处理层两层。
窗口特效层中最为核心的问题就是窗口的特效显示。解决方案是通过图形系统将参与特效显示的窗口绘制到一块内存屏幕中,然后把内存屏幕中的窗口图像通过三维图形技术中的纹理映射方法显示出来,从而达到窗口扭曲形变显示的目的。参与特效显示的窗口都被等同于二维纹理对待,所以在窗口特效设计中允许使用其它图像数据来代替窗口参与到窗口特效的显示之中,丰富了嵌入式窗口特效的显示内容和功能。
三维图形处理层主要功能是利用S3C6410所集成的三维图形加速模块向上层提供一个简单高效的三维图形加速库。在这一层中单独加入了本地显示接口和显示缓存管理模块用于处理窗口特效显示、纹理处理等相关问题。
The mobile embedded systems, such as mobile phone, GPS, PDA, etc, are by far the most widely available computer systems with rendering capabilities in the world, so, this kind of embedded systems become the new vehicle for bringing advance interactive graphics technologies to users. With the rapid increasing of computational power of embedded systems and growing maturity of 3D graphics technologies, there has been a definite tendency to apply 3D technique into embedded graphic system for providing more beautiful and user-friendly experience for clients.
Window effect of embedded graphic systems is developed upon ClearX, which is an embedded graphic system based on X11 protocol. Keeping the internal constructions and external interfaces of ClearX unchanged, overlay image windows and hardware double buffer technologies in Samsung processor, S3C6410, are fully used to make smooth switch between window effect rendering and graphic system. According to the modular hierarchical structure design pattern, the overall design of window effect is divided into two layers, window effect layer and 3D graphics processing layer, based on function.
An essential issue in window effect layer is the window effect rendering. The solution is using graphic system to draw the windows on a memory screen, and then display the windows’image into a stunning 3D style by texture mapping. All the windows participate in window effect are all been treated the same as 2D texture, so, any kind of image data is allowed to participate in window effect instead of windows to enrich the visual content and function.
The key function of 3D graphics processing layer is providing a simple and efficient 3D graphics library, based on a 3D graphics hardware accelerator integrated in S3C6410, for the upper layer. In this layer, a native display interface and a frame buffer management module are added to deal with window effect display, texture processing and other issues.
引文
[1]白文涛,刘正捷.用户界面的需求分析与设计原则.大连海事大学学报, 2004, 30(4):86~88
[2]冯超.基于Linux的嵌入式图形用户界面的研究与开发:[硕士学位论文].武汉:华中科技大学图书馆, 2007.
[3]袁亚莉,马立玲,王军政.基于ARM & Linux图形用户界面开发平台的设计.微计算机信息. 2009, 25(4-2):5~7
[4]赵宁.嵌入式三维图形系统的研究与实现:[硕士学位论文].武汉:华中科技大学图书馆, 2006.
[5] Doug A.Bowman, Ernst Kruijff, Ivan Poupyrev et al. An Introduction to 3-D User Interface Design. The Massachusetts Institute of Technology, 2001.
[6] Lutz Kettner. Theoretical Foundations of 3D-Metaphors. Germany: University of Karlsruhe, 1994.
[7] Kari Pulli, Tomi Aarnio, Ville Miettinen et al. Mobile 3D Graphics with OpenGL ES and M3G. Morgan Kaufmann Publishers. 2008:1~9, 27~54
[8]金峰,武志辉.轻量级嵌入式Linux图形驱动程序与图形用户接口.北京理工大学学报. 2008, 28(3):233~236
[9]朱玮玮,卢虹,杨建明.嵌入式Linux技术研究.工业控制计算机. 2003, 16(4):28~30
[10]张杰.一种嵌入式图形系统的分析与改造:[硕士学位论文].武汉:华中科技大学图书馆, 2004.
[11] Samsung Electronics Co., Ltd. S3C6410X RISC Microprocessor User’s Manual, Preliminary Revision 0.10. 2008.5.16:408~490, 1211~1291
[12] Francis CHO. Introduction of S3C6410. Samsung Electronics Co., Ltd. 2008.3.28:2~13
[13] Daniel C. Cliburn. Advanced graphics application development with OpenGL. Journal of Computing Science in College. 2005, 20(4):144
[14]林锐,石教英.基于OpenGL的可复用软构件库与三维交互设计.计算机研究与发展. 2000.11, 37(11):1360~1366
[15]王秋艳,采用OpenGL实现机械部件的离散元法仿真分析:[硕士学位论文].吉林大学. 2005.
[16]王行仁.建模与仿真的回顾与展望.系统仿真学报. 1999, 11(5):309~311
[17]武志强,康利刚.嵌入式三维地形可视化技术的研究与实现.计算机工程. 2008.5, 34(9):251~253
[18]李亚昆.三维动画及运动仿真技术的研究:[硕士学位论文].大连:大连理工大学. 2004.
[19] Dave Astle, Dave Durnil. OpenGL ES Game Development. Premier Press.2004:35~149
[20]史扬,吴金平. OpenGL ES图形标准在嵌入式系统中的应用.工业控制计算机. 2008, 21(3):27~28
[21] Aaftab Munshi, Jon Leech. OpenGL ES Common/Common-Lite Profile Specification, Version 1.1.12. 2008.2.24:4~114
[22] Aaftab Munshi, Dan Ginsburg, Dave Shreiner. OpenGL ES 2.0 Programming Guide. Addison-Wesley Developers Press. 2008:57~252
[23] Aaftab Munshi, Jon Leech. OpenGL ES Common Profile Specification, Version 2.0.22. 2008.4.30:4~118
[24]许绘香,苏玉. OpenGL图像处理管线研究及实现.电脑知识与技术. 2008,3(8):1785~1787
[25]董朝.基于可编程图形硬件加速的若干技术研究:[硕士学位论文].浙江大学. 2005.
[26] Randi J. Rost. OpenGL Shading Language, 2nd Edition. Addison-Wesley Developers Press. 2006:79~156
[27] Aziz Barbar, Michel Owayjan. Cube Objects with Functionality Facets Enhancer Entities– COFFEE. MIC-CCA. 2008:85~91
[28] Diego Dompe. Introduction to Creating 3D UI with BeagleBoard. ESC Boston. 2008:1~9
[29] Cockburn A. Revisiting 2D vs. 3D Implications on Spatial Memory. University of Canterbury. 2004.
[30] Cockburn A., McKenzie B. Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments. University of Canterbury. 2001.
[31] Jonathan A. Zdziarski. iPhone Open Application Development. O’Reilly Press. 2008:172~211
[32]杨小军.基于嵌入式Linux系统界面的研究.现代电子技术. 2004(15):89~91
[33] Deborah F. Swayne, Dianne Cook, Andreas Buja. Interactive Dynamic Data Visualization in the X Window System. Journal of Computational and Graphical Statistics. 1998, 1(7):113~130
[34]乔梁. X窗口系统的设计与实现.成都信息工程学院学报. 2003, 04:390~392
[35]李增忠.纹理映射技术的研究:[硕士学位论文].西安:西安电子科技大学. 2005.
[36]肖源源,王子牛.基于VC++的OpenGL纹理映射技术的研究与实现.贵州大学学报(自然科学版). 2008, 25(2):158~160
[37]范波,吴慧中.多面体表面纹理映射方法的研究.计算机研究与进展. 1999, 36(4):446~450
[38]周莉,苏鸿根.通用3D模型文件格式和算法的研究及其OpenGL实现.计算机工程与设计. 2009, 30(2):433~439
[39]张尧学,史美林.计算机操作系统教程,第2版.北京:清华大学出版社. 2000:112~127
[40] Mason Woo, Jackie Neider, Tom Davis, et al. OpenGL Programming Guide, 2nd Edition. Addison-Wesley Developers Press. 1997:281~311
[41] Thomas Porter, Tom Duff. Compositing Digital Images. Computer Graphics. 1984, 18(3): 253~259
[2]冯超.基于Linux的嵌入式图形用户界面的研究与开发:[硕士学位论文].武汉:华中科技大学图书馆, 2007.
[3]袁亚莉,马立玲,王军政.基于ARM & Linux图形用户界面开发平台的设计.微计算机信息. 2009, 25(4-2):5~7
[4]赵宁.嵌入式三维图形系统的研究与实现:[硕士学位论文].武汉:华中科技大学图书馆, 2006.
[5] Doug A.Bowman, Ernst Kruijff, Ivan Poupyrev et al. An Introduction to 3-D User Interface Design. The Massachusetts Institute of Technology, 2001.
[6] Lutz Kettner. Theoretical Foundations of 3D-Metaphors. Germany: University of Karlsruhe, 1994.
[7] Kari Pulli, Tomi Aarnio, Ville Miettinen et al. Mobile 3D Graphics with OpenGL ES and M3G. Morgan Kaufmann Publishers. 2008:1~9, 27~54
[8]金峰,武志辉.轻量级嵌入式Linux图形驱动程序与图形用户接口.北京理工大学学报. 2008, 28(3):233~236
[9]朱玮玮,卢虹,杨建明.嵌入式Linux技术研究.工业控制计算机. 2003, 16(4):28~30
[10]张杰.一种嵌入式图形系统的分析与改造:[硕士学位论文].武汉:华中科技大学图书馆, 2004.
[11] Samsung Electronics Co., Ltd. S3C6410X RISC Microprocessor User’s Manual, Preliminary Revision 0.10. 2008.5.16:408~490, 1211~1291
[12] Francis CHO. Introduction of S3C6410. Samsung Electronics Co., Ltd. 2008.3.28:2~13
[13] Daniel C. Cliburn. Advanced graphics application development with OpenGL. Journal of Computing Science in College. 2005, 20(4):144
[14]林锐,石教英.基于OpenGL的可复用软构件库与三维交互设计.计算机研究与发展. 2000.11, 37(11):1360~1366
[15]王秋艳,采用OpenGL实现机械部件的离散元法仿真分析:[硕士学位论文].吉林大学. 2005.
[16]王行仁.建模与仿真的回顾与展望.系统仿真学报. 1999, 11(5):309~311
[17]武志强,康利刚.嵌入式三维地形可视化技术的研究与实现.计算机工程. 2008.5, 34(9):251~253
[18]李亚昆.三维动画及运动仿真技术的研究:[硕士学位论文].大连:大连理工大学. 2004.
[19] Dave Astle, Dave Durnil. OpenGL ES Game Development. Premier Press.2004:35~149
[20]史扬,吴金平. OpenGL ES图形标准在嵌入式系统中的应用.工业控制计算机. 2008, 21(3):27~28
[21] Aaftab Munshi, Jon Leech. OpenGL ES Common/Common-Lite Profile Specification, Version 1.1.12. 2008.2.24:4~114
[22] Aaftab Munshi, Dan Ginsburg, Dave Shreiner. OpenGL ES 2.0 Programming Guide. Addison-Wesley Developers Press. 2008:57~252
[23] Aaftab Munshi, Jon Leech. OpenGL ES Common Profile Specification, Version 2.0.22. 2008.4.30:4~118
[24]许绘香,苏玉. OpenGL图像处理管线研究及实现.电脑知识与技术. 2008,3(8):1785~1787
[25]董朝.基于可编程图形硬件加速的若干技术研究:[硕士学位论文].浙江大学. 2005.
[26] Randi J. Rost. OpenGL Shading Language, 2nd Edition. Addison-Wesley Developers Press. 2006:79~156
[27] Aziz Barbar, Michel Owayjan. Cube Objects with Functionality Facets Enhancer Entities– COFFEE. MIC-CCA. 2008:85~91
[28] Diego Dompe. Introduction to Creating 3D UI with BeagleBoard. ESC Boston. 2008:1~9
[29] Cockburn A. Revisiting 2D vs. 3D Implications on Spatial Memory. University of Canterbury. 2004.
[30] Cockburn A., McKenzie B. Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments. University of Canterbury. 2001.
[31] Jonathan A. Zdziarski. iPhone Open Application Development. O’Reilly Press. 2008:172~211
[32]杨小军.基于嵌入式Linux系统界面的研究.现代电子技术. 2004(15):89~91
[33] Deborah F. Swayne, Dianne Cook, Andreas Buja. Interactive Dynamic Data Visualization in the X Window System. Journal of Computational and Graphical Statistics. 1998, 1(7):113~130
[34]乔梁. X窗口系统的设计与实现.成都信息工程学院学报. 2003, 04:390~392
[35]李增忠.纹理映射技术的研究:[硕士学位论文].西安:西安电子科技大学. 2005.
[36]肖源源,王子牛.基于VC++的OpenGL纹理映射技术的研究与实现.贵州大学学报(自然科学版). 2008, 25(2):158~160
[37]范波,吴慧中.多面体表面纹理映射方法的研究.计算机研究与进展. 1999, 36(4):446~450
[38]周莉,苏鸿根.通用3D模型文件格式和算法的研究及其OpenGL实现.计算机工程与设计. 2009, 30(2):433~439
[39]张尧学,史美林.计算机操作系统教程,第2版.北京:清华大学出版社. 2000:112~127
[40] Mason Woo, Jackie Neider, Tom Davis, et al. OpenGL Programming Guide, 2nd Edition. Addison-Wesley Developers Press. 1997:281~311
[41] Thomas Porter, Tom Duff. Compositing Digital Images. Computer Graphics. 1984, 18(3): 253~259
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |