基于网格的分布式异构空间数据访问与集成
|
摘要
网格技术的发展为空间信息科学的发展带来了机遇,同时也提出了挑战。空间数据的持续大规模增长和数据精度的不断提高,不仅导致“信息孤岛”的出现,同时也对其分析计算的吞吐量和计算能力提出了新要求。针对空间信息的自身特性,人们提出了空间信息网格(Spatial Information Grid,SIG)的概念,将网格技术和空间信息技术结合起来,以实现空间资源的有效组织和管理。
目前,空间信息网格的研究处于起步阶段,网格环境下空间数据的访问与集成作为空间信息网格的基础,需要对现有的网格环境下的数据访问技术进行空间化的扩展。本文借助于网格技术和空间数据库技术设计了一个网格空间数据访问与集成系统,实现了分布式异构空间数据的访问与集成。
针对网格空间数据的访问与集成系统的设计和实现,本文具体作了以下几个方面的研究工作:
论述了空间信息网格的研究意义,介绍了网格、空间信息技术等相关内容的研究现状。
总结了空间信息网格的体系架构、实现机制和支撑技术。介绍了网格技术、Web Service,OpenGIS等基本概念。
设计了网格环境下空间数据访问与集成系统的体系结构,对其组成部分—空间数据源和空间数据代理进行了详细的分析和设计。
在ESRI公司的空间数据库引擎ArcSDE及网格基础软件Globus Tookit 4的基础上,通过在OGSA-DAI中添加对空间数据源的访问支持及扩展OGSA-DAI的活动类Activity,部署了网格环境下的异构空间数据的访问与集成服务。并通过WEB方式的空间数据代理,实现了对分布式异构空间数据的透明访问。为空间信息网格的发展奠定了基础。
The development of grid technology not only has brought the opportunity for geospatial information science, but also has made it faced the challenge at the same time. Spatial data amount increases explosively and its precision becomes more and more exactitude, which bring the problem of "Information Island". Furthermore, spatial data processing and analysis require high powerful computing and high-throughput capability. Considering the characteristics of spatial data, Spatial Information Grid (SIG) was proposed to improve the spatial application environment. SIG integrates spatial technologies with the Grid that can organize and manage spatial resources effectively.
SIG began to be studied a short time ago. As the foundation of SIGs the technology of access and integration spatial data in grid environment demands to improve existing grid access and integration technology. With the grid technology and space database technology designed a grid of spatial data access and integration system, implementate distributed heterogeneous spatial data access and integration.
Considering the design of Grid Spatial Data Access and Integration System and the realization of Spatial Data Access Service, the main work of this paper concentrated on the following parts:
Discussed research value of Spatial Information Grid and introduced research status of Grid, spatial information technologies.
Summarized the framework, implementation technologies and supporting technologies of SIGs and explained basic concepts of Grid, Web Service and OpenGIS.
Designed architecture of Grid Spatial Data Access and Integration System, and its components, namely Spatial Data Resource and Spatial Database Broker, were analyzed and designed in detail.
Based on the ESRI's spatial database engine-ArcSDE and Grid infrastructure software-Globus Toolkit 4, through adding space data sources in OGSA-DAI to support and expand OGSA-DAI Activity Class, deploy the heterogeneous spatial data access and integration services in grid. Through spatial data broker with WEB, implement the transparent access of distributed heterogeneous spatial data. Establishing a foundation for the development of spatial information grid.
目前,空间信息网格的研究处于起步阶段,网格环境下空间数据的访问与集成作为空间信息网格的基础,需要对现有的网格环境下的数据访问技术进行空间化的扩展。本文借助于网格技术和空间数据库技术设计了一个网格空间数据访问与集成系统,实现了分布式异构空间数据的访问与集成。
针对网格空间数据的访问与集成系统的设计和实现,本文具体作了以下几个方面的研究工作:
论述了空间信息网格的研究意义,介绍了网格、空间信息技术等相关内容的研究现状。
总结了空间信息网格的体系架构、实现机制和支撑技术。介绍了网格技术、Web Service,OpenGIS等基本概念。
设计了网格环境下空间数据访问与集成系统的体系结构,对其组成部分—空间数据源和空间数据代理进行了详细的分析和设计。
在ESRI公司的空间数据库引擎ArcSDE及网格基础软件Globus Tookit 4的基础上,通过在OGSA-DAI中添加对空间数据源的访问支持及扩展OGSA-DAI的活动类Activity,部署了网格环境下的异构空间数据的访问与集成服务。并通过WEB方式的空间数据代理,实现了对分布式异构空间数据的透明访问。为空间信息网格的发展奠定了基础。
The development of grid technology not only has brought the opportunity for geospatial information science, but also has made it faced the challenge at the same time. Spatial data amount increases explosively and its precision becomes more and more exactitude, which bring the problem of "Information Island". Furthermore, spatial data processing and analysis require high powerful computing and high-throughput capability. Considering the characteristics of spatial data, Spatial Information Grid (SIG) was proposed to improve the spatial application environment. SIG integrates spatial technologies with the Grid that can organize and manage spatial resources effectively.
SIG began to be studied a short time ago. As the foundation of SIGs the technology of access and integration spatial data in grid environment demands to improve existing grid access and integration technology. With the grid technology and space database technology designed a grid of spatial data access and integration system, implementate distributed heterogeneous spatial data access and integration.
Considering the design of Grid Spatial Data Access and Integration System and the realization of Spatial Data Access Service, the main work of this paper concentrated on the following parts:
Discussed research value of Spatial Information Grid and introduced research status of Grid, spatial information technologies.
Summarized the framework, implementation technologies and supporting technologies of SIGs and explained basic concepts of Grid, Web Service and OpenGIS.
Designed architecture of Grid Spatial Data Access and Integration System, and its components, namely Spatial Data Resource and Spatial Database Broker, were analyzed and designed in detail.
Based on the ESRI's spatial database engine-ArcSDE and Grid infrastructure software-Globus Toolkit 4, through adding space data sources in OGSA-DAI to support and expand OGSA-DAI Activity Class, deploy the heterogeneous spatial data access and integration services in grid. Through spatial data broker with WEB, implement the transparent access of distributed heterogeneous spatial data. Establishing a foundation for the development of spatial information grid.
引文
[1]都志辉,刘鹏,陈渝.网格计算.清华大学出版社.2002
[2]李德仁,邵振峰.空间信息多级网格及其功能.地理空间信息,2005,3(4):1-4
[3]李德仁,易华蓉,江志军.论网格技术及其与空间信息技术的集成.武汉大学学报,2005,30(9):757-761
[4]李德仁.论广义空间信息网格和狭义空间信息网格.遥感学报,2005,9(5):513-520
[5]桂林.空间信息网格的体系结构与关键技术研究.武汉理工大学学报,2005,27(3):13-16
[6]方金云,何建邦.网格GIS体系结构及其实现技术.地球信息科学,2002,(4):36-42
[7]东凯,方裕.空间数据库模型概念与结构研究.地理信息世界.2004,2(2):7-16
[8]金宝轩,边馥等.基于OGSA-DAI的空间数据访问和集成研究.测绘信息与工程.2005,30(3):20-22
[9]金宝轩.网格计算环境下的3维空间信息应用研究.武汉大学博士学位论文2005.4
[10]徐志伟,李晓林,游赣梅.织女星信息网格的体系结构研究,计算机研究与发展.2002,39(8):948-951
[11]宋海朝,杨枉,周俭.分布式空间数据库的研究与设计.计算机工程与设计.2004,25(11):2046-2048
[12]熊丽华,杨峰.基于ArcSDE的空间数据库技术的应用研究.计算机应用.2004,24(3):90-96
[13]杜娟,关泽群.空间信息网格的框架体系和关键技术.地理空间信息.2005,3(2):27-29
[14]钟延江,朱杰勇.网格技术在地学中的应用.云南地质.2004,23(4):395-401
[15]于雷易,GIS网格体系结构探讨 武汉大学学报.2004,29(2):153-156
[16]陈广学,张东等.网格技术与空间信息共享和服务.测绘科学,2005,30(1):42,43,30
[17]陈再清.建立高效运行海量空间数据库的策略与方法.现代测绘.2004,27(5):24,25,34
[18]毛先成,彭华熔 关系数据库存储空间数据模型与结构分析.地球信息科学.2005,7(1):76-83
[19]王旭红,周明全,陈燕.基于Oracle和ArcSDE分布式空间数据库的设计与建立.西北大学学报,2004,34(2):151-154
[20]于雷易.基于空间数据网格的空间数据共享技术研究.博士论文.武汉大学,2004
[21]王兴玲.基于XML的地理信息Web服务研究.博士论文.中科院遥感应用研究所,2002
[22]张毅.构建面向网格的空间数据库引擎.硕士论文.解放军信息工程大学,2004
[23]鲍隐韬 基于OGSA的网格数据库服务系统的研究与实现.硕士论文.东北大学,2005
[24]侯文国.网格数据库访问与集成的研究与实现.硕士论文.广东工业大学,2005
[25]刘文杰.基于Glubos的网格应用关键技术研究.硕士论文.武汉大学2004.5
[26]李凤生.基于空间信息网格的空间数据存储和访问的研究.硕士论文.河海大学2006.3
[27]Jay Unger,Matt Haynos,A visualtour of Open Grid Services Architecture http://www-128.ibm.com/developerWorks/cn/grid/gr-visual/index.eng.shtml 2003-12-9
[28]S.Tuecke,k.Czajkowski,I,Foster,J.Frey,S.Graham,C.Kesselman,m.Maquire,T.Sandholm,D.Snelling,P.Vanderbilt.Open Grid Service Infrastructure[R],OGSI-SpecificationV110.pdf,June 2003
[29]B.Jacob,L.Ferreira,N.Biebrstein,C.Gilzean,J.Girard,R.Strachowski,S.Yu.Enabling Application for Grid Computing with Globus[EB/OL],EnablingApp.pdf,May 2003
[30]Condor Version 6.1.17 Manual[EB/OL].htto://www.cs.wisc.edulcondor,2003
[31]A.Krause.OGSA-DAI Architecture[R],EPCC,University of Edinburgh,July 2003
[32]N.Chue Hong,A.Krause,S.Malaika,G.McCance,N.W Paton,G.Riccardi.Grid Database Service Specification[EB/OL],http://www.gridforum.org/Meetings/ggf/drafts/DAIS_GGF7StatementSpec.pdf, Feb 2003
[33]M.Antonioletti, M.Jackson.OGSA-DAI Product Overview [EB/OL], http://www. ogsa-dai. org/docs/current/OGSA-DAI-USER-PRODUCT-OVERVIEW. pdf, May 2003
[34] XIAO Long, FU Wei. Spatial Data Processing Grid. J.Comput.Sci & Technol. 2003, 18(4): 523-531
[35] ZHU Tie-wen, ZHONG Zhi-nong. Managing Method of Spatial Data in Relational Database Management Systems. Journal of Software. 2002,13(1): 8-14
[36] W. Allocock, A. Chervenak, I. Foster, L. Pearlman, V. Welch, M. Wilde. Globus Toolkit Support for Distributed Data-Intensive Science. International Conference on Computing in High Energy and Nuclear Physics. 2001 (1). Page(s) : 692-695
[37] Neil Chu Hong, Amy Krause, Susan Malaika, Gavin McCance, Simon Laws, James Magowan, Norman W. Paton and Greg Riccardi. Grid Database Service Specification. http://www. ggf. org/Mectings/ggf7/drafts/DAZSwe GGF7StatementSpec. pdf
[38] Foster I, Kesselman C, Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Application. 2001,15(3): 200-222
[39] Vijayshankar Raman, Inderpal Narang, Chris Crone, Laura Haas, Susan Malaika, Tina Mukai, Dan Wolfson, Chaitan Baru. Services for Data Access and Data Processing on Grids. http://www.ggf.org/Meetings /drafts/DAISes DataServices.pdf
[40] Ali Anjomshoaa, Mario Antonioletti. The Design and Implementation of Grid Database Services in OGSA-DAI http://www. cc-pe. net/CCPEwebresource/c815waison/c8150GSA-DAI-6.pdf
[41] M. P. Atkinson, V. Dialani, L. Guy, L. Narang, N. W. Paton, D. Pearson, T. Storey, P. Watson. Grid Database Access and Integration: Requirements and Functionalifes, http://www.ggf. org/documents/GWD-I-E/GFD-1. 013. pdf, 2003
[42] Longbo Ran, Hai An, Zhiping Wang, Chen Huang, Yong Chen, Yongjie Jia. Architecture Design of Global Distributed Storage System for Data Grid. http://www. chinagrid. net/grid/
[44] Yariv Aridor, Dean Lorenz, Benny Rochwerger, Bill Horn, Hany Salem. Reporting Grid Services (ReGS) Specification. http://www. ggf. org/Meetings/ggf7/drafts/draft-ggf-ogsa-regs-01. 3.1. pdf
[45] Gun Chaozhen, Zhuang Miao, Wang Honghong, Han Xingchen, Wu Jia. A Cooperation Mechanism for Spatial Information Sharing. Computer Supported Cooperative Work in Design, 2002. The 7th International Conference on, 25-27 Sept. 2002. Page(s):473-478
[46] IBM redbook. Fundamentals of Grid Computing. 2002
[47] IBM redbook. Enabling Applications for Grid Computing with Globus. June 2003
[48] IBM redbook. Introduction to Grid Computing with Globus. September 2003
[49] IBM redbook. Globus Toolkit 3. 0 Quick Start. September 2003
[50] 中国网格信息中转站. http://www. chinagrid. net/
[51] The OpenGIS Consortium Home Page. http://www.opengis.com/
[52] ESRl-ArcSDE. http://www.esri.com/software/arcgis/arcsde/
[53] OGSA-DAI project Home Page. http://www.ogsadai.org.uk/
[54] The Globus Project Home Page. http://www.globus.org/
[55] Global Grid Forum Home Page. http://www. ggLorg/
[56] Web Services Activity. http://www.w3.oTg/2002/ws/
[2]李德仁,邵振峰.空间信息多级网格及其功能.地理空间信息,2005,3(4):1-4
[3]李德仁,易华蓉,江志军.论网格技术及其与空间信息技术的集成.武汉大学学报,2005,30(9):757-761
[4]李德仁.论广义空间信息网格和狭义空间信息网格.遥感学报,2005,9(5):513-520
[5]桂林.空间信息网格的体系结构与关键技术研究.武汉理工大学学报,2005,27(3):13-16
[6]方金云,何建邦.网格GIS体系结构及其实现技术.地球信息科学,2002,(4):36-42
[7]东凯,方裕.空间数据库模型概念与结构研究.地理信息世界.2004,2(2):7-16
[8]金宝轩,边馥等.基于OGSA-DAI的空间数据访问和集成研究.测绘信息与工程.2005,30(3):20-22
[9]金宝轩.网格计算环境下的3维空间信息应用研究.武汉大学博士学位论文2005.4
[10]徐志伟,李晓林,游赣梅.织女星信息网格的体系结构研究,计算机研究与发展.2002,39(8):948-951
[11]宋海朝,杨枉,周俭.分布式空间数据库的研究与设计.计算机工程与设计.2004,25(11):2046-2048
[12]熊丽华,杨峰.基于ArcSDE的空间数据库技术的应用研究.计算机应用.2004,24(3):90-96
[13]杜娟,关泽群.空间信息网格的框架体系和关键技术.地理空间信息.2005,3(2):27-29
[14]钟延江,朱杰勇.网格技术在地学中的应用.云南地质.2004,23(4):395-401
[15]于雷易,GIS网格体系结构探讨 武汉大学学报.2004,29(2):153-156
[16]陈广学,张东等.网格技术与空间信息共享和服务.测绘科学,2005,30(1):42,43,30
[17]陈再清.建立高效运行海量空间数据库的策略与方法.现代测绘.2004,27(5):24,25,34
[18]毛先成,彭华熔 关系数据库存储空间数据模型与结构分析.地球信息科学.2005,7(1):76-83
[19]王旭红,周明全,陈燕.基于Oracle和ArcSDE分布式空间数据库的设计与建立.西北大学学报,2004,34(2):151-154
[20]于雷易.基于空间数据网格的空间数据共享技术研究.博士论文.武汉大学,2004
[21]王兴玲.基于XML的地理信息Web服务研究.博士论文.中科院遥感应用研究所,2002
[22]张毅.构建面向网格的空间数据库引擎.硕士论文.解放军信息工程大学,2004
[23]鲍隐韬 基于OGSA的网格数据库服务系统的研究与实现.硕士论文.东北大学,2005
[24]侯文国.网格数据库访问与集成的研究与实现.硕士论文.广东工业大学,2005
[25]刘文杰.基于Glubos的网格应用关键技术研究.硕士论文.武汉大学2004.5
[26]李凤生.基于空间信息网格的空间数据存储和访问的研究.硕士论文.河海大学2006.3
[27]Jay Unger,Matt Haynos,A visualtour of Open Grid Services Architecture http://www-128.ibm.com/developerWorks/cn/grid/gr-visual/index.eng.shtml 2003-12-9
[28]S.Tuecke,k.Czajkowski,I,Foster,J.Frey,S.Graham,C.Kesselman,m.Maquire,T.Sandholm,D.Snelling,P.Vanderbilt.Open Grid Service Infrastructure[R],OGSI-SpecificationV110.pdf,June 2003
[29]B.Jacob,L.Ferreira,N.Biebrstein,C.Gilzean,J.Girard,R.Strachowski,S.Yu.Enabling Application for Grid Computing with Globus[EB/OL],EnablingApp.pdf,May 2003
[30]Condor Version 6.1.17 Manual[EB/OL].htto://www.cs.wisc.edulcondor,2003
[31]A.Krause.OGSA-DAI Architecture[R],EPCC,University of Edinburgh,July 2003
[32]N.Chue Hong,A.Krause,S.Malaika,G.McCance,N.W Paton,G.Riccardi.Grid Database Service Specification[EB/OL],http://www.gridforum.org/Meetings/ggf/drafts/DAIS_GGF7StatementSpec.pdf, Feb 2003
[33]M.Antonioletti, M.Jackson.OGSA-DAI Product Overview [EB/OL], http://www. ogsa-dai. org/docs/current/OGSA-DAI-USER-PRODUCT-OVERVIEW. pdf, May 2003
[34] XIAO Long, FU Wei. Spatial Data Processing Grid. J.Comput.Sci & Technol. 2003, 18(4): 523-531
[35] ZHU Tie-wen, ZHONG Zhi-nong. Managing Method of Spatial Data in Relational Database Management Systems. Journal of Software. 2002,13(1): 8-14
[36] W. Allocock, A. Chervenak, I. Foster, L. Pearlman, V. Welch, M. Wilde. Globus Toolkit Support for Distributed Data-Intensive Science. International Conference on Computing in High Energy and Nuclear Physics. 2001 (1). Page(s) : 692-695
[37] Neil Chu Hong, Amy Krause, Susan Malaika, Gavin McCance, Simon Laws, James Magowan, Norman W. Paton and Greg Riccardi. Grid Database Service Specification. http://www. ggf. org/Mectings/ggf7/drafts/DAZSwe GGF7StatementSpec. pdf
[38] Foster I, Kesselman C, Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Application. 2001,15(3): 200-222
[39] Vijayshankar Raman, Inderpal Narang, Chris Crone, Laura Haas, Susan Malaika, Tina Mukai, Dan Wolfson, Chaitan Baru. Services for Data Access and Data Processing on Grids. http://www.ggf.org/Meetings /drafts/DAISes DataServices.pdf
[40] Ali Anjomshoaa, Mario Antonioletti. The Design and Implementation of Grid Database Services in OGSA-DAI http://www. cc-pe. net/CCPEwebresource/c815waison/c8150GSA-DAI-6.pdf
[41] M. P. Atkinson, V. Dialani, L. Guy, L. Narang, N. W. Paton, D. Pearson, T. Storey, P. Watson. Grid Database Access and Integration: Requirements and Functionalifes, http://www.ggf. org/documents/GWD-I-E/GFD-1. 013. pdf, 2003
[42] Longbo Ran, Hai An, Zhiping Wang, Chen Huang, Yong Chen, Yongjie Jia. Architecture Design of Global Distributed Storage System for Data Grid. http://www. chinagrid. net/grid/
[44] Yariv Aridor, Dean Lorenz, Benny Rochwerger, Bill Horn, Hany Salem. Reporting Grid Services (ReGS) Specification. http://www. ggf. org/Meetings/ggf7/drafts/draft-ggf-ogsa-regs-01. 3.1. pdf
[45] Gun Chaozhen, Zhuang Miao, Wang Honghong, Han Xingchen, Wu Jia. A Cooperation Mechanism for Spatial Information Sharing. Computer Supported Cooperative Work in Design, 2002. The 7th International Conference on, 25-27 Sept. 2002. Page(s):473-478
[46] IBM redbook. Fundamentals of Grid Computing. 2002
[47] IBM redbook. Enabling Applications for Grid Computing with Globus. June 2003
[48] IBM redbook. Introduction to Grid Computing with Globus. September 2003
[49] IBM redbook. Globus Toolkit 3. 0 Quick Start. September 2003
[50] 中国网格信息中转站. http://www. chinagrid. net/
[51] The OpenGIS Consortium Home Page. http://www.opengis.com/
[52] ESRl-ArcSDE. http://www.esri.com/software/arcgis/arcsde/
[53] OGSA-DAI project Home Page. http://www.ogsadai.org.uk/
[54] The Globus Project Home Page. http://www.globus.org/
[55] Global Grid Forum Home Page. http://www. ggLorg/
[56] Web Services Activity. http://www.w3.oTg/2002/ws/