基于分布式NoSQL数据库的档案大数据存储与检索方案研究
|
摘要
随着数字档案资源体系建设的不断加快,档案数据的种类日趋丰富,数量迅猛增长,呈现出大数据的特征。传统关系型数据库与集中式存储在档案大数据处理方面存在着适应性、可靠性和扩展性不足的问题。针对当前遇到的问题,通过分析传统档案数据存储模式的局限性,将分布式NoSQL数据库、分布式文件系统、分布式搜索引擎应用于档案大数据的管理。设计一套基于分布式NoSQL数据库的档案大数据存储与检索方案,并开发原型系统进行验证。
With the continuous acceleration of the construction of digital archives resource system, the types of archives data are becoming increasingly abundant, and the number of archives data is growing rapidly, showing the characteristics of large data. The traditional relational database and centralized storage have the problems of insufficient adaptability, reliability and expansibility in archives big data processing. Aiming at these problems, by analyzing the limitations of traditional archives data storage mode, the distributed NoSQL database, distributed file system and distributed search engine were applied to the management of archives big data. We designed a set of archives big data storage and retrieval scheme based on distributed NoSQL database, and developed a prototype system for verification.
With the continuous acceleration of the construction of digital archives resource system, the types of archives data are becoming increasingly abundant, and the number of archives data is growing rapidly, showing the characteristics of large data. The traditional relational database and centralized storage have the problems of insufficient adaptability, reliability and expansibility in archives big data processing. Aiming at these problems, by analyzing the limitations of traditional archives data storage mode, the distributed NoSQL database, distributed file system and distributed search engine were applied to the management of archives big data. We designed a set of archives big data storage and retrieval scheme based on distributed NoSQL database, and developed a prototype system for verification.
引文
[1] 闫政.运用大数据贡献大作为[N].中国档案报,2016-11-24.
[2] 周跃,臧斌宇.分布式NoSQL系统写操作性能优化设计与实现[J].计算机应用与软件,2014,31(11):25-28.
[3] 付世娇,吴传,廖小莉.NOSQL技术在档案检索中的应用探索[J].国土资源信息化,2013(4):69-72.
[4] 刘俊强.基于FastDFS云存储系统的研究与设计[D].成都:电子科技大学,2016.
[5] Chodorow K.MongoDB权威指南[M].2版.人民邮电出版社,2014.
[6] 余庆.分布式文件系统FastDFS架构剖析[J].程序员,2010(11):63-65.
[7] 李城,童彬,刘应波,等.分布式检索在异构科技信息资源中的应用及优化[J].计算机应用与软件,2017,34(10):78-84,156.
[8] Gormley C,Tong Z.Elasticsearch:The Definitive Guide [M].O'Reilly Media,2015.
[2] 周跃,臧斌宇.分布式NoSQL系统写操作性能优化设计与实现[J].计算机应用与软件,2014,31(11):25-28.
[3] 付世娇,吴传,廖小莉.NOSQL技术在档案检索中的应用探索[J].国土资源信息化,2013(4):69-72.
[4] 刘俊强.基于FastDFS云存储系统的研究与设计[D].成都:电子科技大学,2016.
[5] Chodorow K.MongoDB权威指南[M].2版.人民邮电出版社,2014.
[6] 余庆.分布式文件系统FastDFS架构剖析[J].程序员,2010(11):63-65.
[7] 李城,童彬,刘应波,等.分布式检索在异构科技信息资源中的应用及优化[J].计算机应用与软件,2017,34(10):78-84,156.
[8] Gormley C,Tong Z.Elasticsearch:The Definitive Guide [M].O'Reilly Media,2015.