基于LZMA的数据库压缩存储应用研究
|
摘要
目前,诸多数据库应用系统的文字、图形、图像等大数据是直接存入数据库的大字段,其中文字数据以ASC II码存储,这使数据库数据急剧膨胀,且保密性差、传输速度慢、存取效率低。采用LZMA压缩算法,并自定义压缩二进制数据存储结构,把核心压缩二进制算法封装成API动态链接库,通过调用接口函数压缩大数据,再保存至数据库B lob字段;调用数据时,再将保存在数据库中的数据解压缩进行还原,这样不仅节省了数据库的磁盘空间,同时也提高了数据存取效率。
At present,text,graphics,images and other large data in many database application system are directly stored into the large field of database,while the text of large data is saved with ASCII code,that brings many problems to database,such as,the rapid expansion of databases,poor confidentiality,slow transmission,low access efficiency.The highest compression ratio,more efficient LZMA compression algorithm and compression custom binary data storage structure,the core compression algorithm binary API packaged as dynamic link library,are used by calling interface functions to compress large data,then the data saved to the database Blob field,when there is need to be used,the compressed data will be restored.Thus,not only disk space is saved,but also the access rate will rise much.
At present,text,graphics,images and other large data in many database application system are directly stored into the large field of database,while the text of large data is saved with ASCII code,that brings many problems to database,such as,the rapid expansion of databases,poor confidentiality,slow transmission,low access efficiency.The highest compression ratio,more efficient LZMA compression algorithm and compression custom binary data storage structure,the core compression algorithm binary API packaged as dynamic link library,are used by calling interface functions to compress large data,then the data saved to the database Blob field,when there is need to be used,the compressed data will be restored.Thus,not only disk space is saved,but also the access rate will rise much.
引文
1张元国.在数据库中使用压缩技术[J].电脑学习,2004,(2):64-65.
2于振生,等.LZMA压缩算法在固件下载升级中的应用[J].电子测量技术,2006,29(5):135-137.
3李飞鹏,秦前清,李德仁.海量遥感影像数据库实时压缩系统的设计与实现[J].计算机工程与应用,2003,26:9-11.
4骆吉洲,李建中.一种有效的关系数据库压缩方法[J].软件学报,2005,16(2):205-214.
5姚运生,李井冈,李胜乐.提高地震前兆数据存取效率的新方法[J].大地测量与地球动力学,2006,26(3):122-126.
6 Ray G,Harisa JR and Seshadri S.Database compression:A performance enhancement too1[A].In:Chaudhuri S,Deshpande A,Krishnamurthy R,eds.Proc.ofthe Confi onManagement of Data[C].India:Tata McGraw.Hill,1995,106-125.
7 Poess M and Potapov D.Data compression in oracle[A].In:Freytag JC,Lockemann PC,eds.Proc.of the 29th Int’1Confi on Very LargeData Bases[C].Mumbai:MorganKaufmann Publishers,Inc,2003,937-947.
8 Cormack GC.Data compression on a database system[J].Communications ofthe ACM,1985,28(12):1 336-l 342.
9 Westmann T and Kossmann D.The implementation andperformance of compressed database[J].ACM SIGMODRecord,2000,29(3):55-67.
2于振生,等.LZMA压缩算法在固件下载升级中的应用[J].电子测量技术,2006,29(5):135-137.
3李飞鹏,秦前清,李德仁.海量遥感影像数据库实时压缩系统的设计与实现[J].计算机工程与应用,2003,26:9-11.
4骆吉洲,李建中.一种有效的关系数据库压缩方法[J].软件学报,2005,16(2):205-214.
5姚运生,李井冈,李胜乐.提高地震前兆数据存取效率的新方法[J].大地测量与地球动力学,2006,26(3):122-126.
6 Ray G,Harisa JR and Seshadri S.Database compression:A performance enhancement too1[A].In:Chaudhuri S,Deshpande A,Krishnamurthy R,eds.Proc.ofthe Confi onManagement of Data[C].India:Tata McGraw.Hill,1995,106-125.
7 Poess M and Potapov D.Data compression in oracle[A].In:Freytag JC,Lockemann PC,eds.Proc.of the 29th Int’1Confi on Very LargeData Bases[C].Mumbai:MorganKaufmann Publishers,Inc,2003,937-947.
8 Cormack GC.Data compression on a database system[J].Communications ofthe ACM,1985,28(12):1 336-l 342.
9 Westmann T and Kossmann D.The implementation andperformance of compressed database[J].ACM SIGMODRecord,2000,29(3):55-67.
版权所有：© 2023 中国地质图书馆 中国地质调查局地学文献中心