用户名: 密码: 验证码:
矢量量化码书设计及优化算法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
矢量量化作为一种有效的压缩手段,具有编解码简单、压缩比大等特点,使其广泛的应用于卫星遥感影像的压缩,数字电视、DVD等视频的压缩、存储及传输等方面。在矢量量化技术发展的20多年间,逐步形成了三个重点研究方向:码书设计、码字搜索和索引分配,其中码书设计最为关键。虽然矢量量化技术具有许多优点,但在码书设计中由于通常使用的各种局部最优、类全局最优以及全局最优的码书设计算法,使得生成码书的速度不够快、质量不够好。本文针这一制约矢量量化码书设计的关键问题,为加快码书的生成速度及提高码书的质量,分别提出了小生境猴群繁衍模拟算法、自进化萤火虫优化算法,使得码书的生成的速度和质量得到提高。
     小生境猴群繁衍模拟算法是以“小生境”思想为基础的遗传码书设计方法。遗传算法作为一种仿生学算法,能够有效的进行全局搜索。本文在传统的基于训练矢量划分的遗传码书设计算法基础上,提出了一种对交叉空间进行一定约束的,基于“小生境”思想的遗传码书设计算法。由于对交叉空间进行了一定的约束,使当前训练矢量总是按照更加优秀的参照码书,以带有一定随机性的并按空间距离最小的方式进行归类,使码书的生成速度得到提高,并在文中给出了此算法的收敛性证明。实验结果表明,此算法在不降低码书质量的基础上,提高了码书的生成速度。
     自进化萤火虫算法解决的是提高码书质量的问题。在矢量量化码书设计中,只要当前码书不是全局最优码书,都可以对其进行优化以提高码书质量。矢量量化是一种在高维空间中求解多峰值极值的问题,萤火虫算法在高维空间中求解单峰值极值问题,具有良好的效果,但在高维空间中求解多峰值极问题,该算法不能使用。本文对萤火虫算法在矢量量化码书优化过程中的缺陷进行了细致分析,提出了一种改进算法。通过对震荡系数的动态调整,增大了萤火虫之间的距离、减小引力参数、扩大搜索范围,抑制了算法过快收敛的现象。实验表明,此算法能够提高码书性能0.2---0.45dB,使码书更加优化。
     本文将以上两种改进算法应用于图像处理中,并以本文所提出的码书生成算法(或优化算法)为代表,将最终生成的码书分别嵌入到纹理分类及数字水印中。纹理分类以K-View算法作为分类基础框架,将小生境算法生成的码书作为纹理基元参加分类,取得良好效果;在数字水印中,将水印信息直接加载在生成码书中并接受各种攻击。实验结果表明由本文提出的算法生成的码书质量更好,速度更快。
     本文对矢量量化码书设计的贡献是针对制约矢量量化技术发展的速度和质量两个瓶颈问题分别给出了解决方案。其中,小生境猴群繁衍模拟算法在遗传算法及小生境技术上提出了一种不依赖于模式定理以及积木块假设的遗传码书快速生成算法,使码书的生成速度大大加快;自进化萤火虫算法在通过对引力参数的控制,实现了对已生成码书的继续优化,使码书质量大大提高
Vector quantization is an effective method of compression. It widely used in satelliteimage and remote sensing image compression because of its simple codec and highcompression rate.It also could be used in compression, storage and transmission of digital TVand DVD video. The development of vector quantization technical is aboult20years, Itgradually formed the three key research direction:codebook design,codeword search andindex assignment.And the codebook design is the most critical of the three. There are avariety of local optimal,near global optimal and global optimal codebook design algorithmbecause we only know about the necessary condition of optimal codebook in theory.It hasprominent defects to restrict this techniqueusing in many areas Althoughvector quantizationtechnology has many advantages. At present, the bottleneck of vector quantization is thespeed of codebook generation is not fast enough and the quality is not good enough orboth.Aiming at the improving generation speed and quality of codebook, two algorithms areproposed respectively"niche monkeys group multiply simulation algorithm" and "selfevolution glowworm swarm optimization algorithm".
     Genetic algorithm is a bionics algorithm which could effectively global search. Thearticle propose a new method of genetic algorithm which based on the niche ideas andconstraining the cross space based on the traditional codebook design of genetic algorithm ofdeviding training vector.The training vector could be classification with some randomnessand minimum distance in high-dimensional space based on the better reference codebook.Itcould improve the quality of codebook continuously. It also give the improvement ofconvergence of the algorithm. The experiment also show that the algorithm increase in thegeneration rate of codebook without reducing the quality of codebook.
     The self-evolution of firefly algorithm is to improve the codebook quality problems.Inthe codebook design of vector quantization, if the current codebook is not a global optimalcodebook, we could continue optimize it.Vector quantization is a searching extreme problemwith multi-peak of high-dimension. It makes a lot of good algorithms which solve single peakextreme problem well, couldn’t be used in the vector quantization.And firefly algorithm is one of them.The article make a careful analysis of defect in optimization process of codebookusing firefly algorithm. And proposed an improved algorithm.Through the dynamicadjustment of concussion coefficient,it increase the distance of firefly,reduce the parameter ofAttractive and also expand the search area which suppressing the algorithm convergenceexcessive phenomenon. The experiments show that the algorithm can improve the codebookperformance0.2-0.45codebook and more optimized.
     In the last chapter,it introduces the usage of codebook in image processing,which taksthe codebook generation algorithm as the representative described in this article.And make thegeneration codebook embedded into texture classification and digital watermarking in thirdchapter.The texture classification using K-view algorithm as a classification framework andalso use generated codebook using niche algorithm as texture primitives in classification.Itachieves good results.In the digital watermark,the codebook embedded in watermarkinformation directly and accept all kinds of attacks,the experimental results show that thegeneration codebook which proposed in chapter third have good quality
     The contribution of this paper on the vector quantization codebook design is to solvetwo bottlenecks which restrict the development of vecror quantization technique.Thesimulation algorithm of niche group multiply presents an fast genetic codebook generationalgorithm which does not depend on the schema theorem and building block hypothesis.Thegeneration speed of codebook greatly accelerated.Self evolution firefly algorithm realize thecontinuing optimization of existing codebook through controlling the parameter ofgravity,and also greatly inproves the quality of the codebook.
引文
[1] A.Gersho,R.M.Gray. Vector quantization and Signal Compression[M].Boston:KluwerAcademic Publicher,1992
    [2]高木干雄,下田阳久.图像处理技术手册[M].北京:科学出版社,2007
    [3]R.C.Gonzalez,R.E.Woods.Digital Image Processing Second Edition[M].Publicing Houseof Electronics Industry,2002
    [4]Zhang N,Zhang Y J,Liu Q D etc.Method for estimating lossless image compressionbound[J].IEEEL-35(22):1931-1932,1999
    [5]孙圣和,陆哲明.矢量量化技术及应用[M].北京:科学出版社,2002
    [6]胡征,杨有为.矢量量化原理与应用[M].西安:西安电子科技大学出版社,1988
    [7]Y.Linde,A.Buzo,R.M.Gray.An Algorithm for Vector quantization Design[J].IEEETransactions on Communications,1980,28(1):84-95
    [8]R.M.Gray.Source Coding Theory[M].Boston:Kluwer Academic Press,1990
    [9]J.T.Tou,R.C.Gonzales.Pattern Recognition Principles[M].Addison-Wesley,Reading, Mass.,1974
    [10]C.Q.Chen,S.N.Koh,P.Sivaprakasapillai.A Novel Scheme for Optimizing Partitioned VQUsing a Modiffied Resolution Measure[J].Signal Processing,1997,56:157-163
    [11]T.Kohonen,J.Kangas,J.Laaksonen,K.Torkkola.LVQ-PAK:A Program Package for theCorrect Application of Learning Vector Quantization Algorithms[J].IEEE International JointConference on Neural Networks,1992,1:725-730
    [12]C.K.Ma,C.K.Chan.A Fast Method of Designing Better Codebooks for Image VectorQuantization[J].IEEE Transactions on Communications,1994,40(2/3/4):237-242
    [13]陆哲明,孙圣和.基于自组织特征神经网络的矢量量化[J].中国图形图像学报,2000,5A(10):846-850
    [14]K.Zeger,A.Gersho.Stochastic Relaxation Algorithm for Improved Vector QuantizationDesign[J].Electronics Letters,1989,25(14):896-898
    [15]S.Geman,D.Geman,Stochastic Relaxation,Gibba Distrbutions,And Bayesian Restorationof Images[J].IEEE Transactions on Pattern Analysis and MachineIntelligence,1984,6:721-741
    [16]J.S.Pan,F.R.Mcinnes,M.A.Jack.VQ Codebook Design Using GeneticAlgorithms[J].Electronics Letters,1995,31(17):1418-1419
    [17]H.C.Huang,J.S.Pan,Z.M.Lu,S.H.Sun,H.M.Hang.Vector Quantization ased on GeneticSimulated Annealing[J].Signal Processing.2001,81(7):1513-1523
    [18]F.Glover,Tabu search.Part I,ORSA Journal on Computing,1989,1(3):190-206
    [19]N.B.karayiannis,P.I.Pai.Fuzzy Vector Quantization Algorithms and Their Application inImage Compression[J].IEEE Transactions on Image Processing,1995,4(9):1193-1201
    [20] R.L.Baker,R.M.Gray.Differential Vector Quantization of Achromatic Imagery[C].InProceedings of the International Picture Coding Symposium,March1983
    [21] A.Buzo,A.H.Gray,R.M.Gray,H.D.Markel.Speech Coding based upon VectorQuantization[J].IEEE Transactions on Acoustics,Speech Signal Processing,1980,28(5):562-674
    [22]Jerome Yeh,Yen-Tseng Hsu.A G2LA vector quantization for image data coding[J].ExpertSystems with Applications,2009,(36):5660–5665
    [23] Kennedy,J.and Eberhart,R.Particle swarm optimization[J].Proc of IEEE internationalConference on Neural Networks,Piscataway,NJ.pp1942-1948
    [24] Dorigo M,Gambardella L M.Ant Colocy Sysrem:A Cooperative Learning Approach tothe Traveling Salesman Problem[J].IEEE Transactions on EvolutionaryComputations,1997,1(1):53-66
    [25] Krishnanand, K.N. and Ghose, D. Detection of multiple source locations using aglowwormmetaphor with applications to collective robotics[C]. Proceedings of IEEESwarmIntelligence Symposium,2005, a84–a91
    [26]C.D.Bei,R.M.Gray.An Improvement of Minimum Distortion Encoding.Algorithm forVector Quantization[J].IEEE Transactions on Communications.1985,33(10):1132-1133
    [27]K.T.Lo,W.K.Cham.Subcodebook Searching Algorithm for Efficient VQ Endoding ofImages[J].IEEE Proceedings-I,1993,140(5):327-330
    [28]H.S.Pan,F.R.McInnes,M.A.Jack.Fast Clustering Algorithm for VectorQuantization[J].Pattern Recognition,1996,29(3):511-518
    [29]M.T.Orchard.A Fast Nearest neighbor Search Algorithm[C].IEEE InternationalConfference on Acoutics,Speech and Signal Processing,1991:2297-2300
    [30]E.Vidal.An Algorithm for Finding Nearest Neighbbours in (approximately)ConstantAverage Time.Pattern Recognition Letters,1986,54:145-157
    [31]C.M.Huang,Q.Bi,G.S.Stiles,R.W.Harris,Fast Full Search Equivalent Encoding Algorithmsfor Image Compression Using Vector Quan-tization[J].IEEE Transactions on ImageProcessing,1992,1(3):413-416
    [32]S.W.Ra,J.K.Kim.Fast Mean Distance Ordered Partial Codebook Search Algorithm forImage Vector Quantization[J].IEEE Transactions on Circuits andSystems-II,1993,40(9):576-579
    [33]L.Guan,M.kamel.Equal Average Hyperplane Partitioning Method for Vector Quantizationof Image Data[J].Pattern Recognition Letters,1992:693-699
    [34]C.H.Lee,L.H.Chen.Fast Closest codeword Search Algorithm for VectorQuantization[J].IEE ProCessings Vision,Image and Signal Processing,1994,141(3):143-138.
    [35]L.Wang,M.Goldberg.Reduced Difference Pyramid:A Data Structure for ProgressiveImage Transmission[J].Optical Engineering,1989,28(7):708-716
    [36]C.H.Lee,L.H.Chen.High Speed Closest Codeword Search Algorithms for VectorQuantization[J].Signal Processing,1995,43:323-331
    [37]W.J.Hwang,S.S.Heng,B.Y.Chen.Fast Codeword Search Algorithm Using WaveletTransfor and Partial Distance Search Techniques[J].Electronics Letters,1997,33(5):365-366
    [38]Z.M.Lu,J.S.Pan,S.H.Sun.Efficient Codewote Search Algorithm Based on HadamardTransform[J].Electronics Letters,2000,36(16):1364-1365
    [39]K.Zeger,A.Gersho.Pseudo-Gray Coding[J]. IEEE Transactions onCommunications,1990,38(12):2147-2158
    [40]J.S.Pan,F.R.Mcinnes,M.A.jack.Application of Parallel Genetic Algorithm and Property ofMultiple Golbal Optima to VQ CodeVector Index Assignment for NoisyChannels[J].Electronics Letters,1996,32(4):296-297
    [41]N.Farvardin.A Study of Vector Quantization for Noisy Channels[J].IEEE Transactions onInformation Theory,1990,36(4):799-809
    [42]S.Gadkari,K.Rose.Robust Vector Quantisation by Transmission EnergyAllocation[J].Electronics letters,1996,32(16):1451-1453
    [43]J.S.pan,Z.M.Lu,S.H.Sun.Application of Tabu Search Approach to Energy Allocation forIndex Transmission of Codeword[J].Chinere Journal of Electronics,2000,9(4):453-456
    [44]托马斯,林奇.数据压缩技术及其应用[M].北京:人民邮电出版社,1985
    [45]卢开澄,卢华明.组合数学[M].北京:清华大学出版社,2006
    [46]严加安.测度论讲义[M].北京:科学出版社,2004
    [47]Farvardin N.AStudy of Vector Quantization for Noisy Channels[J].IEEE Transactions onInformation Theory,1990,36(4):799-809
    [48]B.Ramamurthi,A.Gersho.Classified Vector Quantization of Images[J].IEEE Transactionson Communications,1986,34(11):1105-1115
    [49]王小平,曹立明.遗传算法-理论、应用与软件实现[M].西安:西安交通大学出版社,2002
    [50]易继锴,侯媛彬.智能控制技术[M].北京:北京工业大学出版社,1999
    [51]徐宗本,张讲社,郑亚林.计算智能汇总的仿生学:理论与算法[M].北京:科学出版社,2003
    [52]张文修,梁怡.遗传算法的数学基础[M]。西安:西安交通大学出版社,2003
    [53]C.K.Ma,S.N.Chan.A Fast Method of Designing Better Codebooks for Image VectorQuantization[J].IEEE Transactions on Communications,1994,40:237-242
    [54]D. Tsolakis, G.E.Tsekouras, J.Tsimikas.Fuzzy vector quantization for image compressionbased on competitiveagglomeration and a novel codeword migration strategy[J].EngineeringApplications of Artificial Intelligence,2011,11:1-14
    [55]Brad L.Miller,Michael J.Shoaw.Genetic Algorithms with Dynamic Niche Sharing forMultimodal Function Optimization[J].IEEE International Conerence on EvolutionaryComputation,1996,786-791
    [56]J H Holland,Adaptation in Natural and Artificial System[M]. Massachusettes Institute ofTechnology.1992
    [57]徐宗本,张讲社,郑亚林.计算智能中的仿生学:理论与算法[M].北京:科学出版社,2003
    [58]Kennedy J,Eberhart R Swarm Interlligence[M],Academic Press(2001)
    [59]Levin.F.S..An Introduction to quantum theory[M].Cambridge:Cambridge UniversityPress.2002
    [60]Sun Jun,Xu WeiBo,Feng Bin.Adaptive parameter Control for quantum behaved particlewarm optimization on individual level[C].Proceeding of IEEE internation Confference onsystems,2005:3049-3054
    [61]李晓磊.一种新型只能优化方法-人工鱼群算法[D].2003
    [62]曲良东,何登旭.基于自适应高斯变异的人工鱼群算法[J].计算机工程,2009,35(15):182
    [63]Gambardella L M,Dorigo M,Solving Symmetric and Asymmetric TSPs byColonies[C]//In Procedings of the IEEE International Conference on EvolutionaryComputation(ICEC’96).IEEE Press,1996:622-627
    [64] Krishnanand, K.N. and Ghose, D. Multimodal function optimization using aglowwormmetaphor with applications to collective robotics[C]. Proceedings of the SecondIndian International Conference on Artificial Intelligence,2005, b328–b346
    [65]Ming-Huwi Horng, Ting-Wei Jiang.Image vector quantization algorithm via honey beemating optimization[J]. Expert Systems with Applications.2011(38):1382-1392
    [66] YANG Xin-she.Nature-inspired metaheuristic algorithms[M].[S.I]Luniver Press,2008:83-96
    [67]Ming Huwi Horng.Vector quantization using the firefly algorithm for imagecompression[J].Expert System with Application,2012,39:1078-1091
    [68] J.h.Holland.Adaptation in Nature and Artificial System[M].The University of MichiganPress,1975
    [69]MichaelW. Marcellin and Thomas R. Fischer.Trellis coded quantization of memorylessandGauss-Markov sources[J],IEEE Transactions on Communications,1990,38(1)82-93.
    [70] Michael M. Marcellin, Thomas R. Fischer and Jerry d. Gibson.Predictive TrellisCodedQuantization of Speech[J], IEEE Transactions on Acoustics Speech and SignalProcessing,1990,38(1):46-55
    [71] Dunbar RIM,Primate Social System.Ithaca,New York:Comstock PublishingAssociates.1998
    [72]周明,孙树栋.遗传算法原理及应用[M].北京:国防工业出版社,1999
    [73]马莉,范影乐.纹理图像分析[M].北京:科学出版社,2009
    [74] Tuceryan M,Jain A K.Textrue Analysis.Handbook of Pattern Recognition and ComputerVision.Sigapore:world Scientific Puglishing Co,1998:207-248
    [75]R M.Haralick.Statistical and structural approaches to texture[J].Proceedings oftheIEEE,1979,67(5):786-8041
    [76]T.Reed,J.du Buf.A review of recent texture segmentationand feature extractiontechniques[J]. CVGIP: ImageUnderstanding,1993,57(3):359-3721
    [77]M.Tuceryan, A K.Jain. Texture Analysis, Handbook PatternRecognitionandComputerVision[M]. Singapore: World Scientific,1993,235-2761
    [78]G R.Cross, AK.Jain. Markov random field texturemodels[J]. IEEETransactions on PatternAnalysis and Machine Intelligence,1983,5(1):25-391
    [79]B H McCormick, SN Jayaramamurthy. Time seriesmodel fortexturesynthesis[J].International JournalofComputer Information Science,1974,3(4):329-3431
    [80] Ng I, Tan T, Kittler J. On local linear transform and Gabor filterrepresentation of texture.InProceeding of the11th IAPRConference on Image, Speech and Signal Analysis[C],Hague,Netherlands,1992:627-6311
    [81] Zhou F, Feng J, ShiQ1Image segmentation based on localfouriertransform.InProceedingsof International Conference on ImageProcessing[C], Wuhan, China,2001:610-6131
    [82]PavlidisT. Structural Descriptions and Graph Grammars[M].Berlin,Germany:SpringerPress,1980:86-1031
    [83] Soille P. Morphological Image Analysis: Principles and Applications[M].Berlin,Germany:SpringerPress,2003:289-317
    [84]Chih-Cheng Hung,Shisong Yang,CharlesLaymon.Use of Characteristic Views in ImageClassification[J].Pattern Recognition,2002,2:949-952
    [85] J. Weszka, C. Dyer and A. Rosenfeld.A Comparative Studyof Texture Measures forTerrain Classification[J].IEEETransactions on Systems, Man, and Cybernetics, SMC-6,1976,pp.269-285.
    [86]王炳锡,陈琦,邓峰森.数字水印技术.西安:西安电子科技大学出版社,2003.
    [87]Voyatzis G,Pitas I.The use of watermarks in the protectionof digitalmultimediaProducts[J].Proceedings of IEEE,1999,87(7):1197-1207
    [88] Chiou-Ting Hsu and Ja-Ling Wu. Hidden Digital Watermarks in Images[J]. IEEETRANSACTIONS ON IMAGE PROCESSING,1999,vol(8):58-68.
    [89]Lu Z M,Xing W,Xu D G,Sun S H.Digital Image Watermarking Method Based on VectorQuantization with Labeled Codewords[J].IEICE Transactions on Information andSystem,2003,E86-D(12):2786-2789.
    [90]Debyeche M,Amrouche A,Haton J P.Distributed TDNN-Fuzzy Vector Quantization forHMM Speech Recognition.International Conference on Multimedia Computing andSysrems[C],2009:72-76.
    [91]R.M.Gray,J.C.Kieffer,Y.Linde.Locally Optimal Bolck Quantizer Design.Information andControl[J],1980,45:178-261

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700