用户名: 密码: 验证码:
智能优化支持向量机预测算法及应用研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
机器学习是人工智能领域非常前沿的、极具智能特征的研究方向之一。支持向量机(Support Vector Machine,SVM)是由Vladimir Naumovich Vapnik等学者于1992年提出的一类新型机器学习方法,该方法以统计学习理论为理论体系,通过寻求结构风险最小化实现学习的真实风险最小化,追求在有限信息条件下得到最佳的学习效果,具有全局最优、结构简单、推广能力强等优点。在20世纪90年代中后期得到了全面深入的发展,在人脸检测、语音识别、图像处理、文本分类、邮件过滤等方面取得了大量的研究成果,成为继人工神经网络之后机器学习领域的又一研究热点。
     支持向量机集成了最大间隔超平面、Mercer核、凸二次规划、稀疏解和松弛变量等多项技术,是机器学习领域多项标准技术的整合和提高,在许多极具挑战性的应用中获得了很好的效果。
     但是,作为一类新兴的革命性的方法,支持向量机还需要进一步研究模型选择、参数优化、大样本快速训练、以及多类分类等问题。
     本文将支持向量机的理论、方法和应用三者相结合,深入研究支持向量机模型选择、参数优化、快速训练等问题,提出了三种新的支持向量机预测算法。本文的主要工作和贡献如下:
     1.提出基于混沌时间序列的粒子群优化支持向量机预测算法(CP-SVM)
     传统时间序列预测方法通常需要对时间序列的特性进行简化,加入了时间序列线性及平稳性的假定,然而这一假定与实际获得的时间序列差别很大,导致了传统时间序列预测方法实际应用效果不佳。人工神经网络预测方法虽然能够在一定程度上进行非线性时间序列预测,但不能解决应用上的“过学习”及局部极小值等问题。本文分析了经典时间序列分析方法的不足,并且在研究时间序列混沌特性的基础上,提出了基于混沌时间序列的粒子群优化支持向量机预测算法(CP-SVM),该算法的创新点在于:结合时间序列的混沌特性,针对预测模型系数的时变特性,采用粒子群算法对模型参数进行寻优,得到最佳的模型参数,以达到提高预测精度的目的。本文采用该算法对电力负荷这类复杂的非线性非平稳时间序列进行短期预测,提高了预测精度。
     2.提出基于核主成分分析的量子行为粒子群优化支持向量机预测算法(KQP-SVM)
     CP-SVM预测算法可以得到较高的预测精度,但预测速度较慢。为了提高预测速度,本文提出了基于核主成分分析的量子行为粒子群优化支持向量机预测算法(KQP-SVM)。KQP-SVM算法的创新点在于:在研究时间序列混沌特性的基础上确定合理的延迟时间和嵌入维数,采用核主成分分析方法提取非线性时间序列的特征,并采用量子行为粒子群算法优化支持向量机核函数的参数。本文将KQP-SVM算法应用于电力负荷短期预测,结果表明,该算法在保证预测精度的前提下,明显地提高了预测速度。
     3.提出改进序列最小优化算法训练样本的小波核最小二乘支持向量机预测算法(SWLS-SVM)
     SWLS-SVM算法的创新点如下:
     (1)对于更加复杂的时间序列,充分发掘小波分析提取信号高频细节特征方面的优势,构造小波核最小二乘支持向量机预测算法。该算法对于复杂度更高的混沌时间序列,可以得到更高的预测精度。
     (2)为了弥补最小二乘支持向量机丧失稀疏性的不足,采用改进的序列最小优化算法对样本进行训练,提高训练速度。
     4.将SWLS-SVM算法应用于火电锅炉主汽温预测控制系统,实现了典型热工系统的先进控制。实验数据表明,SWLS-SVM算法的预测效果优于人工神经网络和标准支持向量机等常用预测方法。
Machine Learning is one of the most advanced and intelligence-featured domains in Artificial Intelligence research. Support Vector Machine (SVM), as a new method of Machine Learning, was proposed by Vladimir Naumovich Vapnik and other scholars in 1992. Based on Statistics Learning Theory, the method seeks for optimal learning effect under limited information by actual risk minimization with structure risk minimization. Support Vector Machine has been regarded as one of new research hotspots following Artificial Neural Network.
     Support Vector Machine integrates technologies in maximum interval hyper-plane, Mercer kernel, convex quadratic programming, sparse solution and slack variable and makes best effect in many challenging applications.
     However, as a newly-rising, revolutionary technology, Support Vector Machine needs to solve some problems including model selection, parameter optimization, large sample fast training and multi-class classification. This dissertation combines the theory, method and application of Support Vector Machine together, makes a thorough study on the model selection, parameter optimization, and large sample fast training of SVM, then proposes three predict algorithms for SVM. The main work and contribution in this dissertation is as follows:
     1. Proposition of Chaotic-based Particle swarm optimization Support Vector Machine (CP-SVM) Algorithm. Traditional prediction algorithm on time series makes the assumption of linearity and stationary of time series to simplify characteristic of time series. However, the assumption makes obvious difference from the practical time series, causing unsatisfactory result in practical application. Although Artificial Neural Network prediction algorithms can make certain prediction on non-linear time series it can not solve problems of over-fitting and local minimum. This dissertation proposes CP-SVM algorithm by analyzing the shortage of classical time series algorithms and characteristic of chaos time series. The novelty of this algorithms lies in that it seeks for optimal model parameter by Particle Swarm Optimization (PSO) algorithm according to the time-variation characteristics of prediction model coefficient. Such algorithm, applied in complicated non-linear, non-stationary time series as electricity load, improves precision for short-term prediction.
     2. Proposition of Kernel principal component analysis based Quantum-behaved Particle swarm optimization algorithm of Support Vector Machines (KQP-SVM) Algorithm. The CP-SVM algorithm can acquire higher precision but with lower speed. To improve the prediction speed under permissible precision, this dissertation proposes KQP-SVM Algorithm. The novelties of KQP-SVM are as follows: it determines reasonable time series steps according to the chaotic characteristic of time series, gets characteristics of non-linear time series with kernel Principal Component Analysis, and optimizes parameter of SVM kernel function with Quantum-behaved Particle Swarm Optimization algorithm. The proposed method is then applied to short-term load prediction, and the results demonstrate that the algorithm can improve the prediction speed under permissible precision.
     3. Proposition of Sequential minimal optimization Wavelet Least Square Support Vector Machine (SWLS-SVM) Algorithm. The novelties of SWLS-SVM are as follows: aiming at more complicated chaos time series, it takes advantages of Wavelet analysis on high frequency detail characteristics and the high speed of Least Squares Support Vector Machine, then constructs Wavelet Least Square Support Vector Machine prediction model. With this algorithm higher prediction precision can be acquired for more complicated chaos time series. Improved sequential minimal optimization algorithm is applied to samples to improve training speed and thus yields the sparse representation of Least Square Support Vector Machine.
     4. Application of the SWLS-SVM algorithm. This algorithm is applied to main temperature control system of electric boiler, especially in advanced control of thermal system is accomplished typically. Experimental results show that SWLS-SVM algorithm has better performance than Artificial Neural Networks algorithm or standard Support Vector Machine algorithms in prediction.
引文
[安德洪等2004]安德洪,韩文秀,岳毅宏.组合预测法的改进及其在负荷预测中的应用[J].系统工程与电子技术,2004,26(6):842-844.
    [边肇祺和张学工2000]边肇祺,张学工.模式识别(第二版)[M].北京:清华大学出版社,2000.
    [程正兴等2007]程正兴,杨守志,冯晓霞.小波分析的理论算法进展和应用[M].北京:国防工业2007.
    [邓聚龙2002]邓聚龙.灰理论基础[M].武汉:华中理工大学出版社,2002.
    [丁宝苍2008]丁宝苍.预测控制的理论与方法[M].北京:机械工业出版社,2008.
    [范剑青和姚琦伟2008]范剑青,姚琦伟著,陈敏译.非线性时间序列--建模、预报及应用[M].北京:高等教育出版社,2008.
    [方崇智和萧德云1988]方崇智,萧德云.过程辨识[M].北京:清华大学出版社,1988.
    [甘文泉等1998]甘文泉,王朝晖,胡保生.结合神经元网络和模糊专家系统进行电力短期负荷预测[J].西安交通大学学报,1998,32(3):28-32.
    [何书元2003]何书元.应用时间序列分析[M].北京:北京大学出版社,2003.
    [胡丹2006]胡丹.小波支持向量回归模型及其应用研究[D].西南交通大学博士学位论文.2006.
    [胡一倩等 2003]胡一倩,吕剑虹,张铁军.一类自适应模糊控制方法研究及在锅炉汽温控制中的应用[J].中国电机工程学报,2003,23(1):136-140.
    [康重庆等1997]康重庆,夏清,相年德 灰色系统参数估计与不良数据辨识[J].清华大学学报(自然科学版),1997,37(4):72-75.
    [雷绍兰2005]基于电力负荷时间序列混沌特性的短期负荷预测方法研究[D].重庆大学博士学位论文,2005.
    [李国正等2004]李国正,王猛,曾华军译.支持向量机导论[M].北京:电子工业出版社,2004.
    [李红莲等2003]李红莲,王春花,袁保宗.一种改进的支持向量机NN-SVM[J].计算机学报.2003,26(8):1015-1020.
    [李辉等2003]李辉,管晓宏,昝鑫,韩崇昭.基于支持向量机的网络入侵检测.计算机研究与发展[J].2003,40(6):799-807.
    [李琦等1998]李琦,卢立东,陆叔军.重视锅炉燃烧调整提高锅炉热效率[J].江西电力,1998,22(2):29-30,35.
    [李天舒2006]混沌时间序列分析方法研究及其应用[D].哈尔滨工程大学博士学位论文,2006.
    [李天云和刘自发2000]李天云,刘自发.电力系统负荷的混沌特性及预测[J].中国电机工程学报,2000,20(11):36-40.
    [李远贵2006]提高支持向量机的学习效率和分类速度的研究和应用[D].上海交通大学博士学位论文.2006.
    [刘斌2004]刘斌.非线性系统建模及预测控制若干问题研究[D].浙江大学博士学位论文,2004.
    [刘延柱和陈立群2000]刘延柱,陈立群编著.非线性动力学[M].上海:上海交通大学出版社,2000.
    [刘志远等2004]刘志远,吕剑虹,陈来九.基于神经网络在线学习的过热汽温自适应控制系统[J].中国电机工程学报,2004,24(4):179-183.
    [马丹2004]马丹.火电厂燃料物流管理与成本控制[J].湖北工学院学报2004,19(2):65-67.
    [钱积新等2007]钱积新,赵均,许祖华.预测控制[M].北京:化学工业出版社,2007.
    [权先章等2000]权先章,蒋传文,张勇传.电力负荷的混沌预测方法[J].华中理工大学学报,2000,28(7):92-94.
    [孙海斌等2001]孙海斌,周淑雄,谢敬东,唐国庆.模糊综合评价在负荷最优组合预测中的应用[J].电力系统及其自动化学报,2001,13(4):8- 1.
    [田翔2006]支持向量机参数选择及训练算法研究[D].华南理工大学博士学位论文,2006.
    [田铮2001]田铮译.时间序列的理论与方法[M].北京:高等教育出版社,2001.
    [万海平2005]模式识别中核方法若干问题研究[D]北京邮电大学博士学位论文,2005.
    [王国胜2007]支持向量机的理论与算法研究[D].北京邮电大学博士学位论文,2007.
    [王海燕和卢山2006]王海燕,卢山.非线性时间序列分析及其应用[M].北京:科学出版社,2006.
    [席裕庚1993]席裕庚.预测控制[M].北京:国防工业出版社,1993.[夏道止等2001]夏道止,王锡凡,周琳,赵登福,张涛.基于RBF神经网络和专家系统的短期负荷预测方法[J].西安交通大学学报,2001,35(04):331-334.
    [许超等2002]许超,陈治纲,邵惠鹤.预测控制技术及应用发展综述[J].化工自动化及仪表,2002,Vol.29(3):1-10.
    [杨叔子等2007]杨叔子,吴雅,轩建平.时间序列分析的工程应用(第二版)(上下册)[M]武汉:华中科技大学出版社,2007.
    [张学工 2000]张学工.关于统计学习理论与支持向量机[J].自动化学报,2000,26(1):32-42.
    [张学工 2000]张学工译.统计学习理论的本质[M].北京:清华大学出版社,2000.
    [张智晟等2003]张智晟,孙雅明,王兆峰,李芳.优化相空间近邻点与递归神经网络融合的短期负荷预测[J].中国电机工程学报,2003,23(8):44-49.
    [周平等1998]周平,杨岚,周家启.电力系统负荷灰色预测的新方法[J].电力系统及其自动化,1998,10(3):45-50.
    [周志华2000]神经计算中若干问题的研究[D].南京大学博士学位论文, 2000.
    
    [诸静2003] 诸静.智能预测控制及其应用[M].杭州:浙江大学出版社,2003.
    
    [Amari and Wu 1999] Amari S., Wu S.. Improving support vector machine classifier by modifying kernel function. Neural Networks, 12, 1999, 783-789.
    [Amari and Wu 1999] Amari S., Wu S.. Improving support vector machine classifier by modifying kernel function. Neural Networks, 12, 1999, 783-789.
    
    [Baudat and Anouar 2000] Baudat G, Anouar F, Generalized discriminant analysis using a kernel approach. NeuralComputation, 2000.12:2385-2404.
    
    [Baudat and Anouar 2003] Baudat G., Anouar F.. Feature vector selection and projection using kernels. Neurocomputing, 55:21-38, 2003.
    
    [Ben-Hur et al. 2001] Ben-Hur A, Horn D, Siegelmann H. T. et al. Support vector clustering. [J] Journal of Machine Learning Research, 2001(2): 125-137.
    
    [Berg et al. 1984] Berg, Christenscn, Resse. Harmonic analysis on semigroups. Beijin: Springer-Verlago Wrorld Publishing Corporation, 1984.
    
    [Bhanu et al. 2002] Bhanu P K, Ramakrishnan A G, Suresh S. et al. Fetal lung maturity analysis using ultrasound image features.[J] IEEE Transactions on Information Technology in Biomedicine, 2002, 6(1): 38-45.
    
    [Boser et al. 1992] Boser B. Guyon I. Vapnik VA training algorithm for optimal margin classifiers. In: Fifth Annual Workshop on Computational Learning Theory pp.144-152. 1992. Pittsburgh: ACM Press.
    
    [Box et al. 1970] Box, G. E. P. and Jenkins, G. M. Time Series Analysis Forecasting and control. 1st edition. Holden-Day, San Franciso, 1970.
    
    [Brown 2000] Brown M., Lewis H.G. and Gunn S.R.. Linear spectral mixture models and support vector machines for remote sensing. IEEE transactions on Geoscience and Remote Sensing. 2000, 38(5): 2346-2360.
    
    [Brown et al. 1999] Brown M, W.Gryndy, D. Lin. et al.. Support vector machine classification of microarray gene expression data. Technical report UCSC-CRL-99-09, University of California, Santa Cruz, 1999
    
    [Burges C 1998] Burges C. A tutorial on support vector machines for pattern recognition. In Data Mining and Knowledge Discovery, Kluwer Academic Publishers, Boston. 1998,2(2): 121-167.
    
    [Cortes and Vapnik 1995] Cortes C. and Vapnik V.. Support Vector Networks[J]. Machine Learning, 1995,20:273-297.
    
    [Cai et al. 2002] Cai Y, Liu X, Xu X. et al. Prediction of protein structural classes by support vector machines [J]. Computers and Chemistry, 2002,26(3): 293-296.
    [Cai et al. 2002] Cai yu-Dong, Liu xiao-Jun, Xu xue-Biao et al.. Prediction of protein structural classes by support vector machines. Computers and Chemistry, 2002, 26(3): 293-296.
    [Cao D. et al. 2005] Cao D., Pang S., Bai Y.. Forecasting exchange rate using support vector machines. International Conference on Machine Leanring and Cybenretics. 2005: 3448-3452.
    
    [Cao L.J. et al. 2003] Cao L.J., Chua K.S., Chong W. K., Lee H. P., Gu Q.M.. A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine. Neurocomputing 55: 321-336,2003.
    
    [CHARLES 1992 ] CHARLES K.CHUI. An Introduction to Wavelets, Volume 1 (Wavelet Analysis and Its Applications). Academic Press 1992.
    
    [Chen et al. 2005] Chen P. -H., Fan R. E., and Lin C. -J.. A study on SMO-type decomposition methods for support vector machines. Technical report, Department of Computer Science, National Taiwan University, 2005. http://www. csie. ntu.edu.tw/ cjlin/papers /generaISMO.pdf.
    
    [Chen et al. 2006] Chen P. -H., Fan R. -E., and Lin C. -J.. A Study on SMO-type Decomposition Methods for Support Vector Machines. IEEE Transactions on Neural Networks, 2006,(17): 893-908.
    
    [Chen et al. 2001] Chen S., Samingan A.K. and Hano L.. Support vector machine multi-user receive for DS-CDMA signals in multipath channels. IEEE transaction on NeuralNetwork,2001,12(3): 604-611.
    [Cherkassky et al. 1997] Cherkassky V., Mulier F. Leanring from Data: Concepts, Theory and Methods. NY: John Viley&Sons, 1997.
    [Chiang and Pell 2004] Chiang L. H. and Pell R.J..Genetic algorithms combined with discriminant analysis for key variable identificaiton. Jounral of process control 2004(14): 143-155.
    
    [Christopher 2007] Christopher M. Bishop. Pattern Recognition and Machine Learning. Springer; 1 edition , 2007.
    
    [Coifman and Wickerhauser Coifman R R, Wickerhauser M V. Entropy-based algorithms for 1992] best basis selection. IEEE Transactions on Information Theory, 1992,38(2): 713-715.
    
    [Comon 1994] Comon. P, Independent component analysis, a new concept, Signal Processing, 1994,36(3): 287-314.
    [Cristianini et al. 2002] Cristianini N, Shawe T J, Kandola J, et al. On Kernel Target Alignment. Neural Information Processing Systems. Cambridge, MA: MIT Press, 2002
    [Dash and Liu 1997] Dash M, Liu Huan. Featllre selection for classification. Intelligent Data Analysis, 1997, 1(3): 131-156.
    [De Kruif and de Vries 2001] De Kruif B.J. and de Vries T.J.A.. On using a support vector machine in learning feed forward control. Proceedings of IEEE/ASME international Conference on Advanced Intelligent Mechatronics,2001, 1(1):272-277.
    
    [de krujf and de Vries 2001 ] de krujf B. J., de Vries T.J. On Using a Support Vector Machine in Learming Feed-Forward Control. Proc 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Como, Italy, 2001, 1: 272-277.
    
    [Domeniconi and Gunopulos Domeniconi C. and Gunopulos D.. Adaptive Neaerst Neighbor 2001] Classification using Support Vector Machines. Advances in Neural Information Processing Systems. MA: MIT Press. 2001.
    [Dougherty et al. 2004] Dougherty E. R., Shmulevich I.,Bittner M.L.. "Genomic signal processing: the salient issues." EURASIP Journal on applied signal processing. 2004, 1:146-153.
    
    [Drezet and Harrison 1998] Drezet P.M.L. and Harrison R.F.. Support vector machines for system identification. In UKACC international conference on control'98, 1998, 1(1):688-692.
    
    [Duan et al. 2001] Duan K., Keerthi S. Sathiya and Poo Aun Neow. Evaluation of simple performance measures for tuning SVM Hyperparameters. Control Division Technical Report CD-01-11, Singapore, 2001.
    
    [Dwight and Kraig 2003] Dwight F. Mix, Kraig J. Olejniczak .Elements of Wavelets for Engineers and Scientists . Wiley-Interscience , 2003.
    
    [EBERHART and KENNEY EBERHART R, KENNEY J. A new optimizer using particle 1995] swarm theory. Proceeding of the Sixth International Symposium on Micro Machine and Human Science, Nagoya, Japan. Piscataway, NJ: IEEE Press, 1995: 39-43.
    
    [Eberhart and Kennedy Eberhart R C, Kennedy J. A new optimizer using particle swarm 1995] theory. Proceedings of the 6th International Symposium on Micro Machine and Human Science, 1995, 1: 39-43.
    
    [Fan and Yao 2003] Fan, J. and Yao, Q.. Nonlinear Time Series: Nonparametric and Parametric Methods Springer, New York, 2003.
    [Francis and Michael2002] Francis R. Bach, Michael I. Jordan. Kernel indepent component analysis. Jounral of Learning Research, 2002, 3: 1-48.
    [Friedman and Kandel 1999] Friedman, M., Kandel, A. Introduction to Patern Recognition, statiscal, neura 1 and fuzzy logic approaches.Singapore: World scientific, Singapore, 1999.
    
    [Gavin and Nicola 2002] Gavin C. Cawley, Nicola L. C. Talbot. Improved sparse least-squares support vector machines .Neurocomputing. 2002, 48: 1025-1031.
    
    [Hastie et al. 2001] Hastie T., Tibshirani R., Friedman J.. The elements of statistical learning, data mining, inference, and prediction. New York, Springer-Verlag, 2001.
    
    [Haussler 1999] Haussler D.. Convolutional kernels on discrete structures. Technical Report UCSC-CRL-99-10, Computer Science Department, University of California at Santa Cruz, 1999.
    [Hiroyuki and Shouichi Hiroyuki Mori,Shouichi Urano. Short-Term Load Forevasting 1996] with Chaos Time Series Analysis[C]. International Conference on Intelligent Systems Applications to Power Systems, ISAP'96, 28 Jan.-2 Feb. 1996 , Pages:133-137.
    [Ibrahim 2000] Ibrahim Kaya. Improving performance using cascade and a Smith predictor [J] ISATransactions, 2000(04): 223-234.
    
    [Jain et al. 2000] Jain A., Duin R. P. W., Mao J.. Statistical pattern recognition: a review. IEEE transaction on pattern analysis and machine intelligence, 22(1): 4-37, 2000.
    
    [John et al. 1994] John G H, Kohavi R, Pfleger K. Irrelevant features and the subset selection problem. Proceedings of the 11th International Conference on Machine Learning. 1994, 121-129.
    
    [John and Nello 2004] John Shawe-Taylor, Nello Cristianini. kernel methods for pattern analysis. Cambridge University Press, Cambridge, 2004
    
    [Kamruzzaman et al. 2003] Kamruzzaman J., Sarker R. A., Ahmad I.. SVM based models for predicting foreign currency exchangerates. Third IEEE Intenrational Conference on Data Mining. 2003: 557-560.
    
    [Kaufman 1998] Kaufman L.. Solving the Quadratic Programming Problem Arising in Support Vector Classification. In B. Scholkopf, C. J. C. Burges, and A. Smola, editors, Advances in Kernel Methods-Support Vector Learning, MIT Press, Cambridge, MA, 1998,10: 147-167.
    
    [Keerthi et al. 2000] Keerthi S. S., Shevade S.K., Bhatacharyya C. and Murthy K.R.K.. A Fast Iterative Nearest Point Algorithm for Support Vector Machine Classifier Design. IEEE transaction on Neural Networks. 2000, 11(1): 124-136.
    
    [Keerthi et al. 2001] Keerthi S.S., Shevade S.K., Bhattacharyya C. and Murthy K.R.K.. Improvements Platto's SMO Algorithm for SVM Classifier Design. Neural Computation.2001, 13:637-649.
    
    [Kennedy and Eberhart Kennedy J, Eberhart R C. Particle Swarm Optimization. 1995] Proceeding of the IEEE International Conference on Neural Networks. Perth, Australia, Piscataway, NJ:IEEE Press,1995: 1942-1948.
    
    [Kennedy and Eberhart Kennedy J, Eberhart R C. Particle swarm optimization. 1995] Proceedings of the IEEE International Conference on Neural Networks, 1995, 1942-1 948.
    
    [Kennedy and Eberhart Kennedy J, Eberhart R C.A discrete binary version of the 1997] particle Swarm algorithm. Proceedings of the World Multiconference on Systemics, Cybernetics and Informatics, 1997,4104-4109.
    [Keren et al. 2001] Keren D., Osadchy M. and Gotsman C. Antifaces: A novel fast method for image detection IEEE transactions on Pattern Analysis and Machine Intelligence 2001, 23(7): 747-761.
    [Kim et al. 1999] Kim H.S. Eykholt R. Salas J.D.. Nonlinear dynamicsdelay times, and embedding windows[J]. Physica D, 1999, 127: 48-60.
    [Kohavi and John 1997] Kohavi R, John G H. Wrappers for feature subset selection. Artificial Intelligence, 1997, 97(1-2): 273-324.
    [Koller and Sahami 1996] Koller D, Sahami M. Toward optimal feature selection. Proceedings of the 13th International Conference on Machine Learning, 1996, 284-292.
    [Liangyue 1997] Liangyue Cao. Practical method for determining the minimum embedding dimension of a scalar time series[J]. Physica D, 1997,110:43-50.
    [Ling et al. 2003] Ling, S.H., Leung, F.H.F., Lam, H.K., Tarn, P.K.S. Short-term electric load forecasting based on a neural fuzzy network[J]. Industrial Electronics, IEEE Transactions on, Volume 50, Issue6, Dec. 2003: 1305-1316.
    [Maciejowski 2002] Maciejowski J.M., Predictive Control with Constraints, Prentice Hall, 2002.
    [Mangasarian 2000] Mangasarian O. L.. Generalized Support Vector Machines. In A. Smola, P. Bartlet, B. Scholkopf, and D. Schuunnans, editors, Advances in large Margin Classifiers, MIT Press, 2000:135-146.
    [Martin et al. 1988] Martin Fisher, Oliver Nelles, Rolf Isermann. Adaptive predictive control of a head exchanger based on a fuzzy model[J]. Control Engineering Practice , 1988(6):259-269.
    [Martin et al. 2002] Martin T. Hagan, Howard B. Demuth, Mark Beale. Neural Network Design. Martin Hagan, 2002.
    [Michanos et al. 2003] Michanos S.P., Tsakoumis A.C.,Fessas P.,Vladov S.S.,Mladenov V.M..Short-Term Load ForecastingUsing a Chaotic Time Series[C]. International Symposium on Signals, Circuits and Systems, SCS., 2003, 2: 437-440.
    [Mika et al. 1999] Mika S., Ratsch G., Weston J.. Fisher Discriminant Analysis with Kenrels. Neural Networks for Signal Processing. IX. 1999.
    [Moran 1953] Moran, P. A. P. . The statistical analysis of the Canadian Lynx cycle I. Structure and prediction. Aust. J. Zool, 1953, 1, 163-173.
    [Mukherjee et al. 1997] Mukherjee Sanyan, Osuna Edger, Giroci Federico. Nonlinear prediction of chaot time series using support vector machines. In Proceedings of the IEEE WorkshoP on Neural Networks for signal Processing. Amelia Island, FL, USA. 1997:511-520.
    [Nello and John 2000] Nello Cristianini and John Shawe-Taylor. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press; 1 edition, 2000.
    [Nello and John 2000 ] Nello Cristianini, John Shawe-Taylor. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press; 1 edition, 2000.
    [Nilsson 1998] Nilsson Nils J.. Artificial Intelligence: a new synthesis 5 Edition, Published by Morgan Kaufmann, 1998.
    [Oren et al. 1997] Oren M., Papageorgiou C. and Sinha P. et al. Pedestrian detection using wavele templates. In Proceedings of CVPR'97, 1997, Puerto Rico.
    [Osuna et al. 1997] Osuna E, Freund R, Girosi F. An improvd training algoirthm for support vector machines [A]. In proceeding of the IEEE workshop on Neural Networks for signal Processing[C] Amelia Island, 1997:276-285.
    [Pang et al. 2005] Pang-Ning Tan, Michael Steinbach, Vipin Kumar. Introduction to Data Mining. [M] New York: Adison-Wesley, 2005.
    [Peter and Richard 2003] Peter J. Brockwell, Richard A. Davis. Introduction to Time Series and Forecasting. Springer; 2nd edition, 2003.
    [Peter and Richard 1998] Peter J. Brockwell, Richard A. Davis Time Series: Theory and Methods, 2nd Edition Springer; 2nd edition, 1998.
    [Platt 1999] Platt J. Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines[A]. Advances in Kernel Methods-Support Vector learning[C]. The MIT Press, 1999.
    [Qin and Badwell 2003] Qin S. J., Badwell T. A., A survey of industrial model predictive control techoology, Control Engineering Practice, 2003, Vol.11: 733-764.
    [Reyna et al. 2000] Reyna R.A., Hernandez N., Esteve D. et al. Segmenting images with support vector machines. In Proceedings 2000 international conference on Image Processing. 2000, 1(1): 820 -823
    [Roobaret 2001] Roobaret Danny. DirectSVM: A Fast and Simple Support Vector Machine perception. Journalof VLSI signal processing systems. 2001, 32(1-2): 147-156.
    [Rychetsky et al. 1999] Rychetsky M., Ortmann S. and Glesner M.. Support vector approaches for engine knock detection. In proc. Of International Conference on Neural Networks (IJCNN'99), 1999, Washington, USA.
    [Samueland Howard 1981.] Samuel Karlin, Howard M. Taylor. A Second Course in Stochastic Processes. Academic Press, 1981.
    [SANCHEZ 2003] SANCHEZ A D. Advanced support vector machines and kernel methods[J]. Neurocomputing, 2003, 55(1): 5-20.
    [Satish and Nazneen 2003] Satish L, Nazneen B. Wavelet-based denoising of partial discharge signals buried in excessive noise and interference[J]. IEEE Transactions on Dielectrics and Electrical Insulation, 2003, 10(2): 354-367.
    [Scholkopf et al. 1998] Scholkopf B., Smola A., Muller K. R.. Nonlinea Component Analysisas a Kenrel Eigenvalue Problem. Neural Computation, 1998,10: 1299-1319.
    [Schtlkopf and Smola 2002.] Schtlkopf B, Smola A. Learning with kernels: support vector machines, regularization, and beyond[R]. Cambridge, MA: MIT Press, 2002.
    [Senjyu et al. 2004] Senjyu T., Mandal P., Uezato K., Funabashi T. Next Day Load Curve Forecasting Using Hybrid Correction Method[J]. IEEE Transactions on Power Systems. Volume 99. Issue99, 2004: 1-8.
    [Shen and Jiang 2004] Shen Qi, Jiang Jianhui. Modified particle swarm optimization algorithm for variable selection in MLR and PLS modeling: QSAR studies of antagonism of angiotensin II antagonists. European Journal of Pharmaceutical Sciences, 2004,22: 145-152.
    [Shie 2001] Shie Qian. Introduction to Time-Frequency and Wavelet Transforms . Prentice Hall PTR, 2001.
    [Simon 2008 ] Simon Haykin. Neural Networks and Learning Machines (3rd Edition). Prentice Hall; 3 edition , 2008.
    [Steinwart 2002] Steinwart I.. On the influence of the kernel on the consistency of support vector machines. Journal of Machine Learning Research, 2002,2: 67-93.
    [Mallat 1999] Mallat S. A Wavelet Tour of Signal Processing, Second Edition (Wavelet Analysis & Its Applications). Academic Press; 2nd edition, 1999.
    [Sun et al. 2004] Sun J, Feng B, Xu W B. Particle swarm optimization with particles having quantum behavior. IEEE Proceeding of Congress on Evolutionary Computation, 2004: 619-623.
    
    [Suykens and Suykens J.A.K., Vandewalle J.. Chaos control using Vandewalle 1999] least-squaer support vector machines. International Journal of Circuit Theory and Applications. 1999, 27(6):605-615.
    [Suykens et al. 2000] Suykens J.A.K., Lukas L., Vandewalle J.. Sparse Least Squaers Support Vector Machine Classifiers. In Proc. Of the European Symposium on Artificial Neural Networks 2000: 37-42. Bruges, Beigium.
    [Suykens et al. 2000] Suykens J.A.K., LukasL., Vandewalle J.. Sparse approximation using least squares support vector machines. In Proceedings of IEEE International Symposium on Circuits and Systems. 2, 2000: 757-760.
    [Suykens et al. 2001] Suykens J.A.K., VandewalleJ., De Moor B.. Optimal control by least squares support vector machine. Neural Network, 2001, 14:23-35.
    [Takens F. 1981] Takens F. On the numerical determination of the dimension of an attractor. In: Rand D, Young L S editors. Dynamical Systems and Turbulence. Warwick, 1980, Lecture Notes in Mathematics, Springer-Verlag, 1981, 898: 366-381.
    
    [Theodoridis and Theodoridis, S., Koutroumbas, K. Pattern Recognition.[M] New Koutroumbas 1999] York: Academic Press, 1999.
    [Tian et al. 2000] Tian Q., Hong P. and Huang T.S.. Update relevant image weights for content-based image retrieval using support vector machines. In Proceedings of 2000 IEEE international conference on Multimedia and Expo. 2000,2(2): 1199-1202.
    [Tom 1997] Tom M.Mitchell Machine Learning, McGraw Hill, 1997. 1 edition (March 1, 1997)
    [Valentini 2002] Valentini G. Gene expression data analysis of human lymphoma using support vector machines and output coding ensembles. [J] Artificial Intelligence in Medicine, 2002, 26(3): 281-304.
    [Vapnik et al. 1994] Vapnik V, LevinE, Le Cun Y. Measuring the VC-dimension of a learning machine. Neural Computation, 1994, 6: 851-876.
    [Vapnik 1982] Vapnik V.. Estimation of Dependences based on Empirical Data. Berlin: Springer Verlag, 1982.
    [Vapnik 1995] Vapnik V. The Nature of Statistical Learning Theory. [M] New York: Springer-Verlag, 1995.
    [Vapnik 1998] Vapnik V. Statistical Learning Theory. [M] New York: John Wiley & Sons, 1998.
    [Vapnik and Chapell 1999] Vapnik V. and Chapell O.. Bounds on error expectation for support vector machine. Advance in Large Margin Classifiers. MIT Press, 1999.
    [Wan and Campbell 2000] Wan V, Campbell W. M.. Support vector machines for speaker verification and identification. In Proceedings of the 2000 IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing. 2000, 2(2):775-784.
    [Wang and Yu 2005] Wang Ling, Yu Jinshou. Fault feature selection based on modified binary PSO with mutation and its application in chemical process fault diagnosis. Proceedings of ICNC, 2005, 832-840.
    [Wang et al. 2003] Wang W, Xu Z, Lu W. et al. Determination of the spread parameter in the Gaussian kernel for classification and regression [J]. Neurocomputing, 2003, 55: 643-663.
    
    [Webb 2002] Webb A. R... Statistical Pattern Recognition, Wiley, 2002.
    
    [Wickerhauser 1991] Wickerhauser M V. Lectures on wavelet packet algorithms, INRIA, 1991.
    [William 1971 ] William Feller. An introduction to probability theory and its applications,Vol. 2. John Wiley&Sons, Inc. 1971.
    [Xin and Wu 2001 ] Xin D, Wu Z. Speaker recognition using continuous density support vector machines.[J] Electronics Leters, 2001, 37:1099-1101.
    [Xin and Wi 2001] Xin Dong and Wi Zhaohui. Speaker recognition using continuous density support vector machines. Electronics Letters. 2001,37(17): 1099-1101.
    [Yule 1927] Yule, G. U. (1927). On a method of invetigating peroidicities in disturbed series with special reference to Wolfer's sunspot numbers. Phil. Trans. R. Soc. (London), A, 226, 267-298.
    
    [Zhong et al. 2003] Zhong Jin, Franck Davoine, Zhen Lou. Facial Expression Analysis By Using KPCA. Proceedings of the 2003 IEEE International Conference on Robotics, Intelligent System and Signal Processing, Changsha, China. 10, 2003: 736-741.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700