基于特征加权的神经网络集成及其应用
|
摘要
泛化能力是机器学习关注的基本问题之一.特征加权是特征选择的更一般情况,它能更加细致地区分特征对结果影响的程度,往往能够获得比特征选择更好的或者至少相等的性能,已经成为普遍的提高学习器的泛化能力的方法之一.该文提出一种基于特征加权的神经网络集成方法FWEART,该方法通过自适应遗传算法的优胜劣汰机制为输入属性确定了特征权值,提高了集成中各个体Category ART网络的精度和差异度,从而提高了神经网络集成的泛化能力.在UCI标准数据集上验证了有效性后,FWEART被应用在地震序列类型预报上,取得了较好的预报效果.
Generalization ability is a principal issue in the field of machine learning.Feature weighting is a general case of feature selection,which has the potential of performing better(or at least similar) feature selection.This paper proposes a new ensemble method named FWEART(Feature Weighting based Ensemble of Adaptive Resonance Theory networks),in which an adaptive genetic algorithm is used to conduct a search for the weight vector that can optimize the classification accuracy of the individual Category ART networks.Furthermore,the generalization ability of the ensemble is improved.Experiments on the UCI datasets show that FWEART has good generalization ability.Finally,FWEART is applied to predict the types of earthquake.The result is satisfactory.
Generalization ability is a principal issue in the field of machine learning.Feature weighting is a general case of feature selection,which has the potential of performing better(or at least similar) feature selection.This paper proposes a new ensemble method named FWEART(Feature Weighting based Ensemble of Adaptive Resonance Theory networks),in which an adaptive genetic algorithm is used to conduct a search for the weight vector that can optimize the classification accuracy of the individual Category ART networks.Furthermore,the generalization ability of the ensemble is improved.Experiments on the UCI datasets show that FWEART has good generalization ability.Finally,FWEART is applied to predict the types of earthquake.The result is satisfactory.
引文
[1]OPTIZ D.Feature selection for ensembles[C]//Proc ofAAAI1999,Orlando,FL.1999:379-384.
[2]BRYLL R,GUTIERREZ-OSUNA R,QUEK R.Attributebagging:improving accuracy of classifier ensembles by usingrandom feature subsets[J].Pattern Recognition,2003,36(3):1291-1302.
[3]WEN W X,LIU H.A feature weighting method forinductive learning[C]//Proc of the 3rd PRICAI,Beijing,China.1994:338-344.
[4]PUNCH W,GOODMAN E,PEI M,et al.Further researchon feature selection and classification using geneticalgorithms[C]//Proc of the Fifth ICGA.1993:379-383.
[5]KOMOSINSKI M,KRAWIEC K.Evolutionary weighting ofimage features for diagnoses of CNS tumors[J].ArtificialIntelligence in Medicine,2000,19:25-38.
[6]丁智国,刘悦,吴耿锋.基于特征加权的Category ART网络及其在地震震型预报中的应用[J].计算机工程,2007,33(8):201-204.
[7]EFRON B,TIBSHIRANI R.An introduction to thebootstrap[M].New York:Chapman&Hall,1993.
[8]WEENINK D.Categroy ART:a variation on adaptiveresonance theory neural net[C]//IFA Proceedings 21.1997:117.
[9]HOLLAND J H.Adaptation in natural and artificial systems[M].Ann Arbor:The University of Michigan Press,1975.
[10]HUSSEIN F,KHARMA N,WARD R.Genetic algorithmsfor feature selection and weighting,a review and study[C]//Proc of ICDAR’01,Seattle,Washington.2001:10-13.
[11]王小平,曹立明.遗传算法——理论、应用与软件实现[M].西安:西安交通大学出版社,2002:79-85.
[12]BLAKE C,KEOGH E,MERZ C J.UCI repository ofmachine learning databases[R/OL].Department ofInformation and Computer Science,University of California,Irvine,California,1998[2007-03-03].http://www.ics.uci.edu/mlearn/MLRepository.html.
[13]林命.大中城市震后趋势判定与应急[M].北京:地震出版社,2003:6.
[2]BRYLL R,GUTIERREZ-OSUNA R,QUEK R.Attributebagging:improving accuracy of classifier ensembles by usingrandom feature subsets[J].Pattern Recognition,2003,36(3):1291-1302.
[3]WEN W X,LIU H.A feature weighting method forinductive learning[C]//Proc of the 3rd PRICAI,Beijing,China.1994:338-344.
[4]PUNCH W,GOODMAN E,PEI M,et al.Further researchon feature selection and classification using geneticalgorithms[C]//Proc of the Fifth ICGA.1993:379-383.
[5]KOMOSINSKI M,KRAWIEC K.Evolutionary weighting ofimage features for diagnoses of CNS tumors[J].ArtificialIntelligence in Medicine,2000,19:25-38.
[6]丁智国,刘悦,吴耿锋.基于特征加权的Category ART网络及其在地震震型预报中的应用[J].计算机工程,2007,33(8):201-204.
[7]EFRON B,TIBSHIRANI R.An introduction to thebootstrap[M].New York:Chapman&Hall,1993.
[8]WEENINK D.Categroy ART:a variation on adaptiveresonance theory neural net[C]//IFA Proceedings 21.1997:117.
[9]HOLLAND J H.Adaptation in natural and artificial systems[M].Ann Arbor:The University of Michigan Press,1975.
[10]HUSSEIN F,KHARMA N,WARD R.Genetic algorithmsfor feature selection and weighting,a review and study[C]//Proc of ICDAR’01,Seattle,Washington.2001:10-13.
[11]王小平,曹立明.遗传算法——理论、应用与软件实现[M].西安:西安交通大学出版社,2002:79-85.
[12]BLAKE C,KEOGH E,MERZ C J.UCI repository ofmachine learning databases[R/OL].Department ofInformation and Computer Science,University of California,Irvine,California,1998[2007-03-03].http://www.ics.uci.edu/mlearn/MLRepository.html.
[13]林命.大中城市震后趋势判定与应急[M].北京:地震出版社,2003:6.
版权所有：© 2023 中国地质图书馆 中国地质调查局地学文献中心