云测试研究现状综述
|
摘要
用文献分析方法剖析了云计算的体系结构,介绍了不同的云计算服务,论述了云计算软件的特点,给出了云测试的定义和应用场景。由此,比较了云测试的优势和挑战,并从云测试的服务类型、类别、内容等角度进行了综述,分析相互之间的对应关系,概括围绕云测试所展开的相关研究工作,展望了未来的研究方向和亟待解决的关键问题,为云测试相关研究提供了参考。
Adopting the literature analysis method,this paper summarized architecture of cloud computing,and introduced different cloud computing service,then discussed characteristic of software in cloud computing,gave the definition and application scene of cloud testing.And it compared the advantages and challenges of cloud testing,analyzed the interrelationship of service types,categories and contents of cloud testing,generalized related research about cloud testing.This paper also presented a summary of the current art of the state of cloud testing,a discussion on the future researches topics and some crucial problems which should be solved pressingly.Researchers of related topic can gain useful information about cloud testing.
Adopting the literature analysis method,this paper summarized architecture of cloud computing,and introduced different cloud computing service,then discussed characteristic of software in cloud computing,gave the definition and application scene of cloud testing.And it compared the advantages and challenges of cloud testing,analyzed the interrelationship of service types,categories and contents of cloud testing,generalized related research about cloud testing.This paper also presented a summary of the current art of the state of cloud testing,a discussion on the future researches topics and some crucial problems which should be solved pressingly.Researchers of related topic can gain useful information about cloud testing.
引文
[1]ARMBRUST M,FOX A,GRI_TH R,et al.Above the clouds:a Berke-ley view of cloud computing,UCB/EECS-2009-28[R].Berkeley:University of California,2009.
[2]李乔,郑啸.云计算研究现状综述[J].计算机科学,2011,38(4):32-37.
[3]陈康,郑纬民.云计算:系统实例与研究现状[J].软件学报,2009,20(5):1337-1348.
[4]GROSSMAN R L,GU Yun-hong.Data mining using high performance clouds:experimental studies using sector and sphere[C]//Proc of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM Press,2008:920-927.
[5]The Sector Project.SECTOR:a distributed storage and computing in-frastructure,version1.4[EB/OL].[2012].http://sourceforge.net/projects/sector/.
[6]BUYYA R,RANJAN R,CALHEIROS R N.Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit:challenges and opportunities[C]//Proc of International Conference on High Performance Computing&Simulation.New York:IEEE Press,2009:1-11.
[7]SRIRAM I.SPECI:a simulation tool exploring cloud-scale datacenters[C]//Proc of the1st International Conference on Cloud Computing.Berlin:Springer-Verlag,2009:381-392.
[8]LI Xin-hui,LI Ying,LIU Tian-cheng,et al.The method and tool of cost analysis for cloud computing[C]//Proc of IEEE International Conference on Cloud Computing.Washington DC:IEEE Computer So-ciety,2009:93-100.
[9]ELMROTH E,GALAN F,HENRIKSSON D,et al.Accounting and billing for federated cloud infrastructures[C]//Proc of the8th Inter-national Conference on Grid and Cooperative Computing.Washington DC:IEEE Computer Society,2009:268-275.
[10]De ASSUNCAO M D,Di COSTANZO A,BUYYA R.Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters[C]//Proc of the18th ACM International Symposium on High Per-formance Distributed Computing.New York:ACM Press,2009:141-150.
[11]XIONG Kai-qi,PERROS H.Service performance and analysis in cloud computing[C]//Proc of Congress on Services.2009:693-700.
[12]PATON N W,ARAGAO M A T,LEE K,et al.Optimizing utility in cloud computing through autonomic workload execution[J].IEEEData Engineering Bulletin,2009,32(1):51-58.
[13]ZAHARIA M,KONWINSKI A,JOSEPH A D,et al.Improving MapReduce performance in heterogeneous environments[C]//Proc of the8th USENIX Symposium on Operating Systems Design and Imple-mentation.Berkely:USENIX Association,2008:29-42.
[14]PushToTest[EB/OL].http://www.pushtotest.com/cloudtesting.
[15]Cloud testing[EB/OL].http://www.cloudtesting.com.
[16]IBM.Smart business test cloud[EB/OL].http://www-935.ibm.com/services/us/index.wss/offering/midware/a1030965.
[17]LoadStorm[EB/OL].http://loadstorm.com/.
[18]BrowserMob[EB/OL].http://browsermob.com/performance-tes-ting.
[19]Cloud-intelligence:Cloud-testing white paper[EB/OL].[2011-03-24].http://www.cloud-intelligence.com/sites/www.cloud-intelli-gence.com/files/Cloud%20Testing%20White%20Paper_0.pdf.
[20]GAISBAUER S,KIRSCHNICK J,EDWARDS N,et al.VATS:virtuali-zed-aware automated test service[C]//Proc of the5th International Conference on Quantitative Evaluation of Systems.Washington DC:IEEE Computer Society,2008:93-102.
[21]YU Lian,TSAI W T,CHEN Xiang-ji,et al.Testing as a service over cloud[C]//Proc of the5th IEEE International Symposium on Service Oriented System Engineering.2010:181-188.
[22]GANON Z,ZILBERSHTEIN I E.Cloud-based performance testing of network management systems[C]//Proc of the14th IEEE Interna-tional Workshop on Computer Aided Modeling and Design of Commu-nication Links and Networks.2009:1-6.
[23]CIORTEA L,ZAMFC C,BUCUR S,et al.Cloud9:a software testing service[J].IEEE Trans on Operating Systems Review,2009,43(4):5-10.
[24]CANDEA G,BUCUR S,ZAMFIR C.Automated software testing as a service[C]//Proc of the1st ACM Symposium on Cloud Computing.New York:ACM Press,2010:155-160.
[25]TAKAYUKI B,HITOSHI K,RYO K,et al.D-cloud:design of a soft-ware testing environment for reliable distributed systems using cloud computing technology[C]//Proc of the10th International Conference on Cluster,Cloud,and Grid Computing.Washington DC:IEEE Com-puter Society,2010:631-636.
[26]HANAWA T,BANZAI T,KOIZUMI H,et al.Large-scale software tes-ting environment using cloud computing technology for dependable parallel and distributed systems[C]//Proc of the3rd International Conference on Software Testing,Verification,and Validation.Wash-ington DC:IEEE Computer Society,2010:428-433.
[27]PARVEEN S N P,TILLEY T,DALEY N,et al.Towards a distributed execution framework for JUnit test cases[C]//Proc of IEEE Interna-tional Conference on Software Maintenance.2009:425-428.
[28]ORIOL M,ULLAH F.YETI on the cloud[C]//Proc of the3rd Inter-national Conference on Software Testing,Verification,and Validation.Washington DC:IEEE Computer Society,2010:434-437.
[29]TAN Jia-qi,PAN Xing-hao,KAVULYA S,et al.SALSA:analyzing logs as state machines[C]//Proc of the1st USENIX Workshop on Analysis of System Logs.Berkeley:USENIX Association,2008:6.
[30]TAN Jia-qi,PAN Xing-hao,KAVULYA S,et al.Mochi:visual log analysis based tools for debugging Hadoop[C]//Proc of Conference on Hot Topics in Cloud Computing.2009.
[31]PAN Xing-hao,TAN Jia-qi,PERTET S,et al.Blind men and the ele-phant:piecing together Hadoop for diagnosis[EB/OL].[2009-05].http://reports-archive.adm.cs.cmu.edu/anon/2009/CMU-CS-09-135.pdf.
[32]PAN Xing-hao,TAN Jia-qi,KAVULYA S,et al.Ganesha:black-box diagnosis of MapReduce systems[J].ACM SIGMETRICS Perfor-mance Evaluation Review,2009,37(3):8-13.
[33]RINGS T,GRABOWSKI J,SCHULZ S.On the standardization of a testing framework for application deployment on grid and cloud infra-structures[C]//Proc of the2nd International Conference on Advances in System Testing and Validation Lifecycle.2010:99-107.
[34]CHAN W K,MEI Li-jun,ZHANG Zhen-yu.Modeling and testing of cloud applications[C]//Proc of IEEE Asia-Pacific Services Compu-ting Conference.2009:111-118.
[35]KING T M,GANTI A S.Migrating autonomic selftesting to the cloud[C]//Proc of the3rd International Conference on Software Testing,Verification,and Validation.Washington DC:IEEE Computer Socie-ty,2010:438-443.
[36]MATHEW R,SPRAETZ R.Test automation on a SaaS platform[C]//Proc of International Conference on Software Testing,Verification and Validation.Washington DC:IEEE Computer Society,2009:317-325.
[37]GU Lin,CHEUNG S C.Constructing and testing privacy-aware services in a cloud computing environment:challenges and opportuni-ties[C]//Proc of the1st Asia-Pacific Symposium on Internetware.New York:ACM Press,2009:1-10.
[38]DU Juan,WEI Wei,GU Xiao-hui,et al.Runtest:assuring integrity of dataflow processing in cloud computing infrastructures[C]//Proc of the5th ACM Symposium on Information,Computer and Communica-tions Security.New York:ACM Press,2010:293-304.
[39]MENZEL M,WARSCHOFSKY R,THOMAS I,et al.The service secu-rity lab:a model-driven platform to compose and explore service secu-rity in the cloud[C]//Proc of the6th World Congress on Services.Washington DC:IEEE Computer Society,2010:115-122.
[40]RIUNGU L M,TAIPALE O,SMOLANDER K.Research issues for software testing in the cloud[C]//Proc of the2nd IEEE International Conference on Cloud Computing Technology and Science.2010:557-564.
[41]PARVEEN T,TILLEY S.When to migrate software testing to the cloud[C]//Proc of the3rd International Conference on Software Tes-ting,Verification and Validation.Washington DC:IEEE Computer Society,2010:424-427.
[42]RIUNGU L M,TAIPALE O,SMOLANDER K.Software testing as an online service:observations from practice[C]//Proc of the3rd Inter-national Conference on Software Testing,Verification and Validation.Washington DC:IEEE Computer Society,2010:418-423.
[43]Cloud testing[EB/OL].[2010-04].http://en.wikipedia.org/wiki/Cloud_testing.
[44]Amazon Web services[EB/OL].http://aws.amazon.com.
[45]Apache Hadoop[EB/OL].http://hadoop.apache.org/core.
[46]DEAN J,GHEMAWAT S.MapReduce:simplied data processing on large clusters[C]//Proc of the6th Symposium on Operating Systems Design and Implementation.2004:137-150.
[47]Apache Hbase[EB/OL].http://hadoop.apache.org/hbase.
[48]Apche Zookeeper[EB/OL].http://hadoop.apache.org/zookeeper.
[49]Google App Engine[EB/OL].http://appengine.google.com.
[50]Microsoft Azure[EB/OL].http://www.microsoft.com/azure.
[51]Salesforce.com[EB/OL].http://www.force.com.
[52]冯登国,张敏,张妍,等.云计算安全研究[J].软件学报,2011,22(1):71-83.
[2]李乔,郑啸.云计算研究现状综述[J].计算机科学,2011,38(4):32-37.
[3]陈康,郑纬民.云计算:系统实例与研究现状[J].软件学报,2009,20(5):1337-1348.
[4]GROSSMAN R L,GU Yun-hong.Data mining using high performance clouds:experimental studies using sector and sphere[C]//Proc of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York:ACM Press,2008:920-927.
[5]The Sector Project.SECTOR:a distributed storage and computing in-frastructure,version1.4[EB/OL].[2012].http://sourceforge.net/projects/sector/.
[6]BUYYA R,RANJAN R,CALHEIROS R N.Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit:challenges and opportunities[C]//Proc of International Conference on High Performance Computing&Simulation.New York:IEEE Press,2009:1-11.
[7]SRIRAM I.SPECI:a simulation tool exploring cloud-scale datacenters[C]//Proc of the1st International Conference on Cloud Computing.Berlin:Springer-Verlag,2009:381-392.
[8]LI Xin-hui,LI Ying,LIU Tian-cheng,et al.The method and tool of cost analysis for cloud computing[C]//Proc of IEEE International Conference on Cloud Computing.Washington DC:IEEE Computer So-ciety,2009:93-100.
[9]ELMROTH E,GALAN F,HENRIKSSON D,et al.Accounting and billing for federated cloud infrastructures[C]//Proc of the8th Inter-national Conference on Grid and Cooperative Computing.Washington DC:IEEE Computer Society,2009:268-275.
[10]De ASSUNCAO M D,Di COSTANZO A,BUYYA R.Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters[C]//Proc of the18th ACM International Symposium on High Per-formance Distributed Computing.New York:ACM Press,2009:141-150.
[11]XIONG Kai-qi,PERROS H.Service performance and analysis in cloud computing[C]//Proc of Congress on Services.2009:693-700.
[12]PATON N W,ARAGAO M A T,LEE K,et al.Optimizing utility in cloud computing through autonomic workload execution[J].IEEEData Engineering Bulletin,2009,32(1):51-58.
[13]ZAHARIA M,KONWINSKI A,JOSEPH A D,et al.Improving MapReduce performance in heterogeneous environments[C]//Proc of the8th USENIX Symposium on Operating Systems Design and Imple-mentation.Berkely:USENIX Association,2008:29-42.
[14]PushToTest[EB/OL].http://www.pushtotest.com/cloudtesting.
[15]Cloud testing[EB/OL].http://www.cloudtesting.com.
[16]IBM.Smart business test cloud[EB/OL].http://www-935.ibm.com/services/us/index.wss/offering/midware/a1030965.
[17]LoadStorm[EB/OL].http://loadstorm.com/.
[18]BrowserMob[EB/OL].http://browsermob.com/performance-tes-ting.
[19]Cloud-intelligence:Cloud-testing white paper[EB/OL].[2011-03-24].http://www.cloud-intelligence.com/sites/www.cloud-intelli-gence.com/files/Cloud%20Testing%20White%20Paper_0.pdf.
[20]GAISBAUER S,KIRSCHNICK J,EDWARDS N,et al.VATS:virtuali-zed-aware automated test service[C]//Proc of the5th International Conference on Quantitative Evaluation of Systems.Washington DC:IEEE Computer Society,2008:93-102.
[21]YU Lian,TSAI W T,CHEN Xiang-ji,et al.Testing as a service over cloud[C]//Proc of the5th IEEE International Symposium on Service Oriented System Engineering.2010:181-188.
[22]GANON Z,ZILBERSHTEIN I E.Cloud-based performance testing of network management systems[C]//Proc of the14th IEEE Interna-tional Workshop on Computer Aided Modeling and Design of Commu-nication Links and Networks.2009:1-6.
[23]CIORTEA L,ZAMFC C,BUCUR S,et al.Cloud9:a software testing service[J].IEEE Trans on Operating Systems Review,2009,43(4):5-10.
[24]CANDEA G,BUCUR S,ZAMFIR C.Automated software testing as a service[C]//Proc of the1st ACM Symposium on Cloud Computing.New York:ACM Press,2010:155-160.
[25]TAKAYUKI B,HITOSHI K,RYO K,et al.D-cloud:design of a soft-ware testing environment for reliable distributed systems using cloud computing technology[C]//Proc of the10th International Conference on Cluster,Cloud,and Grid Computing.Washington DC:IEEE Com-puter Society,2010:631-636.
[26]HANAWA T,BANZAI T,KOIZUMI H,et al.Large-scale software tes-ting environment using cloud computing technology for dependable parallel and distributed systems[C]//Proc of the3rd International Conference on Software Testing,Verification,and Validation.Wash-ington DC:IEEE Computer Society,2010:428-433.
[27]PARVEEN S N P,TILLEY T,DALEY N,et al.Towards a distributed execution framework for JUnit test cases[C]//Proc of IEEE Interna-tional Conference on Software Maintenance.2009:425-428.
[28]ORIOL M,ULLAH F.YETI on the cloud[C]//Proc of the3rd Inter-national Conference on Software Testing,Verification,and Validation.Washington DC:IEEE Computer Society,2010:434-437.
[29]TAN Jia-qi,PAN Xing-hao,KAVULYA S,et al.SALSA:analyzing logs as state machines[C]//Proc of the1st USENIX Workshop on Analysis of System Logs.Berkeley:USENIX Association,2008:6.
[30]TAN Jia-qi,PAN Xing-hao,KAVULYA S,et al.Mochi:visual log analysis based tools for debugging Hadoop[C]//Proc of Conference on Hot Topics in Cloud Computing.2009.
[31]PAN Xing-hao,TAN Jia-qi,PERTET S,et al.Blind men and the ele-phant:piecing together Hadoop for diagnosis[EB/OL].[2009-05].http://reports-archive.adm.cs.cmu.edu/anon/2009/CMU-CS-09-135.pdf.
[32]PAN Xing-hao,TAN Jia-qi,KAVULYA S,et al.Ganesha:black-box diagnosis of MapReduce systems[J].ACM SIGMETRICS Perfor-mance Evaluation Review,2009,37(3):8-13.
[33]RINGS T,GRABOWSKI J,SCHULZ S.On the standardization of a testing framework for application deployment on grid and cloud infra-structures[C]//Proc of the2nd International Conference on Advances in System Testing and Validation Lifecycle.2010:99-107.
[34]CHAN W K,MEI Li-jun,ZHANG Zhen-yu.Modeling and testing of cloud applications[C]//Proc of IEEE Asia-Pacific Services Compu-ting Conference.2009:111-118.
[35]KING T M,GANTI A S.Migrating autonomic selftesting to the cloud[C]//Proc of the3rd International Conference on Software Testing,Verification,and Validation.Washington DC:IEEE Computer Socie-ty,2010:438-443.
[36]MATHEW R,SPRAETZ R.Test automation on a SaaS platform[C]//Proc of International Conference on Software Testing,Verification and Validation.Washington DC:IEEE Computer Society,2009:317-325.
[37]GU Lin,CHEUNG S C.Constructing and testing privacy-aware services in a cloud computing environment:challenges and opportuni-ties[C]//Proc of the1st Asia-Pacific Symposium on Internetware.New York:ACM Press,2009:1-10.
[38]DU Juan,WEI Wei,GU Xiao-hui,et al.Runtest:assuring integrity of dataflow processing in cloud computing infrastructures[C]//Proc of the5th ACM Symposium on Information,Computer and Communica-tions Security.New York:ACM Press,2010:293-304.
[39]MENZEL M,WARSCHOFSKY R,THOMAS I,et al.The service secu-rity lab:a model-driven platform to compose and explore service secu-rity in the cloud[C]//Proc of the6th World Congress on Services.Washington DC:IEEE Computer Society,2010:115-122.
[40]RIUNGU L M,TAIPALE O,SMOLANDER K.Research issues for software testing in the cloud[C]//Proc of the2nd IEEE International Conference on Cloud Computing Technology and Science.2010:557-564.
[41]PARVEEN T,TILLEY S.When to migrate software testing to the cloud[C]//Proc of the3rd International Conference on Software Tes-ting,Verification and Validation.Washington DC:IEEE Computer Society,2010:424-427.
[42]RIUNGU L M,TAIPALE O,SMOLANDER K.Software testing as an online service:observations from practice[C]//Proc of the3rd Inter-national Conference on Software Testing,Verification and Validation.Washington DC:IEEE Computer Society,2010:418-423.
[43]Cloud testing[EB/OL].[2010-04].http://en.wikipedia.org/wiki/Cloud_testing.
[44]Amazon Web services[EB/OL].http://aws.amazon.com.
[45]Apache Hadoop[EB/OL].http://hadoop.apache.org/core.
[46]DEAN J,GHEMAWAT S.MapReduce:simplied data processing on large clusters[C]//Proc of the6th Symposium on Operating Systems Design and Implementation.2004:137-150.
[47]Apache Hbase[EB/OL].http://hadoop.apache.org/hbase.
[48]Apche Zookeeper[EB/OL].http://hadoop.apache.org/zookeeper.
[49]Google App Engine[EB/OL].http://appengine.google.com.
[50]Microsoft Azure[EB/OL].http://www.microsoft.com/azure.
[51]Salesforce.com[EB/OL].http://www.force.com.
[52]冯登国,张敏,张妍,等.云计算安全研究[J].软件学报,2011,22(1):71-83.