基于电网大数据调度支撑电能质量数据治理应用体系研究
|
摘要
随着信息技术的发展与数据量的膨胀,将现场数据采集传输形成大数据进行分析,已经成为电能质量数据治理的时下趋势,传统的数据存储、数据处理体系与方法已经不能满足数据治理的要求,为此,结合大数据技术,提出了基于大数据调度支撑的电能质量数据治理应用体系。引入Hadoop云平台,将传统的数据分析转换为大数据存储分析调度,设计出具有Hbase数据存储的电能质量大数据治理体系,又提出基于映射规约分离器的电能质量数据调度方法,对电能质量数据进行解析挖掘。最后通过搭建实验平台,验证大数据调度电能质量数据治理的有效性与可行性。
With the development of information technology and the expansion of data volume, The field data collection and transmission are formed into big data for analysis, Has become the current trend of power quality data management, Traditional data storage, data processing systems and methods can no longer meet the requirements of data governance. To this end, combined with big data technology, A power quality data management application system based on big data scheduling support is proposed. Introducing Hadoop cloud platform, Convert traditional data analysis into big data storage analysis scheduling, The power quality big data management system with Hbase data storage is designed. The power quality data scheduling method based on the mapping specification separator is also proposed, Analyze and mine power quality data. Finally, by building an experimental platform, Verify the effectiveness and feasibility of big data scheduling power quality data management.
With the development of information technology and the expansion of data volume, The field data collection and transmission are formed into big data for analysis, Has become the current trend of power quality data management, Traditional data storage, data processing systems and methods can no longer meet the requirements of data governance. To this end, combined with big data technology, A power quality data management application system based on big data scheduling support is proposed. Introducing Hadoop cloud platform, Convert traditional data analysis into big data storage analysis scheduling, The power quality big data management system with Hbase data storage is designed. The power quality data scheduling method based on the mapping specification separator is also proposed, Analyze and mine power quality data. Finally, by building an experimental platform, Verify the effectiveness and feasibility of big data scheduling power quality data management.
引文
[1]朱碧钦,吴飞,罗富财.基于大数据的全业务统一数据中心数据分析域建设研究[J].电力信息与通信技术,2017(2):91-96.
[2]韩笑,狄方春,刘广一,等.应用智能电网统一数据模型的大数据应用架构及其实践[J].电网技术,2016,40(10):3206-3212.
[3]金培权,郝行军,岳丽华.面向新型存储的大数据存储架构与核心算法综述[J].计算机工程与科学,2013,35(10):12-24.
[4]陈学斌,王师,董岩岩.面向大数据的并行分类混合算法研究[J].微电子学与计算机,2016,33(4):138-14.
[5]李宏,阿玛尼.基于EM和贝叶斯网络的丢失数据填充算法[J].计算机工程与应用,2010,46(5):123-125.
[2]韩笑,狄方春,刘广一,等.应用智能电网统一数据模型的大数据应用架构及其实践[J].电网技术,2016,40(10):3206-3212.
[3]金培权,郝行军,岳丽华.面向新型存储的大数据存储架构与核心算法综述[J].计算机工程与科学,2013,35(10):12-24.
[4]陈学斌,王师,董岩岩.面向大数据的并行分类混合算法研究[J].微电子学与计算机,2016,33(4):138-14.
[5]李宏,阿玛尼.基于EM和贝叶斯网络的丢失数据填充算法[J].计算机工程与应用,2010,46(5):123-125.