教务校长决策支持系统——数据整合研究与应用
|
摘要
随着信息技术的不断发展与高等教育规模的快速增长,各高校都相继建立了自己的教务管理信息系统。这些系统多半是联机事务处理系统(On-Line TransactionProcessing,简称OLTP),每个部门都有各自的数据源,构成了一个巨大的异构数据环境。出现了数据和信息系统分散、对历史积累的海量信息利用无能为力、支持管理决策能力差等一系列问题。采用数据整合技术、数据仓库技术以及这些系统多半是联机事务处理系统(On-Line Transaction Processing,简称OLTP),工具对教务数据进行多层次、多角度的分析与整合,可以有效解决信息孤岛问题,并可以挖掘出许多有价值的分析数据,这无疑为管理者进行教学决策起着重要的指导意义。
本文针对北京工业职业技术学院教务管理信息系统,深入研究了数据整合技术、数据仓库设计和建立以及OLAP技术,构建了数据仓库,开发了数据整合系统,该系统包括数据的抽取、转换、加载以及OLAP决策分析。在数据仓库设计和建立部分,主要是对数据仓库的逻辑模型进行了研究,对每个主题建立星型模型结构。在此基础上,把原教务系统数据库中的数据,通过抽取、转换处理,最后装载到数据仓库中,实现教务数据的清洗整合。
最后,用OLAP工具验证了数据仓库整合结果,在建立多维数据集的基础上,采用多维数据分析,分别对学习成绩、学生情况、就业情况做了数据分析,并以直方图、饼图、曲线图等做了清晰的展示,根据分析结果,对教务管理者提出有针对性的决策支持与建议。
通过数据整合建立了教务数据中心,基本上消除了信息孤岛的问题,提高了教务管理水平,实现了教务管理的智能化与决策的科学化。
With the continuous development of information technology and the rapid growth of the scale of higher education, various universities have established their own educational management information system. Most of these systems is the On-Line Transaction Processing (OLTP), each department has its own data sources, which constitute a huge heterogeneous data environment. So it causes a series of issues, such as the decentralization of data and information systems, without making use of the mass accumulated information of history and the poor capacity of management decision-making. It can effectively resolve the problem of information island through data integration technology, data warehouse technology and On-Line Analytical Processing(OLAP) tool, and mine a lot of valuable data analysis. They play an important guiding significance for managers to make teaching decisions.
In this paper, I research deeply data integration technology, data warehouse design and OLAP technology to the Administration Information System in Beijing polytechnic college, construct a data warehouse, and develop data integration system, including Extract, Transform,Load and OLAP decision analysis. In the design and establishment of data warehouse, I mainly research the logic of the model for data warehouse and establish star model for the every theme. On this basis, I extract and transform data in the original Educational Administration database system. Finally, I load them into the data warehouse, and realize data cleaning and integration of the Educational Administration System.
Finally, the use of OLAP tools verifies the results of the data integration. On the basis of the establishment of multi-dimensional data set, it analyses students' scores, Students' case, and the employment situation and display clearly through histograms, pie chart, Curve, and so on. According to the results of the analysis, it put forward specific support of making decision and proposals to the Educational managers.
Through data integration, the establishment of the data center essentially eliminates informational island. It has improved the level of the educational administration and realized the intelligent scientific process with decision of educational administration management.
本文针对北京工业职业技术学院教务管理信息系统,深入研究了数据整合技术、数据仓库设计和建立以及OLAP技术,构建了数据仓库,开发了数据整合系统,该系统包括数据的抽取、转换、加载以及OLAP决策分析。在数据仓库设计和建立部分,主要是对数据仓库的逻辑模型进行了研究,对每个主题建立星型模型结构。在此基础上,把原教务系统数据库中的数据,通过抽取、转换处理,最后装载到数据仓库中,实现教务数据的清洗整合。
最后,用OLAP工具验证了数据仓库整合结果,在建立多维数据集的基础上,采用多维数据分析,分别对学习成绩、学生情况、就业情况做了数据分析,并以直方图、饼图、曲线图等做了清晰的展示,根据分析结果,对教务管理者提出有针对性的决策支持与建议。
通过数据整合建立了教务数据中心,基本上消除了信息孤岛的问题,提高了教务管理水平,实现了教务管理的智能化与决策的科学化。
With the continuous development of information technology and the rapid growth of the scale of higher education, various universities have established their own educational management information system. Most of these systems is the On-Line Transaction Processing (OLTP), each department has its own data sources, which constitute a huge heterogeneous data environment. So it causes a series of issues, such as the decentralization of data and information systems, without making use of the mass accumulated information of history and the poor capacity of management decision-making. It can effectively resolve the problem of information island through data integration technology, data warehouse technology and On-Line Analytical Processing(OLAP) tool, and mine a lot of valuable data analysis. They play an important guiding significance for managers to make teaching decisions.
In this paper, I research deeply data integration technology, data warehouse design and OLAP technology to the Administration Information System in Beijing polytechnic college, construct a data warehouse, and develop data integration system, including Extract, Transform,Load and OLAP decision analysis. In the design and establishment of data warehouse, I mainly research the logic of the model for data warehouse and establish star model for the every theme. On this basis, I extract and transform data in the original Educational Administration database system. Finally, I load them into the data warehouse, and realize data cleaning and integration of the Educational Administration System.
Finally, the use of OLAP tools verifies the results of the data integration. On the basis of the establishment of multi-dimensional data set, it analyses students' scores, Students' case, and the employment situation and display clearly through histograms, pie chart, Curve, and so on. According to the results of the analysis, it put forward specific support of making decision and proposals to the Educational managers.
Through data integration, the establishment of the data center essentially eliminates informational island. It has improved the level of the educational administration and realized the intelligent scientific process with decision of educational administration management.
引文
[1]邓英.数字化校园建设中公共数据整合方案研究[J].电脑知识与技术,2008,(04):589-591
[2]周茂伟,邓苏,黄宏斌.基于元数据的ETL工具设计与实现[J].科学技术与工程,2006,(21):3503-3507
[3]张宁,贾自艳,史忠植.数据仓库中ETL技术的研究[J]计算机工程与应用,2002,(24):213-216
[4]武彦峰,朱仲英.基于DTS组件的数据仓库的数据抽取工具的设计与实现[J]微型电脑应用,2004,(03):1-3,9
[5]吴远红.ETL执行过程的优化研究[J].计算机科学,2007,(01):81-83.
[6]段永威,秦峰.异构数据源数据转换工具的设计与实现[J].现代图书情报技术,2004,(04):59-62.
[7]尹邢飞,陈钢.ETL在高校信息化建设中的应用与研究[J].计算机与数字工程,2005,(03):46-48,72.
[8]张军.异构数据源之间的数据转换方法[J]计算机应用,2005,(S1):175-175,180.
[9]邓杰超.数字校园建设中的资源整合研究[J].广东科技,2007,(02):34-35.
[10]卢明春.数据整合在校园网建设中的应用[D].吉林大学,2007
[11]杨发毅,曾琼.异构数据整合技术研究[J].中华医学图书情报杂志,2007,(02):65-68.
[12]周志逵,徐先传.数据仓库中数据抽取、转换及加载工具研究[J]北京理工大学学报,2003,(06):720-723.
[13]秦剑波.高校数字化校园建设中数据整合的探讨[J].科技资讯,2007,(19).
[14][美]RalPhKimball,MargyRoss著,谭明金译.数据仓库工具箱:维度建模的完全指南(第二版).电子工业出版社,2003.10
[15]章立民编著,SQL Server 2000完全实战-数据转换服务(DTS),中国铁道出版社,第一版,2002年6月52-68
[16]沈兆阳编著.SQLServer20000LAP解决方案一数据仓库AnalysiSServiCeS.清华大学出版社,2001.9
[17]高洪深著,决策支持系统(DSS)理论方法案例,清华大学出版社,第二版,2000年9月44-53
[18]姜炜.ETL应用浅析数据仓库之原创资料 http://www.dwway.com,2003年4月
[19]雷乔.数据仓库ETL研究及实现:[硕士学位论文).东北大学,2006.
[20]陈弦,陈松乔.基于数据仓库的通用ETL工具的设计与实现[J].计算机应用研究,2004,21(8):214-216.
[21]常新功,肖玉巍,金红.数据仓库的ETL策略[J].山西财经大学学报,2002,24(24):2-3.
[22]张宁,贾自艳,史忠植.数据仓库中ETL技术的研究.计算机工程与应用,2002(24):213-216.
[23]王咏梅ETL及其在数据仓库创建中的重要作用.
[24]Kamal Hathi SQL Server 2005集成服务简介.
[25]沈立强.数据整合四个阶段.中国教育网络:2007年9期:10-10,12-14
[26]陆定涛,庄成三,关戍.异构数据库之间的数据集成和备份模型.计算机应用,2002,卷22,第11期:88-90。
[27]熊丽荣,蔡家楣,郑河荣,郭行波.移动网管平台中数据仓库数据抽取、净化和集成.计算机应用研究.2002.19(4):140-141.
[28]沈兆阳.数据仓库与Analysis Services.北京:清华大学出版社,2001。
[29]Thalhammer,Thomas.Realizing active data warehouses with off-the-shelf database technology.Software-Practice and Experience.Vol.32(12):1193-1222,2002.
[30]LI,Jianzhong,Gao,Hong Multidimensional data modeling for data warehouses.Journal of Software Vol.11(7):908-917,2000.(In Chinese)
[31]Sim,Seungjae,Park,Gilju,Lenn,Wonjun,Lee,Sunmi Case study:How to make telecom pricing strategy using data warehouse approach.Proceedings of the Hawaii InternationalConference on System Sciences Vol.6(1):55-60,1998,Sponsored by:IEEE Institute of Electrical and Electronics Engineers Computer Society.
[32]Palopoli.L,Pontieri,Terracina,G,Urisino,D A novel three-level architecture for large data warehouses.Journal of Systems Architecture.Vol.47(11):937-958,2002.
[33][意]PaoloGiudiei;实用数据挖掘.北京:电子工业出版社,2004.6
[34][美]TonyBain等著,邵勇译.SQLServer2000数据仓AnalysiSServiceS.中国电力出版社,2003.3
[35]Henry,S.;Hoon,S.;Hwang,M.;Lee,D.;DeVore,M.D.Engineering trade study:extract,transform,load tools for data migration Systems and Information Engineering Design Symposium,2005 IEEE,29 April 2005 Page(s):1-8
[36]Simitsis,A.;Vassiliadis,P.;Sellis,T..Optimizing ETL processes in data warehouses Data Engineering,2005.ICDE 2005.Proceedings.21st International Conference on 5-8 April 2005 Page(s):564-575
[37]Agrawal,H.;Girish Chafle;Sunil Goyal;Mittal,S.;Mukherjea,S.An Enhanced Extract-Transform-Load System for Migrating Data in Telecom Billing Data Engineering,2008.ICDE 2008.IEEE 24th International Conference on 7-12 April 2008 Page(s):1277-1286
[38]Getta,J.R.Optimization of online data integration.Databases and Information Systems,2006 7th International Baltic Conference on 3-6 July 2006 Page(s):91-97
[39]Li,Junkui;Wang,Yuanzhen;Li,Zhuan.DM_Integration:A Framework for Iterative Large Volume Data Integration Data,Privacy,and E-Commerce,2007.ISDPE 2007.The First International Symposium on 1-3 Nov.2007 Page(s):68-73
[40]Keijzer,A.;van Keulen,M.IMPrECISE:Good-is-good-enough data integration.Data Engineering,2008.ICDE 2008.IEEE 24th International Conference on 7-12 April 2008 Page(s):1548-1551
[41]Conn,S.S.OLTP and OLAP data integration:a review of feasible implementation methods and architectures for real time data analysis.SoutheastCon,2005.Proceedings.IEEE 8-10 April 2005 Page(s):515-520
[2]周茂伟,邓苏,黄宏斌.基于元数据的ETL工具设计与实现[J].科学技术与工程,2006,(21):3503-3507
[3]张宁,贾自艳,史忠植.数据仓库中ETL技术的研究[J]计算机工程与应用,2002,(24):213-216
[4]武彦峰,朱仲英.基于DTS组件的数据仓库的数据抽取工具的设计与实现[J]微型电脑应用,2004,(03):1-3,9
[5]吴远红.ETL执行过程的优化研究[J].计算机科学,2007,(01):81-83.
[6]段永威,秦峰.异构数据源数据转换工具的设计与实现[J].现代图书情报技术,2004,(04):59-62.
[7]尹邢飞,陈钢.ETL在高校信息化建设中的应用与研究[J].计算机与数字工程,2005,(03):46-48,72.
[8]张军.异构数据源之间的数据转换方法[J]计算机应用,2005,(S1):175-175,180.
[9]邓杰超.数字校园建设中的资源整合研究[J].广东科技,2007,(02):34-35.
[10]卢明春.数据整合在校园网建设中的应用[D].吉林大学,2007
[11]杨发毅,曾琼.异构数据整合技术研究[J].中华医学图书情报杂志,2007,(02):65-68.
[12]周志逵,徐先传.数据仓库中数据抽取、转换及加载工具研究[J]北京理工大学学报,2003,(06):720-723.
[13]秦剑波.高校数字化校园建设中数据整合的探讨[J].科技资讯,2007,(19).
[14][美]RalPhKimball,MargyRoss著,谭明金译.数据仓库工具箱:维度建模的完全指南(第二版).电子工业出版社,2003.10
[15]章立民编著,SQL Server 2000完全实战-数据转换服务(DTS),中国铁道出版社,第一版,2002年6月52-68
[16]沈兆阳编著.SQLServer20000LAP解决方案一数据仓库AnalysiSServiCeS.清华大学出版社,2001.9
[17]高洪深著,决策支持系统(DSS)理论方法案例,清华大学出版社,第二版,2000年9月44-53
[18]姜炜.ETL应用浅析数据仓库之原创资料 http://www.dwway.com,2003年4月
[19]雷乔.数据仓库ETL研究及实现:[硕士学位论文).东北大学,2006.
[20]陈弦,陈松乔.基于数据仓库的通用ETL工具的设计与实现[J].计算机应用研究,2004,21(8):214-216.
[21]常新功,肖玉巍,金红.数据仓库的ETL策略[J].山西财经大学学报,2002,24(24):2-3.
[22]张宁,贾自艳,史忠植.数据仓库中ETL技术的研究.计算机工程与应用,2002(24):213-216.
[23]王咏梅ETL及其在数据仓库创建中的重要作用.
[24]Kamal Hathi SQL Server 2005集成服务简介.
[25]沈立强.数据整合四个阶段.中国教育网络:2007年9期:10-10,12-14
[26]陆定涛,庄成三,关戍.异构数据库之间的数据集成和备份模型.计算机应用,2002,卷22,第11期:88-90。
[27]熊丽荣,蔡家楣,郑河荣,郭行波.移动网管平台中数据仓库数据抽取、净化和集成.计算机应用研究.2002.19(4):140-141.
[28]沈兆阳.数据仓库与Analysis Services.北京:清华大学出版社,2001。
[29]Thalhammer,Thomas.Realizing active data warehouses with off-the-shelf database technology.Software-Practice and Experience.Vol.32(12):1193-1222,2002.
[30]LI,Jianzhong,Gao,Hong Multidimensional data modeling for data warehouses.Journal of Software Vol.11(7):908-917,2000.(In Chinese)
[31]Sim,Seungjae,Park,Gilju,Lenn,Wonjun,Lee,Sunmi Case study:How to make telecom pricing strategy using data warehouse approach.Proceedings of the Hawaii InternationalConference on System Sciences Vol.6(1):55-60,1998,Sponsored by:IEEE Institute of Electrical and Electronics Engineers Computer Society.
[32]Palopoli.L,Pontieri,Terracina,G,Urisino,D A novel three-level architecture for large data warehouses.Journal of Systems Architecture.Vol.47(11):937-958,2002.
[33][意]PaoloGiudiei;实用数据挖掘.北京:电子工业出版社,2004.6
[34][美]TonyBain等著,邵勇译.SQLServer2000数据仓AnalysiSServiceS.中国电力出版社,2003.3
[35]Henry,S.;Hoon,S.;Hwang,M.;Lee,D.;DeVore,M.D.Engineering trade study:extract,transform,load tools for data migration Systems and Information Engineering Design Symposium,2005 IEEE,29 April 2005 Page(s):1-8
[36]Simitsis,A.;Vassiliadis,P.;Sellis,T..Optimizing ETL processes in data warehouses Data Engineering,2005.ICDE 2005.Proceedings.21st International Conference on 5-8 April 2005 Page(s):564-575
[37]Agrawal,H.;Girish Chafle;Sunil Goyal;Mittal,S.;Mukherjea,S.An Enhanced Extract-Transform-Load System for Migrating Data in Telecom Billing Data Engineering,2008.ICDE 2008.IEEE 24th International Conference on 7-12 April 2008 Page(s):1277-1286
[38]Getta,J.R.Optimization of online data integration.Databases and Information Systems,2006 7th International Baltic Conference on 3-6 July 2006 Page(s):91-97
[39]Li,Junkui;Wang,Yuanzhen;Li,Zhuan.DM_Integration:A Framework for Iterative Large Volume Data Integration Data,Privacy,and E-Commerce,2007.ISDPE 2007.The First International Symposium on 1-3 Nov.2007 Page(s):68-73
[40]Keijzer,A.;van Keulen,M.IMPrECISE:Good-is-good-enough data integration.Data Engineering,2008.ICDE 2008.IEEE 24th International Conference on 7-12 April 2008 Page(s):1548-1551
[41]Conn,S.S.OLTP and OLAP data integration:a review of feasible implementation methods and architectures for real time data analysis.SoutheastCon,2005.Proceedings.IEEE 8-10 April 2005 Page(s):515-520