基于电厂燃料管理系统的数据库迁移方案Database migration scheme based on power plant fuel management system
马晨曦,陈建平,柴硕,杨睿,杜金刚,赵轩,王涛
摘要(Abstract):
电厂燃料管理系统作为火电厂燃煤管理的核心,进行国产化替代是电站信息化建设的必经之路,数据库国产化是其中的关键。数据迁移承担了新旧系统交接的重要环节。基于对数据迁移方法的充分研究,针对电厂燃料管理系统数据特点,提出了优化的数据迁移方案。重点对校验数据一致性的方法进行了测试,分析了逐行对比和二分法2种数据校验方法的特点,发现在问题数据占比较小、分布较集中时二分法具备一定的性能优势,随着问题数据量的增加、分布的均匀化,二分法耗时显著增加。设计开发了适于电厂燃料管理系统的数据迁移工具,实现数据校验的可视化,对校验规则配置、执行方式设置、校验结果反馈等功能支持批量操作,丰富校验规则种类,支持自定义校验规则,增加校验异常处理机制等。该数据迁移工具划分为用户层、服务层和数据层,可实现电厂燃料管理系统数据迁移。
关键词(KeyWords): 电厂燃料管理系统;燃煤管理;数据迁移;数据校验;数据库
基金项目(Foundation): 西安热工研究院有限公司科技项目(GM-23-TYK12)~~
作者(Author): 马晨曦,陈建平,柴硕,杨睿,杜金刚,赵轩,王涛
DOI: 10.19666/j.rlfd.202403152
参考文献(References):
- [1]陆叶杉.系统数据迁移常见问题及案例分析[J].计算机科学, 2019, 46(增刊1):412-416.LU Yeshan. Common issues and case analysis of system data migration[J]. Computer Science, 2019, 46(Suppl.1):412-416.
- [2]裴立公.国产数据库替代国外数据库演化过程分析[J].金融科技时代, 2023, 31(4):94-97.PEI Ligong. Analysis of the evolution process of domestic database replacing foreign database[J]. Fin Tech Time, 2023, 31(4):94-97.
- [3]李世斌,郭永振,唐刚.国产数据库选型测评指标体系[J].计算机系统应用, 2020, 29(8):266-270.LI Shibin, GUO Yongzhen, TANG Gang, et al. Current status and prospects of intelligent fuel management in thermal power enterprises[J]. Computer System&Applications, 2020, 29(8):266-270.
- [4]陈真玄,张怡,杨柳,等.水利行业国产数据库选型思考[J].水利信息化, 2022(1):42-48.CHEN Zhenxuan, ZHANG Yi, YANG Liu, et al.Reflection on the selection of domestic databases in the water conservancy industry[J]. Water Resources Informatization, 2022(1):42-48.
- [5]付晓丹,史韶旭,栗继房,等.铁路局集团公司办公系统国产化替代迁移方案研究[J].铁路计算机应用,2021, 30(11):21-25.FU Xiaodan, SHI Shaoxu, LI Jifang, et al. Alternative relocation scheme for domestic substitution of OA system of Railway Group Co., Ltd.[J]. Railway Computer Application, 2021, 30(11):21-25.
- [6]李越.铁路列车确报信息系统数据库国产化替代及信创适配研究[J].中国铁路, 2023(8):106-111.LI Yue. Localization substitution and IT innovation adaptation of railway train confirmation information system database[J]. China Railway, 2023(8):106-111.
- [7]霍永鉴. ERP综合业务系统数据库国产化改造[J].木工机床, 2022(4):16-18.HUO Yongjian. ERP integrate business system database localisation transformation[J]. Woodworking Machinery,2022(4):16-18.
- [8]姜湘岗,刘瑾,张晓昆,等. Oracle数据库向国产数据库迁移的技术分析[J].北京电子科技学院学报, 2017,25(4):39-44.JIANG Xianggang, LIU Jin, ZHANG Xiaokun, et al. A technical analysis of Oracle database migration to domestic database[J]. Journal of Beijing Electronic Science and Technology Institute, 2017, 25(4):39-44.
- [9]高满达,李庚达,王昕,等.火电厂智能燃料典型建设方向与应用研究进展[J].热力发电, 2021, 50(5):10-17.GAO Manda, LI Gengda, WANG Xin, et al. Progress on typical construction direction and application for smart fuel in thermal power plants[J]. Thermal Power Generation, 2021, 50(5):10-17.
- [10]张海廷.论燃料智能化系统在火电企业燃料管理中的应用与发展[J].信息记录材料, 2019, 20(10):220-221.ZHANG Haiting. Application and development of fuel intelligence system in fuel management of thermal power enterprises[J]. Information Recording Materials, 2019,20(10):220-221.
- [11]马新蕊,张庆辉.火电企业燃料智能化管理现状及展望[J].山东工业技术, 2017(11):196.MA Xinrui, ZHANG Qinghui. Current status and prospects of intelligent fuel management in thermal power enterprises[J]. Journal of Shandong Industrial Technology, 2017(11):196.
- [12]胡宏伟,杨建国,翁善勇,等.电厂燃料管理及煤质优化系统的开发及应用[J].热力发电, 2004, 33(4):70-72.HU Hongwei, YANG Jianguo, WENG Shanyong, et al.Development and application of fuel management and coal quality optimizing system in power plants[J].Thermal Power Generation, 2004, 33(4):70-72.
- [13]许山山,史涯晴,韩敬利,等.数据迁移研究综述[J].软件导刊, 2023, 22(7):234-246.XU Shanshan, SHI Yaqing, HAN Jingli, et al. A review of data migration research[J]. Software Guide, 2023,22(7):234-246.
- [14]陈晓,王健,姜铭敏,等.基于国产数据库历史数据迁移的研究与实践[J].民航学报, 2020, 4(5):107-111.CHEN Xiao, WANG Jian, JIANG Mingmin, et al.Research on and practice in historical data migration based on home-made database[J]. Journal of Civil Aviation, 2020, 4(5):107-111.
- [15] HALLER K, MATTHES F, SCHULZ C. A detailed process model for large scale data migration projects[C]//International conference on business information systems. Springer, Berlin, Heidelberg, 2012.
- [16]陈相.县区级不动产数据库迁移与整合关键技术研究[D].连云港:江苏海洋大学, 2022:1.CHEN Xiang. Key technology research of county level real estate data base migration and integration[D].Lianyungang:Jiangsu Ocean University, 2022:1.
- [17]章嘉炜.基于全息画像的数据库迁移评估系统设计与实现[D].西安:西安电子科技大学, 2022:1.ZHANG Jiawei. Design and implementation of database migration evaluation system based on holographic portrait[D]. Xi’an:Xidian University, 2022:1.
- [18]武森,冯小东,单志广.基于不完备数据聚类的缺失数据填补方法[J].计算机学报, 2012, 35(8):1726-1738.WU Sen, FENG Xiaodong, SHAN Zhiguang, et al.Missing data imputation approach based on incomplete data clustering[J]. Chinese Journal of Computers, 2012,35(8):1726-1738.
- [19]景应刚,罗俊,徐奎,等.厂级时序数据存储及分析系统技术研究[J].中国信息化, 2023(6):62-63.JING Yinggang, LUO Jun, XU Kui, et al. Research on plant level time series data storage and analysis system technology[J]. IChina, 2023(6):62-63.
- [20]陈俊.企业信息化项目中的业务数据迁移研究[D].苏州:苏州大学, 2014:1.CHEN Jun. Research on business data migration within enterprise informatization project[D]. Suzhou:Soochow University, 2014:1.
- [21]张玲.数据库迁移测试系统的设计与实现[D].大连:大连理工大学, 2005:1.ZHANG Ling. Design and realization of the database migration testing system[D]. Dalian:Dalian University of Technology, 2005:1.
- [22]韦依姗,曹晓梅,王少辉,等.面向云存储的双重数据完整性验证方案[J/OL].小型微型计算机系统, 1-9[2024-03-11]. http://kns.cnki.net/kcms/detail/21.1106.TP.20240202.0931.008.html.WEI Yishan, CAO Xiaomei, WANG Shaohui, et al. Dual data integrity verification scheme for cloud storage[J].Journal of Chinese Computer System, 1-9[2024-03-11].http://kns.cnki.net/kcms/detail/21.1106.TP.20240202.0931.008.html.
- [23]屈波.分布数据库环境下的数据通信及其数据一致性应用研究[D].武汉:武汉理工大学, 2005:1.QU Bo. Application study of data communication and data consistency in the distributed database environment[D]. Wuhan:Wuhan University of Technology, 2005:1.
- [24]优刻得官网.跨云迁移过程中的数据同步及一致性校验实践(一)[EB/OL].(2022-06-28)[2024-03-01].https://www.ucloud.cn/yun/126052.html.Ucloud. Practice of data synchronization and consistency verification in cross cloud migration process(1)[EB/OL].(2022-06-28)[2024-03-01]. https://www.ucloud.cn/yun/126052.html.
- [25]葛维春,陈硕,乔林,等.浅谈电力行业达梦到Oracle数据迁移研究[C]//2017年“电子技术应用”智能电网会议,北京:中国学术期刊电子出版社, 2017:72-74.GE Weichun, CHEN Shuo, QIAO Lin, et al. A study on Oracle data migration from Da Meng to Da Meng in the power industry[C]//2017 Smart Grid Conference on“Electronic Technology Applications”. Beijing:China Academic Journal Electronic Publishing House, 2017:72-74.