Review of Deep Reinforcement Learning and Its Application in Modern Renewable Power System Control
Author:
Li Qingyan1, Lin Tao1, Yu Qianyi2, Du Hui1, Li Jun1, Fu Xiyue1
Affiliation:
1. Hubei Engineering and Technology Research Center for AC/DC Intelligent Distribution Network, School of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, China 2. Faculty of Information Technology, Monash University, Melbourne, VIC 3800, Australia
Abstract
With the ongoing transformation of electricity generation from large thermal power plants to smaller renewable energy sources (RESs), such as wind and solar, modern renewable power systems need to address the new challenge of the increasing uncertainty and complexity caused by the deployment of electricity generation from RESs and the integration of flexible loads and new technologies. At present, a high volume of available data is provided by smart grid technologies, energy management systems (EMSs), and wide-area measurement systems (WAMSs), bringing more opportunities for data-driven methods. Deep reinforcement learning (DRL), as one of the state-of-the-art data-driven methods, is applied to learn optimal or near-optimal control policy by formulating the power system as a Markov decision process (MDP). This paper reviews the recent DRL algorithms and the existing work of operational control or emergency control based on DRL algorithms for modern renewable power systems and control-related problems for small signal stability. The fundamentals of DRL and several commonly used DRL algorithms are briefly introduced. Current issues and expected future directions are discussed.
Funder
science and technology project of the State Grid Corporation of China
Subject
Energy (miscellaneous),Energy Engineering and Power Technology,Renewable Energy, Sustainability and the Environment,Electrical and Electronic Engineering,Control and Optimization,Engineering (miscellaneous),Building and Construction
Reference86 articles.
1. Area-wide system protection scheme against extreme contingencies;Lachs;Proc. IEEE,2005 2. Muir, A., and Lopatto, J. (2004). Final Report on the 14 August 2003 Blackout in the United States and Canada: Causes and Recommendations, U.S.-Canada Power System Outage Task Force. 3. A comprehensive review on uncertainty modeling techniques in power system studies;Aien;Renewableand Sustain. Energy Rev.,2016 4. Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv. 5. Mastering the game of go without human knowledge;Silver;Nature,2017
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|