Abstract
The worldwide aspiration for a sustainable energy future has led to an increasing deployment of variable and intermittent renewable energy sources (RESs). As a result, predicting and planning the operation of power grids has become more complex. Batteries can play a critical role to this problem as they can absorb the uncertainties introduced by RESs. In this paper, we solve the problem of computing a dispatch plan for a distribution grid with RESs and batteries with a novel approach based on Reinforcement Learning (RL). Although RL is not inherently suited for planning problems that require open loop policies, we have developed an iterative algorithm that calls a trained RL agent at each iteration to compute the dispatch plan. Since the feedback given to the RL agent cannot be directly observed because the dispatch plan is computed ahead of operation, it is estimated. Compared to the conventional approach of scenario-based optimization, our RL-based approach can exploit significantly more prior information on the uncertainty and computes dispatch plans faster. Our evaluation and comparative results demonstrate the accuracy of the computed dispatch plans as well as the adaptability of our agent to input data that diverge from the training data.
Funder
Swiss Federal Office of Energy SFOE
Subject
Energy (miscellaneous),Energy Engineering and Power Technology,Renewable Energy, Sustainability and the Environment,Electrical and Electronic Engineering,Control and Optimization,Engineering (miscellaneous),Building and Construction
Reference37 articles.
1. IEA (2021, October 19). Renewables. Available online: https://www.iea.org/reports/renewables-2021.
2. Comparing the Costs of Intermittent and Dispatchable Electricity Generating Technologies;Joskow;Am. Econ. Rev.,2011
3. Influencing the Bulk Power System Reserve by Dispatching Power Distribution Networks Using Local Energy Storage;Bozorg;Electr. Power Syst. Res.,2018
4. Electricity Advisory Committee (2018). Securing the 21st-Century Grid: The Potential Role of Storage in Providing Resilience, Reliability, and Security Services, Recommendations for the U.S. Department of Energy, U.S. Department of Energy. Technical Report.
5. Dispatching Stochastic Heterogeneous Resources Accounting for Grid and Battery Losses;Stai;IEEE Trans. Smart Grid,2018