Simulation of the Bidding Behavior of Electricity Retailers Based on the Q -Learning Algorithm

Abstract

At present, the reform of electricity marketization has become a new trend in the development of the world’s electric power industry and electricity retailers have a huge role in further activating power market competition. Simulation of the bidding behavior of electricity sales companies is helpful to analyze the rationality of the transaction behaviors of electricity sales companies and predict the potential risks of market operation. Considering the complex and diverse behaviors of electricity retailers and the immaturity of existing simulation technologies in the power sales market, this paper proposes a $Q$ -learning algorithm-based simulation method for the bidding behavior of electricity retailers. Firstly, we analyze the factors influencing the bidding behavior of electricity retailers, then, we construct a simulation model of electricity retailers’ bidding behavior based on the $Q$ -learning algorithm, and finally, we simulate the bidding process of medium- and long-term trading in provincial power markets by using simultaneous learning from both sides of the generation and consumption. The results show that the behavior of different types of electricity retailers meets the expected level of the model and the simulation method has generalization and extension significance. On this basis, this paper also proposes a bid simulation system architecture based on the bid line simulation model of electricity retailers, which provides a certain reference value for market operation agencies to carry out the corresponding deduction work.