Deep Reinforcement Learning for Voltage Control in Power Systems


The great complexity and size of electrical power systems makes their operation and control a challenging task. Maintaining a stable voltage profile to assure the security and stability of the system is one of many tasks that must be conducted daily by power system operators and its automatic control equipment. This work proposes a deep reinforcement learning framework for controlling the equipment responsible for keeping the voltages across the system buses within their limits. More specifically, a smart agent that is capable of deciding the best course of action in order to keep the system’s voltages within a specified range while taking into account system’s conditions is proposed. Besides the traditional deep reinforcement learning approach, three novel reinforcement learning variations named windowed, ensemble and windowed ensemble Q-Learning, which alter the agent’s learning process for voltage control, are presented and tested on IEEE 13, 37 and 123 bus systems, simulated on OpenDSS.
BARG, Mauricio W.; RODRIGUES, Barbara S.; JUSTINO, Gabriela T.; COTTA, Kleyton Pontes; PORTUITA, Hugo R. V.; LOUÇÃO JR., Flávio L.; ABREU, Iran Pereira; PIGOSSI JR., Antônio Carlos. Deep Reinforcement Learning for Voltage Control in Power Systems. In: BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS), 12. , 2023, Belo Horizonte/MG. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2023 . p. 213-227. ISSN 2643-6264.