Coordinated Electric Vehicle Active and Reactive Power Control for Active Distribution Networks

The deployment of renewable energy in power systems may raise serious voltage instabilities. Electric vehicles (EVs), owing to their mobility and flexibility characteristics, can provide various ancillary services including active and reactive power. However, the distributed control of EVs under such scenarios is a complex decision-making problem with enormous dynamics and uncertainties. Most existing literature employs model-based approaches to formulate the active and reactive power control problems, which require full models and are time-consuming. This paper proposes a multi-agent reinforcement learning method featuring actor-critic networks and a parameter sharing framework to solve the EVs coordinated active and reactive power control problem towards both demand-side response and voltage regulations. The proposed method can further enhance the learning stability and scalability with privacy perseverance via the location marginal prices. Simulation results based on a modified IEEE 15-bus network are developed to validate its effectiveness in providing system charging and voltage regulation services.