Control-Guided Reinforcement Learning for Cooperative Energy Management

Engineering notes

Engineering notes will be added by the Power for Solar editorial team.

Chinese explanation / 中文解读

中文解读待补充：本站会优先为光伏效率、钙钛矿太阳能电池、储能技术、太阳能热利用、BIPV、并网技术等高价值论文补充中文说明。

Original abstract

Addressing the urgent transition to low-carbon energy systems requires microgrids capable of locally coordinating electricity generation, storage, and flexible consumption. Their efficient integration calls for control strategies that are scalable, privacy-preserving, and robust to uncertainty. To address such a challenging control problem, this work proposes a decentralised Multi-Agent Reinforcement Learning (MARL) approach based on the Cross-Entropy Method (CEM) for the coordination of prosumers, equipped with renewable generation and vehicle-to-grid capabilities. To improve sample efficiency and robustness, the policy is warm-started using Behaviour Cloning (BC) from a classical Proportional-Integral-Derivative (PID) controller, resulting in a hybrid BC–CEM framework. The proposed method is evaluated in a realistic microgrid simulation with stochastic demand and real weather and generation profiles. Results show that BC–CEM accelerates convergence and achieves lower energy costs compared to both PID control and randomly initialized CEM, without sacrificing comfort or mobility requirements. The findings highlight the effectiveness of combining derivative-free optimization with imitation learning in complex MARL tasks, such as energy flexibility coordination.

Links and sources

• PDF from original source

Comments