Fan
Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning
Fan
Authors
Abstract
As the world seeks to become more sustainable, intelligent solutions are needed to increase the penetration of renewable energy. In this paper, the model-free deep reinforcement learning algorithm Rainbow Deep Q-Networks is used to control a battery in a small microgrid to perform energy arbitrage and more efficiently utilise solar and wind energy sources. The grid operates with its own demand and renewable generation based on a dataset collected at Keele University, as well as using dynamic energy pricing from a real wholesale energy market. Four scenarios are tested including using demand and price forecasting produced with local weather data. The algorithm and its subcomponents are evaluated against two continuous control benchmarks with Rainbow able to outperform all other method. This research shows the importance of using the distributional approach for reinforcement learning when working with complex environments and reward functions, as well as how it can be used to visualise and contextualise the agent's behaviour for real-world applications.
Citation
Fan. (2022). Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning. Energy, https://doi.org/10.1016/j.energy.2021.121958
Acceptance Date | Aug 28, 2021 |
---|---|
Online Publication Date | Sep 8, 2021 |
Publication Date | Jan 1, 2022 |
Publicly Available Date | Oct 19, 2021 |
Journal | Energy |
Print ISSN | 0360-5442 |
Publisher | Elsevier |
DOI | https://doi.org/10.1016/j.energy.2021.121958 |
Keywords | Actor-critic methods; Deep Q-Networks; Demand response; Microgrids; Renewable energy |
Public URL | https://keele-repository.worktribe.com/output/421292 |
Publisher URL | https://linkinghub.elsevier.com/retrieve/pii/S0360544221022064 |
Files
2106.06061v1.pdf
(1.9 Mb)
PDF
Publisher Licence URL
https://creativecommons.org/licenses/by-nc-nd/4.0/
You might also like
The role of ‘living laboratories’ in accelerating the energy system decarbonization
(2022)
Journal Article
A Review of Privacy-preserving Federated Learning for the Internet-of-Things
(2021)
Book Chapter
Downloadable Citations
About Keele Repository
Administrator e-mail: research.openaccess@keele.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search