M. Razghandi, H. Zhou, M. Erol-Kantarci, and D. Turgut

Smart Home Energy Management: Sequence-to-Sequence Load Forecasting and Q-Learning


Cite as:

M. Razghandi, H. Zhou, M. Erol-Kantarci, and D. Turgut. Smart Home Energy Management: Sequence-to-Sequence Load Forecasting and Q-Learning. In Proc. of IEEE GLOBECOM 2021, December 2021.

Download:

Download 

Abstract:

A smart home energy management system (HEMS) can contribute towards reducing the energy costs of customers; however, HEMS suffers from uncertainty in both energy generation and consumption patterns. In this paper, we propose a sequence to sequence (Seq2Seq) learning-based supply and load prediction along with reinforcement learning-based HEMS control. We investigate how the prediction method affects the HEMS operation. First, we use Seq2Seq learning to predict photovoltaic (PV) power and home devices’ load. We then apply Q-learning for offline optimization of HEMS based on the prediction results. Finally, we test the online performance of the trained Q-learning scheme with actual PV and load data. The Seq2Seq learning is compared with VARMA, SVR, and LSTM in both prediction and operation levels. The simulation results show that Seq2Seq performs better with a lower prediction error and online operation performance.

BibTeX:

@inproceedings{Razghandi-2021-GLOBECOM,
	author = "M. Razghandi and H. Zhou and M. Erol-Kantarci and D. Turgut",
	title = "Smart Home Energy Management: Sequence-to-Sequence Load Forecasting and Q-Learning",
	booktitle = "Proc. of IEEE GLOBECOM 2021",
	year = "2021",
	month = "December",
	abstract = {A smart home energy management system (HEMS) can contribute towards reducing the energy costs of customers; however, HEMS suffers from uncertainty in both energy generation and consumption patterns. In this paper, we propose a sequence to sequence (Seq2Seq) learning-based supply and load prediction along with reinforcement learning-based HEMS control. We investigate how the prediction method affects the HEMS operation. First, we use Seq2Seq learning to predict photovoltaic (PV) power and home devices’ load. We then apply Q-learning for offline optimization of HEMS based on the prediction results. Finally, we test the online performance of the trained Q-learning scheme with actual PV and load data. The Seq2Seq learning is compared with VARMA, SVR, and LSTM in both prediction and operation levels. The simulation results show that Seq2Seq performs better with a lower prediction error and online operation performance.},
}

Generated by bib2html.pl (written by Patrick Riley, Lotzi Boloni ) on Sun Mar 03, 2024 18:41:16