Author:
Huang C,Seidel S,Bräunig J
Abstract
Abstract
In this work, a Q-learning based supply temperature control approach for a demonstrator building is proposed. The purpose is to improve the temperature behaviour inside the building and to tackle comfort problems such as overheating and undercooling which cannot be coped with by the standard heating curve. The Q-learning controller considers predicted future weather data as system states. This can be shown to be superior to Q-learning controllers without weather prediction. Furthermore, in order for the controller to capture different thermal effects of different time constants, a cascaded control structure is designed: An inner Q-learning based controller deals with thermal effects of smaller time constants. It is wrapped by an outer slower Q-learning controller which can tackle effects of larger time constants. Therewith, further improvement of comfort can be achieved.
Subject
Computer Science Applications,History,Education
Reference14 articles.
1. Use of model predictive control and weather forecasts for energy efficient building climate control;Oldewurtel,2012
2. Model predictive control for the operation of building cooling systems;Ma;IEEE Transactions on Control Systems Technology,2012
3. Bilinear model predictive control of a HVAC system using sequential quadratic programming;Kelman;IFAC Proceedings Volumes,2011
4. A Review of Reinforcement Learning for Autonomous Building Energy Management;Mason,2019
5. Experimental analysis of simulated reinforcement learning control for active and passive building thermal storage inventory: Part 1: Theoretical foundation;Liu;Energy and Buildings,2006