The Performance of Reinforcement Learning for Indoor Climate Control Devices according to the Level of Outdoor Air Particulate Matters

Abstract

As people spend more than 90% of their time indoors, indoor environmental quality (IEQ) has become an important factor in maintaining a healthy space for the occupants. There are many indoor climate control devices for improving IEQ. However, it is difficult to maintain an appropriate IEQ with changing outdoor air conditions and occupant behavior in a building. This study proposes a reinforcement learning (RL) algorithm to maintain indoor air quality (IAQ) with low energy consumption in a residential environment by optimally operating indoor climate control devices such as ventilation systems, air purifiers, and kitchen hoods. The proposed artificial intelligence algorithm (AI2C2) employs DDQN (double deep Q-network) to determine the optimal operation of various indoor climate control devices, reflecting IAQ and energy consumption via different outdoor levels of particulate matter. This approach considers the outdoor air condition and occupant activities in training the developed algorithm, which are the most significant factors affecting IEQ and building energy performance. A co-simulation platform using Python and EnergyPlus is applied to train and evaluate the model. As a result, the proposed approach reduced energy consumption and maintained good IAQ. The developed RL algorithm for energy and IAQ showed different performances based on the outdoor PM 2.5 level. The results showed the RL-based control can be more effective when the outdoor PM 2.5 level is higher (or unhealthy) compared to moderate (or healthy) conditions.