RECA: A Multi-Task Deep Reinforcement Learning-Based Recommender System for Co-Optimizing Energy, Comfort and Air Quality in Commercial Buildings

We present the design and implementation of RECA, a novel human-centric recommender system for co-optimizing energy consumption, comfort and air quality in commercial buildings. Existing works generally optimize these objectives separately, or by only controlling energy consuming resources within the building without directly engaging occupants. We develop a deep reinforcement learning architecture based on multitask learning, demonstrate how it can be used to jointly learn energy savings, comfort and air quality improvements for different actions, and build a recommender system with humans-in-the-loop. Through real deployments in multiple commercial buildings, we found that RECA has the potential to further reduce energy consumption by up to in energy-focused optimization, improve all objectives by in joint optimization, and improve thermal comfort by up to in comfort and air quality focused optimization, over existing solutions.