Open this publication in new window or tab >>2025 (English)In: Energy and AI, E-ISSN 2666-5468, Vol. 22, article id 100603Article in journal (Refereed) Published
Abstract [en]
As district heating networks evolve to meet climate-neutral objectives, optimizing their control under heterogeneous building characteristics and dynamic environmental conditions remains a significant challenge. Traditional control strategies often lack the adaptability necessary to account for building-specific dynamics and to ensure real-time adherence to operational safety constraints. In this work, we present an integrated machine learning-based framework that combines an adaptive context-aware transformer model with deep reinforcement learning to address these limitations. The proposed approach introduces an adaptive context-aware transformer as a predictive environment within a Deep Q-Network (DQN) framework, enabling data-driven, building-specific control of district heating systems. Utilizing real-world data from 148 residential buildings across Sweden and Finland, the model incorporates contextual embeddings and temporal features to predict indoor temperature trajectories with high accuracy, achieving root mean square error values between 0.18-0.24 degrees C for Swedish buildings and 0.26-0.32 degrees C for Finnish buildings. The DQN agent leverages these predictions to optimize heating control while ensuring compliance with operational safety limits and preserving occupant comfort. Experimental results demonstrate significant energy savings, with mid-rise buildings achieving up to 14.85% reduction in energy consumption, and peak seasonal savings exceeding 20% during spring months. This integrated approach illustrates the potential for substantial energy optimization and reliable indoor climate management in future district heating networks.
Place, publisher, year, edition, pages
Elsevier, 2025
Keywords
Residential buildings, Adaptive context-aware transformer, District heating, Energy optimization, Reinforcement learning (RL)
National Category
Artificial Intelligence
Identifiers
urn:nbn:se:oru:diva-124092 (URN)10.1016/j.egyai.2025.100603 (DOI)001577905300001 ()
Funder
Knowledge Foundation, 20190128
Note
This work has been supported by the Industrial Graduate School Collaborative AI & Robotics funded by the Swedish Knowledge Foundation Dnr: 20190128 and in collaboration with industrial partner EcoGuard AB.
2025-10-022025-10-022025-10-02Bibliographically approved