To Örebro University

oru.seÖrebro University Publications
Change search
Link to record
Permanent link

Direct link
Publications (10 of 23) Show all publications
Kalidindi, S. S., Banaee, H., Karlsson, H. & Loutfi, A. (2025). District heating optimization in residential buildings using reinforcement learning with adaptive context-aware predictive environment. Energy and AI, 22, Article ID 100603.
Open this publication in new window or tab >>District heating optimization in residential buildings using reinforcement learning with adaptive context-aware predictive environment
2025 (English)In: Energy and AI, E-ISSN 2666-5468, Vol. 22, article id 100603Article in journal (Refereed) Published
Abstract [en]

As district heating networks evolve to meet climate-neutral objectives, optimizing their control under heterogeneous building characteristics and dynamic environmental conditions remains a significant challenge. Traditional control strategies often lack the adaptability necessary to account for building-specific dynamics and to ensure real-time adherence to operational safety constraints. In this work, we present an integrated machine learning-based framework that combines an adaptive context-aware transformer model with deep reinforcement learning to address these limitations. The proposed approach introduces an adaptive context-aware transformer as a predictive environment within a Deep Q-Network (DQN) framework, enabling data-driven, building-specific control of district heating systems. Utilizing real-world data from 148 residential buildings across Sweden and Finland, the model incorporates contextual embeddings and temporal features to predict indoor temperature trajectories with high accuracy, achieving root mean square error values between 0.18-0.24 degrees C for Swedish buildings and 0.26-0.32 degrees C for Finnish buildings. The DQN agent leverages these predictions to optimize heating control while ensuring compliance with operational safety limits and preserving occupant comfort. Experimental results demonstrate significant energy savings, with mid-rise buildings achieving up to 14.85% reduction in energy consumption, and peak seasonal savings exceeding 20% during spring months. This integrated approach illustrates the potential for substantial energy optimization and reliable indoor climate management in future district heating networks.

Place, publisher, year, edition, pages
Elsevier, 2025
Keywords
Residential buildings, Adaptive context-aware transformer, District heating, Energy optimization, Reinforcement learning (RL)
National Category
Artificial Intelligence
Identifiers
urn:nbn:se:oru:diva-124092 (URN)10.1016/j.egyai.2025.100603 (DOI)001577905300001 ()
Funder
Knowledge Foundation, 20190128
Note

This work has been supported by the Industrial Graduate School Collaborative AI & Robotics funded by the Swedish Knowledge Foundation Dnr: 20190128 and in collaboration with industrial partner EcoGuard AB.

Available from: 2025-10-02 Created: 2025-10-02 Last updated: 2025-10-02Bibliographically approved
Mironenko, O., Banaee, H. & Loutfi, A. (2025). Evaluation of Coordination Strategies for Underground Automated Vehicle Fleets in Mixed Traffic. In: 2025 IEEE Intelligent Vehicles Symposium (IV): Proceedings. Paper presented at 36th IEEE Intelligent Vehicles Symposium (IEEE IV2025), Cluj-Napoca, Romania, June 22-25, 2025 (pp. 1020-1026). IEEE
Open this publication in new window or tab >>Evaluation of Coordination Strategies for Underground Automated Vehicle Fleets in Mixed Traffic
2025 (English)In: 2025 IEEE Intelligent Vehicles Symposium (IV): Proceedings, IEEE, 2025, p. 1020-1026Conference paper, Published paper (Refereed)
Abstract [en]

This study investigates the efficiency and safety outcomes of implementing different adaptive coordination models for automated vehicle (AV) fleets, managed by a centralized coordinator that dynamically responds to human-controlled vehicle behavior. The simulated scenarios replicate an underground mining environment characterized by narrow tunnels with limited connectivity. To address the unique challenges of such settings, we propose a novel metric — Path Overlap Density (POD) — to predict efficiency and potentially the safety performance of AV fleets. The study also explores the impact of map features on AV fleets performance. The results demonstrate that both AV fleet coordination strategies and underground tunnel network characteristics significantly influence overall system performance. While map features are critical for optimizing efficiency, adaptive coordination strategies are essential for ensuring safe operations. 

Place, publisher, year, edition, pages
IEEE, 2025
Series
IEEE Intelligent Vehicles Symposium (IV), ISSN 1931-0587, E-ISSN 2642-7214
Keywords
Mixed traffic with fleets of automated vehicles, path overlap density (POD), human behavior in driving, centralized coordination, coordination strategies, underground mining
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:oru:diva-122686 (URN)10.1109/IV64158.2025.11097685 (DOI)001556907500146 ()9798331538033 (ISBN)9798331538040 (ISBN)
Conference
36th IEEE Intelligent Vehicles Symposium (IEEE IV2025), Cluj-Napoca, Romania, June 22-25, 2025
Funder
Knowledge Foundation, 20190128
Note

This work has been supported by Sustainable Underground Mining (SUM) Academy, Project SP-12 2021-2024, and the Industrial Graduate School Collaborative AI & Robotics funded by the Swedish Knowledge Foundation Dnr:20190128. 

Available from: 2025-08-07 Created: 2025-08-07 Last updated: 2025-10-02Bibliographically approved
Kalidindi, S. S., Banaee, H., Karlsson, H. & Loutfi, A. (2024). Adaptive Context Embedding for Temperature Prediction in Residential Buildings. In: Ulle Endriss; Francisco S. Melo; Kerstin Bach; Alberto Bugarín-Diz; José M. Alonso-Moral; Senén Barro; Fredrik Heintz (Ed.), 27th European Conference on Artificial Intelligence, 19–24 October 2024, Santiago de Compostela, Spain – Including 13th Conference on Prestigious Applications of Intelligent Systems (PAIS 2024): . Paper presented at 27th European Conference on Artificial Intelligence (ECAI 2024), Santiago de Compostela, Spain, October 19-24, 2024 (pp. 4727-4733). IOS Press, 392
Open this publication in new window or tab >>Adaptive Context Embedding for Temperature Prediction in Residential Buildings
2024 (English)In: 27th European Conference on Artificial Intelligence, 19–24 October 2024, Santiago de Compostela, Spain – Including 13th Conference on Prestigious Applications of Intelligent Systems (PAIS 2024) / [ed] Ulle Endriss; Francisco S. Melo; Kerstin Bach; Alberto Bugarín-Diz; José M. Alonso-Moral; Senén Barro; Fredrik Heintz, IOS Press, 2024, Vol. 392, p. 4727-4733Conference paper, Published paper (Refereed)
Abstract [en]

Transformer-based models have gained increasing popularity for time-series prediction; however, in specific applications such as residential heating systems, static contextual data of buildings is crucial to effectively capture and learn complex environmental dynamics. This paper presents a novel transformer-based model that adapts the contextual meta-data of residential buildings, generalizing across diverse environments. The model integrates temporal data with adaptive embedding of building-specific contextual meta-data such as geographic locations and building characteristics to dynamically learn and adapt to the variations. These adaptive context embeddings allow the model to comprehensively understand how different buildings respond to environmental changes over time. Initial results show improved accuracy and reliability in indoor temperature predictions of residential buildings, demonstrating the model’s potential to optimize district heating systems across a diverse array of residential buildings. This proposed model provides a basis for developing proactive heat management systems in buildings.

Place, publisher, year, edition, pages
IOS Press, 2024
Series
Frontiers in Artificial Intelligence and Applications, ISSN 0922-6389, E-ISSN 1879-8314 ; 392
Keywords
Time series Prediction, Transformer model, Temperature Prediction, Residential buildings, Context aware
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:oru:diva-119317 (URN)10.3233/FAIA241070 (DOI)2-s2.0-85216620102 (Scopus ID)9781643685489 (ISBN)
Conference
27th European Conference on Artificial Intelligence (ECAI 2024), Santiago de Compostela, Spain, October 19-24, 2024
Funder
Knowledge Foundation, 20190128
Note

This work has been supported by the Industrial Graduate School Collaborative AI & Robotics funded by the Swedish Knowledge Foundation Dnr:20190128 and in collaboration with industrial partner EcoGuard AB.

Available from: 2025-02-17 Created: 2025-02-17 Last updated: 2025-02-18Bibliographically approved
Mironenko, O., Banaee, H. & Loutfi, A. (2024). Evaluation of Human Interaction with Fleets of Automated Vehicles in Dynamic Underground Mining Environments. In: Angelo Ferrando; Rafael C. Cardoso (Ed.), Agents and Robots for reliable Engineered Autonomy: 4th Workshop, AREA 2024, Santiago de Compostela, Spain, October 19, 2024, Proceedings. Paper presented at Agents and Robots for reliable Engineered Autonomy (AREA 2024), in conjunction with ECAI 2024, Santiago de Compostela, Spain, October 19, 2024 (pp. 54-72). Springer
Open this publication in new window or tab >>Evaluation of Human Interaction with Fleets of Automated Vehicles in Dynamic Underground Mining Environments
2024 (English)In: Agents and Robots for reliable Engineered Autonomy: 4th Workshop, AREA 2024, Santiago de Compostela, Spain, October 19, 2024, Proceedings / [ed] Angelo Ferrando; Rafael C. Cardoso, Springer, 2024, p. 54-72Conference paper, Published paper (Refereed)
Abstract [en]

This study investigates the complexities of Mixed Traffic with Fleets of Automated Vehicles (MTF-AVs) in underground mining environments characterized by confined spaces, limited visibility, and strict navigation requirements. The research focuses on integrating human-controlled vehicles into coordinated AV fleets, addressing the unpredictable interactions that arise from human behaviour. The ORU coordination framework, originally designed for a fully autonomous system, is adapted for mixed traffic scenarios to evaluate the impact of human behaviour on system efficiency and safety. Through a series of simulations, the study explores how fleet coordination algorithms adapt to human driver behaviour. These simulations demonstrate that human error and rule violations significantly reduce performance, increasing safety risks and decreasing efficiency. Findings emphasize the need for advanced coordination algorithms that dynamically adapt to unpredictable human behaviour in MTF-AVs. Such algorithms would optimize interactions between automated and human-controlled vehicles, enhancing both safety and efficiency in these complex and dynamic environments. Future research will further explore the influence of human behaviour on the coordination system and develop advanced coordination algorithms with methods to evaluate these interactions effectively.

Place, publisher, year, edition, pages
Springer, 2024
Series
Communications in Computer and Information Science, ISSN 1865-0929, E-ISSN 1865-0937
Keywords
Human behaviour in driving, Mixed traffic with fleets of automated vehicles, Centralised coordination, Underground mining
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:oru:diva-117072 (URN)10.1007/978-3-031-73180-8_4 (DOI)001437042500004 ()2-s2.0-85207572427 (Scopus ID)9783031731808 (ISBN)9783031731792 (ISBN)
Conference
Agents and Robots for reliable Engineered Autonomy (AREA 2024), in conjunction with ECAI 2024, Santiago de Compostela, Spain, October 19, 2024
Funder
Knowledge Foundation, 20190128
Note

This work has been supported by Sustainable Underground Mining (SUM) Academy, Project SP-12 2021-2024, and the Industrial Graduate School Collaborative AI & Robotics funded by the Swedish Knowledge Foundation Dnr:20190128.

Available from: 2024-10-30 Created: 2024-10-30 Last updated: 2025-04-15Bibliographically approved
Banaee, H., Klügl, F., Novakazi, F. & Lowry, S. (2024). Intention Recognition and Communication for Human-Robot Collaboration. In: Ericson P., Khairova N., De Vos M. (Ed.), CEUR Workshop Proceedings: . Paper presented at 3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI-WS 2024, Malmo 10-11 June 2024 (pp. 101-108). CEUR-WS, 3825
Open this publication in new window or tab >>Intention Recognition and Communication for Human-Robot Collaboration
2024 (English)In: CEUR Workshop Proceedings / [ed] Ericson P., Khairova N., De Vos M., CEUR-WS , 2024, Vol. 3825, p. 101-108Conference paper, Published paper (Refereed)
Abstract [en]

Human-robot collaboration follows rigid processes, in order to ensure safe interactions. In case of deviations from predetermined tasks, typically, processes come to a halt. This position paper proposes a conceptual framework for intention recognition and communication, enabling a higher granularity of understanding of intentions to facilitate more efficient and safe human-robot collaboration, especially in events of deviations from expected behaviour.

Place, publisher, year, edition, pages
CEUR-WS, 2024
Keywords
human-robot collaboration, human-robot communication, intention granularity, Intention recognition, Social robots, Conceptual frameworks, High granularity, Position papers, Microrobots
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:oru:diva-118435 (URN)2-s2.0-85210319239 (Scopus ID)
Conference
3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI-WS 2024, Malmo 10-11 June 2024
Available from: 2025-01-14 Created: 2025-01-14 Last updated: 2025-01-14Bibliographically approved
Gutiérrez Maestro, E., Banaee, H. & Loutfi, A. (2024). Towards Addressing Label Ambiguity in Sequential Emotional Responses Through Distribution Learning. In: 12th International Conference on Affective Computing and Intelligent Interactions, Glasgow, United Kingdom, September 15-18, 2024: . Paper presented at 12th International Conference on Affective Computing and Intelligent Interaction (ACII 2024), Glasgow, UK, September 15-18, 2024. IEEE
Open this publication in new window or tab >>Towards Addressing Label Ambiguity in Sequential Emotional Responses Through Distribution Learning
2024 (English)In: 12th International Conference on Affective Computing and Intelligent Interactions, Glasgow, United Kingdom, September 15-18, 2024, IEEE, 2024Conference paper, Published paper (Refereed)
Abstract [en]

This work highlights the challenge of labeling data with single-label categories, as there may be ambiguity in the assigned labels. This ambiguity arises when a data sample, which can be influenced by previous affective events is labeled with a single-label category (known as priming). Label distribution learning (LDL) is proposed as an approach to contend with the ambiguity among labels. This approach has been relatively unexplored in the field of affective computing. In this work, an experiment is designed to explore the benefits of employing LDL using specifically the SEED and SEED-V datasets. In these datasets, different emotions are induced by exposing participants to a sequence of stimuli (videoclip watching). However, these datasets provide single labels, where each data point corresponds to one affective state or emotion. Due to the lack of label distributions within existing benchmarks, label enhancement serves as a preparatory step, whose goal is to compute label distributions from the feature space and single labels before training a label distribution learning model. Experimental results show that the LDL approach reduces confusion with respect to the emotion induced in the previous trial. Distribution learning is an approach that can help to further improve the prediction of affect, which to date remains a difficult and ambiguous concept to label.

Place, publisher, year, edition, pages
IEEE, 2024
Series
International Conference on Affective Computing and Intelligent Interaction, ISSN 2156-8103, E-ISSN 2156-8111
Keywords
Affective computing, label distribution learning, label enhancement
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:oru:diva-117858 (URN)9798331516437 (ISBN)9798331516444 (ISBN)
Conference
12th International Conference on Affective Computing and Intelligent Interaction (ACII 2024), Glasgow, UK, September 15-18, 2024
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Available from: 2025-01-17 Created: 2025-01-17 Last updated: 2025-07-30Bibliographically approved
Kalidindi, S. S., Banaee, H., Karlsson, H. & Loutfi, A. (2023). Indoor temperature prediction with context-aware models in residential buildings. Building and Environment, 244, Article ID 110772.
Open this publication in new window or tab >>Indoor temperature prediction with context-aware models in residential buildings
2023 (English)In: Building and Environment, ISSN 0360-1323, E-ISSN 1873-684X, Vol. 244, article id 110772Article in journal (Refereed) Published
Abstract [en]

This paper presents a novel approach for predicting average indoor temperature in residential buildings, utilizing contextual factors of the rise of the building and geographical location. The proposed approach employs advanced deep learning architectures, such as Long Short-Term Memory (LSTM) and Transformers, to create generalized predictive models applicable to a range of residential buildings. The models are trained using historical data from 18 residential buildings over a period of 6 to 10 years, where the buildings are located in different climate zones. Testing is done on nine different data sets representing three different locations and three different types of buildings. The study demonstrates that incorporating the context of building rise significantly improves the models' predictive performance. Specifically, the transformer-based models show improvements in R2 of 4%-27% in a 6 h prediction horizon. The proposed approach explicitly using context information significantly improves the accuracy of predicting, making learnt models a good starting point for optimizing district heating distribution.

Place, publisher, year, edition, pages
Elsevier, 2023
Keywords
Residential buildings, Indoor temperature prediction, Context-aware models, Long Short-Term Memory (LSTM), Transformer
National Category
Computer Sciences
Identifiers
urn:nbn:se:oru:diva-109061 (URN)10.1016/j.buildenv.2023.110772 (DOI)001075152300001 ()2-s2.0-85171620775 (Scopus ID)
Funder
Knowledge Foundation, 20190128
Note

This work has been supported by the Industrial Graduate School Collaborative AI & Robotics funded by the Swedish Knowledge Foundation Dnr:20190128 and in collaboration with industrial partner Eco-Guard AB, Sweden.

Available from: 2023-10-24 Created: 2023-10-24 Last updated: 2023-10-24Bibliographically approved
Gutiérrez Maestro, E., Banaee, H. & Loutfi, A. (2023). Stress Lingers: Recognizing the Impact of Task Order on Design of Stress and Emotion Detection Systems. In: 2023 IEEE EMBS Special Topic Conference on Data Science and Engineering in Healthcare, Medicine and Biology: . Paper presented at 2023 IEEE EMBS Special Topic Conference on Data Science and Engineering in Healthcare, Medicine and Biology, (IEEECON 2023), Portomaso, St. Julians, Malta, December 7-9, 2023 (pp. 175-176). IEEE
Open this publication in new window or tab >>Stress Lingers: Recognizing the Impact of Task Order on Design of Stress and Emotion Detection Systems
2023 (English)In: 2023 IEEE EMBS Special Topic Conference on Data Science and Engineering in Healthcare, Medicine and Biology, IEEE, 2023, p. 175-176Conference paper, Published paper (Refereed)
Abstract [en]

This paper examines the significance of the priming effect in designing and developing models for recognizing of affective states. Using a public dataset, often considered a benchmark in automatic stress recognition, the significance of the priming effect is explicated. Two experimental setups confirm the importance of task ordering in this problem. The results demonstrate the statistical significance of the model’s confusion when the subject has previously experienced stress and illustrate the importance for the Affective Computing community to develop methods to mitigate the priming effect where the order of tasks impacts how data should be modelled.

Place, publisher, year, edition, pages
IEEE, 2023
Keywords
Artificial Intelligence, Deep Learning, Digital Health
National Category
Computer Sciences
Identifiers
urn:nbn:se:oru:diva-118553 (URN)10.1109/IEEECONF58974.2023.10404878 (DOI)2-s2.0-85185561031 (Scopus ID)9798350383386 (ISBN)9798350383393 (ISBN)
Conference
2023 IEEE EMBS Special Topic Conference on Data Science and Engineering in Healthcare, Medicine and Biology, (IEEECON 2023), Portomaso, St. Julians, Malta, December 7-9, 2023
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Available from: 2025-01-16 Created: 2025-01-16 Last updated: 2025-01-16Bibliographically approved
Kalidindi, S. S., Banaee, H., Klügl, F. & Loutfi, A. (2022). A Context-aware Predictive model to Optimize Energy Consumption in Residential Buildings. In: : . Paper presented at Swedish AI Society (SAIS 2022), Stockholm, Sweden, June 13-14, 2022.
Open this publication in new window or tab >>A Context-aware Predictive model to Optimize Energy Consumption in Residential Buildings
2022 (English)Conference paper, Oral presentation with published abstract (Other academic)
Keywords
Context-aware, Predictive model, LSTM, Transformer
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:oru:diva-119320 (URN)
Conference
Swedish AI Society (SAIS 2022), Stockholm, Sweden, June 13-14, 2022
Available from: 2025-02-17 Created: 2025-02-17 Last updated: 2025-02-18Bibliographically approved
Kalidindi, S. S., Banaee, H. & Loutfi, A. (2022). Transformers and Contextual Information in Temperature Prediction of Residential Buildings for Improved Energy Consumption. In: : . Paper presented at 1st Annual AAAI Workshop on AI to Accelerate Science and Engineering (AI2ASE), February 28, 2022.
Open this publication in new window or tab >>Transformers and Contextual Information in Temperature Prediction of Residential Buildings for Improved Energy Consumption
2022 (English)Conference paper, Published paper (Refereed)
Abstract [en]

Energy optimization plays a vital role in decreasing the carbon footprint of residential buildings. In this paper, we present a prediction model of indoor temperature in residential buildings in three different case studies in different towns in Sweden. To predict the indoor temperature accurately, a dataset based on several years of data collection (up to 7 years) has been used. This paper applies both the traditional LSTM model as well as the more recent transformer model. The latter has been used because of its ability to perform a mechanism of self-attention that shows particular promise in multivariate sensor data. In addition to these algorithms, the data set is also modified based on contextual information and compared against an approach where no contextual information is used. Contextual information in this case takes into account the physical location of specific apartment units within the full residence and builds individual models based on the location of the unit. The results demonstrate that transformers are better suited for task of prediction, and that transformers combined with contextual information, provide a suitable approach for energy consumption prediction. 

Keywords
Transformers, Contextual Information, Residential Buildings
National Category
Computer Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:oru:diva-112197 (URN)
Conference
1st Annual AAAI Workshop on AI to Accelerate Science and Engineering (AI2ASE), February 28, 2022
Funder
Knowledge Foundation, 20190128
Note

This work has been supported by the Industrial Graduate School Collaborative AI & Robotics funded by the Swedish Knowledge Foundation Dnr:20190128.

Available from: 2024-03-07 Created: 2024-03-07 Last updated: 2024-03-08Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-9607-9504

Search in DiVA

Show all publications