To Örebro University

oru.seÖrebro University Publications
Change search
Link to record
Permanent link

Direct link
Publications (10 of 26) Show all publications
Elmadagli, C. & Renoux, J. (2026). Theory of Whose Mind? Exposing the Shortcomings of One of HRI's Core Concepts. In: Lynne Baillie; William D. Smart; Maartje De Graaf; Matthew Gombolay; Ilaria Torre (Ed.), Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction (HRI ’26): . Paper presented at 21st International Conference on Human Robot Interaction (HRI '26), Edinburgh, Scotland, UK, March 16-19, 2026 (pp. 1369-1377). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Theory of Whose Mind? Exposing the Shortcomings of One of HRI's Core Concepts
2026 (English)In: Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction (HRI ’26) / [ed] Lynne Baillie; William D. Smart; Maartje De Graaf; Matthew Gombolay; Ilaria Torre, Association for Computing Machinery (ACM), 2026, p. 1369-1377Conference paper, Published paper (Refereed)
Abstract [en]

The concept of Theory of Mind (ToM) is central to many social robotic studies. It may be invoked during the design of social robots as a way to improve collaboration or create a form of "social intelligence". It is also considered as an established fact and never put in question. However, many scholars have analysed the concept of ToM from a critical perspective and argued that it is, in fact, a theory with significant shortcomings, that rests on neuronormative and neuroprivileged grounds. In this paper, we explore these arguments and what this change of perspective means for the field of Social Robotics. We argue that the field should abandon the concept of ToM and move forward to more appropriate and inclusive models and research questions, and propose some directions to do so.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2026
Keywords
Theory of Mind, Critical Research, Social Robotics, Autism, Mindreading, Mentalizing
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:oru:diva-130153 (URN)10.1145/3757279.3788818 (DOI)001774477000146 ()9798400721281 (ISBN)
Conference
21st International Conference on Human Robot Interaction (HRI '26), Edinburgh, Scotland, UK, March 16-19, 2026
Available from: 2026-07-23 Created: 2026-07-23 Last updated: 2026-07-23Bibliographically approved
Hrckova, A., Renoux, J., Tolosana Calasanz, R., Chuda, D., Tamajka, M. & Simko, J. (2025). AI Research Is Not Magic, It Has to Be Reproducible and Responsible: Challenges in the AI Field from the Perspective of Its PhD Students. In: Ludger Hagedorn; Ute Schmid; Susan Winter; Stefan Woltran (Ed.), Digital Humanism: First Interdisciplinary Science and Research Conference, DIGHUM 2025, Vienna, Austria, November 20–21, 2025, Proceedings. Paper presented at First Interdisciplinary Science and Research Conference (DIGHUM 2025), Vienna, Austria, November 20–21, 2025 (pp. 451-466). Springer, 16319
Open this publication in new window or tab >>AI Research Is Not Magic, It Has to Be Reproducible and Responsible: Challenges in the AI Field from the Perspective of Its PhD Students
Show others...
2025 (English)In: Digital Humanism: First Interdisciplinary Science and Research Conference, DIGHUM 2025, Vienna, Austria, November 20–21, 2025, Proceedings / [ed] Ludger Hagedorn; Ute Schmid; Susan Winter; Stefan Woltran, Springer, 2025, Vol. 16319, p. 451-466Conference paper, Published paper (Refereed)
Abstract [en]

Unlocking the full societal potential of artificial intelligence demands a fundamental shift towards responsible and reproducible research. Understanding that PhD students are pivotal in conducting and reproducing experiments, we investigated the challenges of 28 AI PhD candidates from 13 European countries. We identify three critical areas where current practices fall short: (1) the findability and quality of AI resources such as datasets, models, and experiments; (2) the difficulties in replicating the experiments in AI papers; (3) and the lack of trustworthiness and interdisciplinarity. After uncovering some of the underlying reasons behind the challenges, we propose a combination of social and technical recommendations to overcome the identified challenges and foster a more transparent and reliable AI research ecosystem. Socially, we recommend the general adoption of reproducibility initiatives in AI conferences and journals, as well as improved interdisciplinary scientific collaboration, especially in data governance practices. On the technical front, we call for enhanced tools to better support versioning control of datasets and code, and a computing infrastructure that facilitates the sharing and discovery of AI resources, as well as the sharing, execution, and verification of experiments.

Place, publisher, year, edition, pages
Springer, 2025
Series
Lecture Notes in Computer Science (LNCS), ISSN 0302-9743, E-ISSN 1611-3349 ; 16319
National Category
Information Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:oru:diva-126321 (URN)10.1007/978-3-032-11108-1_34 (DOI)001718514100034 ()9783032111074 (ISBN)9783032111081 (ISBN)
Conference
First Interdisciplinary Science and Research Conference (DIGHUM 2025), Vienna, Austria, November 20–21, 2025
Note

This work was supported by the European Commission via Horizon projects AI4Europe (Grant 101070000) and Low Resource Artificial Intelligence (Grant 101136646); by the Government of Aragon (Group Ref. T64_20R, COSMOS research group); and as part of project PID2020-113037RB-I00, funded by MICIU/AEI/10.13039/501100011033.

Available from: 2026-01-15 Created: 2026-01-15 Last updated: 2026-04-07Bibliographically approved
Sabu, K. M., Renoux, J., Grosinger, H. J. & Saffiotti, A. (2025). First the action has to be perceived for communication to take place. In: Michele Braccini; Allegra De Filippo; Michela Milano; Alessandro Saffiotti; Mauro Vallati (Ed.), HAIC 2025 Workshop on Human-AI Collaborative Systems 2025: Proceedings of the 1st Workshop on Human-AI Collaborative Systems co-located with 28th European Conference on Artificial Intelligence (ECAI 2025). Paper presented at First International Workshop on Human-AI Collaborative Systems (HAIC 2025), Bologna, Italy, October 25-26, 2025 (pp. 84-90). Technical University of Aachen
Open this publication in new window or tab >>First the action has to be perceived for communication to take place
2025 (English)In: HAIC 2025 Workshop on Human-AI Collaborative Systems 2025: Proceedings of the 1st Workshop on Human-AI Collaborative Systems co-located with 28th European Conference on Artificial Intelligence (ECAI 2025) / [ed] Michele Braccini; Allegra De Filippo; Michela Milano; Alessandro Saffiotti; Mauro Vallati, Technical University of Aachen , 2025, p. 84-90Conference paper, Published paper (Refereed)
Abstract [en]

In this short paper, we consider scenarios in human-robot collaboration where the robot relies on deliberation to activate communicative actions. We claim that reasoning about the perception of these actions is a key, but often disregarded ingredient for successful communication, and propose a pre-theoretical model that accounts for this. We also discuss the problems that may arise if perception is neglected when reasoning about communication.

Place, publisher, year, edition, pages
Technical University of Aachen, 2025
Series
CEUR Workshop Proceedings, E-ISSN 1613-0073
Keywords
Deliberative Communication, Human-Robot Interaction, Human-Agent Communication, Human-Agent Collaboration
National Category
Artificial Intelligence
Identifiers
urn:nbn:se:oru:diva-125802 (URN)2-s2.0-105020793502 (Scopus ID)
Conference
First International Workshop on Human-AI Collaborative Systems (HAIC 2025), Bologna, Italy, October 25-26, 2025
Funder
Swedish Research Council, 2022-04676Swedish Research Council, 2021-05542EU, Horizon Europe, 101070000
Available from: 2025-12-18 Created: 2025-12-18 Last updated: 2026-01-16Bibliographically approved
Renoux, J., Correia, F., Campos, J., Morillo-Mendez, L., Akalin, N., Santos, F. P. & Paiva, A. (2025). The Effect of Agent-Based Feedback on Prosociality in Social Dilemmas. In: Y. Vorobeychik; S. Das; A. Nowé (Ed.), AAMAS '25: Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems. Paper presented at 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025), Detroit, USA, May 19-23, 2025 (pp. 1755-1763). International Foundation for Autonomous Agents and Multiagent Systems
Open this publication in new window or tab >>The Effect of Agent-Based Feedback on Prosociality in Social Dilemmas
Show others...
2025 (English)In: AAMAS '25: Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems / [ed] Y. Vorobeychik; S. Das; A. Nowé, International Foundation for Autonomous Agents and Multiagent Systems , 2025, p. 1755-1763Conference paper, Published paper (Refereed)
Abstract [en]

Tackling many of humanity's contemporary challenges requires individuals to cooperate in so-called collective risk dilemmas, i.e. scenarios where cooperation is costly yet required to reach collective targets and prevent catastrophic outcomes. It remains a scientific challenge to understand which external incentives enable cooperation and whether that can be facilitated through socially interactive agents. In this paper, we evaluate human cooperation in the presence of an artificial virtual agent. We developed a game called The Pest Control, in which five players attempt to maximize their earnings while avoiding being infested by a spreading pest. Controlling the pest requires costly public good contributions, yet free-riding on the efforts of others leads to maximum individual payoffs. We conducted an online experiment and analyzed the data of 265 participants, where we manipulated the feedback strategy of the virtual agent in a between-subject design. Our results suggest that feedback highlighting salient elements of the game increases participants' cooperation, while feedback regarding the consequences of actions slightly promotes selfish behaviors. Our study provides insight into how future artificial agents and AI systems could be designed to promote cooperation in complex social dilemmas by leveraging different strategies.

Place, publisher, year, edition, pages
International Foundation for Autonomous Agents and Multiagent Systems, 2025
Keywords
Prosociality, Collective Risk Dilemma, Human-Agent Interaction, Game Theory, Asymmetric Risk
National Category
Computer Sciences
Identifiers
urn:nbn:se:oru:diva-123759 (URN)001532048100192 ()2-s2.0-105009795809 (Scopus ID)9798400714269 (ISBN)
Conference
24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2025), Detroit, USA, May 19-23, 2025
Note

This work has been supported by the European Commission, under the Horizon HumanE AI Network project, grant agreement 952026, the Horizon AI4Europe project, grand agreement 101070000, by CRAI C628696807-00454142 (IAPMEI/PRR) and by FCT under 10.54499/LA/P/0083/2020, 10.54499/UIDP/50009/2020, 10.54499/ UIDB/50009/2020, and 2022.00816.CEECIND/CP1713/CT0013.

Available from: 2025-09-19 Created: 2025-09-19 Last updated: 2026-01-16Bibliographically approved
Renoux, J., Grosinger, J., Romeo, M., Sabu, K. M., Baraka, K. & Kaptelinin, V. (2024). Communication in Human-AI Interaction - CHAI (preface). In: Ericson P., Khairova N., De Vos M. (Ed.), CEUR Workshop Proceedings: . Paper presented at 3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI-WS 2024, Malmo 10-11 June 2024 (pp. 78-83). CEUR-WS, 3825
Open this publication in new window or tab >>Communication in Human-AI Interaction - CHAI (preface)
Show others...
2024 (English)In: CEUR Workshop Proceedings / [ed] Ericson P., Khairova N., De Vos M., CEUR-WS , 2024, Vol. 3825, p. 78-83Conference paper, Published paper (Refereed)
Abstract [en]

As Artificially Intelligent systems are becoming more and more present in our surroundings, our ways of interacting with them are also changing. From commercial chatbots to home assistants and robot companions, machines are progressively taking up the role of “communicators”, provided with their own agency, and able to interact with their human counterparts in new ways. This workshop aimed at gathering experts in fields relevant to the study of AI systems as communicators, including but not limited to Human-Computer Interaction, Artificial Intelligence, Human-Robot and Human-AI Interaction. It was organized in order to discuss new challenges brought by this recent shift, compare methods and perspectives between different fields, and foster long-term collaborations.

Place, publisher, year, edition, pages
CEUR-WS, 2024
Keywords
AI Communicators, Embodied AI, Human-AI Communication, Human-Centered Design, Multimodal Interaction, Adversarial machine learning, Human robot interaction, User centered design, AI communicator, AI systems, Chatbots, Computer interaction, Human-centred designs, In-field, Robot companion, Microrobots
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:oru:diva-118432 (URN)2-s2.0-85210321162 (Scopus ID)
Conference
3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI-WS 2024, Malmo 10-11 June 2024
Available from: 2025-01-14 Created: 2025-01-14 Last updated: 2026-03-24Bibliographically approved
Sabu, K. M., Renoux, J. & Saffiotti, A. (2024). Deliberative Communication for Human-Agent Interaction: A Position Paper. In: HAI 2024 - Proceedings of the 12th International Conference on Human-Agent Interaction: . Paper presented at 12th International Conference on Human-Agent Interaction, HAI 2024, Swansea, November 24-27, 2024 (pp. 11-16). Association for Computing Machinery, Inc
Open this publication in new window or tab >>Deliberative Communication for Human-Agent Interaction: A Position Paper
2024 (English)In: HAI 2024 - Proceedings of the 12th International Conference on Human-Agent Interaction, Association for Computing Machinery, Inc , 2024, p. 11-16Conference paper, Published paper (Refereed)
Abstract [en]

In this position paper, we argue for the need for deliberation in communication for artificial agents that perform tasks together with humans. Existing works use a set of terms and concepts with different meanings, resulting in ambiguity which does not allow for a general framework. As an initial step towards such a framework, we propose the notion of deliberative communication, clarify the necessary concepts and terminology, highlight the capabilities required in using deliberation for agents that communicate with human users, and discuss the main challenges.

Place, publisher, year, edition, pages
Association for Computing Machinery, Inc, 2024
Keywords
Human-Robot Interaction, Human-Virtual Agent Interaction, Chatbots, Intelligent virtual agents, Microrobots, Agent interaction, Artificial agents, Human users, Human-agent interaction, Humans-robot interactions, Position papers, Virtual agent, Human robot interaction
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:oru:diva-119083 (URN)10.1145/3687272.3688299 (DOI)001436563800002 ()2-s2.0-85215510952 (Scopus ID)9798400708244 (ISBN)
Conference
12th International Conference on Human-Agent Interaction, HAI 2024, Swansea, November 24-27, 2024
Available from: 2025-02-04 Created: 2025-02-04 Last updated: 2026-03-24Bibliographically approved
Faridghasemnia, M., Renoux, J. & Saffiotti, A. (2024). Visual Noun Modifiers: The Problem of Binding Visual and Linguistic Cues. In: 2024 IEEE International Conference on Robotics and Automation (ICRA): . Paper presented at IEEE International Conference on Robotics and Automation, ICRA 2024, Yokohama, May 13-17, 2024 (pp. 11178-11185). Institute of Electrical and Electronics Engineers Inc.
Open this publication in new window or tab >>Visual Noun Modifiers: The Problem of Binding Visual and Linguistic Cues
2024 (English)In: 2024 IEEE International Conference on Robotics and Automation (ICRA), Institute of Electrical and Electronics Engineers Inc. , 2024, p. 11178-11185Conference paper, Published paper (Refereed)
Abstract [en]

In many robotic applications, especially those involving humans and the environment, linguistic and visual information must be processed jointly and bound together. Existing works either encode the image or the language into a subsymbolic space, like the CLIP model, or create a symbolic space of extracted information, like the object detection models. In this paper, we propose to describe images by nouns and modifiers and introduce a new embedded binding space where the linguistic and visual cues can effectively be bound. We investigate how state-of-the-art models perform in recognizing nouns and modifiers from images, and propose our method by introducing a dataset and CLIP-like recognition techniques based on transfer learning and metric learning. We show real-world experiments that demonstrate the practical applicability of our approach to robotics applications. Our results indicate that our method can surpass the state-of-the-art in recognizing nouns and modifiers from images. Interestingly, our method exhibits a language characteristic related to context sensitivity.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc., 2024
Keywords
Adversarial machine learning, Contrastive Learning, Image coding, Object detection, Object recognition, Robot learning, Transfer learning, Visual languages, ART model, Detection models, Environment information, Linguistic information, Objects detection, Robotics applications, State of the art, Sub-symbolic, Visual cues, Visual information, Linguistics
National Category
Robotics and automation
Identifiers
urn:nbn:se:oru:diva-118593 (URN)10.1109/ICRA57147.2024.10611332 (DOI)001369728001128 ()2-s2.0-85202445079 (Scopus ID)9798350384574 (ISBN)
Conference
IEEE International Conference on Robotics and Automation, ICRA 2024, Yokohama, May 13-17, 2024
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)EU, Horizon 2020, 101016442
Note

This work has been partially supported by the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation, and has also been supported by the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 101016442 (AIPlan4EU).

Available from: 2025-01-16 Created: 2025-01-16 Last updated: 2025-09-08Bibliographically approved
Lobo, I., Koch, J., Renoux, J., Batina, I. & Prada, R. (2024). When Should I Lead or Follow?: Understanding Initiative Levels in Human-AI Collaborative Gameplay. In: Anna Vallgårda; Li Jönsson; Jonas Fritsch; Sarah Fdili Alaoui; Christopher A. Le Dantec (Ed.), DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference: . Paper presented at Proceedings of the 2024 ACM Designing Interactive Systems Conference, DIS 2024, Copenhagen, Denmark, 1-5 July, 2024. (pp. 2037-2056). ACM Digital Library
Open this publication in new window or tab >>When Should I Lead or Follow?: Understanding Initiative Levels in Human-AI Collaborative Gameplay
Show others...
2024 (English)In: DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems Conference / [ed] Anna Vallgårda; Li Jönsson; Jonas Fritsch; Sarah Fdili Alaoui; Christopher A. Le Dantec, ACM Digital Library, 2024, p. 2037-2056Conference paper, Published paper (Refereed)
Abstract [en]

Dynamics in Human-AI interaction should lead to more satisfying and engaging collaboration. Key open questions are how to design such interactions and the role personal goals and expectations play. We developed three AI partners of varying initiative (leader, follower, shifting) in a collaborative game called Geometry Friends. We conducted a within-subjects experiment with 60 participants to assess personal AI partner preference and performance satisfaction as well as perceived warmth and competence of AI partners. Results show that AI partners following human initiative are perceived as warmer and more collaborative. However, some participants preferred AI leaders for their independence and speed, despite being seen as less friendly. This suggests that assigning a leadership role to the AI partner may be suitable for time-sensitive scenarios. We identify design factors for developing collaborative AI agents with varying levels of initiative to create more efective human-AI teams that consider context and individual preference.

Place, publisher, year, edition, pages
ACM Digital Library, 2024
Keywords
Collaboration Preference, Collaborative Game, Human-AI Collaboration, Initiative in AI Partners, Collaborative gameplay, Collaborative games, Design factors, Individual preference, Initiative in AI partner, Leader-follower, Performance, Subject experiment
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:oru:diva-118436 (URN)10.1145/3643834.3661583 (DOI)2-s2.0-85200369716 (Scopus ID)9798400705830 (ISBN)
Conference
Proceedings of the 2024 ACM Designing Interactive Systems Conference, DIS 2024, Copenhagen, Denmark, 1-5 July, 2024.
Available from: 2025-01-14 Created: 2025-01-14 Last updated: 2025-01-14Bibliographically approved
Veiga, T. & Renoux, J. (2023). From Reactive to Active Sensing: A Survey on Information Gathering in Decision-theoretic Planning. ACM Computing Surveys, 55(13S), Article ID 280.
Open this publication in new window or tab >>From Reactive to Active Sensing: A Survey on Information Gathering in Decision-theoretic Planning
2023 (English)In: ACM Computing Surveys, ISSN 0360-0300, E-ISSN 1557-7341, Vol. 55, no 13S, article id 280Article in journal (Refereed) Published
Abstract [en]

In traditional decision-theoretic planning, information gathering is a means to a goal. The agent receives information about its environment (state or observation) and uses it as a way to optimize a state-based reward function. Recent works, however, have focused on application domains in which information gathering is not only the mean but the goal itself. The agent must optimize its knowledge of the environment. However, traditional Markov-based decision-theoretic models cannot account for rewarding the agent based on its knowledge, which leads to the development of many approaches to overcome this limitation. We survey recent approaches for using decision-theoretic models in information-gathering scenarios, highlighting common practices and existing generic models, and show that existing methods can be categorized into three classes: reactive sensing, single-agent active sensing, and multi-agent active sensing. Finally, we highlight potential research gaps and suggest directions for future research.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2023
Keywords
Decision-theoretic planning, information gathering, active sensing
National Category
Computer Sciences
Identifiers
urn:nbn:se:oru:diva-109481 (URN)10.1145/3583068 (DOI)001056300600018 ()2-s2.0-85168797237 (Scopus ID)
Available from: 2023-10-31 Created: 2023-10-31 Last updated: 2023-10-31Bibliographically approved
Luperto, M., Monroy, J., Renoux, J., Lunardini, F., Basilico, N., Bulgheroni, M., . . . Borghese, N. A. (2023). Integrating Social Assistive Robots, IoT, Virtual Communities and Smart Objects to Assist at-Home Independently Living Elders: the MoveCare Project. International Journal of Social Robotics, 15(3), 517-545
Open this publication in new window or tab >>Integrating Social Assistive Robots, IoT, Virtual Communities and Smart Objects to Assist at-Home Independently Living Elders: the MoveCare Project
Show others...
2023 (English)In: International Journal of Social Robotics, ISSN 1875-4791, E-ISSN 1875-4805, Vol. 15, no 3, p. 517-545Article in journal (Refereed) Published
Abstract [en]

The integration of Ambient Assisted Living (AAL) frameworks with Socially Assistive Robots (SARs) has proven useful for monitoring and assisting older adults in their own home. However, the difficulties associated with long-term deployments in real-world complex environments are still highly under-explored. In this work, we first present the MoveCare system, an unobtrusive platform that, through the integration of a SAR into an AAL framework, aimed to monitor, assist and provide social, cognitive, and physical stimulation in the own houses of elders living alone and at risk of falling into frailty. We then focus on the evaluation and analysis of a long-term pilot campaign of more than 300 weeks of usages. We evaluated the system's acceptability and feasibility through various questionnaires and empirically assessed the impact of the presence of an assistive robot by deploying the system with and without it. Our results provide strong empirical evidence that Socially Assistive Robots integrated with monitoring and stimulation platforms can be successfully used for long-term support to older adults. We describe how the robot's presence significantly incentivised the use of the system, but slightly lowered the system's overall acceptability. Finally, we emphasise that real-world long-term deployment of SARs introduces a significant technical, organisational, and logistical overhead that should not be neglected nor underestimated in the pursuit of long-term robust systems. We hope that the findings and lessons learned from our work can bring value towards future long-term real-world and widespread use of SARs.

Place, publisher, year, edition, pages
Springer, 2023
Keywords
Ambient Assisted Living, IoT network, Monitoring, Socially assistive robots, Virtual communities
National Category
Computer Systems
Identifiers
urn:nbn:se:oru:diva-97653 (URN)10.1007/s12369-021-00843-0 (DOI)000754927900001 ()35194482 (PubMedID)2-s2.0-85124749539 (Scopus ID)
Note

Funding agency:

European Commission Joint Research Centre ICT-26-2016b-GA 732158

Correction:

DOI: 10.1007/s12369-022-00885-y

WOS: 000857896600001

Available from: 2022-02-24 Created: 2022-02-24 Last updated: 2023-12-08Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-2385-9470

Search in DiVA

Show all publications