To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
SOCIAL ROBOTS / SOCIAL COGNITION: Robots' Gaze Effects in Older and Younger Adults
Örebro University, School of Science and Technology.ORCID iD: 0000-0001-7339-8118
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This dissertation presents advances in social human-robot interaction (HRI) and human social cognition through a series of experiments in which humans face a robot. A predominant approach to studying the human factor in HRI consists of placing the human in the role of a user to explore potential factors affecting the acceptance or usability of a robot. This work takes a broader perspective and investigates if social robots are perceived as social agents, irrespective of their final role or usefulness in a particular interaction. To do so, it adopts methodologies and theories from cognitive and experimental psychology, such as the use of behavioral paradigms involving gaze following and a framework of more than twenty years of research employing gaze to explore social cognition. The communicative role of gaze in robots is used to explore their essential effectiveness and as a tool to learn how humans perceive them. Studying how certain social robots are perceived through the lens of research in social cognition is the central contribution of this dissertation.

This thesis presents empirical research and the multidisciplinary literature on (robotic) gaze following, aging, and their relation with social cognition. Papers I and II investigate the decline in gaze following associated with aging, linked with a broader decline in social cognition, in scenarios with robots as gazing agents. In addition to the participants' self-reported perception of the robots, their reaction times were also measured to reflect their internal cognitive processes. Overall, this decline seems to persist when the gazing Overall, this decline seems to persist when the gazing agent is a robot, highlighting our depiction of robots as social agents. Paper IV explores the theories behind this decline using a robot, emphasizing how these theories extend to non-human agents. This work also investigates motion as a competing cue to gaze in social robots (Paper III), and mentalizing in robotic gaze following (Paper V).

Through experiments with participants and within the scope of HRI and social cognition studies, this thesis presents a joint framework highlighting that robots are depicted as social agents. This finding emphasizes the importance of fundamental insights from social cognition when designing robot behaviors. Additionally, it promotes and supports the use of robots as valuable tools to explore the robustness of current theories in cognitive psychology to expand the field in parallel.

Place, publisher, year, edition, pages
Örebro: Örebro University , 2023. , p. 87
Series
Örebro Studies in Technology, ISSN 1650-8580 ; 98
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:oru:diva-108225ISBN: 9789175295213 (print)OAI: oai:DiVA.org:oru-108225DiVA, id: diva2:1796250
Public defence
2023-10-13, Örebro universitet, Forumhuset, Hörsal F, Fakultetsgatan 1, Örebro, 09:00 (English)
Opponent
Supervisors
Available from: 2023-09-12 Created: 2023-09-12 Last updated: 2023-09-28Bibliographically approved
List of papers
1. Age-Related Differences in the Perception of Eye-Gaze from a Social Robot
Open this publication in new window or tab >>Age-Related Differences in the Perception of Eye-Gaze from a Social Robot
2021 (English)In: Social Robotics: 13th International Conference, ICSR 2021, Singapore, Singapore, November 10–13, 2021, Proceedings / [ed] Haizhou Li; Shuzhi Sam Ge; Yan Wu; Agnieszka Wykowska; Hongsheng He; Xiaorui Liu; Dongyu Li; Jairo Perez-Osorio, Springer , 2021, Vol. 13086, p. 350-361Conference paper, Published paper (Refereed)
Abstract [en]

The sensibility to deictic gaze declines naturally with age and often results in reduced social perception. Thus, the increasing efforts in developing social robots that assist older adults during daily life tasks need to consider the effects of aging. In this context, as non-verbal cues such as deictic gaze are important in natural communication in human-robot interaction, this paper investigates the performance of older adults, as compared to younger adults, during a controlled, online (visual search) task inspired by daily life activities, while assisted by a social robot. This paper also examines age-related differences in social perception. Our results showed a significant facilitation effect of head movement representing deictic gaze from a Pepper robot on task performance. This facilitation effect was not significantly different between the age groups. However, social perception of the robot was less influenced by its deictic gaze behavior in older adults, as compared to younger adults. This line of research may ultimately help informing the design of adaptive non-verbal cues from social robots for a wide range of end users.

Place, publisher, year, edition, pages
Springer, 2021
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349 ; 13086 LNCS
Keywords
Human-robot interaction, Older adults, Non-verbal cues
National Category
Robotics Computer Sciences
Identifiers
urn:nbn:se:oru:diva-96658 (URN)10.1007/978-3-030-90525-5_30 (DOI)000776504300030 ()2-s2.0-85119849431 (Scopus ID)9783030905255 (ISBN)9783030905248 (ISBN)
Conference
13th International Conference (ICSR 2021), Singapore, Singapore, November 10–13, 2021
Funder
European Commission, 754285Knut and Alice Wallenberg Foundation
Note

Funding agency:

Spanish Government RTI2018095599-A-C22

Available from: 2022-01-24 Created: 2022-01-24 Last updated: 2023-09-20Bibliographically approved
2. Age-Related Differences in the Perception of Robotic Referential Gaze in Human-Robot Interaction
Open this publication in new window or tab >>Age-Related Differences in the Perception of Robotic Referential Gaze in Human-Robot Interaction
2024 (English)In: International Journal of Social Robotics, ISSN 1875-4791, E-ISSN 1875-4805, Vol. 16, no 6, p. 1069-1081Article in journal (Refereed) Published
Abstract [en]

There is an increased interest in using social robots to assist older adults during their daily life activities. As social robots are designed to interact with older users, it becomes relevant to study these interactions under the lens of social cognition. Gaze following, the social ability to infer where other people are looking at, deteriorates with older age. Therefore, the referential gaze from robots might not be an effective social cue to indicate spatial locations to older users. In this study, we explored the performance of older adults, middle-aged adults, and younger controls in a task assisted by the referential gaze of a Pepper robot. We examined age-related differences in task performance, and in self-reported social perception of the robot. Our main findings show that referential gaze from a robot benefited task performance, although the magnitude of this facilitation was lower for older participants. Moreover, perceived anthropomorphism of the robot varied less as a result of its referential gaze in older adults. This research supports that social robots, even if limited in their gazing capabilities, can be effectively perceived as social entities. Additionally, this research suggests that robotic social cues, usually validated with young participants, might be less optimal signs for older adults.

Supplementary Information: The online version contains supplementary material available at 10.1007/s12369-022-00926-6.

Place, publisher, year, edition, pages
Springer, 2024
Keywords
Aging, Gaze following, Human-robot interaction, Non-verbal cues, Referential gaze, Social cues
National Category
Gerontology, specialising in Medical and Health Sciences Robotics
Identifiers
urn:nbn:se:oru:diva-101615 (URN)10.1007/s12369-022-00926-6 (DOI)000857896500001 ()36185773 (PubMedID)2-s2.0-85138680591 (Scopus ID)
Funder
European Commission, 754285Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

Funding agency:

RobWell project - Spanish Ministerio de Ciencia, Innovacion y Universidades RTI2018-095599-A-C22

Available from: 2022-10-04 Created: 2022-10-04 Last updated: 2024-07-30Bibliographically approved
3. Robotic Gaze Drives Attention, Even with No Visible Eyes
Open this publication in new window or tab >>Robotic Gaze Drives Attention, Even with No Visible Eyes
2023 (English)In: HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, ACM / Association for Computing Machinery , 2023, p. 172-177Conference paper, Published paper (Refereed)
Abstract [en]

Robots can direct human attention using their eyes. However, it remains unclear whether it is the gaze or the low-level motion of the head rotation that drives attention. We isolated these components in a non-predictive gaze cueing task with a robot to explore how limited robotic signals orient attention. In each trial, the head of a NAO robot turned towards the left or right. To isolate the direction of rotation from its gaze, NAO was presented frontally and backward along blocks. Participants responded faster to targets on the gazed-at site, even when the eyes of the robot were not visible and the direction of rotation was opposed to that of the frontal condition. Our results showed that low-level motion did not orient attention, but the gaze direction of the robot did. These findings suggest that the robotic gaze is perceived as a social signal, similar to human gaze.

Place, publisher, year, edition, pages
ACM / Association for Computing Machinery, 2023
Keywords
Motion cue, Reflexive attention, Gaze following, Gaze cueing, Social robots
National Category
Computer Vision and Robotics (Autonomous Systems)
Identifiers
urn:nbn:se:oru:diva-108211 (URN)10.1145/3568294.3580066 (DOI)001054975700029 ()2-s2.0-85150446663 (Scopus ID)9781450399708 (ISBN)
Conference
ACM/IEEE International Conference on Human-Robot Interaction (HRI '23), Stockholm, Sweden, March 13-16, 2023
Funder
EU, Horizon 2020, 754285Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

Funding agency:

Spanish Ministerio de Ciencia, Innovación y Universidades, RobWell project (No RTI2018-095599-A-C22)

Available from: 2023-09-11 Created: 2023-09-11 Last updated: 2024-02-27Bibliographically approved
4. Gaze cueing in older and younger adults is elicited by a social robot seen from the back
Open this publication in new window or tab >>Gaze cueing in older and younger adults is elicited by a social robot seen from the back
2023 (English)In: Cognitive Systems Research, ISSN 2214-4366, E-ISSN 1389-0417, Vol. 82, article id 101149Article in journal (Refereed) Published
Abstract [en]

The ability to follow the gaze of others deteriorates with age. This decline is typically tested with gaze cueing tasks, in which the time it takes to respond to targets on a screen is faster when they are preceded by a facial cue looking in the direction of the target (i.e., gaze cueing effect). It is unclear whether age-related differences in this effect occur with gaze cues other than the eyes, such as head orientation, and how these vary in function of the cue-target timing. Based on the perceived usefulness of social robots to assist older adults, we asked older and young adults to perform a gaze cueing task with the head of a NAO robot as the central cue. Crucially, the head was viewed from the back, and so its eye gaze was conveyed. In a control condition, the head was static and faced away from the participant. The stimulus onset asynchrony (SOA) between cue and target was 340 ms or 1000 ms. Both age groups showed a gaze cueing effect at both SOAs. Older participants showed a reduced facilitation effect (i.e., faster on congruent gazing trials than on neutral trials) at the 340-ms SOA compared to the 1000-ms SOA, and no differences between incongruent trials and neutral trials at the 340-ms SOA. Our results show that a robot with non-visible eyes can elicit gaze cueing effects. Age-related differences in the other effects are discussed regarding differences in processing time.

Place, publisher, year, edition, pages
Elsevier, 2023
Keywords
Gaze following, Gaze cueing effect, Human-robot interaction, Aging
National Category
Computer Vision and Robotics (Autonomous Systems)
Identifiers
urn:nbn:se:oru:diva-108208 (URN)10.1016/j.cogsys.2023.101149 (DOI)001054852800001 ()2-s2.0-85165450249 (Scopus ID)
Funder
EU, Horizon 2020, 754285Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

Funding agency:

Spanish Ministerio de Ciencia, RobWellproject RTI2018-095599-A-C22

Available from: 2023-09-11 Created: 2023-09-11 Last updated: 2023-09-20Bibliographically approved
5. Can the robot "see" what I see? Robot gaze drives attention depending on mental state attribution
Open this publication in new window or tab >>Can the robot "see" what I see? Robot gaze drives attention depending on mental state attribution
Show others...
2023 (English)In: Frontiers in Psychology, E-ISSN 1664-1078, Vol. 14, article id 1215771Article in journal (Refereed) Published
Abstract [en]

Mentalizing, where humans infer the mental states of others, facilitates understanding and interaction in social situations. Humans also tend to adopt mentalizing strategies when interacting with robotic agents. There is an ongoing debate about how inferred mental states affect gaze following, a key component of joint attention. Although the gaze from a robot induces gaze following, the impact of mental state attribution on robotic gaze following remains unclear. To address this question, we asked forty-nine young adults to perform a gaze cueing task during which mental state attribution was manipulated as follows. Participants sat facing a robot that turned its head to the screen at its left or right. Their task was to respond to targets that appeared either at the screen the robot gazed at or at the other screen. At the baseline, the robot was positioned so that participants would perceive it as being able to see the screens. We expected faster response times to targets at the screen the robot gazed at than targets at the non-gazed screen (i.e., gaze cueing effect). In the experimental condition, the robot's line of sight was occluded by a physical barrier such that participants would perceive it as unable to see the screens. Our results revealed gaze cueing effects in both conditions although the effect was reduced in the occluded condition compared to the baseline. These results add to the expanding fields of social cognition and human-robot interaction by suggesting that mentalizing has an impact on robotic gaze following.

Place, publisher, year, edition, pages
Frontiers Media S.A., 2023
Keywords
attention, cueing effect, gaze following, intentional stance, mentalizing, social robots
National Category
Robotics
Identifiers
urn:nbn:se:oru:diva-107503 (URN)10.3389/fpsyg.2023.1215771 (DOI)001037081700001 ()37519379 (PubMedID)2-s2.0-85166030431 (Scopus ID)
Funder
EU, European Research Council, 754285Wallenberg AI, Autonomous Systems and Software Program (WASP), RTI2018-095599-A-C22
Note

Funding Agency:

RobWell project - Spanish Ministerio de Ciencia, Innovacion y Universidades

Available from: 2023-08-10 Created: 2023-08-10 Last updated: 2023-09-20Bibliographically approved

Open Access in DiVA

Cover(1361 kB)65 downloads
File information
File name COVER01.pdfFile size 1361 kBChecksum SHA-512
921e467c5aa2608205a0a88b878b5e3db11e167ada726046a5c5f825a8fc0adfe4408286a551f0e663b91499d23145444aaedd8254fcabedf04c54c649bfa328
Type coverMimetype application/pdf
Spikblad(184 kB)52 downloads
File information
File name SPIKBLAD01.pdfFile size 184 kBChecksum SHA-512
5b0c2b284844d547d560c3d147263d5dd9fa895618ef9b936255b432f4610bc1e7ce1a0927869d15e64538305db2057f865c1fdc0bc7e75d7f4285b187636a9f
Type spikbladMimetype application/pdf
SOCIAL ROBOTS / SOCIAL COGNITION: Robots' Gaze Effects in Older and Younger Adults(36121 kB)513 downloads
File information
File name FULLTEXT04.pdfFile size 36121 kBChecksum SHA-512
869fe165b8afe5885cdfc751aebe774168a15226c224229a1167afdf9c67905b9c401b3c646e16a1291ec42f0bc6195073329588e0785194cb7453398a7ed477
Type fulltextMimetype application/pdf

Authority records

Morillo-Mendez, Lucas

Search in DiVA

By author/editor
Morillo-Mendez, Lucas
By organisation
School of Science and Technology
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 528 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 1503 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf