To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Affordance-Based Goal Imagination for Embodied AI Agents
Örebro University, School of Science and Technology. (Machine Perception and Interaction Lab)ORCID iD: 0000-0002-2465-4215
Department of Computer Science, CUSAT, India.
European Spallation Source, ERIC, Lund, Sweden.
Örebro University, School of Science and Technology.ORCID iD: 0000-0002-0579-7181
Show others and affiliations
2024 (English)In: 2024 IEEE International Conference on Development and Learning (ICDL), IEEE, 2024, p. 1-6Conference paper, Published paper (Refereed)
Abstract [en]

Goal imagination in robotics is an emerging concept and involves the capability to automatically generate realistic goals, which, in turn, requires the assessment of the feasibility of transitioning from the current conditions of an initial scene to thedesired goal state. Existing research has explored the utilization of diverse image-generative models to create images depicting potential goal states based on the current state and instructions. In this paper, we illustrate the limitations of current state-of-the-art image generative models in accurately assessing the feasibility of specific actions in particular situations. Consequently, we present how integrating large language models, which possess profound knowledge of real-world objects and affordances, can enhance the performance of image-generative models in discerning plausible from implausible actions and simulating the outcomes of actions in a given context. This will be a step towards achieving the pragmatic goal of imagination in robotics.

Place, publisher, year, edition, pages
IEEE, 2024. p. 1-6
Keywords [en]
Embodiment, Affordance
National Category
Computer graphics and computer vision
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:oru:diva-118193DOI: 10.1109/ICDL61372.2024.10644764ISI: 001338553000023Scopus ID: 2-s2.0-85203835311ISBN: 9798350348552 (electronic)ISBN: 9798350348569 (print)OAI: oai:DiVA.org:oru-118193DiVA, id: diva2:1925990
Conference
IEEE International Conference on Development and Learning (ICDL 2024), Austin, Texas, USA, May 20-23, 2024
Funder
Swedish Research Council, 2021-05229Available from: 2025-01-09 Created: 2025-01-09 Last updated: 2025-02-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Aregbede, VictorLängkvist, MartinLoutfi, Amy

Search in DiVA

By author/editor
Aregbede, VictorLängkvist, MartinLoutfi, Amy
By organisation
School of Science and Technology
Computer graphics and computer vision

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 74 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf