To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Here's your PDDL Problem File! On Using VLMs for Generating Symbolic PDDL Problem Files
Örebro University, School of Science and Technology. (Centre for Applied Autonomous Sensor Systems)ORCID iD: 0000-0002-2465-4215
Örebro University, School of Science and Technology. (Centre for Applied Autonomous Sensor Systems)ORCID iD: 0000-0003-4784-5089
Örebro University, School of Science and Technology. (Centre for Applied Autonomous Sensor Systems)ORCID iD: 0000-0001-9364-7994
Örebro University, School of Science and Technology. (Centre for Applied Autonomous Sensor Systems)ORCID iD: 0000-0002-2953-1564
Show others and affiliations
2025 (English)In: IEEE International Conference on Robotics and Automation: Proceedings / [ed] Ott, C, IEEE, 2025, p. 4455-4461Conference paper, Published paper (Refereed)
Abstract [en]

Large Language Models (LLMs) excel at generating contextually relevant text but lack logical reasoning abilities. They rely on statistical patterns rather than logical inference, making them unreliable for structured decision-making. Integrating LLMs with task planning can address this limitation by combining their natural language understanding with the precise, goal-oriented reasoning of planners. This paper introduces ViPlan, a hybrid system that leverages Vision Language Models (VLMs) to extract high-level semantic information from visual and textual inputs while integrating classical planners for logical reasoning. ViPlan utilizes VLMs to generate syntactically correct and semantically meaningful PDDL problem files from images and natural language instructions, which are then processed by a task planner to generate an executable plan. The entire process is embedded within a behavior tree framework, enhancing efficiency, reactivity, replanning, modularity, and flexibility. The generation and planning capabilities of ViPlan are empirically evaluated with simulated and real-world experiments.

Place, publisher, year, edition, pages
IEEE, 2025. p. 4455-4461
Series
IEEE International Conference on Robotics and Automation (ICRA), ISSN 1050-4729, E-ISSN 2577-087X
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:oru:diva-125574DOI: 10.1109/ICRA55743.2025.11127832ISI: 001582497400399ISBN: 9798331541392 (electronic)ISBN: 9798331541408 (print)OAI: oai:DiVA.org:oru-125574DiVA, id: diva2:2023120
Conference
2025 IEEE International Conference on Robotics and Automation (ICRA 2025), Atlanta, USA, May 19-23, 2025
Funder
EU, Horizon Europe, 101070596Swedish Research Council, 2021-05229Available from: 2025-12-18 Created: 2025-12-18 Last updated: 2025-12-18Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records

Aregbede, VictorForte, PaoloGupta, HimanshuAndreasson, HenrikKöckemann, Uwe

Search in DiVA

By author/editor
Aregbede, VictorForte, PaoloGupta, HimanshuAndreasson, HenrikKöckemann, Uwe
By organisation
School of Science and Technology
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 126 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf