To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Online Model Learning for Shape Control of Deformable Linear Objects
Örebro University, School of Science and Technology. (Autonomous Mobile Manipulation Lab, Center for Applied Autonomous Sensor Systems (AASS))ORCID iD: 0000-0003-1528-4301
Örebro University, School of Science and Technology. (Autonomous Mobile Manipulation Lab, Center for Applied Autonomous Sensor Systems (AASS))ORCID iD: 0000-0003-3958-6179
Örebro University, School of Science and Technology. (Autonomous Mobile Manipulation Lab, Center for Applied Autonomous Sensor Systems (AASS))ORCID iD: 0000-0002-6013-4874
2022 (English)In: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2022, p. 4056-4062Conference paper, Published paper (Refereed)
Abstract [en]

Traditional approaches to manipulating the state of deformable linear objects (DLOs) - i.e., cables, ropes - rely on model-based planning. However, constructing an accurate dynamic model of a DLO is challenging due to the complexity of interactions and a high number of degrees of freedom. This renders the task of achieving a desired DLO shape particularly difficult and motivates the use of model-free alternatives, which while maintaining generality suffer from a high sample complexity. In this paper, we bridge the gap between these fundamentally different approaches and propose a framework that learns dynamic models of DLOs through trial-and-error interaction. Akin to model-based reinforcement learning (RL), we interleave learning and exploration to solve a 3D shape control task for a DLO. Our approach requires only a fraction of the interaction samples of the current state-of-the-art model-free RL alternatives to achieve superior shape control performance. Unlike offline model learning, our approach does not require expert knowledge for data collection, retains the ability to explore, and automatically selects relevant experience.

Place, publisher, year, edition, pages
IEEE, 2022. p. 4056-4062
National Category
Computer Vision and Robotics (Autonomous Systems)
Identifiers
URN: urn:nbn:se:oru:diva-103194DOI: 10.1109/IROS47612.2022.9981080ISI: 000908368203013ISBN: 9781665479271 (electronic)ISBN: 9781665479288 (print)OAI: oai:DiVA.org:oru-103194DiVA, id: diva2:1727549
Conference
35th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022), Kyoto, Japan, October 23-27, 2022
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)Vinnova, SIP-STRIM projects 2019-05175Available from: 2023-01-16 Created: 2023-01-16 Last updated: 2023-09-18
In thesis
1. Advancing Modeling and Tracking of Deformable Linear Objects for Real-World Applications
Open this publication in new window or tab >>Advancing Modeling and Tracking of Deformable Linear Objects for Real-World Applications
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Deformable linear objects (DLOs), such as cables, wires, ropes, and sutures, are important components in various applications in robotics. Although automating DLO manipulation tasks through robot deployment can offer benefits in terms of cost reduction and increased efficiency, it presents difficult challenges. Unlike rigid objects, DLOs can deform and possess high-dimensionalstate space, significantly amplifying the complexity of their dynamics. These inherent characteristics, combined with the absence of distinctive features and the occurrence of occlusion, contribute to the difficulties involved in DLO manipulation tasks.

This dissertation focuses on developing novel approaches for two aspects: modeling and tracking DLOs. Both aspects are important in DLO manipulation, yet they remain open research questions. Current analytical physics-based methods for modeling DLO dynamics are either time-consuming or inaccurate and often undifferentiable, which hampers their applications in robot planning and control. Although deep learning methods have shown promise in modeling object dynamics, there is still a gap in learning DLO dynamics in a 3D environment. As for the tracking, many current methods rely on assumptions such as knowing the DLO initial state and segmented DLO point sets, which are rarely fulfilled in real-world scenarios, significantly limiting their practical applicability.

This dissertation aims to answer three research questions: How can data-driven models be used for learning DLO dynamics? How can the data-driven models be efficiently trained for real-world DLO manipulation tasks? How can images be used to track the state of DLOs during manipulation in uncontrolled real-world settings?

The first contribution of this dissertation is a data-driven model that effectively simulates DLO state transitions. To bridge the current gap in learning full 3D DLO dynamics, a new DLO representation and a recurrent network module are introduced to facilitate better effect propagation between different segments along the DLO. Meanwhile, the model is differentiable, enabling efficient model predictive control for real-world DLO shape control tasks. However, data-driven approaches demand a large amount of training data, which can be time-consuming and laborious to collect in practice. Thus, the second and third contributions propose two frameworks for minimizing the burden incurred by the data collection process. Specifically, a framework is proposed for learning the data-driven model on synthetic data from simulation. Parameters of the simulation model are identified by solving an optimization problem using the differential evolution algorithm with only a few trajectories of a real DLO required. This dissertation also proposes a trial-and-error interaction approach inspired by model-based reinforcement learning, which significantly reduces the need for training data and automates the data collection process.

The above contributions rely on artificial markers for tracking the DLO state during data collection and closed-loop control, which is acknowledged as a limitation. To address this, the fourth contribution proposes a novel approach that utilizes a particle filter within a low-dimensional state embedding learned by an autoencoder. This approach achieves robust tracking under occlusion and eliminates the need for high-fidelity physics simulations or manually designed constraints. Furthermore, the particle-filter-based method is employed and extended to track the state of a branched deformable linear object (BDLO), which is more challenging because of its complex branched structure. The proposed approach learns a likelihood prediction function directly from depth images in simulation, without requiring segmented point sets of the BDLO.

In conclusion, with the proposed methods for modeling and tracking DLOs, this dissertation contributes to advancing a broad range of applications, including DLO simulation, tracking, and manipulation. The development of these approaches lays the foundations for various directions of future research, which are further discussed in the dissertation.

Place, publisher, year, edition, pages
Örebro: Örebro University, 2023. p. 65
Series
Örebro Studies in Technology, ISSN 1650-8580 ; 99
Keywords
Deformable Linear Object, Model Learning, Model-based Control, Tracking, Robustness
National Category
Computer Sciences
Identifiers
urn:nbn:se:oru:diva-107846 (URN)9789175295220 (ISBN)
Public defence
2023-10-13, Örebro universitet, Långhuset, Hörsal L2, Fakultetsgatan 1, Örebro, 13:15 (English)
Opponent
Supervisors
Available from: 2023-08-25 Created: 2023-08-25 Last updated: 2023-09-20Bibliographically approved

Open Access in DiVA

Online Model Learning for Shape Control of Deformable Linear Objects(333 kB)389 downloads
File information
File name FULLTEXT01.pdfFile size 333 kBChecksum SHA-512
04efb9c5a3719b2218391b6952b902f28b649909b649954a695cb2c1c21d442743fabc8569b55857040ec2dccc0b9d43040829a4eaa1fe530ee25388b2b9e199
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Yang, YuxuanStork, Johannes AndreasStoyanov, Todor

Search in DiVA

By author/editor
Yang, YuxuanStork, Johannes AndreasStoyanov, Todor
By organisation
School of Science and Technology
Computer Vision and Robotics (Autonomous Systems)

Search outside of DiVA

GoogleGoogle Scholar
Total: 396 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 522 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf