To Örebro University

oru.seÖrebro University Publications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
NDT-6D for color registration in agri-robotic applications
Örebro University, School of Science and Technology. (Centre for Applied Autonomous Sensor System)
Örebro University, School of Science and Technology. Perception for Intelligent Systems, TechnicalUniversity of Munich, Munich, Germany. (Centre for Applied Autonomous Sensor System)ORCID iD: 0000-0003-0217-9326
Örebro University, School of Science and Technology. (Centre for Applied Autonomous Sensor System)ORCID iD: 0000-0002-2953-1564
Centre for Applied Autonomous SensorSystems, Institutionen för naturvetenskap &teknik, Örebro University, Örebro, Sweden; Department of Radiation Science, RadiationPhysics, Umeå University, Umeå, Sweden.
2023 (English)In: Journal of Field Robotics, ISSN 1556-4959, E-ISSN 1556-4967, Vol. 40, no 6, p. 1603-1619Article in journal (Refereed) Published
Abstract [en]

Registration of point cloud data containing both depth and color information is critical for a variety of applications, including in-field robotic plant manipulation, crop growth modeling, and autonomous navigation. However, current state-of-the-art registration methods often fail in challenging agricultural field conditions due to factors such as occlusions, plant density, and variable illumination. To address these issues, we propose the NDT-6D registration method, which is a color-based variation of the Normal Distribution Transform (NDT) registration approach for point clouds. Our method computes correspondences between pointclouds using both geometric and color information and minimizes the distance between these correspondences using only the three-dimensional (3D) geometric dimensions. We evaluate the method using the GRAPES3D data set collected with a commercial-grade RGB-D sensor mounted on a mobile platform in a vineyard. Results show that registration methods that only rely on depth information fail to provide quality registration for the tested data set. The proposed color-based variation outperforms state-of-the-art methods with a root mean square error (RMSE) of 1.1-1.6 cm for NDT-6D compared with 1.1-2.3 cm for other color-information-based methods and 1.2-13.7 cm for noncolor-information-based methods. The proposed method is shown to be robust against noises using the TUM RGBD data set by artificially adding noise present in an outdoor scenario. The relative pose error (RPE) increased similar to 14% for our method compared to an increase of similar to 75% for the best-performing registration method. The obtained average accuracy suggests that the NDT-6D registration methods can be used for in-field precision agriculture applications, for example, crop detection, size-based maturity estimation, and growth modeling.

Place, publisher, year, edition, pages
John Wiley & Sons, 2023. Vol. 40, no 6, p. 1603-1619
Keywords [en]
agricultural robotics, color pointcloud, in-field sensing, machine perception, RGB-D registration, stereo IR, vineyard
National Category
Computer Vision and Robotics (Autonomous Systems)
Identifiers
URN: urn:nbn:se:oru:diva-106131DOI: 10.1002/rob.22194ISI: 000991774400001Scopus ID: 2-s2.0-85159844423OAI: oai:DiVA.org:oru-106131DiVA, id: diva2:1761421
Funder
EU, Horizon 2020Available from: 2023-06-01 Created: 2023-06-01 Last updated: 2023-11-28Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Gupta, HimanshuLilienthal, AchimAndreasson, Henrik

Search in DiVA

By author/editor
Gupta, HimanshuLilienthal, AchimAndreasson, Henrik
By organisation
School of Science and Technology
In the same journal
Journal of Field Robotics
Computer Vision and Robotics (Autonomous Systems)

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 34 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf