In-field grape cluster size assessment for vine yield estimation using a mobile robot and a consumer level RGB-D cameraShow others and affiliations
2020 (English)In: IEEE Robotics and Automation Letters, E-ISSN 2377-3766, Vol. 5, no 2, p. 2031-2038Article in journal (Refereed) Published
Abstract [en]
Current practice for vine yield estimation is based on RGB cameras and has limited performance. In this paper we present a method for outdoor vine yield estimation using a consumer grade RGB-D camera mounted on a mobile robotic platform. An algorithm for automatic grape cluster size estimation using depth information is evaluated both in controlled outdoor conditions and in commercial vineyard conditions. Ten video scans (3 camera viewpoints with 2 different backgrounds and 2 natural light conditions), acquired from a controlled outdoor experiment and a commercial vineyard setup, are used for analyses. The collected dataset (GRAPES3D) is released to the public. A total of 4542 regions of 49 grape clusters were manually labeled by a human annotator for comparison. Eight variations of the algorithm are assessed, both for manually labeled and auto-detected regions. The effect of viewpoint, presence of an artificial background, and the human annotator are analyzed using statistical tools. Results show 2.8-3.5 cm average error for all acquired data and reveal the potential of using lowcost commercial RGB-D cameras for improved robotic yield estimation.
Place, publisher, year, edition, pages
IEEE , 2020. Vol. 5, no 2, p. 2031-2038
Keywords [en]
Field Robots, RGB-D Perception, Agricultural Automation, Robotics in Agriculture and Forestry
National Category
Computer Vision and Robotics (Autonomous Systems)
Research subject
computer and systems sciences
Identifiers
URN: urn:nbn:se:oru:diva-80966DOI: 10.1109/LRA.2020.2970654ISI: 000526520700001Scopus ID: 2-s2.0-85079829054OAI: oai:DiVA.org:oru-80966DiVA, id: diva2:1421196
Funder
Knowledge Foundation
Note
Funding Agencies:
Israeli Ministry of Science 20187
Ben Gurion University of the Negev through the Helmsley Charitable Trust
Agricultural, Biological and Cognitive Robotics Initiative
Marcus Endowment Fund
Rabbi W. Gunther Plaut Chair in Manufacturing Engineering
2020-04-022020-04-022024-01-17Bibliographically approved