umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Performance of RGB-D camera for different object types in greenhouse conditions
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0002-4600-8652
2019 (English)In: 2019 European Conference on Mobile Robots (ECMR) / [ed] Libor Přeučil, Sven Behnke, Miroslav Kulich, IEEE, 2019Conference paper, Published paper (Refereed)
Abstract [en]

RGB-D cameras play an increasingly important role in localization and autonomous navigation of mobile robots. Reasonably priced commercial RGB-D cameras have recently been developed for operation in greenhouse and outdoor conditions. They can be employed for different agricultural and horticultural operations such as harvesting, weeding, pruning and phenotyping. However, the depth information extracted from the cameras varies significantly between objects and sensing conditions. This paper presents an evaluation protocol applied to a commercially available Fotonic F80 time-of-flight RGB-D camera for eight different object types. A case study of autonomous sweet pepper harvesting was used as an exemplary agricultural task. Each of the objects chosen is a possible item that an autonomous agricultural robot must detect and localize to perform well. A total of 340 rectangular regions of interests (ROI) were marked for the extraction of performance measures of point cloud density, and variability around center of mass, 30-100 ROIs per object type. An additional 570 ROIs were generated (57 manually and 513 replicated) to evaluate the repeatability and accuracy of the point cloud. A statistical analysis was performed to evaluate the significance of differences between object types. The results show that different objects have significantly different point density. Specifically metallic materials and black colored objects had significantly less point density compared to organic and other artificial materials introduced to the scene as expected. The point cloud variability measures showed no significant differences between object types, except for the metallic knife that presented significant outliers in collected measures. The accuracy and repeatability analysis showed that 1-3 cm errors are due to the the difficulty for a human to annotate the exact same area and up to ±4 cm error is due to the sensor not generating the exact same point cloud when sensing a fixed object.

Place, publisher, year, edition, pages
IEEE, 2019.
Keywords [en]
agriculture, cameras, feature extraction, greenhouses, image colour analysis, image sensors, industrial robots, mobile robots, object tracking, robot vision, statistical analysis, pruning, sensing conditions, evaluation protocol, object types, autonomous sweet pepper harvesting, exemplary agricultural task, autonomous agricultural robot, ROI, point cloud density, object type, point density, black colored objects, point cloud variability measures, fixed object, greenhouse conditions, autonomous navigation, mobile robots, agricultural operations, horticultural operations, commercial RGB-D cameras, Fotonic F80 time-of-flight RGB-D camera, size 4.0 cm, size 1.0 cm to 3.0 cm, Cameras, Three-dimensional displays, Robot vision systems, End effectors, Green products
National Category
Computer Vision and Robotics (Autonomous Systems)
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:umu:diva-165545DOI: 10.1109/ECMR.2019.8870935Scopus ID: 2-s2.0-85074395978OAI: oai:DiVA.org:umu-165545DiVA, id: diva2:1373093
Conference
European Conference on Mobile Robots (ECMR), September 4–6, 2019, Prague, Czech Republic
Funder
Knowledge FoundationEU, Horizon 2020, 66313Available from: 2019-11-26 Created: 2019-11-26 Last updated: 2019-11-27Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records BETA

Ringdahl, Ola

Search in DiVA

By author/editor
Ringdahl, OlaKurtser, Polina
By organisation
Department of Computing Science
Computer Vision and Robotics (Autonomous Systems)

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 24 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf