umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Object Classification and Image Labeling using RGB-Depth Information
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2013 (English)Licentiate thesis, comprehensive summary (Other academic)Alternative title
Klassificering av föremål och bildmärkning med hjälp av RGB-djup-information (Swedish)
Abstract [en]

This thesis is part of research for the vision systems of four robots in the EU funded project, CROPS[l], where the robots should harvest apples, sweet peppers and grapes, and explore forests. The whole process of designing such a system, including the software architecture, creation of the image database, image labeling and object detection, is presented.

The software architecture chapter of this thesis provides a review of some of the latest frameworks for robotics. It describes the structure of robetics components and the communication systems between them. The vision system is a subsystem of the robetics architecture studied in conjunction with other components of the robetics system. To build a vision system, three main steps should be taken. First a collection of images that are similar to what the robots are expected to meet should be created. Second, all the images should be labeled manually or automatically. Finally, learning systems should use the labeled images to build object medels. Details about these steps make up the majority of the content in this thesis. With new widely available low-cost sensors such as Microsoft Kinect, it is possible to use depth imagesalong with RGB images to increase the performance of vision systems. We particularly focus on various methods that integrate depth information in the three steps that are mentioned for building a vision system. More specifically, the image labeling tools help to extract objects in images to be used as ground truth for learning and testing processes in object detection. The inputs for such tools are usually RGB images. Despite the existence of many powerful tools for image labeling, there is still a need for RGB-Depth adapted tools. We present a new interactive labeling tool that partially automates image labeling, with two major contributions. First, the method extends the concept of image segmentatian from RGB to RGB-Depth. Second, it minimizes the interadion time needed for object extraction by using a highly efficient segmentatian method in RGB-Depth space. The ent~re procedure requires very few elieks campared to other already existing tools. In fact, when the desired object is the dosest object to the camera, as is the case in our forestry application, no click is required to extract the object. Finally, while we present state of the art in object detection with 2D environments, object detection using RGB-depth information is mainly addressed for future work.

Place, publisher, year, edition, pages
Umeå: Department of Computing Science, Umeå University , 2013. , 62 p.
National Category
Robotics
Identifiers
URN: urn:nbn:se:umu:diva-71477ISBN: 978-91-7459-657-1 (print)ISBN: 978-91-7459-658-8 (print)OAI: oai:DiVA.org:umu-71477DiVA: diva2:624199
Presentation
2013-05-06, MIT-building, MC313, Umeå University, Umeå, 13:00 (English)
Supervisors
Available from: 2013-05-30 Created: 2013-05-30 Last updated: 2013-05-30Bibliographically approved
List of papers
1. Robotics architecture frameworks, available tools and further requirements
Open this publication in new window or tab >>Robotics architecture frameworks, available tools and further requirements
2013 (English)Report (Other academic)
Abstract [en]

For every robotics project, choosing a suitable framework and middleware for software and hardware is a challenging task which may influence the entire project. Robotics applications typically are resource constrained when it comes to computations and memory usage. They are built on different hardware platforms and applied in different domains. Therefore it is hard to introduce a common framework for all types of projects. However, in recent years several new attempts have been made and received attention from both researchers and industry. These frameworks are still under development and need to be extended. This paper discusses the different features that are needed for robotics frameworks and compares some of the available middleware and standards.

Place, publisher, year, edition, pages
Umeå: Department of Computing Science, Umeå University, 2013. 6 p.
Series
UMINF, ISSN 0348-0542 ; 13.02
Keyword
ROS, MRDS, Middleware
National Category
Robotics
Identifiers
urn:nbn:se:umu:diva-71438 (URN)
Available from: 2013-05-29 Created: 2013-05-29 Last updated: 2013-05-31Bibliographically approved
2. Semi-automatic image labeling using depth information
Open this publication in new window or tab >>Semi-automatic image labeling using depth information
(English)Manuscript (preprint) (Other academic)
National Category
Computer and Information Science
Identifiers
urn:nbn:se:umu:diva-71440 (URN)
Available from: 2013-05-29 Created: 2013-05-29 Last updated: 2013-05-30Bibliographically approved
3. Integrating kinect depth data with a stochastic object classification framework for forestry robots
Open this publication in new window or tab >>Integrating kinect depth data with a stochastic object classification framework for forestry robots
2012 (English)In: Proceedings of the 9th International Conference on Informatics in Control, Automation and Robotics: Volume 2, SciTePress , 2012, 314-320 p.Conference paper, Published paper (Other academic)
Place, publisher, year, edition, pages
SciTePress, 2012
National Category
Robotics
Identifiers
urn:nbn:se:umu:diva-71443 (URN)
Conference
9th International Conference on Informatics in Control, Automation and Robotics, 28-31 July 2012, Rome, Italy
Available from: 2013-05-29 Created: 2013-05-29 Last updated: 2013-05-30Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Pordel, Mostafa
By organisation
Department of Computing Science
Robotics

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 224 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf