oru.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Semantic mapping using virtual sensors and fusion of aerial images with sensor data from a ground vehicle
Örebro University, Department of Technology.
2008 (English)Doctoral thesis, monograph (Other academic)
Abstract [en]

In this thesis, semantic mapping is understood to be the process of putting a tag or label on objects or regions in a map. This label should be interpretable by and have a meaning for a human. The use of semantic information has several application areas in mobile robotics. The largest area is in human-robot interaction where the semantics is necessary for a common understanding between robot and human of the operational environment. Other areas include localization through connection of human spatial concepts to particular locations, improving 3D models of indoor and outdoor environments, and model validation.

This thesis investigates the extraction of semantic information for mobile robots in outdoor environments and the use of semantic information to link ground-level occupancy maps and aerial images. The thesis concentrates on three related issues: i) recognition of human spatial concepts in a scene, ii) the ability to incorporate semantic knowledge in a map, and iii) the ability to connect information collected by a mobile robot with information extracted from an aerial image.

The first issue deals with a vision-based virtual sensor for classification of views (images). The images are fed into a set of learned virtual sensors, where each virtual sensor is trained for classification of a particular type of human spatial concept. The virtual sensors are evaluated with images from both ordinary cameras and an omni-directional camera, showing robust properties that can cope with variations such as changing season.

In the second part a probabilistic semantic map is computed based on an occupancy grid map and the output from a virtual sensor. A local semantic map is built around the robot for each position where images have been acquired. This map is a grid map augmented with semantic information in the form of probabilities that the occupied grid cells belong to a particular class. The local maps are fused into a global probabilistic semantic map covering the area along the trajectory of the mobile robot.

In the third part information extracted from an aerial image is used to improve the mapping process. Region and object boundaries taken from the probabilistic semantic map are used to initialize segmentation of the aerial image. Algorithms for both local segmentation related to the borders and global segmentation of the entire aerial image, exemplified with the two classes ground and buildings, are presented. Ground-level semantic information allows focusing of the segmentation of the aerial image to desired classes and generation of a semantic map that covers a larger area than can be built using only the onboard sensors.

Place, publisher, year, edition, pages
Örebro: Örebro universitet , 2008. , p. 170
Series
Örebro Studies in Technology, ISSN 1650-8580 ; 30
Keywords [en]
semantic mapping, aerial image, mobile robot, supervised learning, semi-supervised learning
National Category
Engineering and Technology
Research subject
Industrial Measurement Technology
Identifiers
URN: urn:nbn:se:oru:diva-2186ISBN: 978-91-7668-593-8 (print)OAI: oai:DiVA.org:oru-2186DiVA, id: diva2:135976
Public defence
2008-09-12, Hörsal T, Teknikhuset, Örebro, 13:00 (English)
Opponent
Supervisors
Available from: 2008-05-28 Created: 2008-05-28 Last updated: 2017-10-18Bibliographically approved

Open Access in DiVA

cover(294 kB)68 downloads
File information
File name COVER01.pdfFile size 294 kBChecksum MD5
7c49a9da7a9912ee6acc2790b1bec1ff6688756949c32fa4cb0eb3b874493e4d987e40b0
Type coverMimetype application/pdf
errata(10 kB)35 downloads
File information
File name ERRATA01.pdfFile size 10 kBChecksum MD5
82244ea3dc29882a1285acd93f66b6dcfe1a1e45932ea0a2c2bc3a0832edd9330a75eb05
Type errataMimetype application/pdf
fulltext(2240 kB)1973 downloads
File information
File name FULLTEXT01.pdfFile size 2240 kBChecksum MD5
213742fea6cd17a498dd41514da1f0b81d460f73b5d9007ffcf938f518d1e956947aded1
Type fulltextMimetype application/pdf

Authority records BETA

Persson, Martin

Search in DiVA

By author/editor
Persson, Martin
By organisation
Department of Technology
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 1973 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 839 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf