Multi-modal Semantic Place Classification

A. Pronobis, O. Mozos, B. Caputo, P. Jensfelt

In: International Journal of Robotics Research (IJRR), Special Issue on Robotic Vision, 29(2-3), 2010.

About

Paper: PDF
DOI: 10.1177/0278364909356483

The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environment. The system effectively utilizes information from different robotic sensors by fusing multiple visual cues and laser range data. This is achieved using a high-level cue integration scheme based on a Support Vector Machine (SVM) that learns how to optimally combine and weight each cue. Our multi-modal place classification approach can be used to obtain a real-time semantic space labeling system which integrates information over time and space. We perform an extensive experimental evaluation of the method for two different platforms and environments, on a realistic off-line database and in a live experiment on an autonomous robot. The results clearly demonstrate the effectiveness of our cue integration scheme and its value for robust place classification under varying conditions.

BibTeX

COPY DOWNLOAD

@article{pronobis2010ijrr,
  author =       {Pronobis, Andrzej and Mozos, Oscar M. and Caputo, Barbara and Jensfelt, Patric},
  title =        {Multi-modal Semantic Place Classification},
  journal =      {International Journal of Robotics Research (IJRR), Special Issue on Robotic Vision},
  year =         2010,
  volume =       29,
  number =       {2-3},
  month =        feb,
  pages =        {298-320},
  doi =          {10.1177/0278364909356483},
  url =          {http://www.pronobis.pro/publications/pronobis2010ijrr}
}