Back to Top
Andrzej Pronobis

Overview of the CLEF 2009 Robot Vision Track

A. Pronobis, L. Xing, B. Caputo

In: Multilingual Information Access Evaluation Vol. II Multimedia Experiments (C. Peters, B. Caputo, J. Gonzalo, G. Jones, J. Kalpathy-Cramer, H. Müller, T. Tsikrika, eds.), Volume 6242 of Lecture Notes in Computer Science, Springer, 2010.


The robot vision track has been proposed to the ImageCLEF participants for the first time in 2009 and attracted considerable attention. The track addressed the problem of visual place recognition applied to robot topological localization. Participants were asked to classify rooms of an office environment on the basis of image sequences captured by a perspective camera mounted on a mobile robot. The algorithms proposed by the participants had to answer the question “where are you?” (I am in the kitchen, in the corridor, etc) when presented with a test sequence imaging rooms seen during training, or additional rooms that were not imaged in the training sequence. The participants were asked to solve the problem separately for each test image (obligatory task). Additionally, results could also be reported for algorithms exploiting the temporal continuity of the image sequences (optional task). Robustness of the algorithms was evaluated in presence of variations introduced by changing illumination conditions and dynamic variations observed across a time span of almost two years. The participants submitted 18 runs to the obligatory task, and 9 to the optional task. The best results were obtained by the Idiap Research Institute, Martigny, Switzerland for the obligatory task and the University of Castilla-La Mancha, Albacete, Spain for the optional task.


  author =       {Pronobis, Andrzej and Xing, Li and Caputo, Barbara},
  title =        {Overview of the {CLEF} 2009 {R}obot {V}ision Track},
  booktitle =    {Multilingual Information Access Evaluation Vol. II Multimedia Experiments},
  series =       {Lecture Notes in Computer Science},
  editor =       {Peters, Carol and Caputo, Barbara and Gonzalo, Julio and Jones, Gareth J. F. and Kalpathy-Cramer, Jayashree and M\"{u}ller, Henning and Tsikrika, Theodora},
  pages =        {110-119},
  volume =       6242,
  publisher =    {Springer},
  year =         2010,
  doi =          {10.1007/978-3-642-15751-6_11},
  url =          {}