Pedestrian detection is a key problem in many computer vision applications, especially in surveillance and security systems. To this end, information integration from different imaging modalities, such as thermal infrared and visible spectrum, can significantly improve the detection rate in respect to mono-modal strategies. For this reason, an effective fusion scheme is necessary to combine the information presented by multiple sensors. In this paper, we propose a pedestrian classification method based on the multiple kernel learning framework; standard pixel features (such as spatial derivatives) from both imaging modalities are employed to learn several feature-related basic kernels and a compound kernel is found as an optimized linear combination of basic kernels. Finally the compound kernel is used to train an SVM. Experiments performed on the OTCBVS dataset, demonstrate that our recipe definitely outclasses a wide set of literature fusion modalities.

A Multiple Kernel Learning Approach to Multi-Modal Pedestrian Classification

CRISTANI, Marco;CASTELLANI, Umberto;MURINO, Vittorio
2012-01-01

Abstract

Pedestrian detection is a key problem in many computer vision applications, especially in surveillance and security systems. To this end, information integration from different imaging modalities, such as thermal infrared and visible spectrum, can significantly improve the detection rate in respect to mono-modal strategies. For this reason, an effective fusion scheme is necessary to combine the information presented by multiple sensors. In this paper, we propose a pedestrian classification method based on the multiple kernel learning framework; standard pixel features (such as spatial derivatives) from both imaging modalities are employed to learn several feature-related basic kernels and a compound kernel is found as an optimized linear combination of basic kernels. Finally the compound kernel is used to train an SVM. Experiments performed on the OTCBVS dataset, demonstrate that our recipe definitely outclasses a wide set of literature fusion modalities.
2012
9784990644116
Pedestrian Detection; Fusion; Multiple Kernel Learning
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/472372
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 5
  • ???jsp.display-item.citation.isi??? 2
social impact