The detection of groups of individuals is attracting the attention of many researchers in diverse fields, from surveillance to social robotics, with a growing number of approaches published every year. Unexpectedly, the evaluation metrics for this problem are not consolidated, with some measures being inherited from the people detection field, others come from clustering or were designed specifically for a particular approach, thus lacking in generalization and making the comparisons hard to be carried out. Moreover, the existent metrics are scarcely expressive, ignoring, for example, the fact that groups have different cardinalities, and that, obviously, larger groups are harder to find. This work fills this gap by presenting the GROup DEtection (GRODE) metrics, which formally define precision and recall on the groups, including the group cardinality as a variable. This gives the possibility to investigate aspects never considered so far, such as the tendency of a method of over- or undersegmenting groups, or of better dealing with specific group cardinalities. The GRODE metrics have been applied to all the publicly available approaches of group detection, on several datasets, discovering interesting strengths and pitfalls so far neglected from the state-of-the-art metrics.

The GRODE Metrics

Setti, Francesco;Cristani, Marco
2017-01-01

Abstract

The detection of groups of individuals is attracting the attention of many researchers in diverse fields, from surveillance to social robotics, with a growing number of approaches published every year. Unexpectedly, the evaluation metrics for this problem are not consolidated, with some measures being inherited from the people detection field, others come from clustering or were designed specifically for a particular approach, thus lacking in generalization and making the comparisons hard to be carried out. Moreover, the existent metrics are scarcely expressive, ignoring, for example, the fact that groups have different cardinalities, and that, obviously, larger groups are harder to find. This work fills this gap by presenting the GROup DEtection (GRODE) metrics, which formally define precision and recall on the groups, including the group cardinality as a variable. This gives the possibility to investigate aspects never considered so far, such as the tendency of a method of over- or undersegmenting groups, or of better dealing with specific group cardinalities. The GRODE metrics have been applied to all the publicly available approaches of group detection, on several datasets, discovering interesting strengths and pitfalls so far neglected from the state-of-the-art metrics.
2017
9780128092767
F-formation, Group detection, Performance metrics
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/971090
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact