Human pose estimation (HPE) from images and videos is an essential part of motion analysis and is increasingly used in various fields, ranging from Healthcare to Industry 5.0. Nevertheless, such CNN-based model has an intrinsic inaccuracy, which sources include insufficient CNN training, sensor low- quality, inadequate computational capability for the inference phase, or heavy occlusions in the real scene. Several techniques are continuously proposed to increase the HPE accuracy. They focus on more advanced convolutional neural networks (CNN), smarter training, or denoising and completion procedures. State- of-the-art methods to measure the system accuracy usually rely on testsets that differ from the specific conditions faced in the final real-world deployment and on solution-oriented evaluation metrics. This makes the evaluation of the accuracy of such platforms in real application scenarios imprecise and biased. To solve this problem, we propose an automatic verification platform in which the different types of inaccuracy sources are represented by error models and implemented by software mutants. The platform injects the mutants to simulate the inaccuracy and measures, through a large set of key indicators and statistics, the HPE software robustness. We evaluated our verification methodology on a popular HPE dataset with a state-of-the-art pose estimator.

A Verification Platform for Human Pose Estimation Models

Stefano Aldegheri;Michele Boldo;Chiara Bozzini;Mirco De Marchi;Roberto Di Marco;Enrico Martini;Nicola Bombieri
2024-01-01

Abstract

Human pose estimation (HPE) from images and videos is an essential part of motion analysis and is increasingly used in various fields, ranging from Healthcare to Industry 5.0. Nevertheless, such CNN-based model has an intrinsic inaccuracy, which sources include insufficient CNN training, sensor low- quality, inadequate computational capability for the inference phase, or heavy occlusions in the real scene. Several techniques are continuously proposed to increase the HPE accuracy. They focus on more advanced convolutional neural networks (CNN), smarter training, or denoising and completion procedures. State- of-the-art methods to measure the system accuracy usually rely on testsets that differ from the specific conditions faced in the final real-world deployment and on solution-oriented evaluation metrics. This makes the evaluation of the accuracy of such platforms in real application scenarios imprecise and biased. To solve this problem, we propose an automatic verification platform in which the different types of inaccuracy sources are represented by error models and implemented by software mutants. The platform injects the mutants to simulate the inaccuracy and measures, through a large set of key indicators and statistics, the HPE software robustness. We evaluated our verification methodology on a popular HPE dataset with a state-of-the-art pose estimator.
2024
human pose estimation
model verification
noise injection
platform benchmarking
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/1125412
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact