Skip to Main content Skip to Navigation
Conference papers

Multitask Metamodel for Keypoint Visibility Prediction in Human Pose Estimation

Abstract : The task of human pose estimation (HPE) aims to predict the coordinates of body keypoints in images. Even if nowadays, we achieve high performance on HPE, some difficulties remain to be fully overcome. For instance, a strong occlusion can deceive the methods and make them predict false-positive keypoints with high confidence. This can be problematic in applications that require reliable detection, such as posture analysis in car-safety applications. Despite this difficulty, actual HPE solutions are designed to always predict coordinates for each keypoint. To answer this problem, we propose a new metamodel that predicts both keypoints coordinates and their visibility. Visibility is an attribute that indicates if a keypoint is visible, non-visible, or not labeled. Our model is composed of three modules: the feature extraction, the coordinate estimation, and the visibility prediction modules. We study in this paper the performance of the visibility predictions and the impact of this task on the coordinate estimation. Baseline results are provided on the COCO dataset. Moreover, to measure the performance of this method in a more occluded context, we also use the driver dataset DriPE. Finally, we implement the proposed metamodel on several base models to demonstrate the general aspect of our metamodel.
Complete list of metadata
Contributor : Romain Guesdon Connect in order to contact the contributor
Submitted on : Wednesday, December 8, 2021 - 4:58:02 PM
Last modification on : Monday, May 16, 2022 - 2:10:58 PM
Long-term archiving on: : Wednesday, March 9, 2022 - 7:15:56 PM


Files produced by the author(s)


  • HAL Id : hal-03471147, version 1


Romain Guesdon, Carlos Crispim-Junior, Laure Tougne. Multitask Metamodel for Keypoint Visibility Prediction in Human Pose Estimation. International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), Feb 2022, Virtual Conference, France. ⟨hal-03471147⟩



Record views


Files downloads