Human Pose Estimation is a low-level task useful for surveillance, human action recognition, and scene understanding at large. It also offers promising perspectives for the animation of synthetic characters. For all these applications, and especially the latter, estimating the positions of many joints is desirable for improved performance and realism. To this purpose, we propose a novel method called JUMPS for increasing the number of joints in 2D pose estimates and recovering occluded or missing joints. We believe this is the first attempt to address the issue. We build on a deep generative model that combines a Generative Adversarial Network (GAN) and an encoder. The GAN learns the distribution of high-resolution human pose sequences, the encoder maps the input low-resolution sequences to its latent space. Inpainting is obtained by computing the latent representation whose decoding by the GAN generator optimally matches the joints locations at the input. Post-processing a 2D pose sequence using our method provides a richer representation of the character motion. We show experimentally that the localization accuracy of the additional joints is on average on par with the original pose estimates.
A Generative Adversarial Approach for 2D Human Pose Estimation Completion and Upsampling
A Generative Adversarial Approach for 2D Human Pose Estimation Completion and Upsampling
A Generative Adversarial Approach for 2D Human Pose Estimation Completion and Upsampling
Research Paper / Sep 2020
Related Content
White Paper /May 2025
Media over Wireless: Networks for Ubiquitous Video
Research Paper /Mar 2025
To realize the objectives of Integrated Sensing and
Communication (ISAC) in 6G, there is a need to introduce
new functionalities in 6G core (6GC) architecture that are
dynamic and resource-efficient. In ISAC, sensing signals are used by a Sensing Receiver (SRx) to measure and report Sensing Data Points (SDPs) to the network. However, a direct approach involving …
Research Paper /Mar 2025
This paper proposes a method that enhances the compression performance of the current model under development for the upcoming MPEG standard on Feature Compression for Machines (FCM).
This standard aims at providing inter-operable compressed bitstreams of features in the context of split computing, i.e., when the inference of a large computer vision Neural-Netwo…
Webinar /Jun 2024
Blog Post /Jun 2025
Blog Post /Jun 2025