IP Library › Granted Patent US 12,462,516
Granted Patent B2
US 12,462,516 · App. 18/588,399 · Granted Nov 4, 2025

Methods of estimating a bare body shape from a concealed scan of the body

Inventors: Pengpeng Hu (Ixelles, BE); Adrian Munteanu (Overijse, BE); Nourbakhsh Nastaran (Auderghem, BE); Stephan Sturges (Brussels, BE)
Assignees: VRIJE UNIVERSITEIT BRUSSEL; Treedy's SPRL
G06T19/20G06N3/08G06T13/40G06T2210/16G06T2219/2004G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,516
App. No.
18/588,399
Granted
Nov 4, 2025
Kind
B2
Abstract

Methods are disclosed for generating a training dataset of concealed shapes and corresponding unveiled shapes of a body for training a neural network. These methods may include generating with the aid of computing means a first dataset comprising a plurality of first surface representations representative of a plurality of bare shapes of a plurality of bodies. The plurality of bare shapes are concealed virtually by means of a computer implemented program in order to obtain a plurality of simulated concealed shapes of the plurality of bodies. The plurality of simulated concealed shapes are applied to a scanning simulator, the scanning simulator generating a second dataset comprising a plurality of second surface representations representative of the plurality of simulated concealed shapes.

Claims (28)

1 . A method of estimating a bare shape from a physical concealed shape of a body, the method comprising:

generating a first dataset comprising a plurality of first surface representations representative of a plurality of bare shapes of a plurality of bodies;

virtually concealing the plurality of bare shapes to obtain a plurality of simulated concealed shapes of the plurality of bodies;

applying the plurality of simulated concealed shapes to a scanning simulator, the scanning simulator generating a second dataset comprising a plurality of second surface representations representative of the plurality of simulated concealed shapes;

applying the first dataset and the second dataset to a neural network, wherein the first dataset is considered as a ground truth dataset to train the neural network;

imaging the physical concealed shape with at least one camera device and generating a third surface representation representative of the physical concealed shape, wherein the third surface representation comprises a three-dimensional point cloud; and

applying the third surface representation to the neural network, the neural network outputting a fourth surface representation representative of an estimated bare shape of the body.

2 . The method of claim 1 , wherein the scanning simulator implements a noise model, wherein the noise model adds simulated noise to the plurality of second surface representations, wherein the noise model is representative of a noise signature associated with a three dimensional camera device.

3 . The method of claim 1 , wherein the first surface representations are representative of a plurality of bare shapes assuming a plurality of poses, wherein the neural network outputs the fourth surface representation in substantially a same pose as a pose of the third surface representation.

4 . The method of claim 1 , wherein imaging the physical concealed shape comprises capturing images of the physical concealed shape from multiple points of view.

5 . The method of claim 1 , wherein imaging the physical concealed shape comprises obtaining depth information of the physical concealed shape and wherein the third surface representation is generated based on the depth information.

6 . The method of claim 1 , wherein the physical concealed shape is a dressed human body.

7 . A system, comprising:

a computer implemented with a neural network trained by generating a training dataset of concealed shapes and corresponding bare shapes,

wherein the generating the training dataset comprises:

generating a first dataset comprising a plurality of first surface representations representative of a plurality of bare shapes of a plurality of bodies,

virtually concealing the plurality of bare shapes to obtain a plurality of simulated concealed shapes of the plurality of bodies, and

applying the plurality of simulated concealed shapes to a scanning simulator, the scanning simulator generating a second dataset comprising a plurality of second surface representations representative of the plurality of simulated concealed shapes, and

wherein training the neural network comprises applying the first dataset and the second dataset to the neural network, wherein the first dataset is considered as a ground truth dataset; and

at least one camera device operably coupled to the neural network;

wherein the at least one camera device is configured to capture at least one image a physical concealed shape and feed the at least one image to the computer;

wherein the computer is configured to:

generate a third surface representation representative of the physical concealed shape from the at least one image, wherein the third surface representation comprises a three-dimensional point cloud, and

apply the third surface representation to the neural network, the neural network outputting a fourth surface representation representative of an estimated bare shape of the physical concealed shape.

8 . The system of claim 7 , wherein the neural network is further trained by generating confidence level values associated with nodes of the plurality of second surface representations, and the confidence level values are fed as input to the neural network.

9 . The system of claim 7 , wherein the at least one camera device is configured to capture images of the physical concealed shape from multiple points of view.

10 . The system of claim 7 , configured to obtain depth information of the physical concealed shape from the at least one image.

11 . The system of claim 7 , wherein the physical concealed shape is a dressed human body and the estimated bare shape is an undressed human body.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2024
From: HU, PENGPENG; MUNTEANU, ADRIAN; NASTARAN, NOURBAKHSH; STURGES, STEPHAN
To: VRIJE UNIVERSITEIT BRUSSEL; TREEDY'S SPRL
Reel/Frame 066578/0391 →
Priority Claims (1)
EP 19186137 · Jul 12, 2019 · regional
Continuity (2)
Continuation 17626793
Related Publication 20240193899A1 · Jun 13, 2024
References Cited (32)
US 10282914B1 · Tran et al. · 2019 [cited by applicant]
US 11158121B1 · Tung et al. · 2021 [cited by applicant]
US 20180122146A1 · Black et al. · 2018 [cited by applicant]
US 20180181802A1 · Chen et al. · 2018 [cited by applicant]
US 20210398361A1 · Black et al. · 2021 [cited by applicant]
JP 2005341516A · 2005 [cited by applicant]
JP 2010055301A · 2010 [cited by applicant]
JP 2015184875A · 2015 [cited by applicant]
JP 2015201123A · 2015 [cited by applicant]
WO WO2011156474A2 · 2011 [cited by applicant]
WO WO2015193628A1 · 2015 [cited by applicant]
Abadi, Martin, et al. “Tensorflow: A System for Large-scale Machine Learning”; obtained at 12th USENIX Symposium on Operating Systems Design and Implementation OSDI, 2016. [cited by applicant]
Achlioptas, Panos et al., “Learning Representations and Generative Models for 3Dd Point Clouds”, arXiv:1707.02392v3; Jun. 12, 2018. [cited by applicant]
Anguelov, Dragomir, et al., “SCAPE: Shape Completion and Animation of People”; ACM Transactions on Graphics (TOG), vol. 24, 2005. [cited by applicant]
Endri, Dibra et al., “HS-Nets: Estimating Human Body Shape from Silhouettes with Convolutional Neural Networks”, 2016 Fourth International Conference on 3D Vision (3DV), United States, IEEE, Oct. 25, 2016 (year/month/da… [cited by applicant]
Ge, Liuhao, et al., “Hand PointNet: 3d Hand Pose Estimation Using Point Sets”; obtained at IEEE Conference on Computer Vision and Pattern Recognition, 2018. [cited by applicant]
Groueix, Thibault, et al., “3D-Coded: 3D Correspondences by Deep Deformation,” obtained at European Conference on Computer Vision (ECCV), 2018. [cited by applicant]
Hasler, Nils, et al., “Estimating Body Shape of Dressed Humans”; Computers & Graphics, 2009. [cited by applicant]
Hu, Pengpeng, et al., “Scanning and Animating Characters Dressed in Multiple-layer Garments”; The Visual Computer, vol. 33, 2017. [cited by applicant]
Kanazawa, Angjoo, et al., “End-to-End Recovery of Human Shape and Pose”; obtained at the IEEE Conference on Computer Vision and Pattern Recognition, 2018. [cited by applicant]
Kingma, Diederik P., et al., “A Method for Stochastic Optimization”; obtained at ICLR, 2015. [cited by applicant]
Kowalski, Marek, et al., “Livescan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors,” obtained at International Conference on 3D Vision. IEEE, 2015. [cited by applicant]
Loper, Matthew, et al., “SMPL: A Skinned Multi-Person Linear Model”; ACM Transactions on graphics (TOG), 2015. [cited by applicant]
Oyama Mei et al., “Body Type Estimation from Single Depth Image of a Clothed Person”, IEICE Technical Report, Japan, The Institute of Electronics, Information and Communication Engineers, Jan. 11, 2018. [cited by applicant]
Qi, Charles R., et al., “PointNet: Deep Learing on Point Sets for 3D Classifications and Segmentations”; obtained at IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Stanford University, 2017. [cited by applicant]
Wuhrer, Stefanie, et al., “Estimation of Human Body Shape and Posture Under Clothing, Computer Vision and Image Understanding”, Is. 127, Elsevier, 2014. [cited by applicant]
Yang, Yaoqing, et al., “FoldingNet: Point Cloud Auto-encoder via Deep Grid Deformation”; obtained at IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2018. [cited by applicant]
Yuan, Wentao, et al., “PCN: Point Completion Network”; obtained at International Conference on 3D Vision (3DV), 2018. [cited by applicant]
Alldieck,Thiemo, et al.; “Learning to Reconstruct People in Clothing From a Single RGB Camera”, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, XP033687140, Jun. 15, 2019. [cited by applicant]
Hu, Pengpeng, et al.; Learning to Estimate the Body Shape Under Clothing from a Single 3D Scan, IEEE Transactions on Industrial Informatics, XP055737361, Jan. 1, 2020. [cited by applicant]
Pons-Moll, Gerard, et al.; “ClothCap”, ACM Transactions on Graphics, ACM, NY, US, vol. 36, No. 4, XP058372800, Jul. 20, 2017. [cited by applicant]
Varol, Gul, et al.; “Learning from Synthetic Humans”, arxiv.org, Cornell University Library, 201 Olin Library Cornell University Ithaca, NY 14853, XP081305231, Jan. 5, 2017. [cited by applicant]