IP Library › Granted Patent US 11,922,593
Granted Patent B2
US 11,922,593 · App. 17/626,793 · Granted Mar 5, 2024

Methods of estimating a bare body shape from a concealed scan of the body

Inventors: Pengpeng Hu (Ixelles, BE); Adrian Munteanu (Overijse, BE); Nourbakhsh Nastaran (Auderghem, BE); Stephan Sturges (Brussels, BE)
Assignees: VRIJE UNIVERSITEIT BRUSSEL; Treedy's SPRL
G06T19/20G06N3/08G06T13/40G06T2210/16G06T2219/2004G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,593
App. No.
17/626,793
Granted
Mar 5, 2024
Kind
B2
Abstract

Methods are disclosed for generating a training dataset of concealed shapes and corresponding unveiled shapes of a body for training a neural network. These methods may include generating with the aid of computing means a first dataset comprising a plurality of first surface representations representative of a plurality of bare shapes of a plurality of bodies. The plurality of bare shapes are concealed virtually by means of a computer implemented program in order to obtain a plurality of simulated concealed shapes of the plurality of bodies. The plurality of simulated concealed shapes are applied to a scanning simulator, the scanning simulator generating a second dataset comprising a plurality of second surface representations representative of the plurality of simulated concealed shapes.

Claims (37)

1. A computer-implemented method of generating a training dataset of concealed shapes and corresponding unveiled shapes of a body for training a neural network, the method comprising:

generating a first dataset comprising a plurality of first surface representations representative of a plurality of bare shapes of a plurality of bodies;

virtually concealing the plurality of bare shapes to obtain a plurality of simulated concealed shapes of the plurality of bodies;

applying the plurality of simulated concealed shapes to a scanning simulator, the scanning simulator generating a second dataset comprising a plurality of second surface representations representative of the plurality of simulated concealed shapes; and

generating confidence level values associated with nodes of the plurality of second surface representations, wherein the second surface representations are second point clouds and the confidence level values are associated with points of the second point clouds.

2. The method of claim 1 , wherein the first surface representations are representative of a plurality of bare shapes assuming a plurality of poses.

3. The method of claim 1 , wherein the simulated concealed shapes comprise multi-layer surfaces.

4. The method of claim 3 , wherein the scanning simulator converts the simulated concealed shapes comprising the multi-layer surfaces into the second surface representations representing single layer surfaces.

5. The method of claim 1 , wherein the scanning simulator is a photogrammetry-based simulator.

6. The method of claim 1 , wherein the scanning simulator implements a noise model, wherein the noise model adds simulated noise to the plurality of second surface representations.

7. The method of claim 1 , wherein the scanning simulator implements a plurality of camera simulators arranged at corners of a polygon, wherein the simulated concealed shapes are arranged in a center of the polygon, wherein the plurality of camera simulators image the simulated concealed shapes from different viewing angles.

8. The method of claim 1 , wherein the plurality of bare shapes are representative of a plurality of undressed shapes of a plurality of human or animal bodies, and wherein virtually concealing comprises virtually dressing the plurality of undressed shapes, wherein the plurality of simulated concealed shapes are a plurality of simulated dressed shapes of the plurality of human or animal bodies.

9. The method of claim 8 , wherein the plurality of simulated dressed shapes comprises simulated dressed shapes in a plurality of clothing styles.

10. The method of claim 1 , further comprising:

training a neural network, wherein training the neural network comprises applying the first dataset and the second dataset to the neural network, wherein the first dataset is considered as a ground truth dataset;

wherein the confidence level values are fed as input to the neural network.

11. A method of estimating a bare shape from a physical concealed shape of a body, the method comprising:

generating a first dataset comprising a plurality of first surface representations representative of a plurality of bare shapes of a plurality of bodies;

virtually concealing the plurality of bare shapes to obtain a plurality of simulated concealed shapes of the plurality of bodies;

applying the plurality of simulated concealed shapes to a scanning simulator, the scanning simulator generating a second dataset comprising a plurality of second surface representations representative of the plurality of simulated concealed shapes;

applying the first dataset and the second dataset to a neural network, wherein the first dataset is considered as a ground truth dataset to train the neural network;

scanning the physical concealed shape with a three dimensional camera device and generating a third surface representation representative of the physical concealed shape; and

applying the third surface representation to the neural network, the neural network outputting a fourth surface representation representative of an estimated bare shape of the body.

12. The method of claim 11 , wherein the scanning simulator implements a noise model, wherein the noise model adds simulated noise to the plurality of second surface representations, wherein the noise model is representative of a noise signature associated with the three dimensional camera device.

13. The method of claim 11 , wherein the first surface representations are representative of a plurality of bare shapes assuming a plurality of poses, wherein the neural network outputs the fourth surface representation in substantially a same pose as a pose of the third surface representation.

14. A system, comprising:

a computer implemented with a neural network trained by generating a training dataset of concealed shapes and corresponding bare shapes,

wherein the generating the training dataset comprises:

generating a first dataset comprising a plurality of first surface representations representative of a plurality of bare shapes of a plurality of bodies,

virtually concealing the plurality of bare shapes to obtain a plurality of simulated concealed shapes of the plurality of bodies, and

applying the plurality of simulated concealed shapes to a scanning simulator, the scanning simulator generating a second dataset comprising a plurality of second surface representations representative of the plurality of simulated concealed shapes, and

wherein training the neural network comprises applying the first dataset and the second dataset to the neural network, wherein the first dataset is considered as a ground truth dataset; and

a three dimensional camera device operably coupled to the neural network;

wherein the computer is configured to:

scan one of the concealed shapes using the three dimensional camera device and generate a third surface representation representative of the concealed shape, and

apply the third surface representation to the neural network, the neural network outputting a fourth surface representation representative of an estimated bare shape of the body.

15. The system of claim 14 , wherein the neural network is further trained by generating confidence level values associated with nodes of the plurality of second surface representations, and the confidence level values are fed as input to the neural network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2022
From: HU, PENGPENG; MUNTEANU, ADRIAN; NASTARAN, NOURBAKHSH; STURGES, STEPHAN
To: VRIJE UNIVERSITEIT BRUSSEL; TREEDY'S SPRL
Reel/Frame 059732/0082 →
Priority Claims (1)
EP 19186137 · Jul 12, 2019 · regional
Continuity (1)
Related Publication 20220245911A1 · Aug 4, 2022