IP Library Granted Patent US 10,310,616
Granted Patent B2
US 10,310,616 · App. 14/675,241 · Granted Jun 4, 2019

Modification of three-dimensional garments using gestures

Inventors: Kyle Smith Rose (West Jordan, UT); Pooja Sapra (Midvale, UT); Vivienne Melody Blue (Salt Lake City, UT); Chuck Barnum (Herriman, UT); Giridhar Singam (Taylorsville, UT); Chris Miller (North Salt Lake, UT); Rachel Maxine Minenno (Sandy, UT); James Stephen Perrine (Sandy, UT)
Assignee: eBay Inc.
G06F3/017G06F3/0304G06F3/04815G06F17/5009G06Q30/0643G06T13/40G06T19/20G06T2210/16G06T2219/2016G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,310,616
App. No.
14/675,241
Granted
Jun 4, 2019
Kind
B2
Abstract

Techniques for modifying a garment based on gestures are presented herein. An access module can access a first set of sensor data from a first sensor, and a second set of sensor data from a second sensor. A garment simulation module can generate a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data. A display module can cause a presentation, on a display of a device, of the 3D garment model draped on the avatar. Additionally, the garment simulation module can determine a modification gesture associated with the 3D garment model draped on the avatar based on the first set of sensor data and the second set of sensor data. Furthermore, the garment simulation module can modify the 3D garment model based on the determined modification gesture.

Claims (62)

1. A method comprising:

accessing a first set of sensor data from a first sensor;

accessing a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor;

generating a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data;

causing a presentation, on a display of a device, of the 3D garment model draped on the avatar;

detecting a section-specific garment-fit modification gesture in relation to a section of the 3D garment model draped on the avatar based on the first set of sensor data and the second set of sensor data, including:

identifying a difference between initial and final sensor data of the first set of sensor data with respect to the section of the 3D garment model, the initial sensor data received at a first time and the final sensor data received at a second time; and

determining the section specific garment-fit modification gesture based on the identified difference; and

modifying the 3D garment model by tailoring the section of the 3D garment model as draped on the avatar according to the detected section-specific garment-fit modification gesture, the tailoring including at least one alteration effective to modify the section of the 3D garment model to produce a custom size from a manufacturer-predefined size.

2. The method of claim 1 , wherein generating the 3D garment model draped on the avatar includes:

generating the avatar based on the first set of sensor data and the second set of sensor data; and

draping the 3D garment model of the garment available for sale on the generated avatar.

3. The method of claim 2 , further comprising:

accessing the 3D garment model from a garment model database included as part of an electronic marketplace, the 3D garment model having a material property; and

calculating a simulated force acting on the 3D garment model based on the material property, the 3D garment model being draped on the avatar based on the calculated simulated force.

4. The method of claim 2 , further comprising determining a size for the garment available for sale based on the generated avatar.

5. The method of claim 1 , further comprising updating the presentation, on the display of the device, of the modified 3D garment model draped on the avatar.

6. The method of claim 5 , further comprising:

determining a confirmation gesture for the modified 3D garment model based on the first set of sensor data and the second set of sensor data; and

transmitting a request to modify the garment available for sale based on the determined confirmation gesture.

7. The method of claim 1 , wherein the first sensor includes a depth sensor, a red-green-blue (RGB) camera, and a microphone.

8. The method of claim 1 , further comprising:

accessing a third set of sensor data from a third sensor, wherein the first sensor, the second sensor, and the third sensor are positioned in a triangle configuration;

wherein generating the 3D garment model draped on the avatar is further based on the third set of sensor data; and

wherein detecting the section-specific garment-fit modification gesture is further based on the third set of sensor data.

9. The method of claim 1 , wherein the first set of sensor data includes a two-dimensional (2D) range image, the 2D range image having pixel values corresponding to distance information for depicted objects in relation to the first sensor.

10. The method of claim 1 , wherein generating the 3D garment model draped on the avatar is performed by a graphics processing unit.

11. The method of claim 1 , wherein accessing the first set of sensor data from the first sensor is performed by a wireless transceiver.

12. The method of claim 1 , wherein the section-specific garment-fit modification gesture includes at least one of a hand pulling gesture, a hand stretching gesture, a hand pinching gesture, a pinching and pulling gesture, and a pinching and tucking gesture.

13. The method of claim 12 , wherein the at least one alteration includes at least one of elongating the section of the 3D garment model based on the hand pulling gesture, elongating the section of the 3D garment model based on the hand stretching gesture, shortening the section of the 3D garment model based on the hand stretching gesture, converting the 3D garment model to a smaller size that is not predefined by a manufacturer based on the pinching and pulling gesture, or converting the 3D garment model to a larger size that is not predefined by the manufacturer based on the pinching and tucking gesture.

14. The method of claim 1 , further comprising:

determining at least one garment fit for the avatar based on the first set of sensor data and the second set of sensor data;

determining that manufacturer-predefined sizes of the garment available for sale do not fit the avatar based on the determined at least one garment fit; and

responsive to determining that the manufacturer-predefined sizes do not fit the avatar, performing at least one of:

communicating custom sizing information indicative of the at least one garment fit to the manufacturer; and

modifying the 3D garment model by tailoring the 3D garment model from the manufacturer-predefined size to the custom size based on the at least one garment fit.

15. A system comprising:

an access module configured to:

access a first set of sensor data from a first sensor; and

access a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor;

at least one processor of a garment simulation module configured to generate a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data;

a display module configured to cause a presentation, on a display of a device, of the 3D garment model draped on the avatar; and

the garment simulation module further configured to:

identify, with respect to a section of the 3D garment model draped on the avatar, a difference between initial sensor data and final sensor data of the first set of sensor data, the initial sensor data received at a first time and the final sensor data received at a second time;

determine a section-specific garment-fit modification gesture in relation to the section based on the identified difference; and

modify the 3D garment model by tailoring the section of the 3D garment model as draped on the avatar according to the determined section-specific garment-fit modification gesture, the tailoring including at least one alteration in relation to the section effective to modify the 3D garment model from a manufacturer-predefined size to a custom size.

16. The system of claim 15 , wherein the display module is further configured to update the presentation, on the display of the device, of the modified 3D garment model draped on the avatar.

17. The system of claim 15 , wherein the garment simulation module is further configured to:

determine a confirmation gesture for the modified 3D garment model based on the first set of sensor data and the second set of sensor data; and

transmit a request to modify the garment available for sale based on the determined confirmation gesture.

18. The system of claim 15 , wherein the section-specific garment-fit modification gesture includes at least one of a hand pulling gesture, a hand stretching gesture, a hand pinching gesture, a pinching and pulling gesture, and a pinching and tucking gesture.

19. The system of claim 18 , wherein the at least one alteration includes at least one of elongating the section of the 3D garment model based on the hand pulling gesture, elongating the section of the 3D garment model based on the hand stretching gesture, shortening the section of the 3D garment model based on the hand stretching gesture, converting the 3D garment model to a smaller size that is not predefined by a manufacturer based on the pinching and pulling gesture, or converting the 3D garment model to a larger size that is not predefined by the manufacturer based on the pinching and tucking gesture.

20. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing a first set of sensor data from a first sensor;

accessing a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor;

generating a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data;

determining at least one garment fit for the avatar based on the first set of sensor data and the second set of sensor data;

determining that manufacturer-predefined sizes of the garment available for sale do not fit the avatar based on the determined at least one garment fit; and

responsive to determining that the manufacturer-predefined sizes do not fit the avatar, performing at least one of:

communicating custom sizing information indicative of the at least one garment fit to the manufacturer; and

modifying the 3D garment model by tailoring the 3D garment model from a manufacturer-predefined size to a custom size based on the at least one garment fit; and

causing a presentation, on a display of a device, of the 3D garment model having the custom size draped on the avatar.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2018
From: ROSE, KYLE SMITH; SAPRA, POOJA; BARNUM, CHUCK; SINGAM, GIRIDHAR; MILLER, CHRIS; MINENNO, RACHEL MAXINE; PERRINE, JAMES STEPHEN
To: EBAY INC.
Reel/Frame 045686/0372 →
EMPLOYEE AGREEMENT Recorded May 1, 2018
From: WATTS, DAVIN BLUE
To: EBAY INC.
Reel/Frame 046051/0880 →
Continuity (1)
Related Publication 20160292779A1 · Oct 6, 2016
Cited By (2)
US 1,080,673 US 12,379,784