IP Library Granted Patent US 11,062,508
Granted Patent B1
US 11,062,508 · App. 16/297,445 · Granted Jul 13, 2021

Creating a custom three-dimensional body shape model

Inventor: Christopher Erick Moody (Oakland, CA)
Assignee: Stitch Fix, Inc.
G06T17/00A41H1/02G06T7/174G06T7/194G06T15/60G06T2207/10024G06T2207/10028G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,062,508
App. No.
16/297,445
Granted
Jul 13, 2021
Kind
B1
Abstract

A series of captured images of a user is received. Using a processor, the images are processed to identify a portion of each of the images corresponding to the user. Parameters of a predetermined three-dimensional human model are modified to fit a modified version of the predetermined three-dimensional human model across the identified portions of the images to determine a set of specific parameters representing a body profile of the user.

Claims (44)

1. A method, comprising:

receiving a series of captured images of a user;

extracting one or more silhouettes from the series of captured images of the user;

using a processor to process the captured images to identify a portion of each of the captured images corresponding to the user, wherein the identified portions of the captured images corresponding to the user include identified user joint locations of the user;

modifying, based on the identified user joint locations of the user, parameters of a predetermined three-dimensional human model to fit a modified version of the predetermined three-dimensional human model across the identified portions of the captured images to determine a set of specific parameters representing a body profile of the user; and

refining the modified version of the predetermined three-dimensional human model based on comparing the modified version of the predetermined three-dimensional human model to the one or more extracted silhouettes.

2. The method of claim 1 , wherein the parameters of the predetermined three-dimensional human model include one or more of the following: a height, a width, a leg length, and a hip width parameter.

3. The method of claim 1 , wherein the series of captured images of the user includes color data and depth data.

4. The method of claim 1 , wherein the identified portions of the captured images corresponding to the user include identified foreground portions of the captured images.

5. The method of claim 1 , wherein the user joint locations include shoulder, elbow, wrist, hand, hip, knee, ankle, and foot locations.

6. The method of claim 1 , wherein the identified portions of the captured images corresponding to the user include identified facial feature locations of the user.

7. The method of claim 6 , wherein the identified facial feature locations include ear locations, eye locations, a nose location, and a mouth location.

8. The method of claim 1 , further comprising determining a value identifying a predicted size fit between an item and the user based on the set of specific parameters representing the body profile of the user.

9. The method of claim 8 , further comprising selecting and providing the item to the user based on the value identifying the predicted size fit exceeding a threshold value.

10. The method of claim 1 , wherein the predetermined three-dimensional human model is based on a sex or an age of the user.

11. The method of claim 1 , wherein the predetermined three-dimensional human model includes a spectral decomposition model.

12. The method of claim 1 , further comprising:

identifying two-dimensional joint locations of the user in each of the captured images; and

fitting three-dimensional joint locations of the predetermined three-dimensional human model based on the identified two-dimensional joint locations.

13. The method of claim 1 , further comprising determining an accuracy metric of the modified version of the predetermined three-dimensional human model including by comparing rendered silhouettes of the modified version to silhouette images based on the identified portions of the captured images corresponding to the user.

14. The method of claim 1 , further comprising matching a stylist to the user based on attributes of the stylist matching the set of specific parameters representing the body profile of the user.

15. The method of claim 1 , further comprising:

selecting a subset of parameters of the set of specific parameters representing the body profile of the user; and

identifying a group of users with similar body profiles using the selected subset of parameters.

16. The method of claim 15 , further comprising at least in part automatically determining a parameter of a garment sized for the identified group of users.

17. The method of claim 1 , further comprising:

displaying a rendering of the modified version of the predetermined three-dimensional human model to the user; and

receiving feedback from the user regarding an accuracy rating of the modified version.

18. The method of claim 17 , wherein the feedback identifies a portion of the modified version where an additional refinement is desired.

19. The method of claim 18 , further comprising receiving one or more additional captured images of the user corresponding to the portion of the modified version where the additional refinement is desired.

20. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

receiving a series of captured images of a user;

extracting one or more silhouettes from the series of captured images of the user;

processing the captured images to identify a portion of each of the captured images corresponding to the user, wherein the identified portions of the captured images corresponding to the user include identified user joint locations of the user;

modifying, based on the identified user joint locations of the user, parameters of a predetermined three-dimensional human model to fit a modified version of the predetermined three-dimensional human model across the identified portions of the captured images to determine a set of specific parameters representing a body profile of the user; and

refining the modified version of the predetermined three-dimensional human model based on comparing the modified version of the predetermined three-dimensional human model to the one or more extracted silhouettes.

21. A system, comprising:

a processor; and

a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:

receive a series of captured images of a user;

extract one or more silhouettes from the series of captured images of the user;

process the captured images to identify a portion of each of the captured images corresponding to the user, wherein the identified portions of the captured images corresponding to the user include identified user joint locations of the user; and

modify, based on the identified user joint locations of the user, parameters of a predetermined three-dimensional human model to fit a modified version of the predetermined three-dimensional human model across the identified portions of the captured images to determine a set of specific parameters representing a body profile of the user; and

refine the modified version of the predetermined three-dimensional human model based on comparing the modified version of the predetermined three-dimensional human model to the one or more extracted silhouettes.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Dec 5, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY (SUCCESSOR BY PURCHASE TO THE FEDERAL DEPOSIT INSURANCE CORPORATION AS RECEIVER FOR SILICON VALLEY BRIDGE BANK, N.A. (AS SUCCESSOR TO SILICON VALLEY BANK)), AS ADMINISTRATIVE AGENT
To: STITCH FIX, INC.
Reel/Frame 065770/0341 →
SECURITY INTEREST Recorded Dec 4, 2023
From: STITCH FIX, INC.
To: CITIBANK N.A.
Reel/Frame 065754/0926 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 3, 2020
From: STITCH FIX, INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052831/0801 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2019
From: MOODY, CHRISTOPHER ERICK
To: STITCH FIX, INC.
Reel/Frame 049067/0760 →
Cited By (2)
US 12,567,207 US 12,656,932