IP Library Granted Patent US 11,232,506
Granted Patent B1
US 11,232,506 · App. 16/715,867 · Granted Jan 25, 2022

Contextual set selection

Inventor: Kevin J. Zielnicki (Oakland, CA)
Assignee: Stitch Fix, Inc.
G06Q30/0631G06N20/00G06Q10/083
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,232,506
App. No.
16/715,867
Granted
Jan 25, 2022
Kind
B1
Abstract

An initial list of candidate items automatically evaluated and chosen for an end-user is provided. A selection of one or more items in the initial list of candidate items is received from an expert user different than the end-user to include in an item group set for the end-user. Eligible items are evaluated to identify an additional item to include in the item group set based at least in part on an expert judgment prediction machine learning model trained to predict based at least in part on the one or more items already in the item group set a likelihood of a certain item being evaluated would be selected for inclusion in the item group set. Based on the evaluation, the additional item is included in the item group set. Member items in the item group set are indicated.

Claims (43)

1. A method, comprising:

providing an initial list of candidate items automatically evaluated and chosen for an end-user;

receiving a selection of one or more items in the initial list of candidate items from an expert user different than the end-user to include in an item group set for the end-user;

evaluating eligible items to identify an additional item to include in the item group set based at least in part on an expert judgment prediction machine learning model trained to predict based at least in part on the one or more items already in the item group set a likelihood of a certain item being evaluated would be selected for inclusion in the item group set, wherein the expert judgment prediction machine learning model is trained in part by using previous item selections by experts to predict items likely to be selected by an expert for different types of end-users;

based on the evaluation, including the additional item in the item group set;

indicating member items in the item group set;

receiving from the expert user feedback regarding the member items in the item group set; and

retraining the expert judgment prediction machine learning model based on the expert user feedback.

2. The method of claim 1 , wherein evaluating the initial list of candidate items includes using an outcome prediction machine learning model trained to predict a likelihood that a candidate item would be purchased by the end-user.

3. The method of claim 1 , wherein an outcome prediction machine learning model was trained based on previous purchase histories of a plurality of different end-users.

4. The method of claim 2 , wherein evaluating the initial list of candidate items includes using the expert judgment prediction machine learning model.

5. The method of claim 1 , wherein the initial list of candidate items are automatically ranked and provided in an order based on the rankings.

6. The method of claim 1 , wherein the item group set is to include a preconfigured number of items to be shipped together to the end-user.

7. The method of claim 1 , wherein evaluating the eligible items includes determining a corresponding machine learning prediction score for each of the eligible items among an inventory of items and identifying an item with a best prediction score as the additional item to include in the item group set.

8. The method of claim 7 , wherein determining the machine learning prediction score includes utilizing an outcome prediction machine learning model trained to predict a likelihood that the certain item being evaluated would be purchased by the end-user.

9. The method of claim 8 , wherein determining the machine learning prediction score includes determining a weighted sum of an output of the expert judgment prediction machine learning model and an output of the outcome prediction machine learning model.

10. The method of claim 1 , wherein a plurality of items are to be automatically identified for inclusion in the item group set and each additional item in the plurality of items to be automatically identified is serially determined by using different iterations of the expert judgment prediction machine learning model that accounts for any previously determined additional item in the item group set to determine a next additional item in the item group set.

11. The method of claim 1 , wherein the feedback includes receiving an approval of the member items in the item group set from the expert user and causing the item group set to be provided to the end-user.

12. The method of claim 1 , wherein the feedback includes receiving an indication from the expert user to replace one of the member items in the item group set.

13. The method of claim 12 , further comprising evaluating at least a portion of the eligible items to identify a ranked list of replacement item candidates at least in part by using the expert judgment prediction machine learning model.

14. The method of claim 13 , wherein the feedback includes receiving a selection of one of the replacement item candidates from the expert user and further comprising replacing the indicated member item in the item group set with the selected replacement item candidate.

15. The method of claim 1 , wherein the item group set includes clothing items.

16. A system, comprising:

a processor configured to:

provide an initial list of candidate items automatically evaluated and chosen for an end-user;

receive a selection of one or more items in the initial list of candidate items from an expert user different than the end-user to include in an item group set for the end-user;

evaluate eligible items to identify an additional item to include in the item group set based at least in part on an expert judgment prediction machine learning model trained to predict based at least in part on the one or more items already in the item group set a likelihood of a certain item being evaluated would be selected for inclusion in the item group set, wherein the expert judgment prediction machine learning model is trained in part by using previous item selections by experts to predict items likely to be selected by an expert for different types of end-users;

based on the evaluation, include the additional item in the item group set;

indicate member items in the item group set;

receive from the expert user feedback regarding the member items in the item group set; and

retrain the expert judgment prediction machine learning model based on the expert user feedback; and

a memory coupled to the processor and configured to provide the processor with instructions.

17. The system of claim 16 , wherein evaluating the eligible items includes utilizing an outcome prediction machine learning model trained to predict a likelihood that the certain item being evaluated would be purchased by the end-user.

18. The system of claim 16 , wherein a plurality of items are to be automatically identified for inclusion in the item group set and each additional item in the plurality of items to be automatically identified is serially determined by using different iterations of the expert judgment prediction machine learning model that accounts for any previously determined additional item in the item group set to determine a next additional item in the item group set.

19. The system of claim 16 , wherein the feedback includes an indication from the expert user to replace one of the member items in the item group set and the processor is further configured to evaluate at least a portion of the eligible items to identify a ranked list of replacement item candidates at least in part by using the expert judgment prediction machine learning model.

20. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

providing an initial list of candidate items automatically evaluated and chosen for an end-user;

receiving a selection of one or more items in the initial list of candidate items from an expert user different than the end-user to include in an item group set for the end-user;

evaluating eligible items to identify an additional item to include in the item group set based at least in part on an expert judgment prediction machine learning model trained to predict based at least in part on the one or more items already in the item group set a likelihood of a certain item being evaluated would be selected for inclusion in the item group set, wherein the expert judgment prediction machine learning model is trained in part by using previous item selections by experts to predict items likely to be selected by an expert for different types of end-users;

based on the evaluation, including the additional item in the item group set;

indicating member items in the item group set;

receiving from the expert user feedback regarding the member items in the item group set; and

retraining the expert judgment prediction machine learning model based on the expert user feedback.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Dec 5, 2023
From: FIRST-CITIZENS BANK & TRUST COMPANY (SUCCESSOR BY PURCHASE TO THE FEDERAL DEPOSIT INSURANCE CORPORATION AS RECEIVER FOR SILICON VALLEY BRIDGE BANK, N.A. (AS SUCCESSOR TO SILICON VALLEY BANK)), AS ADMINISTRATIVE AGENT
To: STITCH FIX, INC.
Reel/Frame 065770/0341 →
SECURITY INTEREST Recorded Dec 4, 2023
From: STITCH FIX, INC.
To: CITIBANK N.A.
Reel/Frame 065754/0926 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 3, 2020
From: STITCH FIX, INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052831/0801 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: ZIELNICKI, KEVIN J.
To: STITCH FIX, INC.
Reel/Frame 052767/0025 →
Continuity (1)
Provisional Application 62870498 · Jul 3, 2019
Cited By (11)
US 12,242,490 US 12,260,079 US 12,288,242 US 12,292,898 US 12,307,498 US 12,353,442 US 12,354,750 US 12,373,498 US 12,597,060 US 12,639,374 US 12,646,100