IP Library Granted Patent US 12,367,518
Granted Patent B2
US 12,367,518 · App. 18/654,301 · Granted Jul 22, 2025

Methods and apparatuses for recommending substitutions made during order fulfillment processes

Inventors: Hyun Duk Cho (San Francisco, CA); Swati Bhatt (Mountain View, CA); Vidya Sagar Kalidindi (Milpitas, CA); Kamiya Motwani (Madhya Pradesh, IN); Sushant Kumar (San Jose, CA); Kannan Achan (Saratoga, CA)
Assignee: Walmart Apollo, LLC
G06Q30/0629G06Q30/0201G06Q30/0635G06Q30/0641
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,518
App. No.
18/654,301
Granted
Jul 22, 2025
Kind
B2
Abstract

A system is configured to train a customer understanding model to generate a preference score for substitution items. The customer understanding model generates a preference score for each of a plurality of related substitution items based on order data including data indicative of at least one item ordered and location data indicating a location of a first store. The customer understanding model ranks each of the substitution items based on the preference score. Order data is transmitted including substitution data identifying each of the substitution items and corresponding rank. Performance data associated with a set of operations implemented based on the order data and the substitution data is obtained. An updated customer understanding model is trained based on the performance data and iteratively modified based on the updated training dataset and updated performance metrics generated from second performance data.

Claims (55)

1. A system comprising:

a processor; and

a non-transitory memory, storing instructions that, when executed, cause the processor to:

train a customer understanding model to generate customer attributes for a user based on past behavior;

receive, via a communications interface, order data associated with a first user including data indicative of at least one item ordered and location data indicating a location of a first store;

implement the customer understanding model to generate customer attributes for the first user;

generate a preference score for each of a plurality of related substitution items, wherein the preference score is generated based on a combination of the customer attributes and item attributes for each item in the plurality of related substitution items;

generate a relevance score for each of the plurality of related substitution items;

generate a substitution score based on the preference score and the relevance score;

rank each of the plurality of related substitution items based on the substitution scores;

transmit, via the communications interface, the order data and substitution data identifying each of the plurality of related substitution items and corresponding rank;

obtain, via the communications interface, performance data associated with a set of operations implemented based on the order data and the substitution data;

train an updated customer understanding model based on an updated training dataset including the performance data; and

iteratively modify the updated customer understanding model based on the updated training dataset and updated performance metrics generated from second performance data associated with implementation of the updated customer understanding model.

2. The system of claim 1 , wherein the customer understanding model is trained using historical behavior on a corresponding network platform.

3. The system of claim 2 , wherein the performance data includes acceptance data characterizing whether a substitution item is accepted as a replacement for the at least one item ordered, and wherein the processor is further configured to execute the instructions to apply the updated customer understanding model to obtain revised preference scores for the plurality of related substitution items.

4. The system of claim 1 , wherein the customer understanding model is trained using a training dataset including customer purchase behavior over a first predetermined time period and a second predetermined time period.

5. The system of claim 4 , wherein the customer purchase behavior includes customer attribute data determined by identifying a number of purchases of items that include one or more characteristics of a corresponding item attribute data.

6. The system of claim 1 , wherein the processor is further configured to select a preferred group of substitution items from the plurality of related substitution items based on the substitution scores and send the preferred group to a store order management device.

7. The system of claim 1 , wherein the processor is further configured to execute the instructions to generate an overall substitution score for each of the plurality of related substitution items.

8. The system of claim 7 , wherein the overall substitution score is generated based on a relevance score, a preference score, a score parameter, an item attribute, and a customer attribute.

9. A computer-implemented method, comprising:

training a customer understanding model to generate customer attributes for a user based on past behavior;

receiving, via a communications interface, order data associated with a first user including data indicative of at least one item ordered and location data indicating a location of a first store;

implementing the customer understanding model to generate customer attributes for the first user;

generating a preference score for each of a plurality of related substitution items, wherein preference score is generated based on a combination of the customer attributes and item attributes for each item in the plurality of related substitution items;

generating a relevance score for each of the plurality of related substitution items;

generating a substitution score score based on the preference score and the relevance score;

ranking each of the plurality of related substitution items based on the substitution score;

transmitting, via the communications interface, the order data and substitution data identifying each of the plurality of related substitution items and corresponding rank;

obtaining, via the communications interface, performance data associated with a set of operations implemented based on the order data and the substitution data;

training an updated customer understanding model based on an updated training dataset including the performance data; and

iteratively modifying the updated customer understanding model based on the updated training dataset and updated performance metrics generated from second performance data associated with implementation of the updated customer understanding model.

10. The computer-implemented method of claim 9 , wherein the customer understanding model is trained using historical behavior on a corresponding network platform.

11. The computer-implemented method of claim 10 , comprising applying the updated customer understanding model to obtain revised preference scores for the plurality of related substitution items, wherein the performance data includes acceptance data characterizing whether a substitution item is accepted as a replacement for the at least one item ordered.

12. The computer-implemented method of claim 9 , wherein the customer understanding model is trained using a training dataset including customer purchase behavior over a first predetermined time period and a second predetermined time period.

13. The computer-implemented method of claim 12 , wherein the customer purchase behavior includes customer attribute data determined by identifying a number of purchases of items that include one or more characteristics of a corresponding item attribute data.

14. The computer-implemented method of claim 9 , comprising selecting a preferred group of substitution items from the plurality of related substitution items based on the substitution scores and send the preferred group to a store order management device.

15. The computer-implemented method of claim 9 , comprising generating an overall substitution score for each of the plurality of related substitution items.

16. The computer-implemented method of claim 15 , wherein the overall substitution score is generated based on a relevance score, a preference score, a score parameter, an item attribute, and a customer attribute.

17. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause a device to perform operations comprising:

training a customer understanding model to generate customer attributes for a user based on past behavior;

receiving, via a communications interface, order data associated with a first user including data indicative of at least one item ordered and location data indicating a location of a first store;

implementing the customer understanding model to generate customer attributes for the first user;

generating a preference score for each of a plurality of related substitution items, wherein preference score is generated based on a combination of the customer attributes and item attributes for each item in the plurality of related substitution items;

generate a relevance score for each of the plurality of related substitution items;

generate a substitution score based on the preference score and the relevance score;

ranking each of the plurality of related substitution items based on the substitution score;

transmitting, via the communications interface, the order data and substitution data identifying each of the plurality of related substitution items and corresponding rank;

obtaining, via the communications interface, performance data associated with a set of operations implemented based on the order data and the substitution data;

training an updated customer understanding model based on an updated training dataset including the performance data; and

iteratively modifying the updated customer understanding model based on the updated training dataset and updated performance metrics generated from second performance data associated with implementation of the updated customer understanding model.

18. The non-transitory computer readable medium of claim 17 , wherein the instructions cause the device to perform operations comprising applying the updated customer understanding model to obtain revised preference scores for the plurality of related substitution items, wherein the customer understanding model is trained using historical behavior on a corresponding network platform, and wherein the performance data includes acceptance data characterizing whether a substitution item is accepted as a replacement for the at least one item ordered.

19. The non-transitory computer readable medium of claim 17 , wherein the customer understanding model is trained using a training dataset including customer purchase behavior over a first predetermined time period and a second predetermined time period, and wherein the customer purchase behavior includes customer attribute data determined by identifying a number of purchases of items that include one or more characteristics of a corresponding item attribute data.

20. The non-transitory computer readable medium of claim 17 , wherein the instructions cause the device to perform operations comprising selecting a preferred group of substitution items from the plurality of related substitution items based on the substitution scores and send the preferred group to a store order management device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2024
From: CHO, HYUN DUK; BHATT, SWATI; KALIDINDI, VIDYA SAGAR; MOTWANI, KAMIYA; KUMAR, SUSHANT; ACHAN, KANNAN
To: WALMART APOLLO, LLC
Reel/Frame 067306/0324 →
Continuity (2)
Continuation 16752536 · Jan 24, 2020
Related Publication 20240303713A1 · Sep 12, 2024
References Cited (45)
US 7233914B1 · Wijaya et al. · 2007 [cited by applicant]
US 7890415B1 · Keith · 2011 [cited by applicant]
US 8090626B1 · Wijaya · 2012 [cited by examiner]
US 8577733B2 · Atwater et al. · 2013 [cited by applicant]
US 8751334B2 · Wijaya et al. · 2014 [cited by applicant]
US 8768932B1 · Kacholia et al. · 2014 [cited by applicant]
US 9202246B1 · Bundy et al. · 2015 [cited by applicant]
US 10007946B1 · Levy · 2018 [cited by examiner]
US 10127596B1 · Franke et al. · 2018 [cited by applicant]
US 10185984B2 · Shaffer et al. · 2019 [cited by applicant]
US 10346895B2 · Stoll et al. · 2019 [cited by applicant]
US 10540632B2 · Putcha et al. · 2020 [cited by applicant]
US 10685308B1 · Avery, Jr. et al. · 2020 [cited by applicant]
US 10949913B2 · Bahety · 2021 [cited by applicant]
US 11188831B2 · Snyder et al. · 2021 [cited by applicant]
US 12008622B2 · Cho · 2024 [cited by examiner]
US 20070073580A1 · Perry et al. · 2007 [cited by applicant]
US 20080046269A1 · Lopez · 2008 [cited by applicant]
US 20080114640A1 · Knipfer et al. · 2008 [cited by applicant]
US 20080288328A1 · Minor et al. · 2008 [cited by applicant]
US 20090125411A1 · Otto et al. · 2009 [cited by applicant]
US 20100023340A1 · Chowdhary et al. · 2010 [cited by applicant]
US 20100114665A1 · Stengard et al. · 2010 [cited by applicant]
US 20100262521A1 · Robinson et al. · 2010 [cited by applicant]
US 20140089133A1 · Argue et al. · 2014 [cited by applicant]
US 20140214590A1 · Argue · 2014 [cited by examiner]
US 20140278627A1 · Grabovski et al. · 2014 [cited by applicant]
US 20160063548A1 · Simo et al. · 2016 [cited by applicant]
US 20160063604A1 · Shaffer et al. · 2016 [cited by applicant]
US 20160225063A1 · Wical · 2016 [cited by applicant]
US 20170140403A1 · Fujita et al. · 2017 [cited by applicant]
US 20170337523A1 · Roach et al. · 2017 [cited by applicant]
US 20180315059A1 · Venkatesh et al. · 2018 [cited by applicant]
US 20190213509A1 · Burleson et al. · 2019 [cited by applicant]
US 20190378081A1 · Swartz et al. · 2019 [cited by applicant]
US 20210019805A1 · Kumar et al. · 2021 [cited by applicant]
WO 03050735A2 · 2003 [cited by applicant]
WO 2017172753A1 · 2017 [cited by applicant]
WO 2018200996A1 · 2018 [cited by applicant]
Bacel Maddah et al., “Joint replenishment model for multiple products with substitution,” Applied Mathematical lodelling, vol. 40, Dec. 2016, pp. 7678-7688. (Year: 2016). [cited by examiner]
Zhijie Lin et al., “The Demand Effects Product Recommendation Networks: An Empirical Analysis of Network Diversity and Stability,” MIS Quarterly, Jun. 2017, vol. 41, No. 2, pp. 397-426. [cited by applicant]
Levy, “Planners urged to focus on client education” Aug. 2011 Money Management, 1 page. [cited by applicant]
Bacel Maddah et al., “Joint replenishment model for multiple products with substitution,” Applied Mathematical Modelling, vol. 40, Dec. 2016, pp. 7678-7688. [cited by applicant]
Murat Koyuncu, “An Alternative Product Extraction Method for E-Commerce Applications,” Sep. 2007, 18th International Workshop on Database and Expert Systems applications, 5 pages. [cited by applicant]
Zheng Qin, “Introduction to E-commerce,” (Year: 2009) Springer, Springer.com, 360 pages. [cited by applicant]
Cited By (1)
US 12,475,503