IP Library Granted Patent US 11,853,938
Granted Patent B1
US 11,853,938 · App. 17/119,591 · Granted Dec 26, 2023

System and method of reinforced machine-learning retail allocation

Inventors: Ganesh Muthusamy (Hyderabad, IN); Sudhakar Jayapal (Hyderabad, IN); Karthik Kondapaneni (Hyderabad, IN); Rajneesh Kumar Agrawal (Bangalore, IN)
Assignee: Blue Yonder Group, Inc.
G06Q10/06313G06N5/04G06N20/00G06Q10/067G06Q30/0202G06Q50/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,853,938
App. No.
17/119,591
Granted
Dec 26, 2023
Kind
B1
Abstract

A system and method for allocation planning comprise a server comprising a processor and memory and configured to calculate a reward for a historical allocation of a product to one or more stores associated with a retailer. Embodiments include simulating what-if scenarios for the historical allocation to identify an allocation having a greater reward than the historical allocation and allocating a quantity of a product for a current allocation to the one or more stores based, at least in part, on a distance calculation of one or more independent variables for the historical allocation and the current allocation and the identified allocation having the greater reward then the historical allocation.

Claims (54)

1. A system of allocation planning, comprising:

a network, automated warehousing equipment and a server, comprising a processor and memory, the server operably connected over the network to the automated warehousing equipment, the server further configured to:

calculate, using a reward-penalty function as part of a reinforcement learning process, a reward for a historical allocation of a product to one or more stores associated with a retailer, wherein the reward-penalty function comprises product margin, inventory carrying cost and opportunity cost represented by Bellman's equation;

simulate what-if scenarios for the historical allocation to identify an allocation having a greater reward than the historical allocation;

allocate a quantity of a product for a current allocation to the one or more stores based, at least in part, on a distance calculation of one or more independent variables for the historical allocation and the current allocation and the identified allocation having the greater reward then the historical allocation; and

responsive to a difference between a current inventory level and a constrained allocation quantity, retrieve a quantity of the product equal to the difference between the current inventory level and the constrained allocation quantity for transportation to stores by sending instructions over the network to the automated warehousing equipment of one or more distribution centers to automatically retrieve the quantity of the product.

2. The system of claim 1 , wherein the server is further configured to:

calculate an unconstrained allocation quantity representing a product need at the one or more stores.

3. The system of claim 1 , wherein the server is further configured to:

calculate a constrained allocation quantity representing an optimal allocation quantity.

4. The system of claim 3 , wherein calculate a constrained allocation quantity representing an optimal allocation quantity comprises a minimum presentation quantity constraint for at least one of the one or more stores.

5. The system of claim 3 , wherein calculate a constrained allocation quantity representing an optimal allocation quantity comprises a supply level constraint at one or more distribution centers and a minimum presentation quantity constraint for at least one of the one or more stores.

6. The system of claim 5 , wherein the independent variables comprise one or more of:

sales average;

sales variability;

sent receipts;

lags of demand;

seasonal factors;

store clusters;

climate data; and

market trends.

7. A computer-implemented method of allocation planning, comprising:

networking a computer with automated warehousing equipment;

calculating, by the computer comprising a processor and memory, using a reward-penalty function as part of a reinforcement learning process, a reward for a historical allocation of a product to one or more stores associated with a retailer, wherein the reward-penalty function comprises product margin, inventory carrying cost and opportunity cost represented by Bellman's equation;

simulating, by the computer, what-if scenarios for the historical allocation to identify an allocation having a greater reward than the historical allocation;

allocating, by the computer, a quantity of a product for a current allocation to the one or more stores based, at least in part, on a distance calculation of one or more independent variables for the historical allocation and the current allocation and the identified allocation having the greater reward then the historical allocation; and

responsive to a difference between a current inventory level and a constrained allocation quantity, retrieve a quantity of the product equal to the difference between the current inventory level and the constrained allocation quantity for transportation to stores by sending instructions over the network to the automated warehousing equipment of one or more distribution centers to automatically retrieve the quantity of the product.

8. The computer-implemented method of claim 7 , further comprising:

calculating, by the computer, an unconstrained allocation quantity representing a product need at the one or more stores.

9. The computer-implemented method of claim 7 , further comprising:

calculating, by the computer, a constrained allocation quantity representing an optimal allocation quantity.

10. The computer-implemented method of claim 9 , wherein calculating a constrained allocation quantity representing an optimal allocation quantity comprises a minimum presentation quantity constraint for at least one of the one or more stores.

11. The computer-implemented method of claim 9 , wherein calculating a constrained allocation quantity representing an optimal allocation quantity comprises a supply level constraint at one or more distribution centers and a minimum presentation quantity constraint for at least one of the one or more stores.

12. The computer-implemented method of claim 11 , wherein the independent variables comprise one or more of:

sales average;

sales variability;

sent receipts;

lags of demand;

seasonal factors;

store clusters;

climate data; and

market trends.

13. A non-transitory computer-readable medium embodied with software, the software when executed:

networks a computer with automated warehousing equipment;

calculates, using a reward-penalty function as part of a reinforcement learning process, a reward for a historical allocation of a product to one or more stores associated with a retailer, wherein the reward-penalty function comprises product margin, inventory carrying cost and opportunity cost represented by Bellman's equation;

simulates what-if scenarios for the historical allocation to identify an allocation having a greater reward than the historical allocation;

allocates a quantity of a product for a current allocation to the one or more stores based, at least in part, on a distance calculation of one or more independent variables for the historical allocation and the current allocation and the identified allocation having the greater reward then the historical allocation; and

responsive to a difference between a current inventory level and a constrained allocation quantity, retrieves a quantity of the product equal to the difference between the current inventory level and the constrained allocation quantity for transportation to stores by sending instructions over the network to the automated warehousing equipment of one or more distribution centers to automatically retrieve the quantity of the product.

14. The non-transitory computer-readable medium of claim 13 , the software when executed further:

calculates an unconstrained allocation quantity representing a product need at the one or more stores.

15. The non-transitory computer-readable medium of claim 13 , the software when executed further:

calculates a constrained allocation quantity representing an optimal allocation quantity.

16. The non-transitory computer-readable medium of claim 15 , wherein calculates a constrained allocation quantity representing an optimal allocation quantity comprises a minimum presentation quantity constraint for at least one of the one or more stores.

17. The non-transitory computer-readable medium of claim 15 , wherein calculates a constrained allocation quantity representing an optimal allocation quantity comprises a supply level constraint at one or more distribution centers and a minimum presentation quantity constraint for at least one of the one or more stores.

Assignments (2)
RELEASE OF SECURITY INTEREST Recorded Sep 16, 2021
From: JPMORGAN CHASE BANK, N.A.
To: BLUE YONDER GROUP, INC.; BLUE YONDER, INC.; JDA SOFTWARE SERVICES, INC.; I2 TECHNOLOGIES INTERNATIONAL SERVICES, LLC; MANUGISTICS SERVICES, INC.; MANUGISTICS HOLDINGS DELAWARE II, INC.; REDPRAIRIE COLLABORATIVE FLOWCASTING GROUP, LLC; JDA SOFTWARE RUSSIA HOLDINGS, INC.; REDPRAIRIE SERVICES CORPORATION; BY BOND FINANCE, INC.; BY NETHERLANDS HOLDING, INC.; BY BENELUX HOLDING, INC.
Reel/Frame 057724/0593 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2021
From: MUTHUSAMY, GANESH; JAYAPAL, SUDHAKAR; KONDAPANENI, KARTHIK; AGRAWAL, RAJNEESH KUMAR
To: BLUE YONDER GROUP, INC.
Reel/Frame 055443/0097 →