IP Library Granted Patent US 11,514,386
Granted Patent B1
US 11,514,386 · App. 15/907,874 · Granted Nov 29, 2022

System and method of displaying layout-based instructions using augmented reality

Inventors: Justin Soles (Ormeaux, CA); Benoît Rochon (Montreal, CA); Christopher Tyler (Montreal, CA)
Assignee: Blue Yonder Group, Inc.
G06Q10/083G06Q10/087G06Q30/0635G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,514,386
App. No.
15/907,874
Filed
Feb 28, 2018
Granted
Nov 29, 2022
Kind
B1
Art Unit
3625
USPC
705/26.81
Abstract

A system and method are disclosed for a supply chain entity having an inventory of one or more items and a warehouse management system receiving orders for one or more items, determining a container for the one or more items, and generating a packing plan for the items. Aspects of the embodiments may include one or more instruction rendering devices having a sensor and a displaying augmented reality instructions and feedback.

Claims (42)

1. A system, comprising:

a supply chain entity comprising an inventory having one or more items;

a warehouse management system comprising a server and configured to:

receive an order for at least one of the one or more items;

determine a container for the one or more ordered items;

generate a packing plan for each item of the one or more items based, at least in part, on characteristics of the one or more ordered items, characteristics of the container, and a destination of the one or more ordered items; and

generate instructions according to the packing plan; and

an instruction rendering device comprising a sensor and a display and configured to:

display augmented reality instructions and feedback according to a difference between a first mapping of the one or more items, a second mapping of the one or more items, and a mapping of the container;

overlays the augmented reality instructions and feedback in connection with a physical location of the container, wherein the instruction rendering device repeatedly updates the physical location of the augmented reality instructions and feedback according to the difference between the first mapping of the one or more items, the second mapping of the one or more items, and the mapping of the container on the display in connection with a detected movement of the container or a detected movement of the instruction rendering device until the second mapping of the one or more items indicates the one or more items have been packed according to the packing plan; and

identifies on the instruction rendering device when the one or more items have been correctly placed and oriented in the container according to the packing plan.

2. The system of claim 1 , wherein the instruction rendering device displays feedback by generating a transparent mapping of the one or more items on the display in connection with the physical location of the container, such that the transparent mapping indicates a location and orientation where the item should be placed on the container.

3. The system of claim 2 , wherein the characteristics of the items comprise one or more of a weight, size, and crushability.

4. The system of claim 3 , wherein the characteristics of the container comprise one or more of a size, a maximum weight restriction, and a forecasted shipping estimate.

5. A computer-implemented method, comprising:

receiving, by a computer, a current state of items in a supply chain network comprising one or more supply chain entities, wherein an inventory of the one or more supply chain entities is used to store the items, and a state of the items comprises a quantity among the inventory of the one or more supply chain entities;

receiving, by the computer, an order for at least one of the one or more items;

determining, by the computer, a container for the one or more ordered items;

generating, by the computer, a packing plan for each item of the one or more ordered items based, at least in part, on characteristics of the one or more ordered items, characteristics of the container, and a destination of the one or more ordered items;

generating, by the computer, instructions according to the packing plan;

displaying, by an instruction rendering device, augmented reality instructions and feedback according to a difference between a first mapping of the one or more ordered items, a second mapping of the one or more ordered items, and a mapping of the container;

displaying, by the instruction rendering device, one or more visual elements representing the augmented reality instructions and feedback positioned in connection with a physical location of the container;

updating repeatedly, by the instruction rendering device, a position of the one or more visual elements representing the augmented reality instructions and feedback according to the difference between the first mapping of the one or more items, the second mapping of the one or more items, and the mapping of the container on a display in connection with a detected movement of one or more of the container and the instruction rendering device until the second mapping of the one or more items indicates the one or more items have been packed according to the packing plan; and

identifying on the instruction rendering device when the one or more items have been correctly placed and oriented in the container according to the packing plan.

6. The method of claim 5 , further comprising:

displaying, by the instruction rendering device, the feedback by generating a transparent mapping of the one or more items on the display in connection with the physical location of the container, such that the transparent mapping indicates a location and orientation where the item should be placed on the container.

7. The method of claim 6 , wherein the characteristics of the one or more items comprise one or more of a weight, size, and crushability.

8. The method of claim 7 , wherein the characteristics of the container comprise one or more of a size, a maximum weight restriction, and a forecasted shipping estimate.

9. A non-transitory computer-readable medium embodied with software, the software when executed configured to:

receive a current state of items in a supply chain network comprising one or more supply chain entities, wherein an inventory of the one or more supply chain entities is used to store the items, and a state of the items comprises a quantity among the inventory of the one or more supply chain entities;

receive an order for at least one of the one or more items;

determine a container for the one or more ordered items;

generate a packing plan for each item of the one or more ordered items based, at least in part, on characteristics of the one or more ordered items, characteristics of the container, and a destination of the one or more ordered items;

generate instructions according to the packing plan;

render one or more visual elements representing augmented reality instructions and feedback according to a difference between a first mapping of the one or more ordered items, a second mapping of the one or more ordered items, and a mapping of the container;

render the one or more visual elements representing the instructions and the feedback positioned in connection with a physical location of the container;

update repeatedly a position of the one or more visual elements representing the augmented reality instructions and feedback according to the difference between the first mapping of the one or more items, the second mapping of the one or more items, and the mapping of the container on a display in connection with a detected movement of one or more of the container and the instruction rendering device until the second mapping of the one or more items indicates the one or more items have been packed according to the packing plan; and

identify on the instruction rendering device when the one or more items have been correctly placed and oriented in the container according to the packing plan.

10. The non-transitory computer-readable medium of claim 9 , wherein the software when executed is further configured to:

render the feedback by generating a transparent mapping of the one or more items on the display in connection with a physical location of the container, such that the transparent mapping indicates a location and orientation where the item should be placed on the container.

11. The non-transitory computer-readable medium of claim 10 , wherein characteristics of the items comprise one or more of a weight, size, and crushability.

12. The non-transitory computer-readable medium of claim 11 , wherein the characteristics of the container comprise one or more of a size, a maximum weight restriction, and a forecasted shipping estimate.

Assignments (5)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053383/0117) Recorded Nov 3, 2021
From: U.S. BANK NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: BLUE YONDER GROUP, INC.
Reel/Frame 058794/0776 →
RELEASE OF SECURITY INTEREST Recorded Sep 16, 2021
From: JPMORGAN CHASE BANK, N.A.
To: BLUE YONDER GROUP, INC.; BLUE YONDER, INC.; JDA SOFTWARE SERVICES, INC.; I2 TECHNOLOGIES INTERNATIONAL SERVICES, LLC; MANUGISTICS SERVICES, INC.; MANUGISTICS HOLDINGS DELAWARE II, INC.; REDPRAIRIE COLLABORATIVE FLOWCASTING GROUP, LLC; JDA SOFTWARE RUSSIA HOLDINGS, INC.; REDPRAIRIE SERVICES CORPORATION; BY BOND FINANCE, INC.; BY NETHERLANDS HOLDING, INC.; BY BENELUX HOLDING, INC.
Reel/Frame 057724/0593 →
SECURITY AGREEMENT Recorded Aug 3, 2020
From: BLUE YONDER GROUP, INC.
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 053383/0117 →
CHANGE OF NAME Recorded Apr 14, 2020
From: JDA SOFTWARE GROUP, INC.
To: BLUE YONDER GROUP, INC.
Reel/Frame 052393/0538 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2018
From: ROCHON, BENOÎT; TYLER, CHRISTOPHER
To: JDA SOFTWARE GROUP, INC.
Reel/Frame 046769/0740 →