IP Library Granted Patent US 11,657,366
Granted Patent B2
US 11,657,366 · App. 16/054,434 · Granted May 23, 2023

System and method for augmented reality loading

Inventors: Daniel J. Lesieur (Rogers, AR); Steven Lewis (Bentonville, AR)
Assignee: Walmart Apollo, LLC
G06Q10/087G02B27/0176G06T15/005G06T19/006G02B27/017G02B2027/0134G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,657,366
App. No.
16/054,434
Granted
May 23, 2023
Kind
B2
Abstract

Systems, methods, and computer-readable storage media for using augmented reality to improve loading, and in particular improve loading when the types and order of items to be loaded is unknown. A server uses information regarding the packages which have already been stored in a storage area to generate a three-dimensional map of where the stored packages currently are placed. Upon receiving information indicating a subsequent package is going to be stored, the server can identify the best place to store that package in the storage area, then communicate that storage location to an augmented reality device worn by a worker. The worker can then have a visual indication showing where and how to place the subsequent package.

Claims (21)

1. An augmented reality device comprising:

at least one transparent display having an inner surface and an outer surface, wherein the inner surface is configured to display graphics to a user;

a processor;

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

receiving, from a server, physical package dimensions associated with a physical package;

receiving, from the server, a storage location where the physical package should be placed within a storage area;

identifying a current location of the augmented reality device;

identifying a current view of the user of the augmented reality device;

generating augmented view data based on the current location and the current view, wherein the augmented view data defines dimensions of a virtual package in the storage location, the virtual package illustrating how the physical package should be placed within the storage location based on the physical package dimensions and based on package placement rules;

displaying, using the augmented view data and on the inner surface of the at least one transparent display, an augmented view of the storage area such that the user, while storing the physical package, can see the storage area with the virtual package displayed graphically in the storage location;

searching the storage area for a previously stored physical package; and

highlighting, in the augmented view and on the inner surface of the at least one transparent display, the previously stored physical package based on identifying the previously stored physical package in the storage area,

wherein the physical package was unknown to the augmented reality device when another package was previously placed in the storage area,

wherein the augmented reality device generates a confirmation when the physical package is placed in the storage location, and

wherein the augmented view of the storage area is updated based on the confirmation.

2. The augmented reality device of claim 1 , wherein the storage area is a freight truck.

3. The augmented reality device of claim 1 , wherein the storage area is a grocery bag.

4. The augmented reality device of claim 1 , wherein the augmented reality device is wearable by the user, the augmented reality device being shaped as one of glasses and a visor.

5. The augmented reality device of claim 4 , wherein the user is assigned to load a plurality of storage areas.

6. The augmented reality device of claim 1 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

transmitting, to the server, a confirmation that the physical package is placed in the storage location.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2023
From: LESIEUR, DANIEL J.; LEWIS, STEVEN
To: WAL-MART STORES, INC.
Reel/Frame 062494/0894 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2023
From: WAL-MART STORES, INC.
To: WALMART APOLLO, LLC
Reel/Frame 062514/0014 →
Continuity (2)
Provisional Application 62541351 · Aug 4, 2017
Related Publication 20190043004A1 · Feb 7, 2019