IP Library Granted Patent US 11,156,471
Granted Patent B2
US 11,156,471 · App. 16/103,566 · Granted Oct 26, 2021

Hands-free augmented reality system for picking and/or sorting assets

Inventor: Julio Gil (Veldhoven, NL)
Assignee: UNITED PARCEL SERVICE OF AMERICA, INC.
G01C21/365G01C21/3632G01C21/3641G06F1/163G06F3/147G06K9/00671G06Q10/047G06Q10/0833G06T19/006G09G3/001G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,156,471
App. No.
16/103,566
Filed
Aug 14, 2018
Granted
Oct 26, 2021
Kind
B2
Art Unit
3664
USPC
701/431
Abstract

A system is provided for hands-free handling of at least one asset by a user. The system includes a user device configured to be worn by a user and a control system remotely located relative to the user device and configured to exchange asset-related data with the user device, the asset-related data including at least one or more notifications related to the handling of the at least one asset by the user at the asset location. The user device contains a processor configured to determine location data associated with the at least one asset and including a location for the at least one asset, the determination being based, in part, upon the obtained asset identifier data; dynamically generate and display, at the user device, one or more navigational projections configured to guide the user to the asset location; and detect handling of the at least one asset by the user.

Claims (16)

1. A computer implemented method for providing hands-free handling of at least one asset by a user, the method comprising:

receiving, from a remote location relative to a user device that is worn by the user, asset identifier data for at least one asset, the user device and the at least one asset being located within a physical environment;

determining, at the user device, first location data associated with the user device and determining second location data associated with the at least one asset, the second location data being determined, based at least in part, on analyzing the received asset identifier data, the first location data being determined, based at least in part, on analyzing a present position of the user device; and

based at least in part on the determining the first location data and the second location data, dynamically generating and displaying, directly over a surface within the physical environment, one or more navigational projections, the one or more navigational projections configured to guide the user to a location associated with the second location data, wherein the surface is not a lens medium.

2. The method of claim 1 , further comprising detecting, at the user device, handling of the at least one asset by the user in response to the present location of the user device matching the location associated with the at least one asset.

3. The method of claim 2 , wherein the asset identifier data is obtained by a controller system upon receipt of an order for the at least one asset by a customer.

4. The method of claim 1 , wherein the asset identifier data is received, at the user device, via the user device scanning asset identifying data located on the at least one asset.

5. The method of claim 1 , wherein:

the user device further comprises a plurality of depth sensors and a pivoting laser projector;

the dynamic generation and display of the one or more navigational projections occurs via the pivoting laser projector; and

the plurality of depth sensors collect environmental data to determine at least one type of the one or more navigational projections to generate and display.

6. The method of claim 5 , wherein one of the at least one type of navigational projections is a two-dimensional directional arrow configured to instruct the user wearing the user device to make a change relative to the user present movement pattern.

7. The method of claim 5 , wherein one of the at least one type of navigational projections is a two-dimensional frame identifying one or more assets for the user to pick up upon arriving at the location associated with the at least one asset.

8. The method of claim 7 , wherein the two-dimensional frame encompasses multiple assets for picking up by the user.

9. The method of claim 7 , wherein the two-dimensional frame encompasses a single asset.

10. The method of claim 7 , wherein the two-dimensional frame contains text indicia configured to further guide and instruct the user for handling of the one or more assets.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2021
From: GIL, JULIO
To: UNITED PARCEL SERVICE OF AMERICA, INC.
Reel/Frame 055060/0623 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2021
From: GIL, JULIO
To: UNITED PARCEL SERVICE OF AMERICA, INC.
Reel/Frame 054906/0061 →
Continuity (2)
Provisional Application 62545752 · Aug 15, 2017
Related Publication 20190107411A1 · Apr 11, 2019
Cited By (1)
US 12,462,803