IP Library Granted Patent US 8,626,611
Granted Patent B2
US 8,626,611 · App. 12/008,433 · Granted Jan 7, 2014

Method and apparatus for augmented reality shopping assistant

Inventor: Luis Eduardo Bravo (Norcross, GA)
Assignee: NCR Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,626,611
App. No.
12/008,433
Granted
Jan 7, 2014
Kind
B2
Abstract

An augmented reality shopping system in one embodiment includes a store communication network, a memory including program instructions for receiving a product location request, associating the received request with product information stored in a product database, determining the location of the product within the store, receiving shopper location information, determining a route between the determined location of the product and the shopper location based upon the shopper location information, generating route rendering data based upon the determined route, and transmitting the route rendering data through the store communication network. The system further includes a processor operably connected to the store communication network and to the memory for executing the program instructions and a mobile display device operably connected to the processor through the store communication network for rendering an overlay image using the transmitted route rendering data.

Claims (69)

1. An augmented reality shopping system comprising:

a store communication network;

a control system comprising:

I/O devices;

a memory including program instructions for:

receiving a product location request;

associating the received request with product information stored in a product database where the product database is located within the memory and includes product availability information;

determining the location of the product within the store,

receiving shopper location information;

determining a route between the determined location of the product and the shopper location based upon the shopper location information;

generating route rendering data based upon the determined route;

transmitting product availability information through the store communication network; and

transmitting the route rendering data through the store communication network; and

a processor operably connected to the I/O devices, the store communication network and to the memory for executing the program instructions; and

a hands-free mobile display device operably connected to the processor through the store communication network including a lens and a projector for rendering an overlay image on the lens using the transmitted route rendering data and the transmitted product availability information.

2. The system of claim 1 , wherein:

the memory further comprises a stored model of at least a portion of the store; and

the mobile device is further operable to render an overlay image based upon the stored model.

3. The system of claim 1 , wherein the network is a wireless network and the mobile display device is wirelessly integrated into the network.

4. The system of claim 1 , wherein the mobile display device operates based upon voice commands.

5. The system of claim 1 , wherein the mobile display device operates based upon eye tracking.

6. The system of claim 1 , wherein the I/O devices include a keyboard and a pointing device.

7. An augmented reality shopping system comprising:

a store communication network;

a control system comprising:

I/O devices;

a memory including program instructions for:

receiving a product location request;

associating the received request with product information stored in a product database where the product database is located within the memory and includes alternative product availability information;

determining the location of the product within the store;

receiving shopper location information;

determining a route between the determined location of the product and the shopper location based upon the shopper location information;

generating route rendering data based upon the determined route;

transmitting alternative product availability information through the store communication network; and

transmitting the route rendering data through the store communication network; and

a processor operably connected to the I/O devices, the store communication network and to the memory for executing the program instructions; and

a hands-free mobile display device operably connected to the processor through the store communication network including a lens and a projector for rendering an overlay image on the lens using the transmitted route rendering data and the transmitted alternative product availability information.

8. A method of rendering an overlay image on a hands-free mobile display device, the method comprising:

transmitting the product location request through the hands-free mobile display device based upon voice commands to the control system;

receiving by a control system a product location request through a store communications network from the hands-free mobile display device;

associating by the control system the received request with product information stored in a product database located within the control system;

determining the location of the product within the store;

receiving by the control system shopper location information from the hands-free mobile display device;

determining by the control system a route to the determined product location from a determined shopper location based upon the shopper location information;

transmitting by the control system route rendering data through the store communication network including a wireless network to the hands-free mobile display device; and

rendering an overlay image on a lens of the hands-free mobile display device by a projector of the hands-free mobile display device using the transmitted route rendering data.

9. The method of claim 8 , further comprising:

storing a model of at least a portion of the store within the control system; and wherein rendering comprises:

rendering an overlay image based upon the stored model.

10. The method of claim 8 , further comprising:

transmitting by the control system product availability information through the store communication network to the hands-free mobile display device; and

rendering by the control system an overlay image using the product availability information.

11. The method of claim 8 , further comprising:

transmitting by the control system alternative product availability information through the store communication network to the hands-free mobile display device; and

rendering by the control system an overlay image using the alternative product availability information.

12. A method of rendering an overlay image on a hands-free mobile display device, the method comprising:

transmitting the product location request through the hands-free mobile display device to the control system;

receiving eye tracking data from the hands-free mobile display device wherein a micro-electrical mechanical system sensor is used to track eye movement;

receiving by a control system a product location request through a store communications network from the hands-free mobile display device;

associating by the control system the received request with product information stored in a product database located within the control system;

determining the location of the product within the store;

receiving by the control system shopper location information from the hands-free mobile display device;

determining by the control system a route to the determined product location from a determined shopper location based upon the shopper location information;

transmitting by the control system route rendering data through the store communication network including a wireless network to the hands-free mobile display device; and

rendering an overlay image on a lens of the hands-free mobile display device by a projector of the hands-free mobile display device using the transmitted route rendering data.

13. The system of claim 8 , wherein the hands-free mobile display device further comprises a 3-axis gyroscope operable to provide information identifying the orientation of the hands-free mobile display device.

14. The system of claim 13 , wherein the hands-free mobile display device further comprises a micro-electrical mechanical system sensor operable to track the eye movement of a person wearing the hand-free mobile display device and to provide information identifying the person eye position.

15. The method of claim 12 , wherein receiving shopper location information further comprises:

receiving orientation data identifying the orientation of the hands-free mobile display device wherein the orientation data is generated by a 3-axis gyroscope.

Assignments (11)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (REEL 062079, FRAME 0677) Recorded Mar 3, 2026
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: X CORP. (F/K/A TWITTER, INC.)
Reel/Frame 075015/0574 →
RELEASE OF SECURITY INTEREST Recorded Apr 30, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: X CORP. (F/K/A TWITTER, INC.)
Reel/Frame 071127/0240 →
RELEASE OF SECURITY INTEREST Recorded Mar 27, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: X CORP. (F/K/A TWITTER, INC.)
Reel/Frame 070670/0857 →
SECURITY INTEREST Recorded Oct 28, 2022
From: TWITTER, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 061804/0001 →
SECURITY INTEREST Recorded Oct 28, 2022
From: TWITTER, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 061804/0086 →
SECURITY INTEREST Recorded Oct 28, 2022
From: TWITTER, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 062079/0677 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2016
From: VERDI SQUARE, SERIES 67 OF ALLIED SECURITY TRUST I
To: TWITTER, INC.
Reel/Frame 038554/0226 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2015
From: NCR CORPORATION
To: VERDI SQUARE, SERIES 67 OF ALLIED SECURITY TRUST I
Reel/Frame 036083/0939 →
RELEASE OF SECURITY INTEREST Recorded Jun 30, 2015
From: JPMORGAN CHASE BANK, N.A.
To: NCR CORPORATION
Reel/Frame 035935/0718 →
SECURITY AGREEMENT Recorded Jan 15, 2014
From: NCR CORPORATION; NCR INTERNATIONAL, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 032034/0010 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2008
From: BRAVO, LUIS EDUARDO
To: NCR CORPORATION
Reel/Frame 020400/0900 →
Continuity (1)
Related Publication 20090182499A1 · Jul 16, 2009