IP Library Granted Patent US 12663270
Granted Patent B2
US 12663270 · App. 18/423,851 · Granted Jun 23, 2026

Systems and methods of lift to find augmented reality guidance

Inventors: Navin Naidu (Dublin, CA); Shankara Bhargava (Santa Clara, CA); Deepa Mohan (Los Altos, CA)
Assignee: Walmart Apollo, LLC
G01C21/206G06Q30/0639G06Q30/06443G06T7/73G06T11/00G06V20/20G06Q30/0641G06T2200/24G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12663270
App. No.
18/423,851
Granted
Jun 23, 2026
Kind
B2
Abstract

In various embodiments, systems and methods for augmented reality guidance are disclosed. A first position of a local device and a second position of a first item within a predetermined locale are determined. Route data from the first position to the second position is generated and a position of the local device is tracked. In response to the position of the local device being within a predetermined distance of the second position, an image capture element of the local device is activated. Image data is received. When the first item is within the image data, an item highlighter indicating a position of the first item within the image data is generated and when the first item is not within the image data, a direction indicator indicating a position of the first item relative to a field of view of the image data is generated.

Claims (63)

1 . A system, comprising:

a non-transitory memory;

a processor communicatively coupled to the non-transitory memory, wherein the processor is configured to read a set of instructions to:

determine a first position of a local device within a predetermined locale;

determine a second position of a first item within the predetermined locale;

generate route data indicative of a route from the first position to the second position;

track a real-time position of the local device;

in response to the real-time position of the local device being within a predetermined distance of the second position, automatically and without user intervention, activate an image capture element of the local device;

receive image data from the image capture element of the local device; determine whether the first item is within the image data;

in response to determining the first item is not within the image data, generate a direction indicator indicating a position of the first item relative to a field of view of the image data; and

in response to determining the first item is within the image data, generate an item highlighter indicating a position of the first item within the image data, the item highlighter replacing the direction indicator.

2 . The system of claim 1 , wherein the direction indicator is generated by:

identifying one or more location identifiers within the image data;

determining a relative location of the first item with respect to the one or more location identifiers; and

generating the direction indicators to indicate the relative position of the first item.

3 . The system of claim 2 , wherein the one or more location identifiers include a second item.

4 . The system of claim 2 , wherein the one or more location identifiers are each associated with a known location within the predetermined locale.

5 . The system of claim 1 , wherein the processor is configured to read the set of instructions to:

generate a first interface including a virtual representation of at least a portion of the predetermined locale and at least one route indicator corresponding to the route from the first position to the second position; and

generate a second interface including the image data, wherein the second interface includes one of the item highlighter or the direction indicator.

6 . The system of claim 5 , wherein the one of the item highlighter or the direction indicator includes a visual element superimposed over the image data.

7 . The system of claim 1 , wherein the first position of the local device is determined by one or more sensors positioned within the predetermined locale.

8 . The system of claim 7 , wherein the real-time position of the local device is tracked based, at least in part, on data generated by at least one sensor integrated with the local device.

9 . A computer-implemented method, comprising:

determining, by a position tracking engine, a first position of a local device within a predetermined locale;

obtaining a second position of a first item within the predetermined locale;

generating, by a mapping engine, route data indicative of a route from the first position to the second position;

tracking, by the position tracking engine, a real-time position of the local device;

in response to the real-time position of the local device being within a predetermined distance of the second position, automatically and without user intervention, activating an image capture element of the local device;

receiving, by a computer vision engine, image data from the image capture element of the local device;

determining, by the computer vision engine, whether the first item is within the image data;

in response to determining the first item is not within the image data, generating, by the interface generation engine, a direction indicator indicating a position of the first item relative to a field of view of the image data; and

in response to determining the first item is within the image data, generating, by an interface generation engine, an item highlighter indicating a position of the first item within the image data, the item highlighter replacing the direction indicator.

10 . The computer-implemented method of claim 9 , wherein the direction indicator is generated by:

identifying one or more location identifiers within the image data;

determining a relative location of the first item with respect to the one or more location identifiers; and

generating the direction indicators to indicate the relative position of the first item.

11 . The computer-implemented method of claim 10 , wherein the one or more location identifiers include a second item.

12 . The computer-implemented method of claim 10 , wherein the one or more location identifiers are each associated with a known location within the predetermined locale.

13 . The computer-implemented method of claim 9 , comprising:

generating a first interface including a virtual representation of at least a portion of the predetermined locale and at least one route indicator corresponding to the route from the first position to the second position; and

generating a second interface including the image data, wherein the second interface includes one of the item highlighter or the direction indicator.

14 . The computer-implemented method of claim 13 , wherein the one of the item highlighter or the direction indicator include a visual element superimposed over the image data.

15 . The computer-implemented method of claim 9 , wherein the first position of the local device is determined by one or more sensors positioned within the predetermined locale.

16 . The computer-implemented method of claim 15 , wherein the real-time position of the local device is tracked based, at least in part, on data generated by at least one sensor integrated with the local device.

17 . A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause a device to perform operations comprising:

determining, by a position tracking engine, a first position of a local device within a predetermined locale;

obtaining a second position of a first item within the predetermined locale;

generating, by a mapping engine, route data indicative of a route from the first position to the second position;

tracking, by the position tracking engine, a real-time position of the local device;

in response to the real-time position of the local device being within a predetermined distance of the second position, automatically and without user intervention, activating an image capture element of the local device;

receiving, by a computer vision engine, image data from the image capture element of the local device;

determining, by the computer vision engine, whether the first item is within the image data;

in response to determining the first item is not within the image data, generating, by the interface generation engine, a direction indicator indicating a position of the first item relative to a field of view of the image data, the direction indicator expressing relative movement in one or more of six degrees of movement including left-right, up-down, front-back, roll, yaw, or pitch using one or more location identifiers comprising fixed location markers and/or known items with known locations; and

in response to determining the first item is within the image data, generating, by an interface generation engine, an item highlighter indicating a position of the first item within the image data, the item highlighter comprising a dynamic visual overlay that changes color or saturation based on user proximity, the item highlighter replacing the direction indicator.

18 . The non-transitory computer-readable medium of claim 17 , wherein the direction indicator is generated by:

identifying one or more location identifiers within the image data;

determining a relative location of the first item with respect to the one or more location identifiers; and

generating the direction indicators to indicate the relative position of the first item.

19 . The non-transitory computer-readable medium of claim 18 , wherein the one or more location identifiers include a second item associated with a known location within the predetermined locale.

20 . The non-transitory computer-readable medium of claim 17 , wherein the instructions cause the device to perform operations comprising:

generating a first interface including a virtual representation of at least a portion of the predetermined locale and at least one route indicator corresponding to the route from the first position to the second position; and

generating a second interface including the image data, wherein the second interface includes one of the item highlighter or the direction indicator.