IP Library Granted Patent US 11,657,582
Granted Patent B1
US 11,657,582 · App. 17/694,081 · Granted May 23, 2023

Precise plane detection and placement of virtual objects in an augmented reality environment

Inventors: Devin Bhushan (San Jose, CA); Jesse Chor (Saratoga, CA); Glen Wong (Santa Clara, CA)
Assignee: SPLUNK INC.
G06T19/006G06T7/70G06K19/06037
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,657,582
App. No.
17/694,081
Filed
Mar 14, 2022
Granted
May 23, 2023
Kind
B1
Examiner
WU, YANNA
Art Unit
2611
USPC
345/633
Abstract

A mobile device executes an augmented reality (AR) software application that detects an orientation of a client device. The AR software application projects a line from a reference position on the client device to a physical object. The AR software application identifies a first location on the physical object that intersects with the line. The AR software application determines an x-coordinate and a y-coordinate of a portion of the physical object included in an image displayed on the client device based on the first location. The AR software application receives a z-coordinate of the portion of the physical object. In response to receiving user input via the client device, the AR software application anchors an augmented reality object at a second location that corresponds to the x-coordinate, the y-coordinate, and the z-coordinate. The orientation of the augmented reality object corresponds to the orientation of the client device.

Claims (62)

1. A computer-implemented method, comprising:

detecting a first orientation of a client device;

identifying a first location on a physical object with respect to a reference point associated with the client device;

determining, based on the first location, a second location associated with the physical object and included in an image displayed on the client device; and

anchoring an augmented reality object at the second location, wherein an orientation of the anchored augmented reality object is determined based on the first orientation of the client device without consideration of an orientation of the physical object,

wherein, once anchored, the augmented reality object remains in a same position and orientation relative to the physical object.

2. The computer-implemented method of claim 1 , further comprising:

determining that the client device has moved to a new orientation or a new position; and

modifying the anchored augmented reality object based on the new orientation or the new position, wherein, after modification, the anchored augmented reality object remains in the same position and orientation relative to the physical object as prior to the modification.

3. The computer-implemented method of claim 1 , further comprising:

receiving tag data via a tag that is associated with the physical object; and

generating the augmented reality object based on the tag data.

4. The computer-implemented method of claim 1 , further comprising:

receiving tag data via a tag that is associated with the physical object; and

generating the augmented reality object based on the tag data,

wherein the tag comprises at least one of a quick response (QR) code, a near-field communication (NFC) tag, and a universal product code (UPC) marker.

5. The computer-implemented method of claim 1 , further comprising:

receiving tag data via a tag that is associated with the physical object;

transmitting, to a server, a query based on the tag data;

receiving, from the server, search results in response to the query; and

generating the augmented reality object based on the search results.

6. The computer-implemented method of claim 1 , further comprising determining the second location based on an x-coordinate, a y-coordinate, and a z-coordinate associated with the first location.

7. The computer-implemented method of claim 1 , further comprising determining the second location based on an x-coordinate, a y-coordinate, and a z-coordinate associated with the first location, and wherein the z-coordinate is determined by:

computing a distance between the reference point and the first location; and

setting the z-coordinate based on the distance.

8. The computer-implemented method of claim 1 , wherein the augmented reality object comprises an overlay of a visual representation of data associated with the physical object.

9. The computer-implemented method of claim 1 , wherein the augmented reality object comprises an overlay of a visual representation of data associated with the physical object, and the data is generated by executing a query of machine data.

10. The computer-implemented method of claim 1 , further comprising establishing an anchor point within an augmented reality environment, wherein the first location is specified relative to the anchor point.

11. The computer-implemented method of claim 1 , further comprising:

generating a model of a plurality of physical objects, including the physical object, that are visible within an augmented reality environment; and

determining the first location based on the model of the plurality of physical objects.

12. The computer-implemented method of claim 1 , wherein the reference point is associated with at least one of a camera related to the client device and a location sensor related to the client device.

13. One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

detecting a first orientation of a client device;

identifying a first location on a physical object with respect to a reference point associated with the client device;

determining, based on the first location, a second location associated with the physical object and included in an image displayed on the client device; and

anchoring an augmented reality object at the second location, wherein an orientation of the anchored augmented reality object is determined based on the first orientation of the client device without consideration of an orientation of the physical object,

wherein, once anchored, the augmented reality object remains in a same position and orientation relative to the physical object.

14. The one or more non-transitory computer-readable storage media of claim 13 , further including instructions that, when executed by the processor, cause the processor to perform the steps of:

receiving tag data via a tag that is associated with the physical object; and

generating the augmented reality object based on the tag data.

15. The one or more non-transitory computer-readable storage media of claim 13 , further including instructions that, when executed by the processor, cause the processor to perform the steps of:

receiving tag data via a tag that is associated with the physical object; and

generating the augmented reality object based on the tag data,

wherein the tag comprises at least one of a quick response (QR) code, a near-field communication (NFC) tag, and a universal product code (UPC) marker.

16. The one or more non-transitory computer-readable storage media of claim 13 , further including instructions that, when executed by the processor, cause the processor to perform the steps of:

receiving tag data via a tag that is associated with the physical object;

transmitting, to a server, a query based on the tag data;

receiving, from the server, search results in response to the query; and

generating the augmented reality object based on the search results.

17. The one or more non-transitory computer-readable storage media of claim 13 , further including instructions that, when executed by the processor, cause the processor to perform the steps of: determining the second location based on an x-coordinate, a y-coordinate, and a z-coordinate associated with the first location.

18. The one or more non-transitory computer-readable storage media of claim 13 , further including instructions that, when executed by the processor, cause the processor to perform the steps of: determining the second location based on an x-coordinate, a y-coordinate, and a z-coordinate associated with the first location wherein the z-coordinate is determined by:

computing a distance between the reference point and the first location; and

setting the z-coordinate based on the distance.

19. The one or more non-transitory computer-readable storage media of claim 13 , wherein the augmented reality object comprises an overlay of a visual representation of data associated with the physical object.

20. A computing device, comprising:

a memory that includes instructions; and

a processor that is coupled to the memory and, when executing the instructions:

detect a first orientation of a client device;

identify a first location on a physical object with respect to a reference point associated with the client device;

determine, based on the first location, a second location associated with the physical object and included in an image displayed on the client device; and

anchor an augmented reality object at the second location, wherein an orientation of the anchored augmented reality object is determined based on the first orientation of the client device without consideration of an orientation of the physical object, wherein, once anchored, the augmented reality object remains in a same position and orientation relative to the physical object.

Assignments (3)
CHANGE OF NAME Recorded Jul 22, 2025
From: SPLUNK INC.
To: SPLUNK LLC
Reel/Frame 072170/0599 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2025
From: SPLUNK LLC
To: CISCO TECHNOLOGY, INC.
Reel/Frame 072173/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2022
From: BHUSHAN, DEVIN; CHOR, JESSE; WONG, GLEN
To: SPLUNK INC.
Reel/Frame 059937/0167 →
Continuity (2)
Continuation 17142956 · Jan 6, 2021
Continuation 16264504 · Jan 31, 2019