IP Library Patent Application 18970585
Patent Application
App. No. 18/970,585

SMOOTH OBJECT CORRECTION FOR AUGMENTED REALITY DEVICES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/970,585
Abstract

An augmented reality (“AR”) device applies smooth correction methods to correct the location of the virtual objects presented to a user. The AR device may apply an angular threshold to determine whether a virtual object can be moved from an original location to a target location. An angular threshold is a maximum angle by which a line from the AR device to the virtual object can change within a timestep. Similarly, the AR device may apply a motion threshold, which is a maximum on the distance that a virtual object's location can be corrected based on the motion of the virtual object. Furthermore, the AR device may apply a pixel threshold to the correction of the virtual object's location. A pixel threshold is a maximum on the distance that a pixel projection of the virtual object can change based on the virtual object's change in location.

Claims (60)

1 . A method comprising:

receiving sensor data from one or more sensors of an augmented reality device;

determining a first real-world location of the augmented reality device based on the received sensor data;

determining a first target location for a virtual object based on the first real-world location, wherein the first target location for the virtual object is a location in the real-world relative to the augmented reality device at which the virtual object is targeted to appear to be located when viewed through a display of the augmented reality device;

displaying the virtual object at an original location to a user of the augmented reality device based on the target location and the received sensor data;

receiving updated sensor data from the one or more sensors of the augmented reality device;

determining a second real-world location of the augmented reality device based on the received updated sensor data;

determining a second target location for a virtual object based on the second real-world location;

determining whether the first target location is within a threshold of the second target location based on the updated sensor data, wherein the threshold is an angular threshold, a motion threshold, or a pixel threshold; and

responsive to the first target location being outside of the threshold of the second location, displaying the virtual object to the user at a third target location, wherein the third target location is within the threshold of the first location.

2 . The method of claim 1 , wherein the one or more sensors comprise one or more of a movement sensor, an accelerometer, a gyroscope, an inertial measurement unit, a barometer, a positioning system, a thermometer, or a light sensor.

3 . The method of claim 1 , wherein the augmented reality device is a smartphone.

4 . The method of claim 1 , wherein the threshold is an angular threshold that is a maximum angle by which a line from the augmented reality device to the virtual object can change within a timestep.

5 . The method of claim 4 , wherein determining whether the first target location is within the threshold of the second target location comprises:

identifying a first sight line from the second real-world location to the first target location;

identifying a second sight line from the second real-world location to the second target location; and

determining whether an angle between the first sight line and the second sight line exceeds the angular threshold.

6 . The method of claim 4 , wherein displaying the virtual object to the user at an updated location comprises:

determining parameters of a first line that intersects the second target location and intersects a second line at a right angle, wherein the second line corresponds to the angular threshold.

7 . The method of claim 1 , wherein the threshold is a motion threshold that is a maximum distance that a location of the virtual object can be adjusted from the first target location to the second target location, wherein the motion threshold is based on a motion of the virtual object relative to the augmented reality device.

8 . The method of claim 7 , wherein displaying the virtual object at the first target location further comprises:

displaying the virtual object based on motion instructions for the virtual object, wherein the motion instructions comprise a direction of motion of the virtual object and a motion distance that the virtual object travels within a timestep.

9 . The method of claim 1 , wherein the threshold is a pixel threshold that is a maximum number of pixels that the displayed virtual object may move when updating a location of the virtual object.

10 . The method of claim 9 , wherein determining whether the target location is within a pixel threshold of the original location comprises:

generating a first pixel projection of the virtual object at the first target location;

generating a second pixel projection of the virtual object at the second target location; and

computing a number of pixels between the first pixel projection and the second pixel projection.

11 . The method of claim 10 , wherein computing a number of pixels between the first pixel projection and the second pixel projection comprises:

identifying a first subset of pixels within the first pixel projection that correspond to a portion of the virtual object;

identifying a second subset of pixels within the second pixel projection that correspond to the portion of the virtual object; and

comparing the first subset of pixels to the second subset of pixels.

12 . The method of claim 10 , wherein computing a number of pixels between the first pixel projection and the second pixel projection comprises:

identifying a first subset of pixels of the first pixel projection and a second subset of pixels of the second projection, wherein the first subset of pixels and the second subset of pixels are each a subset of pixels of the corresponding pixel projection that is closest to the other pixel projection.

13 . The method of claim 10 , wherein computing a number of pixels between the first pixel projection and the second pixel projection comprises:

identifying a first center pixel within the first pixel projection;

identifying a second center pixel within the second pixel projection; and

computing a distance between the first center pixel and the second center pixel.

14 . A non-transitory computer-readable medium storing instructions that, when executed by a computer system, causes the computer system to perform operations comprising:

receiving sensor data from one or more sensors of an augmented reality device;

determining a first real-world location of the augmented reality device based on the received sensor data;

determining a first target location for a virtual object based on the first real-world location, wherein the first target location for the virtual object is a location in the real-world relative to the augmented reality device at which the virtual object is targeted to appear to be located when viewed through a display of the augmented reality device;

displaying the virtual object at an original location to a user of the augmented reality device based on the target location and the received sensor data;

receiving updated sensor data from the one or more sensors of the augmented reality device;

determining a second real-world location of the augmented reality device based on the received updated sensor data;

determining a second target location for a virtual object based on the second real-world location;

determining whether the first target location is within a threshold of the second target location based on the updated sensor data, wherein the threshold is an angular threshold, a motion threshold, or a pixel threshold; and

responsive to the first target location being outside of the threshold of the second location, displaying the virtual object to the user at a third target location, wherein the third target location is within the threshold of the first location.

15 . The non-transitory computer-readable medium of claim 14 , wherein the threshold is an angular threshold that is a maximum angle by which a line from the augmented reality device to the virtual object can change within a timestep.

16 . The non-transitory computer-readable medium of claim 15 , wherein determining whether the first target location is within the threshold of the second target location comprises:

identifying a first sight line from the second real-world location to the first target location;

identifying a second sight line from the second real-world location to the second target location; and

determining whether an angle between the first sight line and the second sight line exceeds the angular threshold.

17 . The non-transitory computer-readable medium of claim 14 , wherein the threshold is a motion threshold that is a maximum distance that a location of the virtual object can be adjusted from the first target location to the second target location, wherein the motion threshold is based on a motion of the virtual object relative to the augmented reality device.

18 . The non-transitory computer-readable medium of claim 17 , wherein displaying the virtual object at the first target location further comprises:

displaying the virtual object based on motion instructions for the virtual object, wherein the motion instructions comprise a direction of motion of the virtual object and a motion distance that the virtual object travels within a timestep.

19 . The non-transitory computer-readable medium of claim 14 , wherein the threshold is a pixel threshold that is a maximum number of pixels that the displayed virtual object may move when updating a location of the virtual object.

20 . The non-transitory computer-readable medium of claim 19 , wherein determining whether the target location is within a pixel threshold of the original location comprises:

generating a first pixel projection of the virtual object at the first target location;

generating a second pixel projection of the virtual object at the second target location; and

computing a number of pixels between the first pixel projection and the second pixel projection.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2025
From: NIANTIC, INC.
To: NIANTIC SPATIAL, INC.
Reel/Frame 071555/0833 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2025
From: BENFOLD, BEN; PRISACARIU, VICTOR ADRIAN
To: NIANTIC INTERNATIONAL TECHNOLOGY LIMITED
Reel/Frame 071212/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2025
From: NIANTIC INTERNATIONAL TECHNOLOGY LIMITED
To: NIANTIC, INC.
Reel/Frame 071371/0306 →