IP Library Granted Patent US 11,681,361
Granted Patent B2
US 11,681,361 · App. 17/743,194 · Granted Jun 20, 2023

Reducing startup time of augmented reality experience

Inventors: Jeroen Diederik Hol (Hengelo, NL); Matthias Kalkgruber (Vienna, AT); Erick Mendez Mendez (Vienna, AT); Niall Murphy (Dublin, IE); Gerald Nilles (Culver City, CA); Mathieu Emmanuel Vignau (Los Angeles, CA)
Assignee: Snap Inc.
G06F3/012G01C21/1656G02B27/0172G02B27/0179G06F3/14G06T7/20G02B2027/014G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,681,361
App. No.
17/743,194
Granted
Jun 20, 2023
Kind
B2
Abstract

A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.

Claims (54)

1. A method comprising:

receiving, at a device, a device initialization request without an augmented reality experience request, the device comprising a first set of sensors and a second set of sensors;

in response to the device initialization request, activating the first set of sensors without the second set of sensors;

receiving first tracking data based on the activated first set of sensors;

receiving, at the device, the augmented reality experience request;

in response to the augmented reality experience request:

causing display, at the device of a set of augmented reality content items based on the first tracking data, and

activating the second set of sensors;

receiving second tracking data based on the activated second set of sensors; and

updating the display of the set of augmented reality content items based on the second tracking data.

2. The method of claim 1 , wherein the second tracking data is further based on the activated first set of sensors.

3. The method of claim 1 , wherein the first set of sensors comprises inertial measurement unit (IMU) sensors with a first power consumption.

4. The method of claim 3 , wherein the second set of sensors comprises image sensors with a second power consumption that is higher than the first power consunipti on.

5. The method of claim 4 , wherein the second tracking data comprises a set of image frames received by the image sensors.

6. The method of claim 1 , wherein receiving the first tracking data comprises:

receiving the first tracking data from a six-degrees of freedom tracking system, wherein the six-degrees of freedom tracking system determines rotational pose data.

7. The method of claim 1 , wherein receiving the second tracking data comprises:

receiving the second tracking data from a six-degrees of freedom tracking system, wherein the six-degrees of freedom tracking system determines rotational pose data and translational pose data.

8. A computing apparatus comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the apparatus to:

receive, at a device, a device initialization request without an augmented reality experience request, the device comprising a first set of sensors and a second set of sensors;

in response to the device initialization request, activate the first set of sensors without the second set of sensors;

receive first tracking data based on the activated first set of sensors;

receive, at the device, the augmented reality experience request;

in response to the augmented reality experience request:

cause display, at the device of a set of augmented reality content items based on the first tracking data, and

activate the second set of sensors;

receive second tracking data based on the activated second set of sensors; and

update the display of the set of augmented reality content items based on the second tracking data.

9. The computing apparatus of claim 8 , wherein the second tracking data is further based on the activated first set of sensors.

10. The computing apparatus of claim 8 , wherein the first set of sensors comprises inertial measurement unit (IMU) sensors with a first power consumption.

11. The computing apparatus of claim 10 , wherein the second set of sensors comprises image sensors with a second power consumption that is higher than the first power consumption.

12. The computing apparatus of claim 11 , wherein the second tracking data comprises a set of image frames received by the image sensors.

13. The computing apparatus of claim 8 , wherein receiving the first tracking data comprises:

receive the first tracking data from a six-degrees of freedom tracking system herein the six-degrees of freedom tracking system determines rotational pose data.

14. The computing apparatus of claim 8 , wherein receiving the second tracking data comprises:

receive the second tracking data from a six-degrees of freedom tracking system, wherein the six-degrees of freedom tracking system determines rotational pose data and translational pose data.

15. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

receive, at a device, a device initialization request without an augmented reality experience request, the device comprising a first set of sensors and a second set of sensors;

in response to the device initializ tion request, activate the first set of sensors without the second set of sensors;

receive first tracking data based on the activated first set of sensors;

receive, at the device, the augmented reality experience request;

in response to the augmented reality experience request:

cause display, at the device of a set of augmented reality content items based on the st tracking data, and

activate the second set of sensors;

receive second tracking data based on the activated second set of sensors; and

update the display of the set of augmented reality content items based on the second tracking data.

16. The computer-readable storage medium of claim 15 , wherein the second tracking data is further based on the activated first set of sensors.

17. The computer-readable storage medium of claim 15 , wherein the first set of sensors comprises inertial measurement unit (IMU) sensors with a first power consumption.

18. The computer-readable storage medium of claim 17 , wherein the second set of sensors comprises image sensors with a second power consumption that is higher than the first power consumption.

19. The computer-readable storage medium of claim 18 , wherein the second tracking data comprises a set of image frames received by the image sensors.

20. The computer-readable storage medium of claim 15 , wherein receiving the first tracking data comprises:

receive the first tracking data from a six-degrees of freedom tracking system, wherein the six-degrees of freedom tracking system determines rotational pose data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2022
From: HOL, JEROEN DIEDERIK; KALKGRUBER, MATTHIAS; MENDEZ, ERICK MENDEZ; MURPHY, NIALL; NILLES, GERALD; VIGNAU, MATHIEU EMMANUEL
To: SNAP INC.
Reel/Frame 061910/0180 →
Continuity (2)
Provisional Application 63188600 · May 14, 2021
Related Publication 20220365592A1 · Nov 17, 2022
Cited By (1)
US 12,260,016