IP Library Granted Patent US 12,260,016
Granted Patent B2
US 12,260,016 · App. 18/623,982 · Granted Mar 25, 2025

Reducing startup time of augmented reality experience

Inventors: Jeroen Diederik Hol (Hengelo, NL); Matthias Kalkgruber (Vienna, AT); Erick Mendez Mendez (Vienna, AT); Niall Murphy (Dublin, IE); Gerald Nilles (Culver City, CA); Mathieu Emmanuel Vignau (Los Angeles, CA)
Assignee: Snap Inc.
G06F3/012G01C21/1656G02B27/0172G02B27/0179G06F3/14G06T7/20G02B2027/0138G02B2027/014G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,016
App. No.
18/623,982
Granted
Mar 25, 2025
Kind
B2
Abstract

A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.

Claims (53)

1. A method comprising:

operating a device in a low-power mode using first tracking data from a first sensor of the device in response to powering the device;

detecting, at the device, an application request while the device operates in the low-power mode;

in response to detecting the application request, displaying content in a display of the device based on the first tracking data;

in response to detecting the application request, switching the device from the low-power mode to a high-power mode that uses second tracking data from a second sensor of the device; and

updating the content in the display based on the second tracking data.

2. The method of claim 1 , wherein the device comprises an augmented reality device, wherein the application request includes a request to operate an augmented reality application at the device.

3. The method of claim 1 , wherein operating the device in the low-power mode comprises:

activating the first sensor without activating the second sensor after powering the device; and

accessing the first tracking data from the first sensor.

4. The method of claim 1 , wherein operating the device in the high-power mode comprises:

activating the second sensor in response to detecting the application request; and

accessing the second tracking data from the second sensor.

5. The method of claim 1 , further comprising:

performing a device initialization operation upon powering the device, the device initialization operation being separate from the application request; and

in response to the device initialization operation, activating the first sensor without activating the second sensor.

6. The method of claim 1 , wherein the first sensor comprises an inertial measurement unit (IMU) sensor having a first power consumption.

7. The method of claim 6 , wherein the second sensor comprises an image sensor having a second power consumption that is higher than the first power consumption.

8. The method of claim 7 , wherein the second tracking data comprises a set of image frames received by the image sensor.

9. The method of claim 1 , wherein the first tracking data comprise rotational pose data from a six-degrees of freedom tracking system.

10. The method of claim 9 , wherein the second tracking data comprise the rotational pose data and translational pose data from the six-degrees of freedom tracking system.

11. A device comprising:

a first sensor;

a second sensor;

a display;

one or more processors; and

a memory storing instructions that, when executed by the one or more processors, configure the device to perform operations comprising:

operating the device in a low-power mode using first tracking data from the first sensor in response to powering the device;

detecting, at the device, an application request while the device operates in the low-power mode;

in response to detecting the application request, displaying content in the display based on the first tracking data;

in response to detecting the application request, switching the device from the low-power mode to a high-power mode that uses second tracking data from the second sensor; and

updating the content in the display based on the second tracking data.

12. The device of claim 11 , wherein the device comprises an augmented reality device, wherein the application request includes a request to operate an augmented reality application at the device.

13. The device of claim 11 , wherein operating the device in the low-power mode comprises:

activating the first sensor without activating the second sensor after powering the device; and

accessing the first tracking data from the first sensor.

14. The device of claim 11 , wherein operating the device in the high-power mode comprises:

activating the second sensor in response to detecting the application request; and

accessing the second tracking data from the second sensor.

15. The device of claim 11 , wherein the operations further comprise:

performing a device initialization operation upon powering the device, the device initialization operation being separate from the application request, and

in response to the device initialization operation, activating the first sensor without activating the second sensor.

16. The device of claim 11 , wherein the first sensor comprises an inertial measurement unit (IMU) sensor having a first power consumption.

17. The device of claim 16 , wherein the second sensor comprises an image sensor having a second power consumption that is higher than the first power consumption.

18. The device of claim 17 , wherein the second tracking data comprises a set of image frames received by the image sensor.

19. The device of claim 11 , wherein the first tracking data comprise rotational pose data from a six-degrees of freedom tracking system,

wherein the second tracking data comprise the rotational pose data and translational pose data from the six-degrees of freedom tracking system.

20. A non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium including instructions that when executed by a device, cause the device to perform operations comprising:

operating a device in a low-power mode using first tracking data from a first sensor of the device in response to powering the device;

detecting, at the device, an application request while the device operates in the low-power mode;

in response to detecting the application request, displaying content in a display of the device based on the first tracking data;

in response to detecting the application request, switching the device from the low-power mode to a high-power mode that uses second tracking data from a second sensor of the device; and

updating the content in the display based on the second tracking data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2024
From: HOL, JEROEN DIEDERIK; KALKGRUBER, MATTHIAS; MENDEZ, ERICK MENDEZ; MURPHY, NIALL; NILLES, GERALD; VIGNAU, MATHIEU EMMANUEL
To: SNAP INC.
Reel/Frame 066975/0086 →
Continuity (4)
Continuation 18201419 · May 24, 2023
Continuation 17743194 · May 12, 2022
Provisional Application 63188600 · May 14, 2021
Related Publication 20240248531A1 · Jul 25, 2024
References Cited (27)
US 10884505B1 · Huo et al. · 2021 [cited by applicant]
US 11681361B2 · Hol et al. · 2023 [cited by applicant]
US 12008155B2 · Hol · 2024 [cited by examiner]
US 20120147531A1 · Rabii · 2012 [cited by applicant]
US 20150193018A1 · Venable et al. · 2015 [cited by applicant]
US 20150317832A1 · Ebstyne · 2015 [cited by applicant]
US 20170337839A1 · Yudofsky · 2017 [cited by applicant]
US 20180108179A1 · Tomlin et al. · 2018 [cited by applicant]
US 20180261012A1 · Mullins · 2018 [cited by applicant]
US 20190282324A1 · Freeman et al. · 2019 [cited by applicant]
US 20200074738A1 · Hare et al. · 2020 [cited by applicant]
US 20200159337A1 · Kin · 2020 [cited by applicant]
US 20220331013A1 · Shelton, IV et al. · 2022 [cited by applicant]
US 20220365592A1 · Hol et al. · 2022 [cited by applicant]
US 20230297164A1 · Hol et al. · 2023 [cited by applicant]
CN 117321543A · 2023 [cited by applicant]
WO WO2017143716A1 · 2017 [cited by applicant]
WO WO2022241123A1 · 2022 [cited by applicant]
“U.S. Appl. No. 17/743,194, Non Final Office Action mailed Nov. 10, 2022”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/743,194, Notice of Allowance mailed Feb. 8, 2023”, 6 pgs. [cited by applicant]
“U.S. Appl. No. 17/743,194, Response filed Jan. 19, 2023 to Non Final Office Action mailed Nov. 10, 2022”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 18/201,419, Non Final Office Action mailed Dec. 20, 2023”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 18/201,419, Notice of Allowance mailed Jan. 24, 2024”, 5 pgs. [cited by applicant]
“U.S. Appl. No. 18/201,419, Response filed Jan. 3, 2024 to Non Final Office Action mailed Dec. 20, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/029005, International Preliminary Report on Patentability mailed Nov. 23, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/029005, International Search Report mailed Aug. 24, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/029005, Written Opinion mailed Aug. 24, 2022”, 7 pgs. [cited by applicant]