IP Library Granted Patent US 12,411,560
Granted Patent B2
US 12,411,560 · App. 18/435,540 · Granted Sep 9, 2025

Dynamic initialization of 3DOF AR tracking system

Inventors: Jeroen Diederik Hol (Hengelo, NL); Matthias Kalkgruber (Vienna, AT)
Assignee: Snap Inc.
G06F3/0346G06F3/038
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,411,560
App. No.
18/435,540
Filed
Feb 7, 2024
Granted
Sep 9, 2025
Kind
B2
Art Unit
2624
USPC
345/158
Abstract

A method for dynamically initializing a 3 degrees of freedom (3DOF) tracking device is described. In one aspect, the method includes accessing a gyroscope signal from a gyroscope of the 3DOF tracking device, accessing an accelerometer signal from an accelerometer of the 3DOF tracking device, determining an initial state includes a combination of an initial orientation, an initial position, and an initial velocity of the 3DOF tracking device, the initial state indicating a starting condition of the 3DOF tracking device, integrating the gyroscope signal and the accelerometer signal to obtain orientation and position signals using the initial state, and refining an inclination signal of the orientation signal using the position signal.

Claims (67)

1. A method comprising:

turning on a 3 degrees of freedom (3DOF) tracking device;

in response to turning on the 3DOF tracking device, performing a dynamic initialization process of the 3DOF tracking device by determining an initial state that indicates a dynamic and non-stationary condition of the 3DOF tracking device, the initial state corresponding with turning on the 3DOF tracking device; and

operating the 3DOF tracking device based on the dynamic and non-stationary condition of the 3DOF tracking device after the dynamic initialization process.

2. The method of claim 1 , wherein the initial state comprises a combination of an initial orientation of the 3DOF tracking device, an initial position of the 3DOF tracking device, and an initial velocity of the 3DOF tracking device, wherein the 3DOF tracking device is part of an augmented reality device.

3. The method of claim 2 , wherein determining the initial state further comprises:

in response to turning on the 3DOF tracking device, accessing a gyroscope signal from a gyroscope of the 3DOF tracking device;

in response to turning on the 3DOF tracking device, accessing an accelerometer signal from an accelerometer of the 3DOF tracking device;

integrating the gyroscope signal and the accelerometer signal to obtain an orientation signal and a position signal using the initial state;

refining an inclination signal of the orientation signal using the position signal; and

constraining the position signal to remain substantially close to the initial position of the 3DOF tracking device.

4. The method of claim 3 , wherein determining the initial state comprises:

determining the initial state is based on the accelerometer signal without requesting a user of the 3DOF tracking device to remain in stationary conditions.

5. The method of claim 3 , wherein determining the initial state comprises:

using previously estimated orientation and positional signals of the 3DOF tracking device.

6. The method of claim 3 , wherein integrating the gyroscope signal and the accelerometer signal comprise:

integrating the gyroscope signal to determine the orientation signal starting from the initial orientation;

rotating the accelerometer signal from the accelerometer using the orientation signal;

subtracting gravity; and

performing a double integration starting from the initial position to determine the position signal.

7. The method of claim 3 , further comprising:

after integrating only the gyroscope signal and the accelerometer signal, correcting the gyroscope signal and the accelerometer signal with biases; and

refining the inclination signal and biases using the position signal.

8. The method of claim 3 , further comprising:

after integrating only the gyroscope signal and the accelerometer signal, accessing a magnetometer signal from a magnetometer of the 3DOF tracking device; and

refining the orientation signal using the magnetometer signal.

9. The method of claim 3 , further comprising:

after integrating only the gyroscope signal and the accelerometer signal, accessing a location signal from a radio-based sensor of the 3DOF tracking device; and

refining the position signal using the location signal.

10. The method of claim 1 , further comprising:

detecting that the 3DOF tracking device is switched on; and

in response to detecting that the 3DOF tracking device is switched on, initializing the 3DOF tracking device without waiting for a stationary condition of the 3DOF tracking device.

11. A computing apparatus comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the apparatus to perform operations comprising:

turning on a 3 degrees of freedom (3DOF) tracking device;

in response to turning on the 3DOF tracking device, performing a dynamic initialization process of the 3DOF tracking device by determining an initial state that indicates a dynamic and non-stationary condition of the 3DOF tracking device, the initial state corresponding with turning on the 3DOF tracking device; and

operating the 3DOF tracking device based on the dynamic and non-stationary condition of the 3DOF tracking device after the dynamic initialization process.

12. The computing apparatus of claim 11 , wherein the initial state comprises a combination of an initial orientation of the 3DOF tracking device, an initial position of the 3DOF tracking device, and an initial velocity of the 3DOF tracking device, wherein the 3DOF tracking device is part of an augmented reality device.

13. The computing apparatus of claim 12 , wherein determining the initial state further comprises:

accessing a gyroscope signal from a gyroscope of the 3DOF tracking device;

accessing an accelerometer signal from an accelerometer of the 3DOF tracking device;

integrating the gyroscope signal and the accelerometer signal to obtain an orientation signal and a position signal using the initial state;

refining an inclination signal of the orientation signal using the position signal; and

constraining the position signal to remain substantially close to the initial position of the 3DOF tracking device.

14. The computing apparatus of claim 13 , wherein determining the initial state comprises:

determining the initial state is based on the accelerometer signal without requesting a user of the 3DOF tracking device to remain in stationary conditions.

15. The computing apparatus of claim 13 , wherein determining the initial state comprises:

using previously estimated orientation and positional signals of the 3DOF tracking device.

16. The computing apparatus of claim 13 , wherein integrating the gyroscope signal and the accelerometer signal comprise:

integrating the gyroscope signal to determine the orientation signal starting from the initial orientation;

rotating the accelerometer signal from the accelerometer using the orientation signal;

subtracting gravity; and

performing a double integration starting from the initial position to determine the position signal.

17. The computing apparatus of claim 13 , wherein the operations further comprise:

after integrating only the gyroscope signal and the accelerometer signal, correcting the gyroscope signal and the accelerometer signal with biases, and

refining the inclination signal and biases using the position signal.

18. The computing apparatus of claim 13 , wherein the operations further comprise:

after integrating only the gyroscope signal and the accelerometer signal, accessing a magnetometer signal from a magnetometer of the 3DOF tracking device; and

refining the orientation signal using the magnetometer signal.

19. The computing apparatus of claim 13 , wherein the operations further comprise:

after integrating only the gyroscope signal and the accelerometer signal, accessing a location signal from a radio-based sensor of the 3DOF tracking device; and

refining the position signal using the location signal.

20. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

turning on a 3 degrees of freedom (3DOF) tracking device;

in response to turning on the 3DOF tracking device, performing a dynamic initialization process of the 3DOF tracking device by determining an initial state that indicates a dynamic and non-stationary condition of the 3DOF tracking device, the initial state corresponding with turning on the 3DOF tracking device; and

operating the 3DOF tracking device based on the dynamic and non-stationary condition of the 3DOF tracking device after the dynamic initialization process.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2024
From: HOL, JEROEN DIEDERIK; KALKGRUBER, MATTHIAS
To: SNAP INC.
Reel/Frame 066439/0888 →
Continuity (3)
Continuation 17524423 · Nov 11, 2021
Provisional Application 63189845 · May 18, 2021
Related Publication 20240176428A1 · May 30, 2024
References Cited (34)
US 10514776B2 · Liberty et al. · 2019 [cited by applicant]
US 10545584B2 · Tome et al. · 2020 [cited by applicant]
US 10686980B1 · Ricci et al. · 2020 [cited by applicant]
US 10884505B1 · Huo et al. · 2021 [cited by applicant]
US 11435820B1 · Hirsh et al. · 2022 [cited by applicant]
US 11676348B2 · Simpson et al. · 2023 [cited by applicant]
US 20050174324A1 · Liberty et al. · 2005 [cited by applicant]
US 20080080789A1 · Marks et al. · 2008 [cited by applicant]
US 20120212374A1 · Kirby et al. · 2012 [cited by applicant]
US 20130179108A1 · Joseph et al. · 2013 [cited by applicant]
US 20140062881A1 · Solomon et al. · 2014 [cited by applicant]
US 20150261291A1 · Mikhailov · 2015 [cited by examiner]
US 20150294505A1 · Atsmon · 2015 [cited by examiner]
US 20160139665A1 · Lopez et al. · 2016 [cited by applicant]
US 20180031829A1 · Thomas · 2018 [cited by examiner]
US 20180088685A1 · Sang et al. · 2018 [cited by applicant]
US 20180164878A1 · Mcgee et al. · 2018 [cited by applicant]
US 20200319471A1 · Goslin · 2020 [cited by examiner]
US 20220075447A1 · Guo et al. · 2022 [cited by applicant]
US 20220374091A1 · Hol et al. · 2022 [cited by applicant]
CN 117337422A · 2024 [cited by applicant]
EP 2008697A1 · 2008 [cited by applicant]
WO WO2022245815A1 · 2022 [cited by applicant]
“U.S. Appl. No. 17/524,423, Final Office Action mailed Feb. 14, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/524,423, Non Final Office Action mailed Jul. 21, 2023”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 17/524,423, Non Final Office Action mailed Oct. 5, 2022”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/524,423, Notice of Allowance mailed Nov. 24, 2023”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/524,423, Response filed May 15, 2023 to Final Office Action mailed Feb. 14, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/524,423, Response filed Oct. 23, 2023 to Non Final Office Action mailed Jul. 21, 2023”, 13 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/029621, International Preliminary Report on Patentability mailed Nov. 30, 2023”, 11 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/029621, International Search Report mailed Sep. 6, 2022”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/029621, Written Opinion mailed Sep. 6, 2022”, 9 pgs. [cited by applicant]
Manon, Kok, et al., “Using Inertial Sensors for Position and Orientation Estimation”, arxiv.org, Cornell University Library, 201 Olin Library Cornell University Ithaca, NY 14853, (Apr. 20, 2017). [cited by applicant]
Wetzstein, Gordon, “EE 267 Virtual Reality Course Notes: 3-DOF Orientation Tracking with IMUs”, <https://web.archive.org/web/20200427033716/https://stanford.edu/class/ee267/notes/ee267_notes_imu.pdf>, (Apr. 27, 2020), 1… [cited by applicant]