IP Library Granted Patent US 12,333,066
Granted Patent B2
US 12,333,066 · App. 18/745,940 · Granted Jun 17, 2025

Determining angular acceleration

Inventors: Arnau Franci Rodon (San Francisco, CA); Omid Ghasemalizadeh (San Jose, CA)
Assignee: Magic Leap, Inc.
G06F3/012G01P15/08G01P15/165G06F3/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,066
App. No.
18/745,940
Granted
Jun 17, 2025
Kind
B2
Abstract

Disclosed herein are systems and methods for calculating angular acceleration based on inertial data using two or more inertial measurement units (IMUs). The calculated angular acceleration may be used to estimate a position of a wearable head device comprising the IMUs. Virtual content may be presented based on the position of the wearable head device. In some embodiments, a first IMU and a second IMU share a coincident measurement axis.

Claims (44)

1. A system comprising:

a first inertial measurement unit and a second inertial measurement unit, wherein the second inertial measurement unit is disposed at a fixed position with respect to the first inertial measurement unit; and

one or more processors configured to perform a method comprising:

receiving first inertial data via the first inertial measurement unit;

receiving second inertial data via the second inertial measurement unit;

calculating an angular acceleration based on the first inertial data and based further on the second inertial data;

estimating a position of a wearable head device based on the angular acceleration, wherein:

the estimating the position of the wearable head device based on the angular acceleration comprises calculating a pre-integration term based on the angular acceleration, and

the pre-integration term relates a first state of the wearable head device to a second state of the wearable head device; and

performing an operation based on the position of the wearable head device.

2. The system of claim 1 , wherein the calculating the pre-integration term comprises determining a single relative motion constraint based on the first inertial data.

3. The system of claim 1 , wherein the method further comprises estimating the position further based on the pre-integration term.

4. The system of claim 1 , wherein the method further comprises performing simultaneous localization and mapping via the pre-integration term.

5. The system of claim 1 , wherein the method further comprises determining a relative motion constraint between the first state and the second state based on the pre-integration term.

6. The system of claim 1 , wherein each of the first state and the second state comprises a respective keyrig pose.

7. The system of claim 1 , wherein each of the first state and the second state comprises a respective quaternion.

8. The system of claim 1 , wherein the estimating the position of the wearable head device is further based on bias data associated with the first inertial measurement unit.

9. The system of claim 1 , wherein the method further comprises predicting a second position of the wearable head device based on the angular acceleration and based further on the position of the wearable head device.

10. The system of claim 1 , wherein the operation comprises presenting virtual content via the wearable head device.

11. The system of claim 10 , wherein a position of the virtual content is determined based on the position of the wearable head device.

12. The system of claim 1 , wherein each of the first state and the second state comprises respective position data and respective velocity data.

13. A method comprising:

receiving first inertial data via a first inertial measurement unit;

receiving second inertial data via a second inertial measurement unit, wherein the second inertial measurement unit is disposed at a fixed position with respect to the first inertial measurement unit;

calculating an angular acceleration based on the first inertial data and based further on the second inertial data;

estimating a position of a wearable head device based on the angular acceleration,

wherein:

the estimating the position of the wearable head device based on the angular acceleration comprises calculating a pre-integration term based on the angular acceleration, and

the pre-integration term relates a first state of the wearable head device to a second state of the wearable head device; and

performing an operation based on the position of the wearable head device.

14. The method of claim 13 , wherein the calculating the pre-integration term comprises determining a single relative motion constraint based on the first inertial data.

15. The method of claim 13 , further comprising estimating the position further based on the pre-integration term.

16. The method of claim 13 , further comprising performing simultaneous localization and mapping via the pre-integration term.

17. The method of claim 13 , further comprising determining a relative motion constraint between the first state and the second state based on the pre-integration term.

18. The method of claim 13 , further comprising predicting a second position of the wearable head device based on the angular acceleration and based further on the position of the wearable head device.

19. The method of claim 13 , wherein the operation comprises presenting virtual content via the wearable head device.

20. A non-transitory computer-readable medium storing one or more instructions, which, when executed by one or more processors of an electronic device, cause the one or more processors to perform a method comprising:

receiving first inertial data via a first inertial measurement unit;

receiving second inertial data via a second inertial measurement unit, wherein the second inertial measurement unit is disposed at a fixed position with respect to the first inertial measurement unit;

calculating an angular acceleration based on the first inertial data and based further on the second inertial data;

estimating a position of a wearable head device based on the angular acceleration, wherein:

the estimating the position of the wearable head device based on the angular acceleration comprises calculating a pre-integration term based on the angular acceleration, and

the pre-integration term relates a first state of the wearable head device to a second state of the wearable head device; and

performing an operation based on the position of the wearable head device.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073439/0168 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073387/0487 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2025
From: FRANCI RODON, ARNAU; GHASEMALIZADEH, OMID
To: MAGIC LEAP, INC.
Reel/Frame 070844/0661 →
Continuity (4)
Continuation 18068392 · Dec 19, 2022
Continuation 17332917 · May 27, 2021
Provisional Application 63031985 · May 29, 2020
Related Publication 20240338072A1 · Oct 10, 2024
References Cited (97)
US 4852988A · Velez · 1989 [cited by applicant]
US 5933125A · Fernie · 1999 [cited by examiner]
US 6433760B1 · Vaissie · 2002 [cited by applicant]
US 6491391B1 · Blum et al. · 2002 [cited by applicant]
US 6847336B1 · Lemelson · 2005 [cited by applicant]
US 6943754B2 · Aughey · 2005 [cited by applicant]
US 6977776B2 · Volkenandt et al. · 2005 [cited by applicant]
US 7347551B2 · Fergason et al. · 2008 [cited by applicant]
US 7488294B2 · Torch · 2009 [cited by applicant]
US 8235529B1 · Raffle · 2012 [cited by applicant]
US 8611015B2 · Wheeler · 2013 [cited by applicant]
US 8638498B2 · Bohn et al. · 2014 [cited by applicant]
US 8929589B2 · Publicover et al. · 2015 [cited by applicant]
US 9010929B2 · Lewis · 2015 [cited by applicant]
US 9274338B2 · Robbins et al. · 2016 [cited by applicant]
US 9292973B2 · Bar-Zeev et al. · 2016 [cited by applicant]
US 9323325B2 · Perez et al. · 2016 [cited by applicant]
US 9720505B2 · Gribetz et al. · 2017 [cited by applicant]
US 10013053B2 · Cederlund et al. · 2018 [cited by applicant]
US 10025379B2 · Drake et al. · 2018 [cited by applicant]
US 11328475B2 · Huang · 2022 [cited by examiner]
US 11561613B2 · Franci Rodon et al. · 2023 [cited by applicant]
US 11935180B2 · Huang · 2024 [cited by applicant]
US 12056273B2 · Franci Rodon · 2024 [cited by examiner]
US 12249024B2 · Huang et al. · 2025 [cited by applicant]
US 20020060633A1 · Crisco, III · 2002 [cited by examiner]
US 20030030597A1 · Geist · 2003 [cited by applicant]
US 20060023158A1 · Howell et al. · 2006 [cited by applicant]
US 20060185432A1 · Weinberg · 2006 [cited by examiner]
US 20110211056A1 · Publicover et al. · 2011 [cited by applicant]
US 20110213664A1 · Osterhout · 2011 [cited by applicant]
US 20120021806A1 · Maltz · 2012 [cited by applicant]
US 20120078570A1 · Rothkopf · 2012 [cited by examiner]
US 20130077147A1 · Efimov · 2013 [cited by applicant]
US 20140195918A1 · Friedlander · 2014 [cited by applicant]
US 20150168731A1 · Robbins · 2015 [cited by applicant]
US 20160364013A1 · Katz et al. · 2016 [cited by applicant]
US 20160364904A1 · Parker et al. · 2016 [cited by applicant]
US 20170084074A1 · Hwang · 2017 [cited by applicant]
US 20180220937A1 · Mizuochi · 2018 [cited by applicant]
US 20180231385A1 · Fourie et al. · 2018 [cited by applicant]
US 20190096081A1 · Gupta · 2019 [cited by applicant]
US 20190113347A1 · Kim · 2019 [cited by examiner]
US 20190197196A1 · Yang · 2019 [cited by applicant]
US 20190227693A1 · Liao · 2019 [cited by applicant]
US 20200039522A1 · Nakaoka et al. · 2020 [cited by applicant]
US 20220230382A1 · Huang · 2022 [cited by examiner]
US 20240185510A1 · Huang · 2024 [cited by applicant]
CA 2316473A1 · 2001 [cited by applicant]
CA 2362895A1 · 2002 [cited by applicant]
CA 2388766A1 · 2003 [cited by applicant]
EP 3428760A1 · 2019 [cited by applicant]
JP 2008256946A · 2008 [cited by applicant]
JP 2018511098A · 2018 [cited by applicant]
JP 2018126360A · 2018 [cited by applicant]
JP 201947215A · 2019 [cited by applicant]
JP 2019144003A · 2019 [cited by applicant]
WO 2016118371A1 · 2016 [cited by applicant]
WO 2019164498A1 · 2019 [cited by applicant]
WO 2021077024A1 · 2021 [cited by applicant]
WO 2021243103A1 · 2021 [cited by applicant]
Azuma, Ronald T. (Aug. 1997). “A Survey of Augmented Reality,” In Presence: Teleoperators and Virtual Environments 6, 4, Hughes Research Laboratories, Malibu, CA, located at: https://web.archive.org/web/20010604100006/h… [cited by applicant]
Azuma, Ronald T. (Feb. 1995). “Predictive Tracking for Augmented Reality,” Department of Computer Science, UNC-Chapel Hill, Chapel Hill, NC, 262 pages. [cited by applicant]
Chow, J. C. K., et al. “IMU and Multiple RGB-D Camera Fusion for Assisting Indoor Stop-and-Go 3D Terrestrial Laser Scanning,” Robotics 3, p. 247-280. Doi:org/10.3390/robotics3030247 (Year: 2014). [cited by applicant]
European Notice of Allowance dated Jun. 12, 2024, for EP Application No. 20875999.3, ten pages. [cited by applicant]
European Search Report dated Nov. 7, 2022, for EP Application No. 20875999.3, eight pages. [cited by applicant]
European Search Report dated Oct. 13, 2023, for EP Application No. 21813271.0, thirteen pages. [cited by applicant]
Final Office Action mailed Mar. 18, 2024, for U.S. Appl. No. 18/068,392, filed Dec. 19, 2022, nine pages. [cited by applicant]
International Preliminary Report and Written Opinion mailed Dec. 8, 2022, for PCT Application No. PCT/US2021/34647, filed May 27, 2021, seven pages. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion mailed Apr. 28, 2022, for PCT Application No. PCTUS2020/056163, filed Oct. 16, 2020, eight pages. [cited by applicant]
International Search Report and Written Opinion mailed Aug. 31, 2021, for PCT Application No. PCT/US2021/34647, filed May 27, 2021, 13 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jan. 21, 2021, for PCT Application No. PCT/US20/56163, filed Oct. 16, 2020, thirteen pages. [cited by applicant]
Jacob, R. “Eye Tracking in Advanced Interface Design”, Virtual Environments and Advanced Interface Design, Oxford University Press, Inc. (Jun. 1995). [cited by applicant]
Japanese Office Action mailed May 16, 2024, for JP Patent Application No. 2022-522895, with English translation, 6 pages. [cited by applicant]
Japanese Office Action mailed May 2, 2024, for JP Patent Application No. 2022-572567, with English translation, 7 pages. [cited by applicant]
Lin, Pei-Chun et al. (Aug. 1, 2012). “Design and Implementation of a Nine-Axis Inertial Measurement Unit”, IEEE/ASME Transactions On Mechatronics, IEEE Service Center, Piscataway, NJ, US, vol. 17, No. 4, pp. 657-668. [cited by applicant]
Non-Final Office Action mailed May 20, 2022, for U.S. Appl. No. 17/332,917, filed May 27, 2021, nine pages. [cited by applicant]
Non-Final Office Action mailed Nov. 24, 2021, for U.S. Appl. No. 17/072,825, filed Oct. 16, 2020, six pages. [cited by applicant]
Non-Final Office Action mailed Oct. 12, 2023, for U.S. Appl. No. 18/068,392, filed Dec. 19, 2022, seventeen pages. [cited by applicant]
Non-Final Office Action mailed Sep. 14, 2023, for U.S. Appl. No. 17/715,880, filed Apr. 7, 2022, seventeen pages. [cited by applicant]
Notice of Allowance mailed Dec. 7, 2023, for U.S. Appl. No. 17/715,880, filed Apr. 7, 2022, eight pages. [cited by applicant]
Notice of Allowance mailed Jan. 23, 2024, for U.S. Appl. No. 17/715,880, filed Apr. 7, 2022, nine pages. [cited by applicant]
Notice of Allowance mailed Mar. 22, 2022, for U.S. Appl. No. 17/072,825, filed Oct. 16, 2020, nine pages. [cited by applicant]
Notice of Allowance mailed May 16, 2024, for U.S. Appl. No. 18/068,392, filed Dec. 19, 2022, five pages. [cited by applicant]
Notice of Allowance mailed Nov. 17, 2022, for U.S. Appl. No. 17/332,917, filed May 27, 2021, five pages. [cited by applicant]
Ohta, Ken, et al: (Mar. 1, 1994). “Measurement of Angular Velocity and Angular Acceleration in Sports Using Accelerometers”, Transactions of the Society of Instrument and Control Engineers, vol. 30, No. 12, pp. 1442-144… [cited by applicant]
Rolland, J. et al., “High- resolution inset head- mounted display”, Optical Society of America, vol. 37, No. 19, Applied Optics, (Jul. 1, 1998). [cited by applicant]
Tanriverdi, V. et al. (Apr. 2000). “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA 02155, USA, Proceedings of the SIGCHI… [cited by applicant]
Yokokohji Y, et al. (1999). “Accurate Image Overlay on Head-Mounted Displays Using Vision and Accelerometers”, TVRSJ, vol. 4 No. 4 pp. 589-598. (Translation of abstract only). [cited by applicant]
Yokokohji Y, et al. (Mar. 18, 2000). “Accurate Image Overlay on Video See-Through HMDs Using Vision and Accelerometers”, Proceedings IEEE 2000, Virtual Reality, (VR2000). New Brunswick, NJ, Los Alamitos, CA, IEEE Comp. … [cited by applicant]
Yoshida, A. et al., “Design and Applications of a High Resolution Insert Head Mounted Display”, (Jun. 1994). [cited by applicant]
Japanese Notice of Allowance mailed Sep. 12, 2024, for JP Patent Application No. 2022-522895, with English translation, six pages. [cited by applicant]
Japanese Office Action mailed Sep. 27, 2024, for JP Patent Application No. 2022-572567, with English translation, twelve pages. [cited by applicant]
Non-Final Office Action mailed Sep. 23, 2024, for U.S. Appl. No. 18/439,653, filed Feb. 12, 2024, seven pages. [cited by applicant]
Notice of Allowance mailed Jan. 22, 2025, for U.S. Appl. No. 18/439,653, filed Feb. 12, 2024, eight pages. [cited by applicant]
Japanese Final Office Action mailed Feb. 27, 2025, for JP Patent Application No. 2022-572567, with English translation, 7 pages. [cited by applicant]
European Office Action dated Mar. 12, 2025, for EP Application No. 21813271.0, five pages. [cited by applicant]