IP Library Granted Patent US 11,726,582
Granted Patent B2
US 11,726,582 · App. 17/458,890 · Granted Aug 15, 2023

Method and system utilizing phased array beamforming for six degree of freedom tracking for an emitter in augmented reality systems

Inventor: Michael Janusz Woods (Mountain View, CA)
Assignee: Magic Leap, Inc.
G06F3/0346G02B27/0087G06F3/012G06F3/016G01S2013/0245
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,726,582
App. No.
17/458,890
Granted
Aug 15, 2023
Kind
B2
Abstract

An electromagnetic tracking system includes a handheld controller including a first phased array element characterized by a first phase and a second phased array element characterized by a second phase different than the first phase. The first phased array element and the second phased array element are configured to generate a steerable electromagnetic beam characterized by an electromagnetic field pattern. The electromagnetic tracking system also includes a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field pattern.

Claims (53)

1. An electromagnetic tracking system comprising:

a handheld controller including an electromagnetic emitter, the electromagnetic emitter including:

a first phased array element characterized by a first phase; and

a second phased array element characterized by a second phase different than the first phase;

wherein the first phased array element and the second phased array element are configured to generate a steerable electromagnetic beam characterized by an electromagnetic field pattern;

a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field pattern; and

one or more processors configured to:

determine a pose of the electromagnetic sensor;

control the first phase and the second phase to steer the electromagnetic beam to increase received power at the electromagnetic sensor; and

determine a pose of the handheld controller using the pose of the electromagnetic sensor and the electromagnetic field pattern sensed at the electromagnetic sensor.

2. The electromagnetic tracking system of claim 1 , wherein the one or more processors are further configured to:

digitally compute a position and orientation of the handheld controller based on the electromagnetic field pattern.

3. The electromagnetic tracking system of claim 1 , wherein at least one of the one or more processors is disposed in the handheld controller.

4. The electromagnetic tracking system of claim 1 , further comprising an auxiliary unit including the handheld controller.

5. The electromagnetic tracking system of claim 4 , wherein the auxiliary unit comprises a belt pack.

6. The electromagnetic tracking system of claim 1 , wherein the electromagnetic emitter further comprises a third phased array element, wherein the first phased array element, the second phased array element, and the third phased array element are disposed in a plane.

7. The electromagnetic tracking system of claim 6 , wherein the electromagnetic emitter further comprises a fourth phased array element, wherein the first phased array element, the second phased array element, and the third phased array element form three corners of a tetrahedron and the fourth phased array element forms a fourth corner of the tetrahedron.

8. A method of determining a six degree of freedom (DoF) pose of a handheld controller, the method comprising:

determining a pose of an electromagnetic sensor;

generating an electromagnetic beam from the handheld controller, wherein the electromagnetic beam is characterized by an electromagnetic field pattern;

steering the electromagnetic beam to increase received power at the electromagnetic sensor;

determining a beam angle associated with the electromagnetic beam;

determining a distance between the handheld controller and the electromagnetic sensor; and

determining the six DoF pose of the handheld controller using the pose of the electromagnetic sensor, the beam angle, and the distance.

9. The method of claim 8 , wherein the handheld controller includes an electromagnetic emitter, the electromagnetic emitter including:

a first phased array element configured to operate with a first phase; and

a second phased array element configured to operate with a second phase.

10. The method of claim 9 , wherein the electromagnetic emitter further includes a third phased array element, wherein the first phased array element, the second phased array element, and the third phased array element are disposed in a plane.

11. The method of claim 8 , wherein the pose of the electromagnetic sensor comprises a head pose and the electromagnetic sensor is an element of an AR headset.

12. The method of claim 8 , wherein steering the electromagnetic beam comprises aligning a central vector of the electromagnetic beam with a vector from the handheld controller to the electromagnetic sensor.

13. The method of claim 8 , wherein steering the electromagnetic beam to increase received power at the electromagnetic sensor comprises maximizing received power at the electromagnetic sensor.

14. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

determining a pose of an electromagnetic sensor;

generating an electromagnetic beam from a handheld controller, wherein the electromagnetic beam is characterized by an electromagnetic field pattern;

steering the electromagnetic beam to increase received power at the electromagnetic sensor;

determining a beam angle associated with the electromagnetic beam;

determining a distance between the handheld controller and the electromagnetic sensor; and

determining a six degree of freedom (DoF) pose of the handheld controller using the pose of the electromagnetic sensor, the beam angle, and the distance.

15. The non-transitory computer-readable medium of claim 14 , wherein the handheld controller includes an electromagnetic emitter, the electromagnetic emitter including:

a first phased array element configured to operate with a first phase; and

a second phased array element configured to operate with a second phase.

16. The non-transitory computer-readable medium of claim 15 , wherein the electromagnetic emitter further includes a third phased array element, wherein the first phased array element, the second phased array element, and the third phased array element are disposed in a plane.

17. The non-transitory computer-readable medium of claim 14 , wherein the pose of the electromagnetic sensor comprises a head pose and the electromagnetic sensor is an element of an AR headset.

18. The non-transitory computer-readable medium of claim 14 , wherein steering the electromagnetic beam comprises aligning a central vector of the electromagnetic beam with a vector from the handheld controller to the electromagnetic sensor.

19. The non-transitory computer-readable medium of claim 14 , wherein steering the electromagnetic beam to increase received power at the electromagnetic sensor comprises maximizing received power at the electromagnetic sensor.

20. An electromagnetic tracking system comprising:

a handheld controller including an electromagnetic emitter, the electromagnetic emitter including:

a first phased array element characterized by a first phase; and

a second phased array element characterized by a second phase different than the first phase;

a third phased array element, wherein the first phased array element, the second phased array element, and the third phased array element are disposed in a plane; and

a fourth phased array element, wherein the first phased array element, the second phased array element, and the third phased array element form three corners of a tetrahedron and the fourth phased array element forms a fourth corner of the tetrahedron;

wherein the first phased array element, the second phased array element, the third phased array element, and the fourth phased array element are configured to generate a steerable electromagnetic beam characterized by an electromagnetic field pattern; and

a head mounted augmented reality display including an electromagnetic sensor configured to sense the electromagnetic field pattern.

Assignments (3)
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073008/0696 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2021
From: WOODS, MICHAEL JANUSZ
To: MAGIC LEAP, INC.
Reel/Frame 058067/0024 →
Continuity (3)
Continuation PCTUS2020020178 · Feb 27, 2020
Provisional Application 62811914 · Feb 28, 2019
Related Publication 20220050533A1 · Feb 17, 2022