IP Library Granted Patent US 11,994,676
Granted Patent B2
US 11,994,676 · App. 17/684,228 · Granted May 28, 2024

Method and system for resolving hemisphere ambiguity in six degree of freedom pose measurements

Inventors: Ronald Joseph Degges, Jr. (Fairfield, CA); Sheng Wan (San Jose, CA); Andy Warner (Plantation, FL); Akash Gujarati (Plantation, FL)
Assignee: Magic Leap, Inc.
G02B27/0093G01P15/0888G02B27/0172G02B2027/0138G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,994,676
App. No.
17/684,228
Granted
May 28, 2024
Kind
B2
Abstract

Techniques for resolving hemisphere ambiguity are disclosed. One or more magnetic fields are emitted at a handheld controller. The one or more magnetic fields are detected by one or more sensors positioned relative to a headset. Movement data corresponding to the handheld controller or the headset is detected. During a first time interval, a first position and a first orientation of the handheld controller within a first hemisphere are determined based on the detected one or more magnetic fields, and a first discrepancy is calculated based on the first position, the first orientation, and the movement data. During a second time interval, a second position and a second orientation of the handheld controller within a second hemisphere are determined based on the detected one or more magnetic fields, and a second discrepancy is calculated based on the second position, the second orientation, and the movement data.

Claims (57)

1. A method comprising:

emitting magnetic fields at a handheld controller;

detecting the magnetic fields at a magnetic field sensor positioned relative to a headset;

initiating a first processing stack and a second processing stack;

wherein the first processing stack includes, at each of multiple first time steps:

determining a first position and a first orientation of the handheld controller within a first hemisphere with respect to the headset based on the magnetic fields detected by the magnetic field sensor; and

calculating a first discrepancy based on the first position and the first orientation;

wherein the second processing stack includes, at each of multiple second time steps:

determining a second position and a second orientation of the handheld controller within a second hemisphere with respect to the headset based on the magnetic fields detected by the magnetic field sensor, wherein the second hemisphere is diametrically opposite the first hemisphere; and

calculating a second discrepancy based on the second position and the second orientation; and

after the multiple first time steps and the multiple second time steps, making a determination, based on the first discrepancy and the second discrepancy, as whether to (i) abort the first processing stack, (ii) abort the second processing stack, or (iii) continue processing with both the first processing stack and the second processing stack, wherein it is determined to abort the first processing stack if the first discrepancy is greater than a threshold, it is determined to abort the second processing stack if the second discrepancy is greater than the threshold, and it is determined to continue processing with both the first processing stack and the second processing stack if the first discrepancy and the second discrepancy are less than the threshold.

2. The method of claim 1 , further comprising:

detecting movement data corresponding to movement of the handheld controller or the headset, wherein the first discrepancy and the second discrepancy are calculated further based on the movement data.

3. The method of claim 1 , further comprising:

if the determination is to abort the first processing stack, continuing to determine positions and orientations of the handheld controller within the second hemisphere; and

if the determination is to abort the second processing stack, continuing to determine positions and orientations of the handheld controller within the first hemisphere.

4. The method of claim 2 , wherein the movement data corresponds to the movement of the handheld controller, and wherein the movement data is detected by a movement sensor positioned within the handheld controller.

5. The method of claim 2 , wherein the movement data corresponds to the movement of the headset, and wherein the movement data is detected by a movement sensor positioned within the headset.

6. The method of claim 1 , wherein the first hemisphere is a front hemisphere with respect to the headset and the second hemisphere is a back hemisphere with respect to the headset.

7. A system comprising:

a handheld controller comprising a magnetic field emitter configured to emit magnetic fields;

a headset comprising a magnetic field sensor configured to detect the magnetic fields; and

one or more processors configured to perform operations including:

initiating a first processing stack and a second processing stack;

wherein the first processing stack includes, at each of multiple first time steps:

determining a first position and a first orientation of the handheld controller within a first hemisphere with respect to the headset based on the magnetic fields detected by the magnetic field sensor; and

calculating a first discrepancy based on the first position and the first orientation;

wherein the second processing stack includes, at each of multiple second time steps:

determining a second position and a second orientation of the handheld controller within a second hemisphere with respect to the headset based on the magnetic fields detected by the magnetic field sensor, wherein the second hemisphere is diametrically opposite the first hemisphere; and

calculating a second discrepancy based on the second position and the second orientation; and

after the multiple first time steps and the multiple second time steps, making a determination, based on the first discrepancy and the second discrepancy, as whether to (i) abort the first processing stack, (ii) abort the second processing stack, or (iii) continue processing with both the first processing stack and the second processing stack, wherein it is determined to abort the first processing stack if the first discrepancy is greater than a threshold, it is determined to abort the second processing stack if the second discrepancy is greater than the threshold, and it is determined to continue processing with both the first processing stack and the second processing stack if the first discrepancy and the second discrepancy are less than the threshold.

8. The system of claim 7 , further comprising:

a movement sensor configured to detect movement data corresponding to movement of the handheld controller or the headset, wherein the first discrepancy and the second discrepancy are calculated further based on the movement data.

9. The system of claim 7 , wherein the operations further comprise:

if the determination is to abort the first processing stack, continuing to determine positions and orientations of the handheld controller within the second hemisphere; and

if the determination is to abort the second processing stack, continuing to determine positions and orientations of the handheld controller within the first hemisphere.

10. The system of claim 8 , wherein the movement data corresponds to the movement of the handheld controller, and wherein the movement sensor is positioned within the handheld controller.

11. The system of claim 8 , wherein the movement data corresponds to the movement of the headset, and wherein the movement sensor is positioned within the headset.

12. The system of claim 7 , wherein the first hemisphere is a front hemisphere with respect to the headset and the second hemisphere is a back hemisphere with respect to the headset.

13. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

causing magnetic fields to be emitted at a handheld controller;

causing the magnetic fields to be detected at a magnetic field sensor positioned relative to a headset;

initiating a first processing stack and a second processing stack;

wherein the first processing stack includes, at each of multiple first time steps:

determining a first position and a first orientation of the handheld controller within a first hemisphere with respect to the headset based on the magnetic fields detected by the magnetic field sensor; and

calculating a first discrepancy based on the first position and the first orientation;

wherein the second processing stack includes, at each of multiple second time steps:

determining a second position and a second orientation of the handheld controller within a second hemisphere with respect to the headset based on the magnetic fields detected by the magnetic field sensor, wherein the second hemisphere is diametrically opposite the first hemisphere; and

calculating a second discrepancy based on the second position and the second orientation; and

after the multiple first time steps and the multiple second time steps, making a determination as whether to (i) abort the first processing stack, (ii) abort the second processing stack, or (iii) continue processing with both the first processing stack and the second processing stack, wherein it is determined to abort the first processing stack if the first discrepancy is greater than a threshold, it is determined to abort the second processing stack if the second discrepancy is greater than the threshold, and it is determined to continue processing with both the first processing stack and the second processing stack if the first discrepancy and the second discrepancy are less than the threshold.

14. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise:

detecting movement data corresponding to movement of the handheld controller or the headset, wherein the first discrepancy and the second discrepancy are calculated further based on the movement data.

15. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise:

if the determination is to abort the first processing stack, continuing to determine positions and orientations of the handheld controller within the second hemisphere; and

if the determination is to abort the second processing stack, continuing to determine positions and orientations of the handheld controller within the first hemisphere.

16. The non-transitory computer-readable medium of claim 14 , wherein the movement data corresponds to the movement of the handheld controller, and wherein the movement data is detected by a movement sensor positioned within the handheld controller.

17. The non-transitory computer-readable medium of claim 14 , wherein the movement data corresponds to the movement of the headset, and wherein the movement data is detected by a movement sensor positioned within the headset.

Assignments (3)
SECURITY INTEREST Recorded Oct 24, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073255/0581 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2022
From: DEGGES, RONALD JOSEPH, JR.; WAN, SHENG; WARNER, ANDY
To: MAGIC LEAP, INC.
Reel/Frame 059138/0777 →