IP Library Granted Patent US 10,854,165
Granted Patent B2
US 10,854,165 · App. 16/230,169 · Granted Dec 1, 2020

Method for calibrating an augmented reality device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,854,165
App. No.
16/230,169
Granted
Dec 1, 2020
Kind
B2
Abstract

A method for calibrating a device having a first sensor and a second sensor. The method includes capturing sensor data using the first sensor and the second sensor. The device maintains a calibration profile including a translation parameter and a rotation parameter to model a spatial relationship between the first sensor and the second sensor. The method also includes determining a calibration level associated with the calibration profile at a first time. The method further includes determining, based on the calibration level, to perform a calibration process. The method further includes performing the calibration process at the first time by generating one or both of a calibrated translation parameter and a calibrated rotation parameter and replacing one or both of the translation parameter and the rotation parameter with one or both of the calibrated translation parameter and the calibrated rotation parameter.

Claims (64)

1. A method for calibrating a device having a first sensor and a second sensor, the method comprising:

capturing sensor data using the first sensor and the second sensor, wherein the device maintains a calibration profile to model a spatial relationship between the first sensor and the second sensor, the calibration profile including a translation parameter and a rotation parameter;

determining a calibration level associated with the calibration profile at a first time; and

determining, based on the calibration level, to perform either a first calibration process or a second calibration process;

wherein performing the first calibration process includes:

generating a calibrated rotation parameter; and

replacing the rotation parameter with the calibrated rotation parameter;

wherein performing the second calibration process includes:

generating both a calibrated translation parameter and a calibrated rotation parameter; and

replacing both the translation parameter and the rotation parameter with both the calibrated translation parameter and the calibrated rotation parameter.

2. The method of claim 1 , wherein performing the first calibration process includes:

replacing only the rotation parameter with the calibrated rotation parameter.

3. The method of claim 1 , further comprising:

determining a second calibration level associated with the calibration profile at a second time;

determining, based on the second calibration level, to perform either the first calibration process or the second calibration process.

4. The method of claim 1 , wherein:

it is determined to perform the first calibration process when the calibration level is less than a calibration threshold; and

it is determined to perform the second calibration process when the calibration level is greater than the calibration threshold.

5. The method of claim 1 , wherein the sensor data includes:

one or more first images captured using the first sensor; and

one or more second images captured using the second sensor.

6. The method of claim 1 , wherein one or both of the calibrated translation parameter and the calibrated rotation parameter are generated using the sensor data.

7. The method of claim 1 , wherein the calibration level is determined based on the sensor data.

8. The method of claim 1 , further comprising:

capturing additional sensor data using an additional sensor that is separate from the first sensor and the second sensor, wherein the calibration level is determined based on the additional sensor data.

9. A device comprising:

a first sensor and a second sensor configured to capture sensor data;

a memory device configured to store a calibration profile modeling a spatial relationship between the first sensor and the second sensor, the calibration profile including a translation parameter and a rotation parameter;

a processor coupled to the first sensor, the second sensor, and the memory device, wherein the processor is configured to perform operations comprising:

determining a calibration level associated with the calibration profile at a first time; and

determining, based on the calibration level, to perform either a first calibration process or a second calibration process;

wherein performing the first calibration process includes:

generating a calibrated rotation parameter; and

replacing the rotation parameter with the calibrated rotation parameter;

wherein performing the second calibration process includes:

generating both a calibrated translation parameter and a calibrated rotation parameter; and

replacing both the translation parameter and the rotation parameter with both the calibrated translation parameter and the calibrated rotation parameter.

10. The device of claim 9 , wherein performing the first calibration process includes:

replacing only the rotation parameter with the calibrated rotation parameter.

11. The device of claim 9 , wherein the operations further comprise:

determining a second calibration level associated with the calibration profile at a second time;

determining, based on the second calibration level, to perform either the first calibration process or the second calibration process.

12. The device of claim 9 , wherein:

it is determined to perform the first calibration process when the calibration level is less than a calibration threshold; and

it is determined to perform the second calibration process when the calibration level is greater than the calibration threshold.

13. The device of claim 9 , wherein the sensor data includes:

one or more first images captured using the first sensor; and

one or more second images captured using the second sensor.

14. The device of claim 9 , wherein one or both of the calibrated translation parameter and the calibrated rotation parameter are generated using the sensor data.

15. The device of claim 9 , wherein the calibration level is determined based on the sensor data.

16. The device of claim 9 , further comprising:

an additional sensor configured to capture additional sensor data, wherein the additional sensor is separate from the first sensor and the second sensor, and wherein the calibration level is determined based on the additional sensor data.

17. A non-transitory computer-readable medium for calibrating a device having a first sensor and a second sensor, the non-transitory computer-readable medium comprising instructions that, when executed by a processor, cause the processor to perform operations including:

capturing sensor data using the first sensor and the second sensor, wherein the device maintains a calibration profile to model a spatial relationship between the first sensor and the second sensor, the calibration profile including a translation parameter and a rotation parameter;

determining a calibration level associated with the calibration profile at a first time; and

determining, based on the calibration level, to perform either a first calibration process or a second calibration process;

wherein performing the first calibration process includes:

generating a calibrated rotation parameter; and

replacing the rotation parameter with the calibrated rotation parameter;

wherein performing the second calibration process includes:

generating both a calibrated translation parameter and a calibrated rotation parameter; and

replacing both the translation parameter and the rotation parameter with both the calibrated translation parameter and the calibrated rotation parameter.

18. The non-transitory computer-readable medium of claim 17 , wherein performing the first calibration process includes:

replacing only the rotation parameter with the calibrated rotation parameter.

Assignments (3)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2019
From: CHI, YU-TSEH; BOUGUET, JEAN-YVES; SHARMA, DIVYA; HUANG, LEI; STRELOW, DENNIS WILLIAM; GROSSMANN, ETIENNE GREGOIRE; LEVINE, EVAN GREGORY; HARMAT, ADAM; SWAMINATHAN, ASHWIN
To: MAGIC LEAP, INC.
Reel/Frame 048566/0363 →