IP Library Granted Patent US 11,651,569
Granted Patent B2
US 11,651,569 · App. 17/469,388 · Granted May 16, 2023

System and method for mapping

Inventors: Hélder Toshiro Suzuki (Mountain View, CA); Benjamin Wheeler Stiles (Plantation, FL)
Assignee: Magic Leap, Inc.
G06T19/006G06F3/012G06T15/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,569
App. No.
17/469,388
Granted
May 16, 2023
Kind
B2
Abstract

A computer implemented method for updating a point map on a system having first and second communicatively coupled hardware components includes the first component performing a first process on the point map in a first state to generate a first change. The method also includes the second component performing a second process on the point map in the first state to generate a second change. The method further includes the second component applying the second change to the point map in the first state to generate a first updated point map in a second state. Moreover, the method includes the first component sending the first change to the second component. In addition, the method includes the second component applying the first change to the first updated point map in the second state to generate a second updated point map in a third state.

Claims (39)

1. A computer implemented method for updating a point map on a system having first and second communicatively coupled hardware components, comprising:

the first component performing a first process on the point map in a first map state to generate a first map change, wherein the first map state is a state of the point map;

the second component performing a second process on the point map in the first map state to generate a second map change;

the second component applying the second map change to the point map in the first map state to generate a first updated point map in a second map state, wherein the second map state is a state of the first updated point map;

the first component sending the first map change to the second component; and

the second component applying the first map change to the first updated point map in the second map state to generate a second updated point map in a third map state, wherein the third map state is a state of the second updated point map.

2. The method of claim 1 , further comprising:

the second component sending the second map change to the first component;

the first component applying the second map change to the point map in the first map state to generate the first updated point map in the second map state; and

the first component applying the first map change to the first updated point map in the second map state to generate the second updated point map in the third map state.

3. The method of claim 2 , further comprising:

the first component generating a map change order based on the first and second map changes; and

the first component applying the second map change to the point map in the first map state before apply the first map change to the updated point map in the second map state based on the map change order.

4. The method of claim 2 , wherein the first component applying the second map change to the point map in the first map state includes the first component generating a pre-change first map state, and

wherein the first component applying the first map change to the first updated point map in the second map state includes the first component generating a pre-change second map state.

5. The method of claim 1 , wherein the second component applying the second map change to the point map in the first map state includes the second component generating a pre-change first map state, and

wherein the second component applying the first map change to the first updated point map in the second map state includes the second component generating a pre-change second map state.

6. The method of claim 1 , further comprising:

the first component generating a map change order based on the first and second map changes; and

the first component sending the map change order to the second component.

7. The method of claim 6 , further comprising the second component applying the second map change to the point map in the first map state before applying the first map change to the updated point map in the second map state based on the map change order.

8. The method of claim 1 , wherein the first process is selected from the group consisting of tracking, map point deletion, VIO, mapping, insertion of new keyframe/key rigframe, insertion of new map point, insertion of new observation, bundle adjustment, modification of sparse map geometry, online calibration, relocalization, adding new orb feature; add new BoW index; loop closure; modify sparse map geometry; map merge; and joint dense optimization.

9. The method of claim 1 , wherein the point map corresponds to a physical location in which the system is located.

10. The method of claim 9 , wherein the physical location is a room.

11. The method of claim 9 , wherein the physical location is a cell in a room.

12. The method of claim 1 , wherein the point map is a portion of a larger point map.

13. The method of claim 1 , wherein the first component is a head-mounted audio-visual display component of a mixed reality system, and

wherein the second component is a torso-mounted processing component of the mixed reality system.

14. The method of claim 1 , further comprising the second component reconciling the second map change with the first map state before applying the second map change to the point map in the first map state.

15. The method of claim 1 , the first and second components being communicatively coupled to a third component, the method further comprising:

the third component performing a third process on the point map in the first map state to generate a third map change;

the first and second components sending the first and second map changes to the third component, respectively; and

the third component applying the third map change to the second updated point map in the third map state to generate a third updated point map in a fourth map state.

16. The method of claim 15 , wherein the first component is a head-mounted audio-visual display component of a mixed reality system,

wherein the second component is a torso-mounted processing component of the mixed reality system, and

wherein the third component is a cloud based processing component.

17. The method of claim 1 , further comprising the second component receiving the first map change from the first component before generating the second map change.

18. The method of claim 1 , the second component comprising removable media for data storage.

19. The method of claim 1 , wherein the second process is selected from the group consisting of tracking, map point deletion, VIO, mapping, insertion of new keyframe/key rigframe, insertion of new map point, insertion of new observation, bundle adjustment, modification of sparse map geometry, online calibration, relocalization, adding new orb feature; add new BoW index; loop closure; modify sparse map geometry; map merge; and joint dense optimization.

Assignments (3)
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2021
From: SUZUKI, HÉLDER TOSHIRO; STILES, BENJAMIN WHEELER
To: MAGIC LEAP, INC.
Reel/Frame 057415/0532 →
Continuity (3)
Continuation 16519513 · Jul 23, 2019
Provisional Application 62702322 · Jul 23, 2018
Related Publication 20210407207A1 · Dec 30, 2021