IP Library Granted Patent US 11,838,606
Granted Patent B2
US 11,838,606 · App. 16/387,406 · Granted Dec 5, 2023

Methods and systems for large-scale determination of RGBD camera poses

Inventor: Xiaolin Wei (Fremont, CA)
Assignee: Magic Leap, Inc.
H04N23/10G06T7/33G06T7/73G06T2200/04G06T2207/10016G06T2207/10024G06T2207/10028G06T2207/20224G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,838,606
App. No.
16/387,406
Granted
Dec 5, 2023
Kind
B2
Abstract

A method for refining poses includes receiving a plurality of poses and performing volumetric reconstruction for the plurality of poses to produce a global geometry. The method also includes refining each pose of the plurality of poses with respect to the global geometry to produce a plurality of refined poses.

Claims (16)

1. A method for refining poses, the method comprising:

(a) receiving a plurality of poses each associated with one of a plurality of captured depth images, wherein each of the plurality of captured depth images is associated with one of a plurality of captured depth maps;

(b) performing volumetric reconstruction for the plurality of poses to produce a polygonal mesh corresponding to a global geometry;

(c) rendering, using the polygonal mesh, a depth map associated with each of the plurality of poses;

(d) aligning each captured depth map of the plurality of captured depth maps to each rendered depth map associated with each of the plurality of poses to provide refined poses; and

(e) iterating on (b), (c), and (d) using the refined poses for a predetermined number of iterations.

2. The method of claim 1 , wherein performing volumetric reconstruction comprises:

performing volumetric fusion; and

extracting the polygonal mesh.

3. The method of claim 2 , wherein performing volumetric reconstruction further comprises performing volumetric hole filling.

4. The method of claim 2 , wherein performing volumetric fusion comprises fusing each captured depth map associated with each of the plurality of poses into a truncated signed distance function.

5. The method of claim 4 , wherein extracting the polygonal mesh comprises converting the truncated signed distance function into a triangle mesh.

6. The method of claim 2 , wherein extracting the polygonal mesh comprises applying marching cubes.

7. The method of claim 1 , wherein aligning each rendered depth map associated with each of the plurality of poses to each captured depth map comprises an iterative closest point based alignment.

8. The method of claim 1 , wherein aligning each rendered depth map to each captured depth map comprises converging each rendered depth map to each captured depth map.

9. The method of claim 1 , wherein performing volumetric reconstruction for the plurality of poses and refining each pose of the plurality of poses with respect to the global geometry is iteratively performed based on a threshold for differences in one or more refined poses of plurality of refined poses and a corresponding pose of the plurality of poses.

Assignments (4)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2019
From: WEI, XIAOLIN
To: MAGIC LEAP, INC.
Reel/Frame 048917/0502 →
Cited By (1)
US 12,675,962