Granted Patent B2

US 12,493,120 · App. 17/886,692 · Granted Dec 9, 2025

Inventors: Ji Zhang (Pittsburgh, PA); Sanjiv Singh (Pittsburgh, PA); Kevin Joseph Dowling (Gibsonia, PA)

G01S17/42G01S7/4808G01S7/51G01S17/66

Abstract

Claims (33)

1 . A method of operating a simultaneous location and mapping (SLAM) system comprising:

acquiring a point cloud from a LIDAR, the point cloud comprising a plurality of points each of which are attributed with at least a geospatial coordinate and a timestamp;

using the SLAM system:

determining a confidence metric of the plurality of points;

displaying at least a portion of the plurality of points;

displaying, to a user, an indication of a portion of the point cloud exhibiting the confidence metric below a predetermined threshold,

wherein displaying the indication of a portion of the point cloud exhibiting a confidence metric below the predetermined threshold comprises displaying a target location for resuming scanning; and

resolving discrepancies between points in the point cloud by preferentially adjusting location estimates for a segment of the plurality of the points, wherein resolving discrepancies comprises reacquiring a portion of the plurality of points associated with the lower confidence metric, applying a correction to a position of a point when an end point differs from a known origin location for a closed loop point cloud, iteratively refining a residual error between the point cloud and a second point cloud having a geospatial coordinate near the geospatial coordinate of the point cloud, or fusing the point cloud with other content synchronized with the timestamp.

2 . The method of claim 1 , further comprising displaying, to the user, an indication of an unscanned area.

3 . The method of claim 1 , further comprising displaying, to the user, an indication of a geospatial coordinate to resume scanning.

4 . The method of claim 1 , further comprising displaying a representation of the portion of the point cloud colored to represent a point density of the portion of the point cloud.

5 . The method of claim 4 , wherein the portion of the point cloud is further colored to indicate the timestamp of at least one of the plurality of points.

6 . The method of claim 1 , wherein the confidence metric is based on at least one of a density of points, orthogonality, or environmental geometries of the plurality of points.

7 . The method of claim 1 , wherein the confidence metric is based on at least one of a residual squared error or a number of features tracked between frames.

8 . The method of claim 1 , wherein displaying the indication comprises displaying the indication on a mobile phone.

9 . The method of claim 8 , wherein the point cloud is acquired by the LIDAR on a portable simultaneous location and mapping (SLAM) system.

10 . A system, comprising:

a SLAM system in communication with a LIDAR, wherein the SLAM system comprises at least one processor and at least one memory, wherein the at least one memory stores software that when executed by the at least one processor causes the SLAM system to:

acquire a point cloud from a LIDAR, the point cloud comprising a plurality of points each of which are attributed with at least a geospatial coordinate and a timestamp;

determine a confidence metric of the plurality of points;

display at least a portion of the plurality of points;

display, to a user, an indication of a portion of the point cloud exhibiting the confidence metric below a predetermined threshold,

wherein displaying the indication of a portion of the point cloud exhibiting a confidence metric below the predetermined threshold comprises displaying a target location for resuming scanning; and

resolve discrepancies between points in the point cloud by preferentially adjusting location estimates for a segment of the plurality of the points, wherein resolving discrepancies comprises reacquiring a portion of the plurality of points associated with the lower confidence metric, applying a correction to a position of a point when an end point differs from a known origin location for a closed loop point cloud, iteratively refining a residual error between the point cloud and a second point cloud having a geospatial coordinate near the geospatial coordinate of the point cloud, or fusing the point cloud with other content synchronized with the timestamp.

11 . The system of claim 10 , wherein the at least one memory stores software that when executed by the at least one processor causes the SLAM system to display, to the user, an indication of an unscanned area.

12 . The system of claim 10 , wherein the at least one memory stores software that when executed by the at least one processor causes the SLAM system to display, to the user, an indication of a geospatial coordinate to resume scanning.

13 . The system of claim 10 , wherein displaying an indication of a portion of the point cloud exhibiting a confidence metric below the predetermined threshold comprises displaying a target location for resuming scanning.

14 . The system of claim 10 , wherein the at least one memory stores software that when executed by the at least one processor causes the SLAM system to display a representation of the portion of the point cloud colored to represent a point density of the portion of the point cloud.

15 . The system of claim 14 , wherein the portion of the point cloud is further colored to indicate the timestamp of at least one of the plurality of points.

16 . The system of claim 10 , wherein the confidence metric is based on at least one of a density of points, orthogonality, or environmental geometries of the plurality of points.

17 . The system of claim 10 , wherein the confidence metric is based on at least one of a residual squared error or a number of features tracked between frames.

18 . The system of claim 10 , wherein the at least one memory stores software that when executed by the at least one processor causes the SLAM system to display the indication on a mobile phone.

19 . The system of claim 18 , wherein the point cloud is acquired by the LIDAR on a portable simultaneous location and mapping (SLAM) system.

Assignments (2)

Continuity (8)

References Cited (206)