IP Library Granted Patent US 12,014,533
Granted Patent B2
US 12,014,533 · App. 17/061,176 · Granted Jun 18, 2024

Methods and systems for real or near real-time point cloud map data confidence evaluation

Inventor: Steven Huber (Pittsburgh, PA)
Assignee: CARNEGIE MELLON UNIVERSITY
G06V10/757G01S7/497G01S17/42G01S17/86G01S17/89G05D1/0011G05D1/0212G05D1/024G06V20/10G06V20/64
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,014,533
App. No.
17/061,176
Granted
Jun 18, 2024
Kind
B2
Abstract

A method includes acquiring with a scanning device a scan frame including a point cloud comprising a first plurality of points and describing a spatial characteristic of an environment, attributing each of the first plurality of points with a spatial confidence metric, discarding a portion of the first plurality of points when the spatial confidence metric of at least one of the first plurality of points is below a predefined threshold value and directing a user of the scanning device to acquire a second point cloud approximately coincident with the discarded portion of the first plurality of points.

Claims (47)

1. A method comprising:

acquiring with a scanning device a scan frame comprising a point cloud comprising a first plurality of points and describing a spatial characteristic of an environment;

attributing each of the first plurality of points with a spatial confidence metric, wherein the spatial confidence metric comprises a value for each of the first plurality of points indicating a confidence level in a spatial accuracy of each of the first plurality of points determined location;

discarding a portion of the first plurality of points when the spatial confidence metric of at least one of the first plurality of points is below a predefined threshold value; and

directing a user of the scanning device to acquire a second point cloud approximately coincident with the discarded portion of the first plurality of points.

2. The method of claim 1 , wherein the predefined threshold is defined by the user.

3. The method of claim 1 , wherein the predefined threshold is based, at least in part, upon at least one of an environment in which the scanning devices operates, a mapping speed and a mapping accuracy.

4. The method of claim 1 , further comprising providing a notification that the portion was discarded.

5. The method of claim 4 , wherein the notification is provided to the user.

6. The method of claim 5 , wherein the notification is provided via a user interface forming a part of the scanning device.

7. The method of claim 4 , wherein the notification comprises a route planning feedback to a robotic route planner.

8. The method of claim 1 , wherein the spatial confidence metric utilizes at least one of surface normal information and data acquisition direction information.

9. A system comprising:

a laser scanning device comprising at least one processor adapted to execute software that when executed causes the system to:

acquire with the scanning device a scan frame comprising a point cloud comprising a first plurality of points and describing a spatial characteristic of an environment;

attribute each of the first plurality of points with a spatial confidence metric, wherein the spatial confidence metric comprises a value for each of the first plurality of points indicating a confidence level in a spatial accuracy of each of the first plurality of points determined location;

discard a portion of the first plurality of points when the spatial confidence metric of at least one of the first plurality of points is below a predefined threshold value; and

direct a user of the scanning device to acquire a second point cloud approximately coincident with the discarded portion of the first plurality of points.

10. The system of claim 9 , wherein the predefined threshold is defined by the user.

11. The system of claim 9 , wherein the predefined threshold is based, at least in part, upon at least one of an environment in which the scanning devices operates, a mapping speed and a mapping accuracy.

12. The system of claim 9 , wherein the processor is further adapted to provide a notification that the portion was discarded.

13. The system of claim 12 , wherein the notification is provided to the user.

14. The system of claim 13 , wherein the notification is provided via a user interface forming a part of the scanning device.

15. The system of claim 12 , wherein the notification comprises a route planning feedback to a robotic route planner.

16. A method comprising:

acquiring with a scanning device a scan frame comprising a point cloud comprising a first plurality of points and describing a spatial characteristic of an environment;

determining a location estimate of the scanning device via an operation an inertial measurement unit (IMU) forming a part of the scanning device;

refining the location estimate via the inclusion of at least one of visual data acquired by the scanning device or laser odometry data acquired by the scanning device wherein the at least one of visual data acquired by the scanning device or the laser data acquired by the scanning device each comprises an associated confidence metric, wherein the confidence metric comprises a value for each of the first plurality of points indicating a confidence level in a spatial accuracy of each of the first plurality of points determined location; and

utilizing the refined location estimate to discard a portion of the plurality of points from inclusion in the map when the confidence metric is below a predefined threshold.

17. The method of claim 16 , wherein the predefined threshold is defined by the user.

18. The method of claim 16 , wherein the predefined threshold is based, at least in part, upon at least one of an environment in which the scanning devices operates, a mapping speed and a mapping accuracy.

19. The method of claim 16 , further comprising providing notification that the portion was discarded.

20. The method of claim 19 , wherein the notification is provided to the user.

21. The method of claim 20 , wherein the notification is provided via a user interface forming a part of the scanning device.

22. The method of claim 19 , wherein the notification comprises a route planning feedback to a robotic route planner.

23. A system comprising:

a laser scanning device comprising at least one processor adapted to execute software that when executed causes the system to:

acquire with a scanning device a scan frame comprising a point cloud comprising a first plurality of points and describing a spatial characteristic of an environment;

determine a location estimate of the scanning device via an operation an inertial measurement unit (IMU) forming a part of the scanning device;

refine the location estimate via the inclusion of at least one of visual data acquired by the scanning device or laser odometry data acquired by the scanning device, wherein the at least one of visual data acquired by the scanning device or the laser data acquired by the scanning device each comprises an associated confidence metric, wherein the confidence metric comprises a value for each of the first plurality of points indicating a confidence level in a spatial accuracy of each of the first plurality of points determined location; and

utilize the refined location estimate to discard a portion of the plurality of points from inclusion in the map when the confidence metric is below a predefined threshold.

24. The system of claim 23 , wherein the predefined threshold is defined by the user.

25. The method of claim 23 , wherein the predefined threshold is based, at least in part, upon at least one of an environment in which the scanning devices operates, a mapping speed and a mapping accuracy.

26. The method of claim 23 , wherein the processor is further adapted to provide notification that the portion was discarded.

27. The method of claim 26 , wherein the notification is provided to the user.

28. The method of claim 27 , wherein the notification is provided via a user interface forming a part of the scanning device.

29. The method of claim 26 , wherein the notification comprises a route planning feedback to a robotic route planner.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2023
From: KAARTA, INC.
To: CARNEGIE MELLON UNIVERSITY
Reel/Frame 064603/0891 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2021
From: HUBER, STEVEN
To: KAARTA, INC.
Reel/Frame 055239/0045 →
Continuity (3)
Continuation PCTUS2019025360 · Apr 2, 2019
Provisional Application 62651894 · Apr 3, 2018
Related Publication 20210025998A1 · Jan 28, 2021