IP Library › Granted Patent US 12,260,501
Granted Patent B2
US 12,260,501 · App. 18/651,960 · Granted Mar 25, 2025

Point cloud filtering

Inventors: Christopher Frank Eckman (San Francisco, CA); Brady Michael Lowe (Pocatello, ID); Alexander Hall (Rexburg, ID)
Assignee: Lineage Logistics, LLC
G06T17/05G06F18/23G06T17/20G06V20/176G06V20/182G06V20/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,501
App. No.
18/651,960
Granted
Mar 25, 2025
Kind
B2
Abstract

This specification describes systems and methods for refining point cloud data. Methods can include receiving point cloud data for a physical space, iteratively selecting points along an x, y, and z dimension, clustering the selected points into 2D histograms, determining a slope value for each 2D histogram, and removing, based on the slope value exceeding a predetermined value, points from the point cloud data. Methods can also include iteratively voxelizing each 2D histogram into predetermined mesh sizes, summating points in each voxelized 2D histogram, removing, based on determining the summation is below a predetermined sum value, points from the point cloud data, keeping, based on determining that a number of points in each voxelized 2D histogram exceeds a threshold value, a center point, selecting, for each histogram, a point, identifying, nearest neighbors in the point cloud data, removing the identified nearest neighbors from the data, and returning remaining points.

Claims (33)

1. A method for generating information about a physical environment using point cloud data, the method comprising:

receiving point cloud data of a physical environment, wherein the point cloud data comprises a plurality of points in three-dimensional (3D) space that approximates locations of physical surfaces within the physical environment;

identifying points amongst the plurality of points in the point cloud data that correspond to contours of particular types of the physical surfaces within the physical environment;

reducing the plurality of points in the point cloud data to a set of the identified points;

generating information about the physical environment based at least in part on the set of the identified points, wherein the set of the identified points comprises the contours of the particular types of the physical surfaces within the physical environment; and

returning the information about the physical environment.

2. The method of claim 1 , wherein the method further comprises: receiving image data of the physical environment and generating the point cloud data from the image data.

3. The method of claim 1 , wherein generating the information about the physical environment comprises generating a map of the physical environment.

4. The method of claim 1 , wherein generating the information about the physical environment comprises determining location information for at least one of the particular types of the physical surfaces within the physical environment.

5. The method of claim 1 , wherein generating the information about the physical environment comprises determining identification information for at least one of the particular types of the physical surfaces within the physical environment.

6. The method of claim 1 , wherein generating the information about the physical environment comprises determining a size of the physical environment.

7. The method of claim 1 , wherein generating the information about the physical environment comprises determining occupancy information for the physical environment.

8. The method of claim 1 , wherein the particular types of the physical surfaces within the physical environment comprise vertical poles.

9. The method of claim 1 , wherein the particular types of the physical surfaces within the physical environment comprise racks.

10. The method of claim 1 , wherein the particular types of the physical surfaces within the physical environment comprise doorways.

11. The method of claim 1 , wherein the particular types of the physical surfaces within the physical environment comprise vehicles or human workers.

12. The method of claim 1 , wherein the physical environment comprises a facility or a warehouse.

13. The method of claim 1 , wherein the method further comprises: aligning the point cloud data with a width of a predetermined surface in the physical environment to determine an orientation of the point cloud data that corresponds to an orientation of the physical environment.

14. The method of claim 1 , wherein the method further comprises: classifying the points in the set of the identified points as corresponding to at least one of the particular types of the physical surfaces within the physical environment.

15. The method of claim 1 , wherein reducing the plurality of points in the point cloud data to the set of the identified points comprises removing other points from the plurality of points in the point cloud data that do not correspond to the contours of the particular types of the physical surfaces within the physical environment.

16. A system for generating information about a physical environment using point cloud data, the system comprising:

an imaging device positioned within a physical environment, wherein the imaging device is configured to generate two-dimensional (2D) data of the physical environment; and

a computer system in network communication with the imaging device, the computer system comprising one or more processors and memory to generate information about the physical space based on the 2D data captured by the imaging device, wherein the one or more processors are configured to execute operations comprising:

receiving the 2D data from the imaging device;

generating point cloud data of the physical environment from the 2D data, wherein the point cloud data comprises a plurality of points in 3D space that approximates locations of physical surfaces within the physical environment;

identifying points amongst the plurality of points that correspond to contours of particular types of the physical surfaces within the physical environment;

reducing the plurality of points in the point cloud data to a set of the identified points;

generating information about the physical environment based on the set of the identified points; and

returning the information about the physical environment.

17. The system of claim 16 , wherein the imaging device comprises a camera or a drone.

18. The system of claim 16 , wherein the physical environment comprises a facility or a warehouse.

19. The system of claim 16 , wherein generating the information about the physical environment comprises generating a map of the physical environment.

20. The system of claim 16 , wherein generating the information about the physical environment comprises determining a size or an occupancy of the physical environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2024
From: ECKMAN, CHRISTOPHER FRANK; LOWE, BRADY MICHAEL; HALL, ALEXANDER
To: LINEAGE LOGISTICS, LLC
Reel/Frame 067318/0632 →
Continuity (4)
Continuation 18339424 · Jun 22, 2023
Continuation 17862167 · Jul 11, 2022
Continuation 17230730 · Apr 14, 2021
Related Publication 20240355048A1 · Oct 24, 2024
References Cited (31)
US 9165360B1 · Bates et al. · 2015 [cited by applicant]
US 10066925B2 · Kurtz et al. · 2018 [cited by applicant]
US 11403817B1 · Eckman et al. · 2022 [cited by applicant]
US 20070276228A1 · Vining et al. · 2007 [cited by applicant]
US 20130127844A1 · Koeppel et al. · 2013 [cited by applicant]
US 20150063683A1 · Fu · 2015 [cited by applicant]
US 20160203263A1 · Maier et al. · 2016 [cited by applicant]
US 20170358087A1 · Armeni et al. · 2017 [cited by applicant]
US 20180033160A1 · Ishigami · 2018 [cited by applicant]
US 20190125493A1 · Salah et al. · 2019 [cited by applicant]
US 20190279420A1 · Moreno · 2019 [cited by examiner]
US 20190285752A1 · Chattopadhyay · 2019 [cited by examiner]
US 20200043186A1 · Selviah et al. · 2020 [cited by applicant]
US 20200111251A1 · Shi et al. · 2020 [cited by applicant]
US 20200200912A1 · Chen et al. · 2020 [cited by applicant]
US 20200210680A1 · Shreve et al. · 2020 [cited by applicant]
US 20200302241A1 · White et al. · 2020 [cited by applicant]
US 20200388044A1 · Cen et al. · 2020 [cited by applicant]
US 20210233284A1 · Sugio et al. · 2021 [cited by applicant]
US 20210354718A1 · Lu et al. · 2021 [cited by applicant]
US 20210365712A1 · Lu et al. · 2021 [cited by applicant]
US 20210373161A1 · Lu et al. · 2021 [cited by applicant]
US 20210383096A1 · White et al. · 2021 [cited by applicant]
US 20220351464A1 · Eckman et al. · 2022 [cited by applicant]
CN 103902977A · 2014 [cited by applicant]
CN 106485253A · 2017 [cited by applicant]
CN 107016705A · 2017 [cited by applicant]
CN 107038717A · 2017 [cited by applicant]
CN 112149677A · 2020 [cited by applicant]
Office Action in Chinese Application No. 20228003287.2, dated Mar. 8, 2024, with English translation, 10 pages. [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/US2022/024710, mailed on Aug. 2, 2022, 16 pages. [cited by applicant]