IP Library › Granted Patent US 11,302,023
Granted Patent B2
US 11,302,023 · App. 17/129,199 · Granted Apr 12, 2022

Planar surface detection

Inventors: Oliver Montague Welton Dunkley (Santa Clara, CA); Michael Jaison Gnanasekar (Santa Clara, CA); Aitor Aldoma Buchaca (Los Gatos, CA)
Assignee: APPLE INC.
G06T7/60G06T7/50G06T2207/10028G06T2207/20072G06T2207/20076
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,302,023
App. No.
17/129,199
Granted
Apr 12, 2022
Kind
B2
Abstract

In one implementation, a method of generating a horizontal plane hypothesis includes obtaining a point cloud of a scene including a plurality of points in a gravity-aligned coordinate system. The method includes generating, based on the plurality of points, a height histogram indicative of a plurality of non-overlapping height ranges in the gravity-aligned coordinate system and a respective plurality of weights. The method includes generating one or more horizontal plane hypotheses based on the height histogram.

Claims (48)

1. A method comprising:

obtaining a point cloud of a scene including a plurality of points in a gravity-aligned coordinate system;

generating, based on the plurality of points, a line-space image, each pixel of the line-space image corresponding to a two-parameter representation of a respective line at a common height in the gravity-aligned coordinate system and each pixel having a pixel value; and

generating one or more vertical plane hypotheses based on the line-space image.

2. The method of claim 1 , wherein each of the plurality of points is associated with three coordinates in the gravity-aligned coordinate system, one of the three coordinates corresponding to a height of the point.

3. The method of claim 2 , wherein generating the line-space image comprises processing the plurality of points of the point cloud without the one of the three coordinates corresponding to the height of the point.

4. The method of claim 1 , wherein each pixel of the line-space image corresponds to a respective slope-intercept representation of the respective line.

5. The method of claim 1 , wherein each pixel of the line-space image corresponds to respective distance-angle representation of the respective line.

6. The method of claim 1 , wherein generating the line-space image includes performing a Hough transform on a two-dimensional point map of unpaired points of the point cloud.

7. The method of claim 1 , wherein each of the plurality of points is further associated with an uncertainty.

8. The method of claim 1 , wherein generating the line-space image includes:

selecting two points of the point cloud;

determining two parameters of a line projected to the common height in the gravity-aligned coordinate system defined by the two points; and

incrementing, by an amount, a pixel value of a pixel of the line-space image corresponding to the two parameters.

9. The method of claim 8 , wherein selecting the two points of the point cloud includes randomly selecting two unpaired points of the point cloud.

10. The method of claim 9 , wherein generating the line-space image includes repeatedly:

selecting two points of the point cloud:

determining two parameters of a line projected to the common height in the gravity-aligned coordinate system defined by the two points;

determining a probability distribution of the two parameters based on the two parameters and the respective uncertainties of the two points; and

increasing, by an amount, pixels values of a plurality of pixels of the line-space image corresponding to the probability distribution of the two parameters.

11. The method of claim 10 , wherein selecting the two points of the point cloud includes randomly selecting two unpaired points of the point cloud.

12. The method of claim 10 , wherein selecting the two points of the point cloud includes selecting two paired points of the point cloud and the pixel values are increased by the amount scaled by a length of the line.

13. The method of claim 8 , wherein selecting the two points of the point cloud includes selecting two paired points of the point cloud and the pixel value is incremented by the amount scaled by a length of the line.

14. The method of claim 1 , wherein generating the one or more vertical plane hypotheses includes determining that one or more pixel values are greater than a threshold and generating one or more vertical plane hypotheses corresponding to the one or more pixel value greater than the threshold.

15. The method of claim 1 , wherein generating the one or more vertical plane hypotheses includes detecting one or more peaks in the line-space image and generating one or more vertical plane hypotheses corresponding to the peaks.

16. The method of claim 15 , further comprising:

applying a non-maxima suppression algorithm to the line-space image.

17. The method of claim 1 , wherein generating the one or more vertical plane hypotheses includes generating one or more sets of planar coefficients, each set of planar coefficients defining a vertical plane intersecting a respective one of the one or more lines.

18. A device comprising:

one or more processors;

a non-transitory memory;

one or more scene cameras; and

one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:

obtain a point cloud of a scene including a plurality of points in a gravity-aligned coordinate system;

generate, based on the plurality of points, a line-space image, each pixel of the line-space image corresponding to a two-parameter representation of a respective line at a common height in the gravity-aligned coordinate system and each pixel having a pixel value; and

generate one or more vertical plane hypotheses based on the line-space image.

19. The device of claim 18 , wherein generating the line-space image includes:

selecting two points of the point cloud;

determining two parameters of a line projected to the common height in the gravity-aligned coordinate system defined by the two points; and

incrementing, by an amount, a pixel value of a pixel of the line-space image corresponding to the two parameters.

20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with one or more scene cameras, cause the device to:

obtain a point cloud of a scene including a plurality of points in a gravity-aligned coordinate system;

generate, based on the plurality of points, a line-space image, each pixel of the line-space image corresponding to a two-parameter representation of a respective line at a common height in the gravity-aligned coordinate system and each pixel having a pixel value; and

generate one or more vertical plane hypotheses based on the line-space image.

21. The non-transitory memory of claim 20 , wherein generating the line-space image includes:

selecting two points of the point cloud;

determining two parameters of a line projected to the common height in the gravity-aligned coordinate system defined by the two points; and

incrementing, by an amount, a pixel value of a pixel of the line-space image corresponding to the two parameters.

Continuity (4)
Continuation 16254858 · Jan 23, 2019
Provisional Application 62775336 · Dec 4, 2018
Provisional Application 62620971 · Jan 23, 2018
Related Publication 20210110562A1 · Apr 15, 2021