IP Library Granted Patent US 9,097,804
Granted Patent B1
US 9,097,804 · App. 14/332,498 · Granted Aug 4, 2015

Object and ground segmentation from a sparse one-dimensional range data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,097,804
App. No.
14/332,498
Granted
Aug 4, 2015
Kind
B1
Abstract

Methods and systems for object and ground segmentation from a sparse one-dimensional range data are described. A computing device may be configured to receive scan data representing points in an environment of a vehicle. The computing device may be configured to determine if a test point in the scan data is likely to be an obstacle or ground by comparing the point to other points in the scan data to determine if specific constraints are violated. Points that do not pass these tests are likely to be above the ground, and therefore likely belong to obstacles.

Claims (53)

1. A method comprising:

receiving, at a computing device of a vehicle, scan data representing a plurality of points in an environment of the vehicle, the plurality of points being associated with a ground and one or more objects on or proximate to the ground;

determining, using the scan data, a horizontal distance between a first point of the plurality of points and a second point of the plurality of points;

determining, using the scan data, a vertical distance between the first point and the second point;

for the horizontal distance being smaller than a threshold horizontal distance, making a comparison between the vertical distance and a threshold vertical distance; and

based on an output of the comparison indicating that the vertical distance is greater than the threshold vertical distance, determining that the second point is unassociated with the ground and is a candidate object point that represents a given point on the one or more objects.

2. The method of claim 1 , further comprising:

for the vertical distance being less than the threshold vertical distance, determining that the second point is a candidate ground point.

3. The method of claim 1 , further comprising

for the horizontal distance being greater than a threshold horizontal distance, determining a slope of a line connecting the first point and the second point;

making a comparison between the slope and a predetermined slope for the ground; and

based on an output of the comparison indicating the slope being within a threshold slope value from the predetermined slope, determining that the second point is a candidate ground point associated with the ground and unassociated with the one or more objects.

4. The method of claim 3 , further comprising:

based on an output of the comparison indicating the slope is different from the predetermined slope by an amount greater than the threshold slope value, determining that the second point is unassociated with the ground and is a candidate object point that represents a given point on the one or more objects.

5. The method of claim 1 , wherein the scan data further comprises range information indicative of respective horizontal distances between given points of the plurality of points and height information indicative of respective vertical distances between the given points of the plurality of points.

6. The method of claim 5 , further comprising:

determining, based on the range information and the height information, that a given point above an adjacent point and closer to the vehicle than the adjacent point is unassociated with the ground and is associated with the one or more objects.

7. The method of claim 1 , wherein the scan data corresponds to light emitted from a light detection and ranging (LIDAR) device and reflected from the ground and the one or more objects.

8. The method of claim 1 , wherein the scan data comprises pixels of an image captured by an image-capture device coupled to the vehicle and depicting the ground and the one or more objects.

9. The method of claim 1 , wherein the scan data comprises one-dimensional data that represents a column of pixels in an image, a row of pixels in the image, or a laser scan line.

10. The method of claim 1 , wherein the computing device is configured to control the vehicle in an autonomous operation mode, the method further comprising:

providing, by the computing device, instructions to control the vehicle based on determining candidate ground points, wherein providing the instructions comprises determining a driving decision for the vehicle.

11. The method of claim 1 , wherein determining that the second point is a candidate object point comprises determining that the second point is a candidate object point in real-time.

12. A non-transitory computer readable medium having stored thereon instructions that, when executed by a computing device, cause the computing device to perform functions comprising:

receiving scan data representing a plurality of points in an environment of a vehicle, the plurality of points being associated with a ground and one or more objects on or proximate to the ground;

determining, using the scan data, a horizontal distance between a first point of the plurality of points and a second point of the plurality of points;

determining, using the scan data, a vertical distance between the first point and the second point;

for the horizontal distance being smaller than a threshold horizontal distance, making a comparison between the vertical distance and a threshold vertical distance; and

based on an output of the comparison indicating that the vertical distance is greater than the threshold vertical distance, determining that the second point is unassociated with the ground and is a candidate object point that represents a given point on the one or more objects.

13. The non-transitory computer readable medium of claim 12 , wherein the functions further comprise:

for the vertical distance being less than the threshold vertical distance, determining that the second point is a candidate ground point.

14. The non-transitory computer readable medium of claim 12 , wherein the functions further comprise:

for the horizontal distance being greater than a threshold horizontal distance, determining a metric indicative of a slope of a line connecting the first point and the second point;

making a comparison between the metric indicative of the slope and a corresponding metric indicative of a predetermined slope for the ground; and

based on an output of the comparison indicating that the metric is within a threshold slope value from the corresponding metric, determining that the second point is a candidate ground point associated with the ground and unassociated with the one or more objects.

15. The non-transitory computer readable medium of claim 14 , wherein the functions further comprise:

based on an output of the comparison indicating that the metric is different from the corresponding metric by an amount greater than the threshold slope value, determining that the second point is unassociated with the ground and is a candidate object point that represents a given point on the one or more objects.

16. The non-transitory computer readable medium of claim 12 , wherein the scan data comprises one-dimensional data that represents a column of pixels in an image, a row of pixels in the image, or a laser scan line.

17. The non-transitory computer readable medium of claim 12 , wherein the functions further comprise:

providing control instructions to control the vehicle in an autonomous operation mode based on determining candidate ground points, wherein the function of providing the instructions comprises determining a driving decision for the vehicle.

18. A system, comprising:

at least one processor; and

data storage comprising instructions that, when executed by the at least one processor, cause the system to perform functions comprising:

receiving scan data representing a plurality of points in an environment of a vehicle, the plurality of points being associated with a ground and one or more objects on or proximate to the ground;

determining, using the scan data, a horizontal distance between a first point of the plurality of points and a second point of the plurality of points;

determining, using the scan data, a vertical distance between the first point and the second point;

for the horizontal distance being smaller than a threshold horizontal distance, making a comparison between the vertical distance and a threshold vertical distance; and

based on an output of the comparison indicating that the vertical distance is greater than the threshold vertical distance, determining that the second point is unassociated with the ground and is a candidate object point that represents a given point on the one or more objects.

19. The system of claim 18 , wherein the functions further comprise:

for the vertical distance being less than the threshold vertical distance, determining that the second point is a candidate ground point.

20. The system of claim 18 , further comprising:

a light detection and ranging (LIDAR) device coupled to the vehicle; and

an image-capture device coupled to the vehicle, wherein the scan data comprises: (i) a one-dimensional line scan data that corresponds to light emitted from the LIDAR device and reflected from the ground and the one or more objects, or (ii) pixels of an image captured by the image-capture device and depicting the ground and the one or more objects.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE REMOVAL OF THE INCORRECTLY RECORDED APPLICATION NUMBERS 14/149802 AND 15/419313 PREVIOUSLY RECORDED AT REEL: 44144 FRAME: 1. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 4, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068092/0502 →
SUBMISSION TO CORRECT AN ERROR MADE IN A PREVIOUSLY RECORDED DOCUMENT THAT ERRONEOUSLY AFFECTS THE IDENTIFIED APPLICATIONS Recorded Nov 11, 2019
From: WAYMO LLC
To: WAYMO LLC
Reel/Frame 050978/0359 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044144/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2017
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 042084/0741 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2017
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 042085/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2014
From: SILVER, DAVID; FERGUSON, DAVID IAN FRANKLIN
To: GOOGLE INC.
Reel/Frame 033321/0011 →