IP Library Granted Patent US 9,193,355
Granted Patent B2
US 9,193,355 · App. 14/718,237 · Granted Nov 24, 2015

Construction zone sign detection using light detection and ranging

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,193,355
App. No.
14/718,237
Granted
Nov 24, 2015
Kind
B2
Abstract

Methods and systems for construction zone sign detection are described. A computing device may be configured to receive a 3D point cloud of a vicinity of a road on which a vehicle is travelling. The 3D point cloud may include points corresponding to light reflected from objects in the vicinity of the road. The computing device may be configured to determine a set of points representing an area at a given height from a surface of the road, and estimate a shape associated with the set of points. Further, the computing device may be configured to determine a likelihood that the set of points represents a construction zone sign, based on the estimated shape. Based on the likelihood, the computing device may be configured to modify a control strategy associated with a driving behavior of the vehicle; and control the vehicle based on the modified control strategy.

Claims (60)

1. A method, comprising:

selecting, by a computing device of a vehicle, a portion of a three-dimensional (3D) point cloud representing an area at a height greater than a threshold height from a surface of a road of travel of the vehicle;

identifying a shape in the selected portion;

determining, using the computing device, that the identified shape represents a construction zone sign based at least on an outline of the shape;

determining a type of the construction zone sign based at least on the identified shape;

detecting one or more construction zone objects on the road;

determining a severity of road changes based on a number and locations of the one or more construction zone objects; and

controlling, using the computing device, the vehicle based on the type of the construction zone sign and the severity of road changes.

2. The method of claim 1 , wherein the vehicle is in an autonomous operation mode.

3. The method of claim 1 , wherein the predetermined threshold height is related to a given height of a typical construction zone sign.

4. The method of claim 1 , further comprising:

receiving, from a light detection and ranging (LIDAR) sensor coupled to the computing device, LIDAR-based information comprising (i) the 3D point cloud, wherein the 3D point cloud comprises points corresponding to light emitted from the LIDAR and reflected from one or more objects in a vicinity of the road, and (ii) intensity values of the reflected light for the points.

5. The method of claim 4 , wherein determining that the identified shape represents a construction zone sign comprises:

comparing the respective intensity values to a threshold intensity value, wherein the threshold intensity value is related to intensity of light reflected from a reflective surface of a typical construction zone sign.

6. The method of claim 1 , wherein determining that the identified shape represents a construction zone sign comprises:

matching the identified shape to one or more shapes of typical construction zone signs.

7. The method of claim 1 , wherein the computing device has access to map information that includes road traffic sign information and indicates locations and types of traffic signs on the road, the method further comprising:

determining that the identified shape is associated with a traffic sign; and

determining that the traffic sign is missing from the map information, wherein determining that the identified shape represents a construction zone sign is further based on the traffic sign being missing from the map information.

8. The method of claim 1 , wherein controlling the vehicle comprises:

utilizing sensor information received from on-board or off-board sensors in making a navigation decision rather than preexisting map information.

9. A non-transitory computer readable medium having stored thereon instructions that, when executed by a computing device of a vehicle, cause the computing device to perform operations comprising:

selecting a portion of a three-dimensional (3D) point cloud representing an area at a height greater than a threshold height from a surface of a road of travel of the vehicle;

identifying a shape in the selected portion;

determining that the identified shape represents a construction zone sign based at least on an outline of the shape;

determining a type of the construction zone sign based at least on the identified shape;

detecting one or more construction zone objects on the road;

determining a severity of road changes based on a number and locations of the one or more construction zone objects; and

controlling the vehicle based on the type of the construction zone sign and the severity of road changes.

10. The non-transitory computer readable medium of claim 9 , wherein the operation of controlling the vehicle comprises:

controlling the vehicle in an autonomous operation mode.

11. The non-transitory computer readable medium of claim 9 , wherein the predetermined threshold height is related to a given height of a typical construction zone sign.

12. The non-transitory computer readable medium of claim 9 , wherein the operations further comprise:

receiving, from a light detection and ranging (LIDAR) sensor coupled to the computing device, LIDAR-based information comprising (i) the 3D point cloud, wherein the 3D point cloud comprises points corresponding to light emitted from the LIDAR and reflected from one or more objects in a vicinity of the road, and (ii) intensity values of the reflected light for the points.

13. The non-transitory computer readable medium of claim 12 , wherein the operation of determining that the identified shape represents a construction zone sign comprises:

comparing the respective intensity values to a threshold intensity value, wherein the threshold intensity value is related to intensity of light reflected from a reflective surface of a typical construction zone sign.

14. The non-transitory computer readable medium of claim 9 , wherein the computing device has access to map information that includes road traffic sign information and indicates locations and types of traffic signs on the road, and wherein the operations further comprise:

determining that the identified shape is associated with a traffic sign; and

determining that the traffic sign is missing from the map information, wherein the operation of determining that the identified shape represents a construction zone sign is further based on the traffic sign being missing from the map information.

15. The non-transitory computer readable medium of claim 9 , wherein the operation of controlling the vehicle comprises:

utilizing sensor information received from on-board or off-board sensors to estimate lane boundaries rather than utilizing preexisting map information.

16. A control system for a vehicle, comprising:

a light detection and ranging (LIDAR) device configured to capture a three-dimensional (3D) point cloud of a vicinity of a road of travel of the vehicle;

a computing device in communication with the LIDAR device; and

data storage comprising instructions that, when executed by the computing device, cause the control system to perform operations comprising:

selecting a portion of the 3D point cloud representing an area at a height greater than a threshold height from a surface of the road of travel of the vehicle;

identifying a shape in the selected portion;

determining that the identified shape represents a construction zone sign based at least on an outline of the shape;

determining a type of the construction zone sign based at least on the identified shape;

detecting one or more construction zone objects on the road;

determining a severity of road changes based on a number and locations of the one or more construction zone objects; and

controlling the vehicle based on the type of the construction zone sign and the severity of road changes.

17. The control system of claim 16 , wherein the operation of controlling the vehicle comprises:

controlling the vehicle in an autonomous operation mode.

18. The control system of claim 16 , wherein the predetermined threshold height is related to a given height of a typical construction zone sign.

19. The control system of claim 16 , wherein the computing device has access to map information that includes road traffic sign information and indicates locations and types of traffic signs on the road, and wherein the operations further comprise:

determining that the identified shape is associated with a traffic sign; and

determining that the traffic sign is missing from the map information, wherein the operation of determining that the identified shape represents a construction zone sign is further based on the traffic sign being missing from the map information.

20. The control system of claim 16 , wherein the operation of controlling the vehicle comprises:

activating one or more sensors for detection of construction workers and making the navigation decision based on the detection.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2017
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 042084/0741 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2017
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 042085/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2015
From: FERGUSON, DAVID IAN; HAEHNEL, DIRK
To: GOOGLE INC.
Reel/Frame 035687/0778 →