IP Library Granted Patent US 10,740,630
Granted Patent B1
US 10,740,630 · App. 16/224,175 · Granted Aug 11, 2020

Plane estimation for contextual awareness

Inventors: David Ian Franklin Ferguson (San Francisco, CA); David Harrison Silver (San Carlos, CA); Hyman Jack Murveit (Portola Valley, CA)
Assignee: Waymo LLC
G06K9/00818G05D1/0246G06K9/6202G06K9/6267G06K9/00536
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,740,630
App. No.
16/224,175
Granted
Aug 11, 2020
Kind
B1
Abstract

Aspects of the disclosure relate to classifying teh status of objects. For examples, one or more computing devices detect an object from an image of a vehicle's environment. The object is associated with a location. The one or more computing devices receive data corresponding to the surfaces of objects in the vehicle's environment and identifying data within a region around the location of the object. The one or more computing devices also determine whether the data within the region corresponds to a planar surface extending away from an edge of the object. Based on this determination, the one or more computing devices classify the status of the object.

Claims (28)

1. A method for determining whether a vehicle should respond to stop signs, the method comprising:

receiving, by one or more computing devices, sensor data identifying locations and surfaces of objects within the vehicle's environment, including a first object and a location of the first object;

determining, by the one or more computing devices, that the first object corresponds to a stop sign;

processing, by the one or more computing devices, a portion of the sensor data within a volume of space around the location of the first object to determine whether a surface of the stop sign extends away from a second surface; and

determining, by the one or more computing devices, whether the vehicle should respond to the stop sign based on the determination of whether the surface of the stop sign extends away from the second surface.

2. The method of claim 1 , further comprising, when the surface of the stop sign is determined to extend away from a surface of another object, maneuvering the vehicle, by the one or more computing devices, without responding to the stop sign.

3. The method of claim 1 , further comprising, when the surface of the stop sign is determined to not extend away from a surface of another object, maneuvering the vehicle, by the one or more computing devices, to respond to and obey the stop sign.

4. The method of claim 1 , wherein processing the portion of the sensor data includes determining that the first object is a reflection of a stop sign, and wherein determining whether the vehicle should respond to the stop sign is further based on the determination that the object is a reflection of a stop sign.

5. The method of claim 4 , further comprising maneuvering the vehicle, by the one or more computing device, without responding to the stop sign.

6. The method of claim 1 , wherein processing the portion of the sensor data includes determining that the stop sign is located on a flat surface, and wherein determining whether the vehicle should respond to the stop sign is further based on the determination that the stop sign is located on a flat surface.

7. The method of claim 6 , further comprising maneuvering the vehicle, by the one or more computing device, without responding to the stop sign.

8. The method of claim 1 , wherein processing the portion of the sensor data includes determining that there is no second surface, and wherein determining whether the vehicle should respond to the stop sign is further based on the determination that there is no second surface.

9. The method of claim 6 , further comprising maneuvering the vehicle, by the one or more computing device, to respond and obey the stop sign.

10. The method of claim 1 , wherein processing the portion of the sensor data includes determining a distance between the stop sign and the second surface, and wherein determining whether the vehicle should respond to the stop sign is further based on the distance.

11. The method of claim 1 , wherein processing the portion of the sensor data includes determining a distance that the second surface extends away from the surface of the stop sign, and wherein determining whether the vehicle should respond to the stop sign is further based on the distance.

12. The method of claim 1 , wherein the volume of space corresponds to a three-dimensional box.

13. The method of claim 1 , wherein the volume of space corresponds to a sphere.

14. A system for determining whether a vehicle should respond to stop signs, the system comprising one or more computing devices configured to:

receive sensor data identifying locations and surfaces of objects within the vehicle's environment, including a first object and a location of the first object;

determine that the first object corresponds to a stop sign;

process a portion of the sensor data within a volume of space around the location of the first object to determine whether a surface of the stop sign extends away from a second surface; and

determine whether the vehicle should respond to the stop sign based on the determination of whether the surface of the stop sign extends away from the second surface.

15. The system of claim 14 , wherein the one or more computing devices are further configured to, when the surface of the stop sign is determined to extend away from a surface of another object, maneuver the vehicle without responding to the stop sign.

16. The system of claim 14 , wherein the one or more computing devices are further configured to, when the surface of the stop sign is determined to not extend away from a surface of another object, maneuver the vehicle to respond to and obey the stop sign.

17. The system of claim 14 , wherein the one or more computing devices are further configured to process the portion of the sensor data by determining that the first object is a reflection of a stop sign, and to determine whether the vehicle should respond to the stop sign further based on the determination that the first object is a reflection of a stop sign.

18. The system of claim 17 , wherein the one or more computing devices are further configured to maneuver the vehicle without responding to the stop sign.

19. The system of claim 14 , wherein the one or more computing devices are further configured to process the portion of the sensor data by determining that the stop sign is located on a flat surface, and to determine whether the vehicle should respond to the stop sign further based on the determination that the stop sign is located on a flat surface.

20. The system of claim 19 , wherein the one or more computing devices are further configured to maneuver the vehicle without responding to the stop sign.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2020
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 053202/0005 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2020
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 053202/0155 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2018
From: FERGUSON, DAVID IAN FRANKLIN; SILVER, DAVID HARRISON; MURVEIT, HYMAN JACK
To: GOOGLE INC.
Reel/Frame 047817/0744 →
Continuity (3)
Continuation 15383317 · Dec 19, 2016
Continuation 14503626 · Oct 1, 2014
Provisional Application 62043581 · Aug 29, 2014
Cited By (2)
US 12,337,869 US 12,654,740