IP Library Granted Patent US 9,280,710
Granted Patent B1
US 9,280,710 · App. 14/208,385 · Granted Mar 8, 2016

Bus detection for an autonomous vehicle

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,280,710
App. No.
14/208,385
Granted
Mar 8, 2016
Kind
B1
Abstract

Methods and systems are provided that may allow an autonomous vehicle to discern a school bus from image data. An example method may include receiving image data indicative of a vehicles operating in an environment. The image data may depict sizes of the vehicles. The method may also include, based on relative sizes of the vehicles, determining a vehicle that is larger in size as compared the other vehicles. The method may additionally include comparing a size of the determined vehicle to a size of a school bus and based on the size of vehicle being within a threshold size of the school bus, comparing a color of the vehicle to a color of the school bus. The method may further include based on the vehicle being substantially the same color as the school bus, determining that the vehicle is representative of the school bus.

Claims (79)

1. A method comprising:

receiving, by one or more processors of a computing device, image data indicative of one or more vehicles that are operating in an environment, the image data depicting sizes of respective vehicles of the one or more vehicles;

the one or more processors determining a vehicle from the one or more vehicles that substantially fills a bounding box without exceeding the bounding box;

the one or more processors comparing a size of the vehicle to information indicative of a size of a school bus;

based on the size of the vehicle being within a threshold size of the size of the school bus, the one or more processors comparing a color of the vehicle to a color of a given school bus; and

based on the vehicle being substantially the same color as the color of the given school bus, the one or more processors determining that the vehicle is representative of the given school bus.

2. The method of claim 1 , wherein comparing the color of the vehicle to the color of the school bus comprises:

determining a portion of the image data that depicts the vehicle;

dividing the portion of the image data into a plurality of sections;

for respective sections of the plurality of sections, determining a value of difference between a color of the respective section and a substantially orange color;

determining a number of sections of the respective sections of which the value of difference is less than a difference threshold; and

based on the number of sections of the respective sections being greater than a number threshold, determining that the vehicle is representative of the given school bus.

3. The method of claim 1 , further comprising:

the one or more processors determining a portion of the image data that depicts the vehicle;

the one or more processors determining that the portion of the image data includes data indicative of a stop-sign; and

based on the portion of the image data including data indicative of the stop-sign, the one or more processors determining the vehicle is representative of the given school bus.

4. The method of claim 1 , further comprising:

the one or more processors determining a portion of the image data that depicts the vehicle;

the one or more processors determining that the portion of the image data includes data indicative of a school-sign; and

based on the portion of the image data including data indicative of the school-sign, the one or more processors determining the vehicle is representative of the given school bus.

5. The method of claim 1 , further comprising:

the one or more processors receiving operational data indicative of an operation of the vehicle in the environment; and

based on the operational data, the one or more processors determining the vehicle is representative of the given school bus.

6. The method of claim 5 ,

wherein the operational data indicative of the operation of the vehicle in the environment comprises data indicative of a stop pattern of the vehicle, and

the method further comprising:

based on the data indicative of the stop pattern of the vehicle, the one or more processors determining the vehicle is representative of the given school bus.

7. The method of claim 6 , wherein the data indicative of stop pattern includes data indicative of the vehicle operating a component of the vehicle to extend from a side portion of the vehicle as the vehicle stops.

8. The method of claim 1 , wherein the computing device resides in an autonomous vehicle operating in the environment.

9. The method of claim 8 , further comprising based on the vehicle being representative of the given school bus, the one or more processors providing instructions to control the autonomous vehicle in the environment.

10. A vehicle comprising:

a computer system configured to:

receive image data indicative of one or more vehicles that are operating in an environment, the image data depicting sizes of respective vehicles of the one or more vehicles;

determine a vehicle from the one or more vehicles that substantially fills a bounding box without exceeding the bounding box;

compare a size of the vehicle to information indicative of a size of a school bus;

based on the size of the vehicle being within a threshold size of the size of the school bus, compare a color of the vehicle to a color of a given school bus; and

based on the vehicle being substantially the same color as the color of the given school bus, determine that the vehicle is representative of the given school bus.

11. The vehicle of claim 10 , wherein the computer system is further configured to:

determine a portion of the image data that depicts the vehicle;

divide the portion of the image data into a plurality of sections;

for respective sections of the plurality of sections, determining a value of difference between a color of the respective section and a substantially orange color;

determine a number of sections of the respective sections of which the value of difference is less than a difference threshold; and

based on the number of sections of the respective sections being greater than a number threshold, determine that the vehicle is representative of the given school bus.

12. The vehicle of claim 10 , wherein the computer system is further configured to:

determine a portion of the image data that depicts the vehicle;

determine that the portion of the image data includes data indicative of a stop-sign; and

based on the portion of the image data including data indicative of the stop-sign, determine the vehicle is representative of the given school bus.

13. The vehicle of claim 10 , wherein the computer system is further configured to:

determine a portion of the image data that depicts the vehicle;

determine that the portion of the image data includes data indicative of a school-sign; and

based on the portion of the image data including data indicative of the school-sign, determine the vehicle is representative of the given school bus.

14. The vehicle of claim 10 , wherein the computer system is further configured to:

receive operational data indicative of an operation of the vehicle in the environment; and

based on the operational data, determine the vehicle is representative of the given school bus.

15. The vehicle of claim 14 ,

wherein the operational data indicative of the operation of the vehicle in the environment comprises data indicative of a stop pattern of the vehicle, and

the computer system is further configured to:

based on the data indicative of the stop pattern of the vehicle, determine the vehicle is representative of the given school bus.

16. The vehicle of claim 15 , wherein the stop pattern includes data indicative of the vehicle operating a component of the vehicle to extend from a side portion of the vehicle as the vehicle stops.

17. A non-transitory computer readable medium having stored therein instructions, that when executed by a computer system, cause the computer system to perform functions comprising:

receiving image data indicative of one or more vehicles that are operating in an environment, the image data depicting sizes of the one or more vehicles;

determining a vehicle from the one or more vehicles that substantially fills a bounding box without exceeding the bounding box;

comparing a size of the vehicle to information indicative of a size of a school bus;

based on the size of the vehicle being within a threshold size of the size of the school bus, comparing a color of the vehicle to a color of a given school bus; and

based on the vehicle being substantially the same color as the color of the given school bus, determining that the vehicle is representative of the given school bus.

18. The non-transitory computer readable medium of claim 17 , wherein the instructions are further executable by the computer system to cause the computer system to perform functions comprising:

determining a portion of the image data that depicts the vehicle;

dividing the portion of the image data into a plurality of sections;

for respective sections of the plurality of sections, determining a value of difference between a color of the respective section and a substantially orange color;

determining a number of sections of the respective sections of which the value of difference is less than a difference threshold; and

based on the number of sections of the respective sections being greater than a number threshold, determining that the vehicle is representative of the given school bus.

19. The non-transitory computer readable medium of claim 17 , wherein the instructions are further executable by the computer system to cause the computer system to perform functions comprising:

determining a portion of the image data that depicts the vehicle;

determining that the portion of the image data includes data indicative of a stop-sign; and

based on the portion of the image data including data indicative of the stop-sign, determining the vehicle is representative of the given school bus.

20. The non-transitory computer readable medium of claim 17 , wherein the instructions are further executable by the computer system to cause the computer system to perform functions comprising:

determining a portion of the image data that depicts the vehicle;

determining that the portion of the image data includes data indicative of a school-sign; and

based on the portion of the image data including data indicative of the school-sign, determining the vehicle is representative of the given school bus.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE REMOVAL OF THE INCORRECTLY RECORDED APPLICATION NUMBERS 14/149802 AND 15/419313 PREVIOUSLY RECORDED AT REEL: 44144 FRAME: 1. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Mar 4, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068092/0502 →
SUBMISSION TO CORRECT AN ERROR MADE IN A PREVIOUSLY RECORDED DOCUMENT THAT ERRONEOUSLY AFFECTS THE IDENTIFIED APPLICATIONS Recorded Nov 11, 2019
From: WAYMO LLC
To: WAYMO LLC
Reel/Frame 050978/0359 →
CHANGE OF NAME Recorded Oct 6, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044144/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2017
From: GOOGLE INC.
To: WAYMO HOLDING INC.
Reel/Frame 042084/0741 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2017
From: WAYMO HOLDING INC.
To: WAYMO LLC
Reel/Frame 042085/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2014
From: FERGUSON, DAVID IAN FRANKLIN; LO, WAN-YEN
To: GOOGLE INC.
Reel/Frame 032428/0531 →