IP Library Granted Patent US 8,620,032
Granted Patent B2
US 8,620,032 · App. 13/104,220 · Granted Dec 31, 2013

System and method for traffic signal detection

Inventor: Shuqing Zeng (Sterling Heights, MI)
Assignee: GM Global Technology Operations LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,620,032
App. No.
13/104,220
Granted
Dec 31, 2013
Kind
B2
Abstract

A method and system may determine a location of a vehicle, collect an image using a camera associated with the vehicle, analyze the image in conjunction with the location of the vehicle and/or previously collected information on the location of traffic signals or other objects (e.g., traffic signs), and using this analysis locate an image of a traffic signal within the collected image. The position (e.g., a geographic position) of the signal may be determined, and stored for later use. The identification of the signal may be used to provide an output such as the status of the signal, such as green light.

Claims (33)

1. A method comprising:

determining a location of a vehicle;

collecting an image using a camera associated with the vehicle; and

analyzing the image in conjunction with the location of the vehicle and in conjunction with previously collected information on the location of traffic signals, collected by a system in the vehicle and relevant to the specific vehicle, wherein the previously collected information is stored in a database or memory within the vehicle, to locate an image of a traffic signal within the collected image;

locating the image of the traffic signal by analyzing portions of the image, wherein the analysis is weighted by the location of the vehicle in conjunction with known map data, and is input to one or more classifiers, each comprising an ensemble of detectors in cascade.

2. The method of claim 1 comprising determining the geographic location of the traffic signal.

3. The method of claim 1 wherein the previously collected information on the location of traffic signals is collected based on images captured by the camera associated with the vehicle.

4. The method of claim 1 comprising updating the previously collected information on the location of traffic signals with the location of the traffic signal.

5. The method of claim 1 comprising locating an image of a traffic signal by creating a set of candidate windows each surrounding a portion of the image wherein the selection of each window is weighted by previously collected information on the location of traffic signals.

6. The method of claim 1 comprising determining the status of the traffic signal.

7. A system comprising:

a database storing previously collected information on the location of traffic signals;

a camera;

a vehicle location detection system; and

a controller to:

accept a location of a vehicle from the vehicle location detection system;

collect an image using the camera;

analyze the image in conjunction with the location of the vehicle and in conjunction with the previously collected information on the location of traffic signals, collected by a system in the vehicle and relevant to the specific vehicle, wherein the previously collected information is stored in the database or memory within the vehicle, to locate an image of a traffic signal within the collected image; and

wherein the controller is to locate the image of the traffic signal by analyzing portions of the image, wherein the analysis is weighted by the location of the vehicle in conjunction with known map data, and is input to one or more classifiers, each comprising an ensemble of detectors in cascade.

8. The system of claim 7 wherein the controller is to determine the geographic location of the traffic signal.

9. The system of claim 7 wherein the previously collected information on the location of traffic signals is collected based on images captured by the camera.

10. The system of claim 7 wherein the controller is to update the previously collected information on the location of traffic signals with the location of the traffic signal.

11. The system of claim 7 wherein the controller is to locate an image of a traffic signal by creating a set of candidate windows each surrounding a portion of the image wherein the selection of each window is weighted by previously collected information on the location of traffic signals.

12. The system of claim 7 wherein the controller is to determine the status of the traffic signal.

13. A method comprising:

in a vehicle, capturing an image;

searching within a plurality of candidate areas within the image for a traffic signal, wherein the candidate areas are determined using as input, and in conjunction with, previously collected information on the location of traffic signals as stored in a system or database within the vehicle or controlled by the vehicle, and relevant to the specific vehicle;

determining the status of the traffic signal within the image and

wherein searching for the traffic signal within the image is weighted by the location of the vehicle, and is input to one or more classifiers, each comprising an ensemble of detectors in cascade.

14. The method of claim 13 comprising determining the geographic location of the traffic signal.

15. The method of claim 13 wherein the information on the location of traffic signals is collected based on images captured in the vehicle.

16. The method of claim 13 comprising updating information on the location of traffic signals with the location of the traffic signal.

17. The method of claim 13 wherein the candidate areas each define a portion of the image wherein the determination of each area is weighted by information on the location of traffic signals.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034186/0776 →
SECURITY AGREEMENT Recorded Jun 28, 2012
From: GM GLOBAL TECHNOLOGY OPERATIONS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 028466/0870 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2011
From: ZENG, SHUQING
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 026252/0285 →
Continuity (1)
Related Publication 20120288138A1 · Nov 15, 2012