IP Library Granted Patent US 8,134,480
Granted Patent B2
US 8,134,480 · App. 12/224,791 · Granted Mar 13, 2012

Image processing system and method

Assignee: Toyota Jidosha Kabushiki Kaisha
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,134,480
App. No.
12/224,791
Granted
Mar 13, 2012
Kind
B2
Abstract

An image processing system is provided, which includes: a front monitoring device that obtains an image of a view ahead of a vehicle; a vehicle position detecting device that detects the position and orientation of the vehicle; a map database that stores road maps; a traffic indicator position estimating portion that estimates the position of a traffic indicator ( 23 ) based on the shape of a road ahead of the vehicle that has been extracted from the map database, according to the position of the vehicle that has been detected by the vehicle position detecting device; an image processing region setting portion that sets an image processing region within the image obtained by the front monitoring device based on the position of the traffic indicator that has been estimated by the traffic indicator position estimating portion; and a traffic indicator detecting portion that detects the traffic indicator from the image processing region.

Claims (37)

1. An image processing system, comprising:

a front monitoring device that obtains an image of a view ahead of a vehicle;

a vehicle position detecting device that detects a position and an orientation of the vehicle;

a map database that stores a road map;

a traffic indicator position estimating portion that estimates a position of a traffic indicator based on a shape of an intersection ahead of the vehicle that has been extracted from the map database, according to the position of the vehicle that has been detected by the vehicle position detecting device;

an image processing region setting portion that sets, within the image obtained by the front monitoring device, an image processing region over which a predetermined image processing is performed, based on the position of the traffic indicator that has been estimated by the traffic indicator position estimating portion; and

a traffic indicator detecting portion that detects the traffic indicator from the image processing region through the predetermined image processing;

wherein the traffic indicator position estimating portion calculates the position of the traffic indicator based on a curvature of a road before the intersection ahead of the vehicle that has been extracted from the map database, according to the position of the vehicle that has been detected by the vehicle position detecting device, or based on an inclination of the road before the intersection.

2. The image processing system according to claim 1 , wherein

when the shape of the road indicates an intersection, the traffic indicator position estimating portion estimates a traffic indicator or traffic indicators to be located:

a) above a road on which the vehicle is traveling;

b) before and after the intersection, respectively, as viewed in the traveling direction of the vehicle;

c) before and after the intersection, respectively, across a crossing road, as viewed in the traveling direction of the vehicle;

d) within a predetermined distance from each corner of the intersection;

e) before the intersection by a distance that is determined in accordance with a curvature of a curve, as viewed in the traveling direction of the vehicle;

f) before the intersection by a distance that is determined in accordance with an inclination of a road, as viewed in the traveling direction of the vehicle; or

g) substantially at the lateral center of a road on which the vehicle is traveling.

3. The image processing system according to claim 1 , wherein the image processing region is set based on the width of a road on which the vehicle is traveling.

4. The image processing system according to claim 1 , further comprising:

an output device that displays the image of the view ahead of the vehicle and a textual information for a driver, wherein a speaker is connected to the output device, and the speaker outputs an alert when the traffic indicator detecting portion detects the traffic indicator.

5. The image processing system according to claim 1 , further comprising:

a traffic indicator position calculating portion that calculates a coordinate of the position of the traffic indicator, wherein

the traffic indicator position calculating portion calculates the coordinate of the position of the traffic indicator using, as an initial value, the position of the traffic indicator that has been estimated by the traffic indicator position estimating portion, based on the position and orientation of the vehicle that have been detected by the vehicle position detecting device and the position of the traffic indicator in the image that has been detected by the traffic indicator detecting portion.

6. The image processing system according to claim 5 , further comprising:

a spatial model database that records the coordinate of the position of the traffic indicator that has been calculated by the traffic indicator position calculating portion, wherein

if the coordinate of the position of the traffic indicator is recorded in the spatial model database, the recorded coordinate is set as the initial value in the calculation by the traffic indicator position calculating portion.

7. The image processing system according to claim 1 , wherein the traffic indicator includes a traffic signal.

8. An image processing method, comprising:

obtaining an image of a view ahead of a vehicle; detecting a position and an orientation of the vehicle;

extracting a shape of an intersection ahead of the vehicle from a road map database that pre-stores a road map, based on the detected position of the vehicle;

estimating a position of a traffic indicator based on a shape of a road;

setting an image processing region over which a predetermined image processing is performed, based on the estimated position of the traffic indicator; and

detecting the traffic indicator from the image processing region through the predetermined image processing;

wherein estimating a position of a traffic indicator includes calculating the position of the traffic indicator based on a curvature of a road before the intersection ahead of the vehicle that has been extracted from the map database, according to the position of the vehicle that has been detected, or based on an inclination of the road before the intersection.

9. The image processing system according to claim 2 , further comprising:

a traffic indicator position calculating portion that calculates a coordinate of the position of the traffic indicator, wherein

the traffic indicator position calculating portion calculates the coordinate of the position of the traffic indicator using, as an initial value, the position of the traffic indicator that has been estimated by the traffic indicator position estimating portion, based on the position and orientation of the vehicle that have been detected by the vehicle position detecting device and the position of the traffic indicator in the image that has been detected by the traffic indicator detecting portion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2009
From: ONOME, HIROHISA; WATANABE, KOJI
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 022115/0160 →
Priority Claims (1)
JP 2006-060226 · Mar 6, 2006 · national
Continuity (1)
Related Publication 20090303077A1 · Dec 10, 2009