IP Library Granted Patent US 11,893,802
Granted Patent B2
US 11,893,802 · App. 17/270,550 · Granted Feb 6, 2024

Systems and methods for traffic light identification

Inventor: Naoki Taki (Brussels, BE)
Assignee: TOYOTA MOTOR EUROPE
G06V20/584B60W40/04B60W60/0015B60W2420/42B60W2552/00B60W2554/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,893,802
App. No.
17/270,550
Granted
Feb 6, 2024
Kind
B2
Abstract

A traffic signal fixture verification system including an optical recognition means configured to obtain one or more images of two or more traffic signal fixtures in proximity to an ego vehicle, and to detect a motion status of one or more vehicles in proximity to the ego vehicle, a processing means configured to determine a relevance value for two or more traffic signal fixtures identified in the one or more images, monitor a status of each of two or more relevant traffic signal fixtures having a relevance value greater than a threshold value, and based on the relevance values of the two or more relevant traffic signal fixtures, the respective status of each of the two or more relevant traffic signal fixtures, and optionally, and/or the motion status of the one or more vehicles surrounding the vehicle, actuate an accelerator function or a braking function of the ego vehicle.

Claims (28)

1. A traffic signal fixture verification system for an ego vehicle, comprising:

optical recognition means configured to obtain one or more images of two or more traffic signal fixtures in proximity to the ego vehicle, and to detect a motion status of one or more vehicles in proximity to the ego vehicle;

processing means configured to:

determine relevance values for a plurality of traffic signal fixtures identified in the one or more images;

group each of the plurality of traffic signal fixtures that have a same reference value into respective signal groups;

determine which one of the signal groups has relevance values greater than a threshold value;

monitor a status of each of the traffic signal fixtures in the signal group, from among the respective signal groups, that has the relevance values greater than the threshold value;

perform a comparison among all of the traffic signal fixtures in the signal group that has been monitored to determine whether the status of all of the traffic signal fixtures are identical; and

upon the determination that the status of all of the traffic signal fixtures in the monitored signal group are identical, actuate an accelerator function or a braking function of the ego vehicle based on the status of all the traffic signals fixtures in the signal group, and

upon the determination that the status of all of the traffic signal fixtures in the monitored signal group are not identical, actuate an accelerator function or a braking function of the ego vehicle based on at least one of (i) the status of the traffic signal fixture in the signal group that has a highest safety factor or (ii) the motion status of the one or more vehicles surrounding the ego vehicle.

2. The traffic signal fixture verification system according to claim 1 , wherein when the status of one of the traffic signal fixtures in the signal group cannot be determined, a status of another traffic signal fixture from another of the respective signal groups is monitored and used for the actuation.

3. The traffic signal fixture verification system according to claim 1 , wherein the status having the highest safety factor corresponds to a stop light or a caution light of a traffic signal fixture.

4. The traffic signal fixture verification system according to claim 1 , wherein the processing means is configured to receive map data associated with traffic signal fixture locations, and to use the map data in the relevance value determination.

5. The traffic signal fixture verification system according to claim 1 , wherein a distance of each of the plurality of traffic signal fixtures from the ego vehicle is considered in the relevance value determination.

6. The traffic signal fixture verification system according to claim 1 , wherein upon detection of a change in motion status of the one or more vehicles surrounding the ego vehicle being greater than a threshold percentage change, the change in motion status is considered for the actuating.

7. A method for verifying a status of a traffic signal fixture from an ego vehicle, comprising:

obtaining one or more images of two or more traffic signal fixtures in proximity to the ego vehicle;

detecting a motion status of one or more vehicles in proximity to the ego vehicle;

determining relevance values for a plurality of traffic signal fixtures identified in the one or more images;

grouping each of the plurality of traffic signal fixtures that have a same reference value into respective signal groups;

determining which one of the signal groups has relevance values greater than a threshold value;

monitoring a status of each of the traffic signal fixtures in the signal group, from among the signal groups, that has the relevance values greater than the threshold value;

perform a comparison among all of the traffic signal fixtures in the signal group that has been monitored to determine whether the status of all of the traffic signal fixtures are identical; and

upon the determination that the status of all of the traffic signal fixtures in the monitored signal group are identical, actuating an accelerator function or a braking function of the ego vehicle based on the status of all the traffic signals fixtures in the signal group, and

upon the determination that the status of all of the traffic signal fixtures in the monitored signal group are not identical, actuating an accelerator function or a braking function of the ego vehicle based on at least one of (i) the status of the traffic signal fixture in the signal group that has a highest safety factor or (ii) the motion status of the one or more vehicles surrounding the ego vehicle.

8. The method for verifying a status of a traffic signal fixture according to claim 7 , wherein when the status of one of the traffic signal fixtures in the signal group cannot be determined, a status of another traffic signal fixture from another of the respective signal groups is monitored and used for the actuation.

9. The method for verifying a status of a traffic signal fixture according to claim 7 , comprising receiving map data associated with traffic signal fixture locations, and to using the map data in the relevance value determination.

10. The method for verifying a status of a traffic signal fixture according to claim 7 , wherein upon detection of a change in motion status, greater than a threshold percentage change, of the one or more vehicles surrounding the ego vehicle, the change in motion status is considered for the actuation.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2024
From: TOYOTA MOTOR EUROPE
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 068326/0218 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2021
From: TAKI, NAOKI
To: TOYOTA MOTOR EUROPE
Reel/Frame 055365/0744 →
Continuity (1)
Related Publication 20210287024A1 · Sep 16, 2021