IP Library › Granted Patent US 10,970,569
Granted Patent B2
US 10,970,569 · App. 16/194,644 · Granted Apr 6, 2021

Systems and methods for monitoring traffic lights using imaging sensors of vehicles

Inventor: Robert D. Slater (Murphy, TX)
Assignee: TOYOTA MOTOR NORTH AMERICA, INC.
G06K9/00825G05D1/0088G06T7/12G08G1/095G08G1/13G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,970,569
App. No.
16/194,644
Granted
Apr 6, 2021
Kind
B2
Abstract

A traffic light monitoring system includes a vehicle. The vehicle includes an imaging sensor configured to capture images, one or more processors, one or more memory modules, and machine readable instructions stored in the one or more memory modules that cause the vehicle to perform at least the following when executed by the one or more processors: identify a traffic light based on the images, determine a first transition time when a first light of a traffic light turns off and a second light of the traffic light turns on based on the images, determine a second transition time when the second light of the traffic light turns off and a third light of the traffic light turns on based on the images, and transmit information about the first transition time and the second transition time to an edge computing device.

Claims (55)

1. A traffic light monitoring system comprising:

a vehicle configured to:

identify a traffic light based on images captured by an imaging sensor of the vehicle;

determine a first transition time when a first light of a traffic light turns off and a second light of the traffic light turns on based on the images;

determine a second transition time when the second light of the traffic light turns off and a third light of the traffic light turns on based on the images; and

transmit information about the first transition time and the second transition time to an edge computing device; and

the edge computing device configured to:

calculate a period for the second light being on based on the first transition time and the second transition time;

receive another transition time when the first light turns off and the second light turns on from another vehicle, the another transition time being after the first transition time; and

broadcast a notification of an upcoming change of the second light based on the another transition time, the period, and a current time.

2. The traffic light monitoring system of claim 1 , wherein the imaging sensor is a forward facing camera of the vehicle.

3. The traffic light monitoring system of claim 1 , wherein the first light is a red light, the second light is a green light, and the third light is a yellow light.

4. The traffic light monitoring system of claim 1 , wherein the vehicle is further configured to:

determine a third transition time when the third light of the traffic light turns off and the first light of the traffic light turns on based on the images; and

transmit information about the third transition time to the edge computing device.

5. The traffic light monitoring system of claim 4 , wherein-the edge computing device is configured to:

determine a period for the third light being on based on the second transition time and the third transition time.

6. The traffic light monitoring system of claim 1 , wherein:

the vehicle comprises a navigation module, and

the vehicle is configured to:

determine a current location of the vehicle based on a signal from the navigation module;

determine a location of the traffic light based on the current location of the vehicle and the images; and

transmit the location of the traffic light to the edge computing device.

7. The traffic light monitoring system of claim 1 , wherein the vehicle is configured to:

transmit, to the edge computing device, information about the first light being turned off and the second light being turned on along with the first transition time; and

transmit, to the edge computing device, information about the second light being turned off and the third light being turned on along with the second transition time.

8. The traffic light monitoring system of claim 1 , wherein the vehicle is configured to:

determine a third transition time when the third light of the traffic light turns off and a fourth light of the traffic light turns on based on the images;

determine a fourth transition time when the fourth light of the traffic light turns off and the first light of the traffic light turns on based on the images; and

transmit information about the third transition time and the fourth transition time.

9. The traffic light monitoring system of claim 8 , wherein the first light is a red light, the second light is a left-turn light, the third light is a green light, and the fourth light is a yellow light.

10. The traffic light monitoring system of claim 8 , wherein the first light is a red light, the second light is a right-turn light, the third light is a green light, and the fourth light is a yellow light.

11. The traffic light monitoring system of claim 1 , wherein the edge computing device is a road side unit.

12. The traffic light monitoring system of claim 1 , wherein the vehicle is an autonomous vehicle.

13. An edge computing device configured to:

receive a first transition time when a first light of a traffic light turns off and a second light of the traffic light turns on from a vehicle;

receive a second transition time when the second light of the traffic light turns off and a third light of the traffic light turns on from the vehicle;

calculate a period for the second light being on based on the first transition time and the second transition time;

receive another transition time when the first light turns off and the second light turns on from another vehicle, the another transition time being after the first transition time; and

broadcast a notification of an upcoming change of the second light based on the another transition time, the period, and a current time.

14. The edge computing device of claim 13 , further configured to:

determine a timing when the second light turns off after the third transition time based on the third transition time and the period; and

broadcast the timing to vehicles within a predetermined distance of the edge computing device.

15. The edge computing device of claim 13 , further configured to:

receive a third transition time when the third light of the traffic light turns off and the first light of the traffic light turns on from the vehicle; and

calculate a period for the third light being on based on the second transition time and the third transition time.

16. The edge computing device of claim 13 , wherein the first light is a red light, the second light is a green light, and the third light is a yellow light.

17. An edge computing device configured to:

receive a first transition time when a first light of a traffic light turns off and a second light of the traffic light turns on from a first vehicle;

receive a second transition time when the second light of the traffic light turns off and the first light of the traffic light turns on from a second vehicle;

calculate a period for the second light being on based on the first transition time and the second transition time;

receive a third transition time when the first light turns off and the second light turns on from a third vehicle, the third transition time being after the first transition time; and

broadcast a notification of an upcoming change of the second light based on the third transition time, the period, and a current time.

18. The edge computing device of claim 17 , wherein the first light is a red light and the second light is a green light.

19. The edge computing device of claim 17 , wherein the traffic light is a pedestrian traffic light.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: SLATER, ROBERT D.
To: TOYOTA MOTOR NORTH AMERICA, INC.
Reel/Frame 048682/0865 →
Continuity (1)
Related Publication 20200160072A1 · May 21, 2020