IP Library Granted Patent US 12,175,861
Granted Patent B2
US 12,175,861 · App. 17/362,825 · Granted Dec 24, 2024

Image sensor mapping for traffic control systems and methods

Inventors: Stefan Schulte (Marke, BE); Martijn Withouck (Lauwe, BE); Wouter Favoreel (Wevelgem, BE)
Assignee: FLIR BELGIUM BVBA
G08G1/04G01S19/14G06T7/70G06V20/54G08G1/087G06T2207/30236G06V2201/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,175,861
App. No.
17/362,825
Granted
Dec 24, 2024
Kind
B2
Abstract

Systems and methods for controlling traffic signaling includes a wireless sensor operable to detect and receive wireless signals emitted from a vehicle, an image sensor operable to capture a stream of images of a field of view. A traffic control system is operable to extract geographic positioning information for the vehicle from the wireless signals, track the vehicle's movement using the extracted geographic positioning information, detect and track an object in the stream of images corresponding to the vehicle. The vehicle's geographic movement is further tracked using a pixel location of the object in steam of images and a traffic control action is executed based on the geographic movement to facilitate passage of the at least one vehicle through a monitored traffic control location.

Claims (52)

1. A system comprising:

a wireless signal sensor operable to detect and receive wireless signals emitted from at least one vehicle;

a first image sensor operable to capture a stream of images of a field of view; and

a traffic control system comprising a processor and a memory storing program instructions operable to cause the processor to:

perform a calibration process that causes the processor to:

receive a captured image of a GPS sensor positioned at a known geographic location within the field of view, and

generate a mapping between known geographic coordinates and pixels of the captured image associated with the GPS sensor;

extract geographic positioning information for the at least one vehicle from the wireless signals;

track the at least one vehicle's movement using the extracted geographic positioning information;

analyze a stream of images to detect an object comprising a plurality of pixels;

use the mapping to associate the pixels of the object with geographic coordinates of the object to track the object;

match the object to the at least one vehicle by comparing the geographic positioning information of the at least one vehicle with the geographic coordinates of the object;

track geographic movement of the at least one vehicle in the stream of images;

and

execute a traffic control action based on the geographic movement, wherein the traffic control action is determined to facilitate passage of the at least one vehicle through a monitored traffic control location.

2. The system of claim 1 , wherein the wireless signal sensor is an 802.11p, Bluetooth, cellular, and/or wifi protocol sensor.

3. The system of claim 1 , wherein the traffic control system is further operable to calculate an estimated time of arrival at the monitored traffic control location.

4. The system of claim 1 , wherein the wireless signals are associated with an emergency vehicle and the monitored traffic control location is a traffic intersection.

5. The system of claim 1 , wherein the at least one vehicle comprises an emergency vehicle and the processor is further operable to:

detect and track objects in the stream of images corresponding to one or more obstacles for emergency vehicle at or near the monitored traffic control location;

transmit information of the one or more obstacles to the emergency vehicle; and

modify the traffic control action based on the one or more obstacles.

6. The system of claim 1 , wherein the extracted geographic positioning information for the at least one vehicle includes global positioning system data received from a global positioning system sensor.

7. The system of claim 1 , wherein the processor is further operable to map global positioning data with one or more pixel locations corresponding to detected objects in the stream of images.

8. The system of claim 1 , wherein the processing system is further operable to determine an estimated time of arrival for the at least one vehicle at the monitored traffic control location and to transition between using geographic positioning information and pixel coordinates based on the vehicle being within the field of view.

9. The system of claim 1 , wherein the processing system is disposed at an intersection and the traffic control action includes changing a state of at least one traffic signal.

10. A method comprising:

detecting and receiving wireless signals emitted from at least one vehicle;

capturing a stream of images of a field of view; and

operating a traffic control system to control at least one traffic control signal in a monitored traffic control location, comprising:

calibrating, the calibrating comprising:

receiving a captured image of a GPS sensor positioned at a known geographic location within the field of view, and

generating a mapping between known geographic coordinates and pixels of the captured image associated with the GPS sensor;

extracting geographic positioning information for the at least one vehicle from the wireless signals;

analyzing a stream of images to detect an object comprising a plurality of pixels;

using the mapping to associate the pixels of the object with geographic coordinates of the object to track the object;

matching the object to the at least one vehicle by comparing the geographic positioning information of the at least one vehicle with the geographic coordinates of the object;

tracking geographic movement of the at least one vehicle in the stream of images;

and

executing a traffic control action based on the geographic movement, wherein the traffic control action is determined to facilitate passage of the at least one vehicle through a monitored traffic control location.

11. The method of claim 10 , wherein the wireless signals are 802.11p, Bluetooth, cellular, and/or wifi protocol signals.

12. The method of claim 10 , further comprising calculating an estimated time of arrival at the monitored traffic control location, and further comprising transitioning between using geographic positioning information and pixel coordinates based on the vehicle being within the field of view.

13. The method of claim 10 , wherein the wireless signals are associated with an emergency vehicle and the monitored traffic control location is a traffic intersection.

14. The method of claim 10 , further comprising:

detecting and tracking objects in the stream of images corresponding to one or more obstacles for the at least one vehicle at or near the monitored traffic control location; and

modifying the traffic control action based on the one or more obstacles, wherein the at least one vehicle comprises an emergency vehicle.

15. The method of claim 10 , wherein the extracted geographic positioning information for the at least one vehicle includes global positioning system data received from a global positioning system sensor.

16. The method of claim 10 , further comprising mapping global positioning data with one or more pixel locations corresponding to detected objects in the stream of images.

17. The method of claim 10 , further comprising determining an estimated time of arrival for the at least one vehicle at the monitored traffic control location.

18. The method of claim 10 , wherein the traffic control system is disposed at an intersection and the traffic control action includes changing a state of at least one traffic signal.

19. The system of claim 1 , wherein the first image sensor is further operable to calibrate based on a tilt angle and/or height of the first image sensor.

20. The method of claim 10 , further comprising calibrating the first image sensor based on a tilt angle and/or height of the first image sensor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2025
From: FLIR BELGIUM BVBA
To: RAYMARINE UK LIMITED
Reel/Frame 071149/0656 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2022
From: SCHULTE, STEFAN; WITHOUCK, MARTIJN; FAVOREEL, WOUTER
To: FLIR BELGIUM BVBA
Reel/Frame 061283/0520 →
Continuity (3)
Continuation PCTUS2019068834 · Dec 27, 2019
Provisional Application 62787187 · Dec 31, 2018
Related Publication 20210327265A1 · Oct 21, 2021