IP Library Granted Patent US 9,607,220
Granted Patent B1
US 9,607,220 · App. 14/592,720 · Granted Mar 28, 2017

Image-based vehicle speed estimation

Inventors: Shawn B. Smith (Portola Valley, CA); Dihn Tien Son (TPHCM, VN)
Assignee: VaaS, Inc.
G06K9/00624G06K9/325G06T7/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,607,220
App. No.
14/592,720
Granted
Mar 28, 2017
Kind
B1
Abstract

Methods and systems for estimating the speed of passing vehicles based on License Plate Recognition (LPR) image information are described herein. The distance traversed by a vehicle between image frames is estimated based on a difference between a pixel location of a tracking point on the vehicle in a first image and a second pixel location of the tracking point in second image of the vehicle. In some embodiments, the displacement identified in the images is converted to a projected displacement on the roadway surface based on the mapping between pixel locations within the field of view of the image sensor and locations on the surface of the roadway. The projected displacement is corrected by accounting for the difference in height of the camera module and tracking point over the roadway surface. An estimate of vehicle speed is calculated from the corrected displacement and the elapsed time between image frames.

Claims (38)

1. A method comprising:

receiving a plurality of images of a vehicle passing over a surface of a roadway from at least one camera module of a license plate recognition imaging system, wherein the surface of the roadway is within a field of view of an image sensor of the at least one camera module;

determining an estimate of speed of the vehicle passing over the roadway based at least in part on a difference between a first pixel location of a portion of the vehicle in a first of the plurality of images and a second pixel location of the portion of the vehicle in a second of the plurality of images, wherein the determining the estimate of speed of the vehicle involves a correction to the difference between the first pixel location and the second pixel location based on a plurality of passes of a vehicle through the field of view of the image sensor, each pass of the vehicle at a constant, known speed; and

storing the estimate of speed of the vehicle in a memory.

2. The method of claim 1 , wherein the determining the estimate of speed of the vehicle passing over the roadway is also based on a mapping between pixel locations within the field of view of the image sensor and locations on the surface of the roadway.

3. The method of claim 2 , wherein the determining the estimate of speed of the vehicle involves determining a correction of the estimate of speed of the vehicle based at least in part on a distance between the surface of the roadway and the image sensor and a distance between the surface of the roadway and the portion of the vehicle.

4. The method of claim 2 , further comprising:

determining the mapping between pixel locations and locations on the surface of the roadway based at least in part on a calibration of a grid pattern located on the surface of the roadway is within the field of view of the image sensor to an image of the grid pattern generated by the image sensor.

5. The method of claim 4 , wherein the calibration involves a mapping of locations on the grid pattern to pixel locations of the image of the grid pattern.

6. The method of claim 5 , wherein the mapping involves interpolation between locations on the grid pattern and pixel locations of the image of the grid pattern.

7. The method of claim 1 , wherein the portion of the vehicle includes any of a license plate, a taillight, and a bumper.

8. The method of claim 1 , wherein the determining of the estimate of speed of the vehicle involves three of more images of the vehicle passing over the roadway.

9. The method of claim 8 , wherein the determining of the estimate of speed of the vehicle involves discarding an estimate of speed of the vehicle based on two of the three or more images of the vehicle passing over the roadway.

10. The method of claim 1 , further comprising:

determining a distribution of vehicle speeds over the surface of the roadway based at least in part on the estimate of speed of the vehicle.

11. The method of claim 1 , wherein the plurality of images of the vehicle includes color images or infrared images.

12. An apparatus comprising:

a processor; and

a memory storing an amount of program code that, when executed, causes the apparatus to

receive a plurality of images of a vehicle passing over a surface of a roadway from at least one camera module of a license plate recognition imaging system, wherein the surface of the roadway is within a field of view of an image sensor of the at least one camera module;

determine an estimate of speed of the vehicle passing over the roadway based at least in part on a difference between a first pixel location of a portion of the vehicle in a first of the plurality of images and a second pixel location of the portion of the vehicle in a second of the plurality of images, wherein the determining the estimate of speed of the vehicle involves determining a correction of the estimate of speed of the vehicle based at least in part on a distance between the surface of the roadway and the image sensor and a distance between the surface of the roadway and the portion of the vehicle; and

store the estimate of speed of the vehicle in a memory.

13. The apparatus of claim 12 , wherein the determining the estimate of speed of the vehicle involves a correction to the difference between the first pixel location and the second pixel location.

14. The apparatus of claim 13 , the memory also storing an amount of program code that, when executed, causes the apparatus to:

determine the correction to the difference between the first pixel location and the second pixel location based on a plurality of passes of a vehicle through the field of view of the image sensor, each pass of the vehicle at a constant, known speed.

15. The apparatus of claim 12 , the memory also storing an amount of program code that, when executed, causes the apparatus to:

determine a mapping between pixel locations and locations on the surface of the roadway based at least in part on a calibration of a grid pattern located on the surface of the roadway within the field of view of the image sensor to an image of the grid pattern generated by the image sensor.

16. The apparatus of claim 15 , wherein the calibration involves a mapping of locations on the grid pattern to pixel locations of the image of the grid pattern.

17. The apparatus of claim 16 , wherein the mapping involves interpolation between locations on the grid pattern and pixel locations of the image of the grid pattern.

18. The apparatus of claim 12 , the memory also storing an amount of program code that, when executed, causes the apparatus to:

determine a distribution of vehicle speeds over the surface of the roadway based at least in part on the estimate of speed of the vehicle.

19. A non-transitory, computer-readable medium, comprising:

code for causing a computer to receive a plurality of images of a vehicle passing over a surface of a roadway from at least one camera module of a license plate recognition imaging system, wherein the surface of the roadway is within a field of view of an image sensor of the at least one camera module;

code for causing the computer to determine an estimate of speed of the vehicle passing over the roadway based at least in part on a difference between a first pixel location of a portion of the vehicle in a first of the plurality of images and a second pixel location of the portion of the vehicle in a second of the plurality of images, wherein the determining the estimate of speed of the vehicle involves determining a correction of the estimate of speed of the vehicle based at least in part on a distance between the surface of the roadway and the image sensor and a distance between the surface of the roadway and the portion of the vehicle; and

code for causing the computer to store the estimate of speed of the vehicle in a memory.

20. The non-transitory, computer-readable medium of claim 19 , wherein the determining the estimate of speed of the vehicle passing over the roadway is also based on a mapping between pixel locations within the field of view of the image sensor and locations on the surface of the roadway.

21. The non-transitory, computer-readable medium of claim 20 , further comprising:

code for causing the computer to determine the mapping between pixel locations and locations on the surface of the roadway based at least in part on a calibration of a grid pattern located on the surface of the roadway within the field of view of the image sensor to an image of the grid pattern generated by the image sensor.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2019
From: VAAS INTERNATIONAL HOLDINGS, INC.
To: MOTOROLA SOLUTIONS SHELF CORP VI, INC.
Reel/Frame 048235/0464 →
MERGER Recorded Feb 5, 2019
From: MOTOROLA SOLUTIONS SHELF CORP. VI, INC.
To: VAAS INTERNATIONAL HOLDINGS, INC.
Reel/Frame 048235/0592 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 12, 2018
From: BANK OF AMERICA, N.A.
To: VAAS INTERNATIONAL HOLDINGS, INC.
Reel/Frame 049126/0791 →
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded May 8, 2018
From: VAAS INTERNATIONAL HOLDINGS, INC.
To: BANK OF AMERICA, N.A.
Reel/Frame 046102/0795 →
RELEASE OF SECURITY INTEREST Recorded May 3, 2018
From: MUFG UNION BANK, N.A.
To: VAAS INTERNATIONAL HOLDINGS, INC.
Reel/Frame 045704/0181 →
CHANGE OF NAME Recorded May 11, 2017
From: VAAS, INC.
To: VAAS INTERNATIONAL HOLDINGS, INC.
Reel/Frame 042447/0385 →
SECURITY INTEREST Recorded Sep 16, 2015
From: VAAS INTERNATIONAL HOLDINGS, INC.
To: MUFG UNION BANK, N.A.
Reel/Frame 036583/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2015
From: SMITH, SHAWN B.; SON, DINH TIEN
To: VAAS, INC.
Reel/Frame 035889/0159 →