IP Library › Granted Patent US 10,432,911
Granted Patent B2
US 10,432,911 · App. 14/321,691 · Granted Oct 1, 2019

Method for identification of contamination upon a lens of a stereoscopic camera

Inventor: Björn Crona (Jönköping, SE)
Assignee: Kapsch TrafficCom AB
H04N13/239G06T7/0002H04N13/246G06T2207/30168G06T2207/30236H04N2013/0074
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,432,911
App. No.
14/321,691
Granted
Oct 1, 2019
Kind
B2
Abstract

A method for identifying contamination upon a lens of a stereoscopic camera is disclosed. The stereoscopic camera is arranged such that it has the same capturing area over time, and is provided with a first camera providing first images of said capturing area and a second camera providing second images of said capturing area. The first and second images are divided into at least one evaluation area correspondently located in respective image. A traffic surveillance system is also disclosed where contamination upon a lens of a stereoscopic camera is identified according to said method.

Claims (41)

1. A method for identifying contamination upon a lens of a stereoscopic camera, wherein said stereoscopic camera

is arranged such that a capturing area of said stereoscopic camera is predefined such that images from said stereoscopic camera have the same capturing area over time,

is provided with a first camera adapted to cover said capturing area by providing first images of said capturing area, and

is provided with a second camera adapted to cover said capturing area by providing second images of said capturing area, wherein

said first images are divided into at least one evaluation area and said second images are divided into at least one evaluation area, wherein the respective evaluation area of said first and said second images are correspondently located in respective image, wherein said method comprises the steps of:

forming historical image data for said evaluation areas, wherein said historical image data comprises an image parameter representing the respective evaluation area from a predetermined number of previously captured first and second images,

comparing said historical image data for the evaluation area of said first image with historical image data for the evaluation area of said second image, and

indicating that at least one lens of said stereoscopic camera is contaminated, if a deviation larger than a threshold value between the compared historical image data is identified.

2. The method according to claim 1 , wherein the method further comprises the steps of:

identifying a minimum value (Bmin1, Bmin2) and a maximum value (Bmax1, Bmax2) of said image parameter from said historical image data for each evaluation area,

calculating a first difference value between said minimum and said maximum value (Bmin1, Bmin2; Bmax1, Bmax2) for each evaluation area,

comparing said first difference value from the evaluation area of said first images with said first difference value from the evaluation area of said second images, and

identifying the evaluation area of said first or second images associated with the lowest first difference value as obstructed by contamination on the lens.

3. The method according to claim 2 , wherein when a new first and second image has been captured by said stereoscopic camera, the method further comprises the steps of:

calculating an average value of said parameter of said historical image data for the respective evaluation areas of said first and second images,

calculating a second difference value between said average values, and

adding said second difference value to the parameter value from the evaluation area of a newly taken image in which the evaluation area is identified as obstructed.

4. The method according to claim 1 , wherein said historical image data is represented by an average value of said parameter.

5. The method according to claim 1 , wherein said historical image data is represented by a histogram of said parameter.

6. The method according to claim 5 , wherein the histogram has a separate class for each possible value of said parameter, or the histogram has classes for bundles of values of said parameter.

7. The method according to claim 5 , wherein a normal value (n0, nc) is defined as the most frequent image parameter value for the evaluation area of respective first and second images, wherein the method further comprises the step of:

adjusting the histogram of the evaluation area identified as obstructed such, that its shape and position corresponds to the histogram of its corresponding evaluation area.

8. The method according to claim 1 , wherein said parameter is selected among the following parameters; brightness, colour channel, contrast or any other image parameter.

9. The method according to claim 1 , wherein said first and second images are divided into a plurality of correspondent evaluation areas.

10. The method according to claim 9 , wherein each evaluation area is defined as an individual pixel in the respective first and second image.

11. The method according to claim 1 , wherein the historical image data is collected from a predetermined number of previously captured images.

12. The method according to claim 1 , wherein the historical image data is continuously updated.

13. The method according to claim 12 , wherein the historical image data is updated at predetermined time intervals by replacing the image parameter value from the oldest previously captured image by the corresponding image parameter value from a newly captured image.

14. The method according to claim 1 , wherein the method further comprises the step of generating a warning message when at least one lens of said stereoscopic camera is identified to have reached a predetermined level of contamination.

15. A traffic surveillance facility, comprising:

a stereoscopic camera, wherein said stereoscopic camera

is arranged such that a capturing area of said stereoscopic camera is predefined such that images from said stereoscopic camera have the same capturing area over time,

is provided with a first camera adapted to cover said capturing area by providing first images of said capturing area, and

is provided with a second camera adapted to cover said capturing area by providing second images of said capturing area, wherein

said first images are divided into at least one evaluation area and said second images are divided into at least one evaluation area, wherein the respective evaluation area of said first and said second images are correspondently located in respective image; and

an electronic control unit provided to:

control said stereoscopic camera; and

perform an identification of contamination upon a lens of the stereoscopic camera, the electronic control unit configured to:

form historical image data for said evaluation areas, wherein said historical image data comprises an image parameter representing the respective evaluation area from a predetermined number of previously captured first and second images,

compare said historical image data for the evaluation area of said first image with historical image data for the evaluation area of said second image, and

indicate that at least one lens of said stereoscopic camera is contaminated, if a deviation larger than a threshold value between the compared historical image data is identified.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2024
From: KAPSCH TRAFFICCOM AB
To: KAPSCH TRAFFICCOM AG
Reel/Frame 068665/0329 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 4, 2017
From: CRONA, BJÖRN
To: KAPSCH TRAFFICCOM AB
Reel/Frame 042889/0074 →
Priority Claims (1)
EP 13174967 · Jul 3, 2013 · regional
Continuity (1)
Related Publication 20150009296A1 · Jan 8, 2015