IP Library Granted Patent US 9,185,360
Granted Patent B2
US 9,185,360 · App. 14/027,488 · Granted Nov 10, 2015

Systems and methods for detecting obstructions in a camera field of view

Inventors: Gideon Stein (Jerusalem, IL); Ofer Hadassi (Modi'in, IL)
Assignee: MOBILEYE VISION TECHNOLOGIES LTD.
H04N7/181B60Q1/0023B60Q1/1423B60Q1/20B60R11/04B60S1/0822B60S1/0844G06K9/00791B60Q2300/146B60Q2300/312B60Q2300/314
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,185,360
App. No.
14/027,488
Granted
Nov 10, 2015
Kind
B2
Abstract

A system mounted on a vehicle for detecting an obstruction on a surface of a window of the vehicle, a primary camera is mounted inside the vehicle behind the window. The primary camera is configured to acquire images of the environment through the window. A secondary camera is focused on an external surface of the window, and operates to image the obstruction. A portion of the window, i.e. window region is subtended respectively by the field of view of the primary camera and the field of view of the secondary camera. A processor processes respective sequences of image data from both the primary camera and the secondary camera.

Claims (31)

1. A system mountable on a vehicle, the system comprising:

a primary camera configured to acquire a plurality of primary images of the environment through the window;

a secondary camera adapted to focus on at least a portion of a surface of the window to acquire a secondary image of an obstruction when present on the surface, wherein a region of the window is subtended by respective fields of view of the primary camera and the secondary camera; and

a processor adapted to process and continuously monitor the secondary image for the obstruction;

wherein the processor is configured to activate a low visibility mode of the primary camera when the obstruction is detected in the secondary image.

2. The system of claim 1 , wherein the processor is adapted to perform edge detection of the obstruction.

3. The system of claim 1 , wherein information is extracted from at least one of the primary images to selectably either enhance a classification of the obstruction or eliminate false identification of the obstruction.

4. The system of claim 1 , wherein the obstruction causes a measurable deterioration of image quality in the primary images.

5. The system of claim 1 , further comprising:

an activation mechanism operatively attached to the processor, wherein the activation mechanism is operable to cause cleaning fluid to be sprayed on the window and windshield wipers to be activated when the processor identifies the obstruction as including dirt on an external surface of the window while the external surface is dry.

6. The system of claim 1 , further comprising:

an activation mechanism operatively attached to the processor, the activation mechanism activating windshield wipers when the processor identifies the obstruction on an external surface of the window.

7. The system of claim 1 , wherein the processor is adapted to initiate a task to remove the obstruction.

8. The system of claim 7 , wherein the task is selected from the group of tasks consisting of: notification of the driver of the vehicle, disabling the system, activating wipers with or without cleaning fluid, activating defogging, and turning on fog lights.

9. The system of claim 1 , wherein the secondary camera is adapted to also focus on at least a portion of an internal surface of the window and wherein the processor identifies the obstruction when present on the at least a portion of the internal surface.

10. The system of claim 1 , wherein the secondary camera is further adapted to perform a task selected from the group of applications consisting of: ambient light sensing, and gain control sensing.

11. The system of claim 1 , further comprising a pulsing light source, wherein the pulsing light source is capable of illuminating the region, wherein secondary image acquisition by the secondary camera is synchronized with the pulsing light source.

12. A method performable by a system mountable inside a vehicle, the system including a primary camera and a secondary camera both connectable to a processor, the method comprising the steps of:

enabling acquiring through a window from the primary camera a primary image of the environment;

wherein the secondary camera is focused on a surface of the window to provide a secondary image of the surface, wherein a region of the window is subtended by respective fields of view of the primary camera and the secondary camera;

processing and continuously monitoring thereby the secondary image for an obstruction if present on the surface;

enabling activating a low visibility mode of the primary camera when the obstruction is detected in the secondary image.

13. The method of claim 12 , wherein the processing includes edge detection of the obstruction.

14. The method of claim 12 , wherein the processing of the secondary image uses information extracted from the primary image to selectably either enhance identifying the obstruction or eliminating false identification of an obstruction.

15. The method, according to claim 12 , further comprising the step of:

upon determining a level of ambient light, setting a mode of the system to selectably either day mode, dusk mode or night mode.

16. The method, according to claim 15 , when determining the level of ambient light as being of dusk mode or night mode, turning on the headlights.

17. The method of claim 12 , further comprising the step of:

initiating at least one task to remove the obstruction.

18. The method of claim 17 , wherein the at least one task is selected from the group of tasks consisting of: notification of the driver of the vehicle, disabling the system, activating windshield wipers, spraying fluid on windshield and activating defogging of a window.

19. The method of claim 12 , further comprising the step of: illuminating the window with a pulsing light source, wherein the secondary camera is operated synchronously with the pulsing light source.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2014
From: MOBILEYE TECHNOLOGIES LIMITED
To: MOBILEYE VISION TECHNOLOGIES LTD.
Reel/Frame 034305/0993 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2013
From: STEIN, GIDEON; HADASSI, OFER
To: MOBILEYE TECHNOLOGIES LIMITED
Reel/Frame 031749/0542 →
Continuity (3)
Continuation 11562998 · Nov 23, 2006
Provisional Application 60738991 · Nov 23, 2005
Related Publication 20140049648A1 · Feb 20, 2014