IP Library Granted Patent US 11,157,761
Granted Patent B2
US 11,157,761 · App. 17/076,828 · Granted Oct 26, 2021

IR/Visible image camera with dual mode, active-passive-illumination, triggered by masked sensor to reduce power consumption

Inventor: Tomer Kimhi (Tel Aviv, IL)
Assignee: EMZA VISUAL SENSE LTD.
G06K9/2027G06K9/00228G06K9/00362G06K9/00624
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,157,761
App. No.
17/076,828
Granted
Oct 26, 2021
Kind
B2
Abstract

An object recognition device, method and computer program product, the device including a sensor having a plurality of pixels, a mask, where the pixels include a non-masked first group that receives a first wavelength, and a masked second group that receives a second wavelength differing from the first, where the mask passes at most 10% of energy of the first wavelength, and the second group are a majority of the pixels, a light source radiating in the second wavelength, and a processor for operating in a first mode where light in the first wavelength is received by the first group, including capturing a first image by the first group, and analyzing the first image, to recognize a trigger event, and subject to the trigger event, operating in a second mode, including: activating the light source, capturing a second image by the second group, and analyzing the second image.

Claims (56)

1. An object recognition device, comprising:

an image sensor comprising a plurality of pixels;

a mask, wherein

the plurality of pixels comprise pixels of a first group that are not masked by the mask and receive ambient wavelength range, and pixels of a second group that are masked by the mask and receive at least IR wavelength range, wherein the mask passes at most 10% of energy received in the ambient wavelength range, and wherein

the pixels of the second group are a majority of the pixels;

an Infra-Red light source; and

a processor for:

operating in a first mode in which the light source is inactive, including:

capturing a first image by the pixels of the first group; and

analyzing the first image, to recognize whether a trigger event has occurred; and

subject to occurrence of the trigger event, operating in a second mode, including:

activating the light source;

capturing a second image by the pixels of the second group; and

analyzing the second image.

2. The object recognition device of claim 1 , further comprising a second mask for masking the pixels of the first group.

3. The object recognition device of claim 1 , wherein the pixels of the second group are at least 75% of the plurality of pixels.

4. The object recognition device of claim 1 , wherein the pixels of the first group are arranged in a repeating pattern over the image sensor.

5. The object recognition device of claim 1 , wherein the processor is further adapted to resume operation in the first mode after analysis of the second image.

6. The object recognition device of claim 1 , wherein the image sensor is configured to capture a body part of a subject.

7. The object recognition device of claim 6 , wherein the body part is a face.

8. The object recognition device of claim 1 , wherein in the second mode, a value of a pixel of the first group is set in accordance with values of neighboring pixels belonging to the pixels of the second group.

9. The object recognition device of claim 1 , wherein the object recognition device operates constantly in the first mode excluding when the second mode is assumed.

10. The object recognition device of claim 1 , further comprising interface to an external engine for taking an action in response to the analysis of the second image.

11. A method for activating an object recognition device, comprising:

operating in a first mode, including:

capturing a first image by pixels of a first group of pixels of a sensor comprising a multiplicity of pixels; and

analyzing the first image, to recognize whether a trigger event has occurred; and

subject to occurrence of the trigger event, operating in a second mode, including:

activating an Infra-Red light source to illuminate the sensor;

capturing a second image by pixels of a second group of pixels of the sensor; and

analyzing the second image, wherein

a mask is masking the pixels of the second group and not masking the pixels of the first group,

the pixels of the first group receive ambient wavelength range,

the pixels of the second group receive IR wavelength range,

the mask passes at most 10% of energy received in the ambient wavelength range,

the pixels of the second group outnumber the pixels of the first group.

12. The method of claim 11 , wherein the pixels of the first group are masked by a second mask passing the ambient wavelength range.

13. The method of claim 11 , wherein the pixels of the first group are arranged in a repeating pattern over an image sensor comprising the pixels of the first group of and the pixels of the second group.

14. The method of claim 11 , wherein the processor is further adapted to resume operation in the first mode after analysis of the second image.

15. The method of claim 11 , further comprising setting a value of a pixel of the first group in accordance with values of neighboring pixels belonging to the second group.

16. The method of claim 11 , wherein the processor operates constantly in the first mode excluding when the second mode is assumed.

17. The method of claim 11 , further comprising taking an action in response to a result of analyzing the second image.

18. The method of claim 17 wherein the action comprises granting or denying access of a person to a physical or computerized domain.

19. A computer program product comprising a non-transitory computer readable storage medium retaining program instructions, which program instructions when read by a processor, cause the processor to perform a method comprising:

operating in a first mode, including:

capturing a first image by pixels of a first group of pixels of a sensor comprising a multiplicity of pixels; and

analyzing the first image, to recognize whether a trigger event has occurred; and

subject to occurrence of the trigger event, operating in a second mode, including:

activating an Infra-Red light source to illuminate the sensor;

capturing a second image by pixels of a second group of pixels of the sensor; and

analyzing the second image, wherein

a mask is masking the pixels of the second group and not masking the pixels of the first group,

the pixels of the first group receive ambient wavelength range,

the pixels of the second group receive IR wavelength range,

the mask passes at most 10% of energy received in the ambient wavelength range, and

the pixels of the second group outnumber the pixels of the first group.

Assignments (2)
MERGER Recorded Mar 27, 2023
From: EMZA VISUAL SENSE LTD.
To: DSP GROUP LTD.
Reel/Frame 063108/0898 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2021
From: KIMHI, TOMER
To: EMZA VISUAL SENSE LTD.
Reel/Frame 056065/0255 →
Continuity (2)
Provisional Application 62924188 · Oct 22, 2019
Related Publication 20210117710A1 · Apr 22, 2021