IP Library Granted Patent US 11,418,730
Granted Patent B2
US 11,418,730 · App. 16/941,279 · Granted Aug 16, 2022

Use of IR pre-flash for RGB camera's automatic algorithms

Inventors: Arjen Van Der Sijde (Eindhoven, NL); Nicola Bettina Pfeffer (Eindhoven, NL); Charles André Schrama (San Jose, CA)
Assignee: Lumileds LLC
H04N5/332G06T7/521H04N5/23212H04N9/3182H04N13/271
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,418,730
App. No.
16/941,279
Granted
Aug 16, 2022
Kind
B2
Abstract

The image capture system of the present disclosure comprises an illuminator comprising at least one infrared light LED or laser and one visible light LED, an image sensor that is sensitive to infrared light and visible light, a memory configured to store instructions, and a processor configured to execute instructions to cause the image capture system to emit infrared light, receive image data comprising at least one infrared image, and determine depth maps, visible focus settings, or infrared exposure settings based on the infrared image data.

Claims (68)

1. An image capture system, comprising:

an illuminator configured to emit visible light having at least one visible wavelength;

at least one image sensor configured to detect a visible range of wavelengths that includes the at least one visible wavelength;

at least one processor coupled to the illuminator and the at least one image sensor; and

a memory configured to store instructions, that, when executed by the at least one processor, cause the image capture system to perform operations, the operations comprising:

receiving at least one infrared image of a scene;

determining a depth map of the scene based on the at least one infrared image;

determining an infrared exposure setting based on the depth map;

scaling the infrared exposure setting to determine a visible exposure setting;

determining an infrared focus setting based on the depth map;

scaling the infrared focus setting to determine a visible focus setting;

emitting visible light from the illuminator; and

while the visible light is being emitted, capturing a visible image of the scene with the at least one image sensor using the visible exposure setting and the visible focus setting.

2. The image capture system of claim 1 , wherein the visible exposure setting differs from the infrared exposure setting.

3. The image capture system of claim 2 , wherein:

the visible exposure setting includes a visible shutter speed; and

the scaling scales the infrared exposure by a value different from unity such that the infrared exposure setting includes an infrared shutter speed different from the visible shutter speed.

4. The image capture system of claim 1 , wherein:

the illuminator is further configured to emit infrared light; and

the at least one image sensor is further configured to generate a detectable signal when infrared light impinges on the at least one image sensor.

5. The image capture system of claim 4 , wherein the operations further comprise:

emitting infrared light from the illuminator; and

while the infrared light is being emitted, capturing the at least one infrared image with the at least one image sensor.

6. The image capture system of claim 4 , wherein the illuminator further comprises individually addressable segments each of which is configured to emit the infrared light.

7. The image capture system of claim 1 , further comprising at least one of a stereo vision system, a structured lighting system, or an infrared time-of flight sensor to determine the depth map.

8. The image capture system of claim 1 , wherein the operations further comprise:

adjusting white balance settings to pre-defined white balance settings such that the visible image is captured using the visible exposure setting and the pre-defined white balance settings.

9. A method for capturing an image, the method comprising:

receiving at least one infrared image of a scene;

determining a depth map of the scene based on the at least one infrared image;

determining an infrared exposure setting based on the depth map;

scaling the infrared exposure setting to determine a visible exposure setting;

determining an infrared focus setting based on the depth map;

scaling the infrared focus setting to determine a visible focus setting;

emitting visible light from an illuminator, the visible light having at least one visible wavelength; and

while the visible light is being emitted, capturing a visible image of the scene with at least one image sensor using the visible exposure setting and the visible focus setting, the at least one image sensor configured to detect a visible range of wavelengths that includes the at least one visible wavelength.

10. The method of claim 9 , wherein the visible exposure setting differs from the infrared exposure setting.

11. The method of claim 10 , wherein:

the visible exposure setting includes a visible shutter speed; and

the scaling scales the infrared exposure by a value different from unity such that the infrared exposure setting includes an infrared shutter speed different from the visible shutter speed.

12. The method of claim 9 , further comprising:

emitting infrared light from the illuminator.

13. The method of claim 12 ,

wherein the at least one image sensor is further configured to generate a detectable signal when infrared light impinges on the at least one image sensor; and further comprising:

while the infrared light is being emitted, capturing the at least one infrared image with the at least one image sensor.

14. The method of claim 12 , wherein the illuminator further comprises individually addressable segments each of which is configured to emit the infrared light.

15. The method of claim 9 , further comprising determining the depth map using at least one of a stereo vision system, a structured lighting system, or an infrared time-of flight sensor.

16. The method of claim 9 , further comprising:

adjusting white balance settings to pre-defined white balance settings such that the visible image is captured using the visible exposure setting and the pre-defined white balance settings.

17. An image capture system, comprising:

an illuminator configured to emit visible light having at least one visible wavelength;

at least one image sensor configured to detect a visible range of wavelengths that includes the at least one visible wavelength;

at least one processor coupled to the illuminator and the at least one image sensor; and

a memory configured to store instructions, that, when executed by the at least one processor, cause the image capture system to perform operations, the operations comprising:

receiving at least one infrared image of a scene;

determining a depth map of the scene based on the at least one infrared image;

determining an infrared shutter speed based on the depth map;

scaling the infrared shutter speed to determine a visible shutter speed;

determining an infrared focus setting based on the depth map;

scaling the infrared focus setting to determine a visible focus setting;

emitting visible light from the illuminator; and

while the visible light is being emitted, capturing a visible image of the scene with the at least one image sensor using the visible shutter speed and the visible focus setting.

18. The image capture system of claim 17 , wherein:

the illuminator is further configured to emit infrared light;

the at least one image sensor is further configured to generate a detectable signal when infrared light impinges on the at least one image sensor; and

the operations further comprise:

emitting infrared light from the illuminator; and

while the infrared light is being emitted, capturing the at least one infrared image with the at least one image sensor.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2025
From: LUMILEDS LLC
To: LUMILEDS SINGAPORE PTE. LTD.
Reel/Frame 071888/0086 →
RELEASE OF SECURITY INTEREST Recorded Jan 29, 2025
From: SOUND POINT AGENCY LLC
To: LUMILEDS LLC; LUMILEDS HOLDING B.V.
Reel/Frame 070046/0001 →
SECURITY INTEREST Recorded Jan 5, 2023
From: LUMILEDS LLC; LUMILEDS HOLDING B.V.
To: SOUND POINT AGENCY LLC
Reel/Frame 062299/0338 →
PATENT SECURITY AGREEMENT Recorded Dec 9, 2022
From: LUMILEDS, LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 062114/0001 →