IP Library Granted Patent US 10,771,717
Granted Patent B2
US 10,771,717 · App. 16/258,087 · Granted Sep 8, 2020

Use of IR pre-flash for RGB camera's automatic algorithms

Inventors: Arjen Van Der Sijde (Eindhoven, NL); Nicola Pfeffer (Eindhoven, NL); Charles Schrama (San Jose, CA)
Assignee: Lumileds LLC
H04N5/332G06T7/521H04N5/23212H04N9/3182H04N13/271
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,771,717
App. No.
16/258,087
Granted
Sep 8, 2020
Kind
B2
Abstract

The image capture system of the present disclosure comprises an illuminator comprising at least one infrared light LED or laser and one visible light LED, an image sensor that is sensitive to infrared light and visible light, a memory configured to store instructions, and a processor configured to execute instructions to cause the image capture system to emit infrared light, receive image data comprising at least one infrared image, and determine depth maps, visible focus settings, or infrared exposure settings based on the infrared image data.

Claims (59)

1. An image capture system, comprising:

an illuminator configured to emit infrared light having at least one infrared wavelength and emit visible light having at least one visible wavelength;

at least one image sensor having a sensitivity to an infrared range of wavelengths that includes the at least one infrared wavelength and a visible range of wavelengths that includes the at least one visible wavelength;

at least one processor coupled to the illuminator and the at least one image sensor; and

a memory configured to store instructions, that, when executed by the at least one processor, cause the image capture system to perform operations, the operations comprising:

emitting infrared light from the illuminator;

while the infrared light is being emitted, capturing at least one infrared image with the at least one image sensor;

determining a depth map based on the at least one infrared image;

determining an infrared exposure setting based on the depth map;

scaling the infrared exposure setting to determine a visible exposure setting;

determining an infrared focus setting based on the depth map;

scaling the infrared focus setting to determine a visible focus setting;

emitting visible light from the illuminator; and

while the visible light is being emitted, capturing a visible image with the at least one image sensor using the visible exposure setting and the visible focus setting.

2. The image capture system of claim 1 , wherein the illuminator further comprises individually addressable segments each of which is configured to emit the infrared light.

3. The image capture system of claim 1 , further comprising at least one of a stereo vision system, a structured lighting system, or an infrared time-of flight sensor to determine the depth map.

4. The image capture system of claim 1 , wherein the operations further comprise:

adjusting white balance settings to pre-defined white balance settings.

5. The image capture system of claim 1 , wherein the visible exposure setting differs from the infrared exposure setting and the visible focus setting differs from the infrared focus setting.

6. The image capture system of claim 5 , wherein:

the visible exposure setting includes a visible shutter speed; and

the infrared exposure setting includes an infrared shutter speed different from the visible shutter speed.

7. An image capture system, comprising:

an illuminator configured to emit infrared light having at least one infrared wavelength and emit visible light having at least one visible wavelength;

at least one image sensor having a sensitivity to an infrared range of wavelengths that includes the at least one infrared wavelength and a visible range of wavelengths that includes the at least one visible wavelength;

at least one processor coupled to the illuminator and the at least one image sensor; and

a memory configured to store instructions, that, when executed by the at least one processor, cause the image capture system to perform operations, the operations comprising:

emitting infrared light from the illuminator;

while the infrared light is being emitted, capturing at least one infrared image with the at least one image sensor;

determining a depth map based on the at least one infrared image;

determining an infrared exposure setting based on the depth map;

scaling the infrared exposure setting to determine a visible exposure setting;

determining a visible focus setting based on the depth map;

emitting visible light from the illuminator; and

while the visible light is being emitted, capturing a visible image with the at least one image sensor using the visible exposure setting and the visible focus setting.

8. The image capture system of claim 7 , wherein the illuminator further comprises individually addressable segments each of which is configured to emit the infrared light.

9. The image capture system of claim 7 , further comprising at least one of a stereo vision system, a structured lighting system, or an infrared time-of flight sensor to determine the depth map.

10. The image capture system of claim 7 , wherein the operations further comprise:

adjusting white balance settings to pre-defined white balance settings.

11. The image capture system of claim 7 , wherein the visible exposure setting differs from the infrared exposure setting.

12. The image capture system of claim 11 , wherein:

the visible exposure setting includes a visible shutter speed; and

the infrared exposure setting includes an infrared shutter speed different from the visible shutter speed.

13. A method for capturing an image, the method comprising:

emitting infrared light from an illuminator;

while the infrared light is being emitted, capturing at least one infrared image with at least one image sensor;

determining a depth map based on the at least one infrared image;

determining an infrared exposure setting based on the depth map;

scaling the infrared exposure setting to determine a visible exposure setting;

determining an infrared focus setting based on the depth map;

scaling the infrared focus setting to determine a visible focus setting;

emitting visible light from the illuminator; and

while the visible light is being emitted, capturing a visible image with the at least one image sensor using the visible exposure setting and the visible focus setting.

14. The method of claim 13 , wherein the illuminator further comprises individually addressable segments each of which is configured to emit the infrared light.

15. The method of claim 13 , wherein determining the depth map comprises using at least one of a stereo vision system, a structured lighting system, or an infrared time-of flight sensor to determine the depth map.

16. The method of claim 13 , wherein the visible exposure setting differs from the infrared exposure setting and the visible focus setting differs from the infrared focus setting.

17. The method of claim 13 , wherein:

the visible exposure setting includes a visible shutter speed; and

the infrared exposure setting includes an infrared shutter speed different from the visible shutter speed.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2025
From: LUMILEDS LLC
To: LUMILEDS SINGAPORE PTE. LTD.
Reel/Frame 071888/0086 →
RELEASE OF SECURITY INTEREST Recorded Jan 29, 2025
From: SOUND POINT AGENCY LLC
To: LUMILEDS LLC; LUMILEDS HOLDING B.V.
Reel/Frame 070046/0001 →
SECURITY INTEREST Recorded Jan 5, 2023
From: LUMILEDS LLC; LUMILEDS HOLDING B.V.
To: SOUND POINT AGENCY LLC
Reel/Frame 062299/0338 →
PATENT SECURITY AGREEMENT Recorded Dec 9, 2022
From: LUMILEDS, LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 062114/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2020
From: VAN DER SIJDE, ARJEN; PFEFFER, NICOLA BETTINA; SCHRAMA, CHARLES ANDRÉ
To: LUMILEDS LLC
Reel/Frame 053324/0943 →