IP Library Granted Patent US 11,350,022
Granted Patent B2
US 11,350,022 · App. 16/999,401 · Granted May 31, 2022

Pulse chain-driven infrared imaging assembly

Inventors: Arjen Gerben Van Der Sijde (Eindhoven, NL); Erno Fancsali (Heusden-Zolder, BE); Nicola Bettina Pfeffer (Eindhoven, NL); Pieter Johannes Quintus van Voorst Vader (Son, NL)
Assignee: Lumileds LLC
H04N5/2256G01B11/22G06T7/50H04N5/2351H05B45/32G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,350,022
App. No.
16/999,401
Granted
May 31, 2022
Kind
B2
Abstract

The invention describes an infrared imaging assembly ( 1 ) for capturing an infrared image (M 0 , M 1 ) of a scene (S), comprising an infrared-sensitive image sensor ( 14 ); an irradiator ( 10 ) comprising an array of individually addressable infrared-emitting LEDs, wherein each infrared-emitting LED is arranged to illuminate a scene region (S 1 , . . . , S 9 ); a driver ( 11 ) configured to actuate the infrared irradiator ( 10 ) by applying a switching pulse train (T 1 , . . . , T 9 ) to each infrared-emitting LED; an image analysis module ( 13 ) configured to analyse a preliminary infrared image (M 0 ) to determine the required exposure levels ( 130 ) for each of a plurality of image regions (R 1 , . . . , R 9 ); and a pulse train adjusting unit ( 12 ) configured to adjust the duration (L 1 , . . . , L 9 ) of a switching pulse train (T 1 , . . . , T 9 ) according to the required exposure levels ( 130 ). The invention also described a method of generating a depth map (D) for a scene (S); a depth map generator comprising an embodiment of the inventive infrared imaging assembly ( 1 ); and a camera comprising such a depth map generator ( 2 ).

Claims (39)

1. An infrared imaging assembly for capturing an infrared image of a scene, the infrared imaging assembly comprising:

an infrared-sensitive image sensor;

an irradiator comprising an array of individually addressable infrared-emitting LEDs, each infrared-emitting LED arranged to illuminate a scene region of a scene;

a driver configured to actuate the irradiator by applying a switching pulse train to each infrared-emitting LED during dead time of a previous image acquisition event in which analog-digital conversion and three dimensional (3D) map computation are taking place;

an image analysis module configured to analyze a preliminary infrared image to determine exposure levels for each of a plurality of image regions; and

a pulse train adjusting unit configured to adjust a duration of the switching pulse train based on the exposure levels.

2. An infrared imaging assembly according to claim 1 , wherein the image analysis module is configured to determine the exposure level of one of the image regions illuminated by a corresponding infrared-emitting LED of the irradiator.

3. An infrared imaging assembly according to claim 1 , wherein the pulse train adjusting unit is configured to decrease the duration of the switching pulse train for an infrared-emitting LED corresponding to an overexposed image region.

4. An infrared imaging assembly according to claim 1 , wherein the pulse train adjusting unit is configured to increase the duration of the switching pulse train for an infrared-emitting LED corresponding to an underexposed image region.

5. An infrared imaging assembly according to claim 1 , wherein the infrared-sensitive image sensor is a single infrared-sensitive image sensor realized as an array of infrared-sensitive pixels, and the single infrared-sensitive image sensor is arranged to capture the preliminary infrared image and a final image.

6. An infrared imaging assembly according to claim 1 , further comprising a single infrared-sensitive photosensor arranged to record a mean illumination value for the scene region, the preliminary image comprising a sequence of mean illumination values, the infrared-sensitive image sensor being a single infrared-sensitive image sensor realized as an array of infrared-sensitive pixels arranged to capture a final image.

7. An infrared imaging assembly according to claim 1 , wherein the driver is configured to apply the switching pulse train to each infrared-emitting LED for at most about a few percent of an integration time of the infrared-sensitive image sensor.

8. An infrared imaging assembly according to claim 1 , wherein each pixel of the array comprises at least two phase detectors for demodulation at two distinct phase shifts, the at least two phase detectors configured to shift detection by the infrared-sensitive image sensor by a corresponding phase shift.

9. An infrared imaging assembly according to claim 8 , wherein:

each pixel of the array comprises demodulation channels at phase shifts of about 0°, 90°, 180°, and 270°, and

the image analysis module is configured to determine a distance between the infrared-sensitive image sensor and the scene dependent on a combined phase shift that combines signal strengths at each of the phase shifts of the demodulation channels.

10. An infrared imaging assembly according to claim 1 , wherein the driver is configured to apply the switching pulse train to each infrared-emitting LED at a different time such that the switching pulse train to applied to each infrared-emitting LED does not overlap with the switching pulse train to applied to any other infrared-emitting LED.

11. A method of generating a depth map for a scene using an infrared imaging assembly, the method comprising:

actuating an infrared irradiator, comprising an array of individually addressable infrared-emitting LEDs, each infrared-emitting LED arranged to illuminate a scene region of a scene, by applying switching pulse trains of equal duration to each infrared-emitting LED;

capturing a preliminary image obtained when the infrared irradiator is actuated by applying the switching pulse trains of equal duration to each infrared-emitting LED during dead time of a previous image acquisition event in which analog-digital conversion and three dimensional (3D) map computation are taking place;

analyzing the preliminary image to determine an exposure level for each of a plurality of image regions;

adjusting the durations of the switching pulse trains according to the exposure levels;

actuating the infrared irradiator by applying the adjusted switching pulse trains to the infrared-emitting LEDs;

capturing a subsequent image obtained when the infrared irradiator is actuated by applying the adjusted switching pulse trains to each infrared-emitting LED; and

computing a depth map from the subsequent image.

12. A method according to claim 11 , further comprising, prior to capturing the preliminary image, applying a scanning sequence in which the switching pulse train is applied to each infrared-emitting LED at a different time such that the switching pulse train to applied to each infrared-emitting LED does not overlap with the switching pulse train to applied to any other infrared-emitting LED.

13. A method according to claim 12 , further comprising limiting the duration of the scanning sequence to at most 2% of an integration time of an image sensor used to capture the preliminary image.

14. A method according to claim 11 , further comprising repeating capturing the preliminary image and adjusting pulse train durations at least twice before capturing the subsequent image.

15. A method according to claim 11 , further comprising setting at least one of each of the switching pulse trains or adjusted ones of the switching pulse trains such that the at least one of each of the switching pulse trains or adjusted ones of the switching pulse trains comprises a series of uniform pulses with a duty cycle of 50%.

16. A camera comprising:

an infrared imaging assembly comprising:

an infrared-sensitive image sensor;

an irradiator comprising an array of individually addressable infrared-emitting LEDs, each infrared-emitting LED arranged to illuminate a scene region of a scene;

a driver configured to actuate the irradiator by applying a switching pulse train to each infrared-emitting LED during dead time of a previous image acquisition event in which analog-digital conversion and three dimensional (3D) map computation are taking place;

an image analysis module configured to analyze a preliminary infrared image to determine exposure levels for each of a plurality of image regions; and

a pulse train adjusting unit configured to adjust a duration of the switching pulse train based on the exposure levels.

17. A camera according to claim 16 , wherein in the infrared imaging assembly:

each pixel of the array comprises demodulation channels at phase shifts of about 0°, 90°, 180°, and 270°, and

the image analysis module, to determine a depth map of the scene, is configured to determine a distance between the infrared-sensitive image sensor and the scene dependent on a combined phase shift that combines signal strengths at each of the phase shifts of the demodulation channels.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2025
From: LUMILEDS LLC
To: LUMILEDS SINGAPORE PTE. LTD.
Reel/Frame 071888/0086 →
RELEASE OF SECURITY INTEREST Recorded Jan 29, 2025
From: SOUND POINT AGENCY LLC
To: LUMILEDS LLC; LUMILEDS HOLDING B.V.
Reel/Frame 070046/0001 →
SECURITY INTEREST Recorded Jan 5, 2023
From: LUMILEDS LLC; LUMILEDS HOLDING B.V.
To: SOUND POINT AGENCY LLC
Reel/Frame 062299/0338 →
PATENT SECURITY AGREEMENT Recorded Dec 9, 2022
From: LUMILEDS, LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 062114/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE 4TH INVENTOR'S NAME PREVIOUSLY RECORDED AT REEL: 054195 FRAME: 0685. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Feb 4, 2022
From: VAN DER SIJDE, ARJEN GERBEN; FANCSALI, ERNO; PFEFFER, NICOLA BETTINA; VAN VOORST VADER, PIETER JOHANNES QUINTUS
To: LUMILEDS HOLDING B.V.
Reel/Frame 058953/0738 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2021
From: LUMILEDS HOLDING B.V.
To: LUMILEDS LLC
Reel/Frame 056287/0041 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2020
From: VAN DER SIJDE, ARJEN GERBEN; FANCSALI, ERNO; PFEFFER, NICOLA BETTINA; VOORST-VADER, QUINT VAN
To: LUMILEDS HOLDING B.V.
Reel/Frame 054195/0685 →