IP Library Granted Patent US 11,803,104
Granted Patent B2
US 11,803,104 · App. 17/537,614 · Granted Oct 31, 2023

Adaptive light source

Inventors: Arjen Gerben Van der Sijde (Eindhoven, NL); Nicola Bettina Pfeffer (Eindhoven, NL); Pieter Johannes Quintus van Voorst Vader (Son, NL); Yourii Martynov (Geldrop, NL)
Assignee: Lumileds LLC
G03B15/05G06T7/586G06V10/141G06V10/147G06V20/10G06V20/64G06V40/166G06V40/172H04N5/33H04N23/56H04N23/71H04N23/74G03B2215/0567H04N23/69
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,803,104
App. No.
17/537,614
Granted
Oct 31, 2023
Kind
B2
Abstract

A method according to embodiments of the invention includes creating a three-dimensional profile of a scene, calculating a relative amount of light for each portion of the scene based on the three-dimensional profile, and activating a light source to provide a first amount of light to a first portion of the scene, and a second amount of light to a second portion of the scene. The first amount and the second amount are different. The first amount and the second amount are determined by calculating a relative amount of light for each portion of the scene.

Claims (69)

1. A system, comprising:

a camera having a field of view that includes a scene;

at least one hardware-based processor; and

memory, including instructions that, when executed by the at least one hardware-based processor, cause the at least one hardware-based processor to execute instructions, the instructions comprising:

capturing, with the camera, a first image of the scene under ambient lighting;

capturing, with the camera, a second image of the scene while illuminating the scene with a first amount of light;

for portions of the scene that correspond to individual light-emitting diodes (LEDs) in an array of LEDs, determining a distance from the array of LEDs to each portion of the scene;

calculating, based at least in part on the corresponding determined distance from the array of LEDs each portion of the scene, a relative amount of light for each portion of the scene by determining and comparing brightness values of the first image and the second image for each portion of the scene, to reduce overexposure of the respective portion of the scene;

determining, from the calculated relative amounts of light, that a first portion of the scene and a second portion of the scene receive different amounts of light;

providing a first amount of current, based on the calculated relative amounts of light, to a first LED of the array of LEDs to illuminate the first portion of the scene;

providing a second amount of current, different from the first amount and based on the calculated relative amounts of light, to a second LED of the array of LEDs to illuminate the second portion of the scene;

subtracting pixel brightness values of the first image from respective pixel brightness values of the second image to form difference values;

scaling the difference values to determine an exposure level; and

capturing, with the camera, a third image of the scene using the determined exposure level.

2. The system of claim 1 , further comprising a three-dimensional sensor coupled to the at least one hardware-based processor and configured to determine the distance from the array of LEDs to each portion of the scene.

3. The system of claim 1 , wherein capturing the first image of the scene under the ambient lighting comprises capturing the first image of the scene while the array of LEDs is unpowered.

4. The system of claim 1 , wherein illuminating the scene with the first amount of light comprises providing a same amount of current to each LED of the array of LEDs.

5. The system of claim 1 , wherein:

the second image of the scene is captured before determining the distances from the array of LEDs to the portions of the scene; and

the distances from the array of LEDs to the portions of the scene are determined based in part on at least one of the first image of the scene or the second image of the scene.

6. The system of claim 1 , wherein:

the second image of the scene is captured after determining the distances from the array of LEDs to the portions of the scene; and

the distances from the array of LEDs to the portions of the scene are determined based in part on the first image of the scene.

7. The system of claim 1 , wherein the instructions further comprise capturing, with the camera, a third image of the scene while providing the first amount of current to the first LED of the array of LEDs to illuminate the first portion of the scene and providing the second amount of current to the second LED of the array of LEDs to illuminate the second portion of the scene.

8. The system of claim 1 , wherein:

the first LED of the array of LEDs is configured to emit white light having a first emission spectrum; and

the second LED of the array of LEDs is configured to emit white light having a second emission spectrum different from the first emission spectrum.

9. The system of claim 1 , wherein:

the array of LEDs is a first array of LEDs; and

the first array of LEDs and a second array of LEDs are arranged to illuminate one or more same portions of the scene.

10. The system of claim 1 , wherein:

the first array of LEDs is configured to emit light having a first emission spectrum; and

the second array of LEDs is configured to emit light having a second emission spectrum different from the first emission spectrum.

11. A method, comprising:

capturing, with a camera, a first image of a scene under ambient lighting;

capturing, with the camera, a second image of the scene while illuminating the scene with a first amount of light;

for portions of the scene that correspond to individual light-emitting diodes (LEDs) in an array of LEDs, determining a distance from the array of LEDs to each portion of the scene;

calculating, based at least in part on the corresponding determined distance from the array of LEDs each portion of the scene, a relative amount of light for each portion of the scene by determining and comparing brightness values of the first image and the second image for each portion of the scene, to reduce overexposure of the respective portion of the scene;

determining, from the calculated relative amounts of light, that a first portion of the scene and a second portion of the scene receive different amounts of light;

providing a first amount of current, based on the calculated relative amounts of light, to a first LED of the array of LEDs to illuminate the first portion of the scene;

providing a second amount of current, different from the first amount and based on the calculated relative amounts of light, to a second LED of the array of LEDs to illuminate the second portion of the scene;

subtracting pixel brightness values of the first image from respective pixel brightness values of the second image to form difference values;

scaling the difference values to determine an exposure level; and

capturing, with the camera, a third image of the scene using the determined exposure level.

12. The method of claim 11 , further comprising: capturing, with the camera, a third image of the scene while providing the first amount of current to the first LED of the array of LEDs to illuminate the first portion of the scene and providing the second amount of current to the second LED of the array of LEDs to illuminate the second portion of the scene.

13. The method of claim 11 , wherein determining the distance from the array of LEDs to each portion of the scene comprises using a three-dimensional sensor coupled to at least one hardware-based processor to determine the distance from the array of LEDs to each portion of the scene.

14. The method of claim 11 , wherein capturing the first image of the scene under the ambient lighting comprises capturing the first image of the scene while the array of LEDs is unpowered.

15. The method of claim 11 , wherein illuminating the scene with the first amount of light comprises providing a same amount of current to each LED of the array of LEDs.

16. The method of claim 11 , wherein:

the second image of the scene is captured before determining the distances from the source to the portions of the scene; and

the distances from the source to the portions of the scene are determined based in part on at least one of the first image of the scene or the second image of the scene.

17. The method of claim 11 , wherein:

the second image of the scene is captured after determining the distances from the source to the portions of the scene; and

the distances from the source to the portions of the scene are determined based in part on the first image of the scene.

18. A system, comprising:

a camera having a field of view that includes a scene;

an array of light emitting diodes (LEDs); and

at least one hardware-based processor coupled to the camera and the array of LEDs; and

memory, including instructions that, when executed by the at least one hardware-based processor, cause the at least one hardware-based processor to execute instructions, the instructions comprising:

for portions of the scene that correspond to individual light-emitting diodes (LEDs) in an array of LEDs, determining a distance from the array of LEDs to each portion of the scene;

capturing, with the camera, a first image of the scene while the array of LEDs is unpowered;

capturing, with the camera, a second image of the scene while illuminating the scene while providing a same amount of current to each LED of the array of LEDs;

calculating, based at least in part on the corresponding determined distance from the array of LEDs each portion of the scene, a relative amount of light for each portion of the scene by determining and comparing brightness values of the first image and the second image for each portion of the scene, to reduce overexposure of the respective portion of the scene;

determining, from the calculated relative amounts of light, that a first portion of the scene and a second portion of the scene receive different amounts of light;

providing a first amount of current, based on the calculated relative amounts of light, to a first LED of the array of LEDs to illuminate the first portion of the scene;

providing a second amount of current, different from the first amount and based on the calculated relative amounts of light, to a second LED of the array of LEDs to illuminate the second portion of the scene;

subtracting pixel brightness values of the first image from respective pixel brightness values of the second image to form difference values;

scaling the difference values to determine an exposure level; and

capturing, with the camera, a third image of the scene using the determined exposure level.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2025
From: LUMILEDS LLC
To: LUMILEDS SINGAPORE PTE. LTD.
Reel/Frame 071888/0086 →
RELEASE OF SECURITY INTEREST Recorded Jan 29, 2025
From: SOUND POINT AGENCY LLC
To: LUMILEDS LLC; LUMILEDS HOLDING B.V.
Reel/Frame 070046/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2023
From: LUMILEDS HOLDING B.V.
To: LUMILEDS LLC
Reel/Frame 062779/0007 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2023
From: VAN DER SIJDE, ARJEN GERBEN; PFEFFER, NICOLA BETTINA; VAN VOORST VADER, PIETER JOHANNES QUINTUS; MARTYNOV, YOURII
To: LUMILEDS HOLDING B.V.
Reel/Frame 062837/0299 →
SECURITY INTEREST Recorded Jan 5, 2023
From: LUMILEDS LLC; LUMILEDS HOLDING B.V.
To: SOUND POINT AGENCY LLC
Reel/Frame 062299/0338 →
PATENT SECURITY AGREEMENT Recorded Dec 9, 2022
From: LUMILEDS, LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH
Reel/Frame 062114/0001 →