IP Library Granted Patent US 10,484,616
Granted Patent B2
US 10,484,616 · App. 15/591,040 · Granted Nov 19, 2019

Adaptive light source

Inventors: Arjen Van der Sijde (Aachen, DE); Nicola Pfeffer (Aachen, DE); Quint Van Voorst-Vader (Aachen, DE); Yourii Martynov (Aachen, DE); Charles Schrama (Aachen, DE)
Assignee: Lumileds LLC
H04N5/2354G03B15/05G06K9/00201G06K9/00255G06K9/00288G06K9/00664G06K9/209G06K9/2027G06T7/586H04N5/2256H04N5/2351H04N5/33G03B2215/0567H04N5/23296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,484,616
App. No.
15/591,040
Granted
Nov 19, 2019
Kind
B2
Abstract

A method includes capturing a first image of a scene, detecting a face in a section of the scene from the first image, and activating an infrared (IR) light source to selectively illuminate the section of the scene with IR light. The IR light source includes an array of IR light emitting diodes (LEDs). The method includes capturing a second image of the scene under selective IR lighting from the IR light source, detecting the face in the second image, and identifying a person based on the face in the second image.

Claims (88)

1. A method, comprising:

capturing a first image of a scene;

detecting a face in a section of the scene from the first image;

creating a three dimensional profile of the face;

calculating an amount of infrared (IR) light to illuminate the section of the scene based on the first image and the three dimensional profile of the face;

activating an infrared (IR) light source to selectively illuminate the section of the scene with the amount of IR light, the IR light source comprising an array of IR light emitting diodes (LEDs);

capturing a second image of the scene under selective IR lighting from the IR light source;

detecting the face in the second image; and

identifying a person based on the face in the second image.

2. The method of claim 1 , prior to said capturing the first image of the scene, further comprising activating the IR light source to uniformly illuminate the scene with IR light by driving each of the IR LEDs in the array with a first individual current.

3. The method of claim 2 , wherein said activating the IR light source to selectively illuminate the section of the scene with IR light comprises selecting a group of IR LEDs in the array and driving each of the IR LEDs in the group with a second individual current that is greater than the first individual current.

4. The method of claim 3 , wherein a first total current comprising a sum of the first individual currents and a second total current comprising a sum of the second individual currents are equal.

5. The method of claim 1 , wherein said activating the IR light source to selectively illuminate the section of the scene with IR light comprises selecting a group of IR LEDs in the array and driving each of the IR LEDs in the group with a second individual current less than the first current, a first total current comprising a sum of the first individual currents being greater than a second total current comprising a sum of the second individual currents.

6. The method of claim 1 , wherein said capturing the first image of the scene occurs under ambient lighting.

7. The method of claim 6 , prior to said activating the IR light source to selectively illuminate the section of the scene with IR light, further comprising:

activating the IR light source to uniformly illuminate the scene with IR light;

capturing an intermediate image of the scene under uniform IR lighting from the IR light source;

detecting the face in the intermediate image; and

calculating the amount of IR light to illuminate the section of the scene based on brightness values of the face in the first image and the intermediate image.

8. The method of claim 7 , wherein said calculating the amount of IR light to illuminate the section of the scene is based on a difference between corresponding brightness value of the face from the first image and the intermediate image.

9. A method, comprising:

capturing a first image of a scene;

detecting a face in a section of the scene from the first image;

creating a three dimensional profile of the face;

activating an infrared (IR) light source to uniformly illuminate the scene with uniform IR lighting, the IR light source comprising an array of IR light emitting diodes (LEDs);

capturing an intermediate image of the scene under the uniform IR lighting from the IR light source;

detecting the face in the intermediate image;

calculating an amount of IR light to illuminate the section of the scene based on brightness values of the face in the first and the intermediate images and the three dimensional profile of the face;

activating the IR light source to selectively illuminate the section of the scene with the amount of IR light;

capturing a second image of the scene under selective IR lighting from the IR light source;

detecting the face in the second image; and

identifying a person based on the face in the second image.

10. The method of claim 9 , wherein a first LED in the array emits IR light of a different emission spectrum than IR light emitted by a second LED in the array.

11. The method of claim 9 , wherein the array is a first array of IR LEDs, the IR light source further comprises a second array of IR LEDs, and the first array of IR LEDs and the second arrays of IR LEDs illuminate different portions of the face.

12. The method of claim 11 , wherein a first LED in the array emits IR light of a different emission spectrum than IR light emitted by a second LED in the array.

13. The method of claim 9 , wherein said identifying a person based on the face in the second image comprises comparing the face in the second image against facial images in a database and finding a match.

14. A system, comprising:

a camera having a field of view;

an infrared (IR) light source comprising an array of IR light emitting diodes (LEDs);

nonvolatile memory storing instructions for a face detection and recognition application; and

a microprocessor encoded with instructions that, when executed by the microprocessor, cause the system to:

capture, with the camera, a first image of a scene;

detect a face in a section of the scene from the first image;

create a three dimensional profile of the face;

calculate an amount of IR light to illuminate the section of the scene based on the first image and the three dimensional profile of the face;

activate the IR light source to selectively illuminate the section of the scene with the amount of IR light;

capture, with the camera, a second image of the scene under selective IR lighting from the IR light source;

detect the face in the second image; and

identify a person based on the face in the second image.

15. The system of claim 14 , wherein the instructions that, when executed by the microprocessor, cause the system to, prior to said capturing the first image of the scene, activate the IR light source to uniformly illuminate the scene with IR light by driving each of the IR LEDs in the array with a first individual current.

16. The system of claim 15 , wherein said activating the IR light source to selectively illuminate the section of the scene with IR light comprises selecting a group of IR LEDs in the array and driving each of the IR LEDs in the group with a second individual current that is greater than the first individual current.

17. The system of claim 16 , wherein a first total current comprising a sum of the first individual currents and a second total current comprising a sum of the second individual currents are equal.

18. The system of claim 15 , wherein said activating the IR light source to selectively illuminate the section of the scene with IR light comprises selecting a group of IR LEDs in the array and driving each of the IR LEDs in the group with a second individual current less than the first individual current, a first total current comprising a sum of the first individual currents being greater than a second total current comprising a sum of the second individual currents.

19. The system of claim 14 , wherein said capturing the first image of the scene occurs under ambient lighting.

20. The system of claim 19 , wherein the instructions that, when executed by the microprocessor, cause the system to, prior to said activating the IR light source to selectively illuminate the section of the scene with IR light:

activate the IR light source to uniformly illuminate the scene with IR light capturing an intermediate image of the scene under uniform IR lighting from the IR light source;

detect the face in the intermediate image; and

calculate the amount of IR light to illuminate the section of the scene based on brightness values of the face in the first and the intermediate images.

21. The system of claim 20 , wherein said calculating the amount of IR light to illuminate the section of the scene is based on a difference between corresponding brightness value of the face from the first image and the intermediate image.

22. A system, comprising:

a camera having a field of view;

an infrared (IR) light source comprising an array of IR light emitting diodes (LEDs);

nonvolatile memory storing instructions for a face detection and recognition application; and

a microprocessor encoded with instructions that, when executed by the microprocessor, cause the system to:

capture, with the camera, a first image of a scene;

detect a face in a section of the scene from the first image;

create a three dimensional profile of the face;

activate the IR light source to uniformly illuminate the scene with uniform IR lighting;

capture an intermediate image of the scene under the uniform IR lighting from the IR light source;

detect the face in the intermediate image;

calculate an amount of IR light to illuminate the section of the scene is based brightness values of the face in the first and the intermediate images and the three dimensional profile of the face;

activate the IR light source to selectively illuminate the section of the scene with the amount of IR light;

capture, with the camera, a second image of the scene under selective IR lighting from the IR light source;

detect the face in the second image; and

identify a person based on the face in the second image.

23. The system of claim 22 , wherein a first LED in the array emits IR light of a different emission spectrum than IR light emitted by a second LED in the array.

24. The system of claim 22 , wherein the array of IR LEDs is a first array of IR LEDs, the IR light source further comprises a second array of IR LEDs, the first and the second arrays of IR LEDs illuminate different portions of the face.

25. The system of claim 24 , wherein a first LED in the array emits IR light of a different emission spectrum than IR light emitted by a second LED in the array.

26. The system of claim 22 , wherein said identifying the person based on the face in the second image comprises comparing the face in the second image against facial images in a database and finding a match.

27. A non-transitory, computer-readable storage medium encoded with instructions executable by a microprocessor to selectively illuminate a scene, the instructions, when executed by the microprocessor, cause performance of operations, the operations comprising:

capturing a first image of a scene;

detecting a face in a section of the scene from the first image;

creating a three dimensional profile of the face;

calculating an amount of infrared (IR) light to illuminate the section of the scene based on the first image and the three dimensional profile of the face;

activating an IR light source to selectively illuminate the section of the scene with the amount of IR light, the IR light source comprising an array of IR light emitting diodes (LEDs);

capturing a second image of the scene under selective IR lighting from the IR light source;

detecting the face in the second image; and

identifying a person based on the face in the second image.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2025
From: LUMILEDS LLC
To: LUMILEDS SINGAPORE PTE. LTD.
Reel/Frame 071888/0086 →
RELEASE OF SECURITY INTEREST Recorded Jan 29, 2025
From: SOUND POINT AGENCY LLC
To: LUMILEDS LLC; LUMILEDS HOLDING B.V.
Reel/Frame 070046/0001 →
SECURITY INTEREST Recorded Jan 5, 2023
From: LUMILEDS LLC; LUMILEDS HOLDING B.V.
To: SOUND POINT AGENCY LLC
Reel/Frame 062299/0338 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2018
From: KONINKLIJKE PHILIPS N.V.
To: LUMILEDS LLC
Reel/Frame 045859/0005 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2017
From: SCHRAMA, CHARLES
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 044074/0691 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2017
From: VAN DER SIJDE, ARJEN; PFEFFER, NICOLA; VAN VOORST-VADER, QUINT; MARTYNOV, YOURII
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 043915/0910 →
SECURITY INTEREST Recorded Jul 7, 2017
From: LUMILEDS LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 043108/0001 →
Priority Claims (1)
EP 16158004 · Mar 1, 2016 · regional
Continuity (3)
Continuation In Part PCTEP2016076360 · Nov 2, 2016
Provisional Application 62253580 · Nov 10, 2015
Related Publication 20170249501A1 · Aug 31, 2017