IP Library › Granted Patent US 11,265,523
Granted Patent B2
US 11,265,523 · App. 17/356,677 · Granted Mar 1, 2022

Illuminant estimation referencing facial color features

Inventor: Xiaoning Huai (Sunnyvale, CA)
Assignee: Real Imaging Technology Co., Ltd
H04N9/73H04N5/2351H04N5/2355H04N5/23219H04N5/23222
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,265,523
App. No.
17/356,677
Granted
Mar 1, 2022
Kind
B2
Abstract

Disclosed is a method and apparatus of illuminant estimation referencing characterized facial color features in a digital image. Example embodiments of automatic white balance of the digital image leveraging the illuminant estimation are illustrated.

Claims (34)

1. A method of illuminant estimation comprising the steps of:

acquiring a first data set of color profiles of a face;

acquiring a digital image containing the face;

acquiring data of the color profiles of the face in the digital image; and

conducting an illuminant estimation of the face in the digital image based on referencing the data of the color profiles of the face in the digital image with the first data set of the color profiles of the face.

2. The method of claim 1 , wherein the step of acquiring the first data set of color profiles of a face is initiated and re-initiable by a user and/or a service routine and comprises one or more of the following procedures:

Procedure 1:

acquiring an image including the face under each of a set of standard reference illuminations of known color profiles;

conducting face detection and segmentation of skin tone area, eyeball white, and teeth of the face; and

extracting data of the color profiles of the face;

Procedure 2:

acquiring an image including the face and a reference gray chart in a variety of common shooting conditions and determining a color profile of an illumination in each of the shooting conditions by analyzing the reference gray chart;

corresponding to the determined color profile of the illumination in each of the shooting conditions, conducting a face detection and segmentation of skin tone area, eyeball white, and teeth of the face; and

extracting data of the color profiles of the face;

Procedure 3:

acquiring at least one set of data of the color profiles of the face through Procedure 1 or Procedure 2, wherein the face is illuminated by an illumination of a known or determined color profile; and

conducting an extrapolation within a human facial skin tone statistical distribution trajectory in a color space to obtain more data of the color profiles of the face; and

Procedure 4:

by a machine learning from acquired images comprising the face.

3. The method of claim 1 , further comprising the step of conducting a color correction or enhancement of a digital image based on the illuminant estimation.

4. The method of claim 1 , wherein an integrated implementation scheme accomplishes all the steps of the method in a single electronic media device, or a distributed implementation scheme accomplishes one or more of the steps of the method in a plurality of electronic media devices.

5. The method of claim 1 , further comprising setting a priority rank number associated with an entry of a user in a facial color features set, wherein the illuminant estimation is biased in an order favoring highest priority rank numbers when the digital image contains multiple faces.

6. An electronic media device, comprising:

one or more processors or configurable hardware computational circuitries; and

one or more memory storage modules having instructions or data thereon causing the the one or more processors or configurable hardware computational circuitries to:

acquire a first data set of color profiles of a face;

acquire a digital image containing the face;

acquire data of the color profiles of the face in the digital image; and

conduct the illuminant estimation of the face in the digital image based on referencing the data of the color profiles of the face in the digital image with the first data set of the color profiles of the face.

7. The electronic media device of claim 6 , wherein the instructions or data further cause the one or more processors or configurable hardware computational circuitries to:

conduct a color correction or enhancement of a digital image based on the illuminant estimation.

8. The electronic media device of claim 7 , wherein the instructions or data further cause the one or more processors or configurable hardware computational circuitries to:

set a priority rank number associated with an entry of a user in a facial color features set wherein the illuminant estimation is biased in an order favoring the highest priority rank numbers when the digital image containing multiple faces.

9. The electronic media device of claim 6 , wherein the electronic media device is a camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2026
From: HUAI, XIAONING
To: REAL IMAGING TECHNOLOGY CO., LTD
Reel/Frame 075463/0616 →
Priority Claims (2)
CN 201410630837 · Nov 11, 2014 · national
CN 201510230311 · May 4, 2015 · national
Continuity (2)
Division 17151166 · Jan 17, 2021
Related Publication 20210329208A1 · Oct 21, 2021