IP Library Granted Patent US 10,282,868
Granted Patent B2
US 10,282,868 · App. 15/414,305 · Granted May 7, 2019

Method and system for generating accurate graphical chromophore maps

Inventors: Martin Sidney Maltz (Rochester, NY); Luisa Fernanda Polania Cabrera (Webster, NY); Paul Jonathan Matts (Surrey, GB); Ankur Purwar (Sunglade, SG)
Assignee: The Procter & Gamble Company
G06T11/001G06T7/0014G06T7/90G06T2207/10024G06T2207/30088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,282,868
App. No.
15/414,305
Filed
Jan 24, 2017
Granted
May 7, 2019
Kind
B2
Examiner
WU, CHONG
Art Unit
2613
USPC
345/604
Abstract

A method, non-transitory computer readable medium and apparatus for generating one or more graphical chromophore maps are disclosed. For example, the method includes receiving a plurality of images from a plurality of different customers, estimating a plurality of different illuminates that were used to capture each one of the plurality of images, calculating a correlation of a spectral reflectance of a lip region of a customer with an absorption curve of hemoglobin for the each one of the plurality of images for each one of the plurality of different illuminates that is estimated, selecting an illuminance of the plurality of different illuminates that provides a highest correlation and generating one or more graphical chromophore maps for subsequently received images of customers using the illuminance that is selected.

Claims (36)

1. A method for generating one or more graphical chromophore maps, comprising:

receiving, by a processor, a plurality of images from a plurality of different customers;

estimating, by the processor, a plurality of different illuminants that were used to capture each one of the plurality of images;

calculating, by the processor, a correlation of a spectral reflectance of a lip region of a customer with an absorption curve of hemoglobin for the each one of the plurality of images for each one of the plurality of different illuminants that is estimated;

selecting, by the processor, an illuminant from the plurality of different illuminants that provides a highest correlation;

converting, by the processor, subsequently received images of customers from a red, a green, and a blue (RGB) color space to spectral representation, wherein the converting is based upon a function of a response of each color of the RGB color space, the spectral reflectance of the lip region at a location (x, y), a spectral power distribution of the illuminant that is selected and a spectral sensitivity of a camera; and

generating, by the processor, the one or more graphical chromophore maps for the subsequently received images of customers using the illuminant that is selected.

2. The method of claim 1 , wherein the plurality of different illuminants comprises a fluorescent light source, an incandescent light source, or a tungsten light source.

3. The method of claim 2 , wherein the fluorescent light source comprises a plurality of different F series.

4. The method of claim 1 , wherein the highest correlation is based on an average of the correlations of the each one of the plurality of images for the each one of the plurality of different illuminants.

5. The method of claim 1 , wherein the correlation comprises a Pearson correlation coefficient.

6. The method of claim 1 , wherein the one or more graphical chromophore maps are for a melanin content and a hemoglobin content.

7. A non-transitory computer-readable medium storing a plurality of instructions, which when executed by a processor, cause the processor to perform operations for generating one or more graphical chromophore maps, the operations comprising:

receiving a plurality of images from a plurality of different customers;

estimating a plurality of different illuminants that were used to capture each one of the plurality of images;

calculating a correlation of a spectral reflectance of a lip region of a customer with a absorption curve of hemoglobin for the each one of the plurality of images for each one of the plurality of different illuminants that is estimated;

selecting an illuminant from the plurality of different illuminants that provides a highest correlation;

converting subsequently received images of customers from a red, a green, and a blue (RGB) color space to spectral representation, wherein the converting is based upon a function of a response of each color of the RGB color space, the spectral reflectance of the lip region at a location (x, y), a spectral power distribution of the illuminant that is selected and a spectral sensitivity of a camera; and

generating the one or more graphical chromophore maps for the subsequently received images of customers using the illuminant that is selected.

8. The non-transitory computer-readable medium of claim 7 , wherein the plurality of different illuminants comprises a fluorescent light source, an incandescent light source, or a tungsten light source.

9. The non-transitory computer-readable medium of claim 8 , wherein the fluorescent light source comprises a plurality of different F series.

10. The non-transitory computer-readable medium of claim 8 , wherein the one or more graphical chromophore maps are for a melanin content and a hemoglobin content.

11. The non-transitory computer-readable medium of claim 7 , wherein the highest correlation is based on an average of the correlations of the each one of the plurality of images for the each one of the plurality of different illuminants.

12. The non-transitory computer-readable medium of claim 7 , wherein the correlation comprises a Pearson correlation coefficient.

13. A method for generating one or more graphical chromophore maps, comprising:

receiving, by a processor, a plurality of images from a plurality of different customers;

estimating, by the processor, a plurality of different illuminants that were used to capture each one of the plurality of images;

calculating, by the processor, a Pearson correlation coefficient of a spectral reflectance of a lip region of a customer with an absorption curve of hemoglobin for the each one of the plurality of images for each one of the plurality of different illuminants that is estimated;

selecting, by the processor, an illuminant from the plurality of different illuminants that provides a highest Pearson correlation coefficient;

receiving, by the processor, a subsequent image of a face of a subsequent customer;

converting, by the processor, the subsequent image from a red, a green, and a blue (RGB) color space to spectral representation based upon a function of a response of each color of the RGB color space, the spectral reflectance of the lip region at a location (x, y), a spectral power distribution of the illuminant that is selected and a spectral sensitivity of a camera;

separating, by the processor, a melanin component and a hemoglobin component from the subsequent image in the spectral representation; and

generating, by the processor, a melanin graphical chromophore map based on the melanin component and a hemoglobin graphical chromophore map based on the hemoglobin component.

14. The method of claim 13 , wherein the plurality of different illuminants comprises a fluorescent light source, an incandescent light source, or a tungsten light source.

15. The method of claim 14 , wherein the fluorescent light source comprises a plurality of different F series.

16. The method of claim 13 , wherein the highest Pearson correlation coefficient is based on an average of the Pearson correlation coefficient of the each one of the plurality of images for the each one of the plurality of different illuminants.

Assignments (11)
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2018
From: XEROX CORPORATION
To: PROCTER & GAMBLE COMPANY
Reel/Frame 045473/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2017
From: MATTS, PAUL JONATHAN; PURWAR, ANKUR
To: XEROX CORPORATION
Reel/Frame 043724/0756 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: MALTZ, MARTIN S.; POLANIA CABRERA, LUISA FERNANDA
To: XEROX CORPORATION
Reel/Frame 041143/0274 →
Continuity (2)
Provisional Application 62311183 · Mar 21, 2016
Related Publication 20170270691A1 · Sep 21, 2017