IP Library Granted Patent US 10,438,258
Granted Patent B2
US 10,438,258 · App. 15/414,002 · Granted Oct 8, 2019

Method and apparatus for generating graphical chromophore maps

Inventors: Luisa Fernanda Polania Cabrera (Webster, NY); Raja Bala (Pittsford, NY); Paul Jonathan Matts (Surrey, GB); Ankur Purwar (Sunglade, SG)
Assignee: The Procter & Gamble Company
G06Q30/0621G06K9/00G06T7/11G06T7/90G06T11/00G06T2207/10024G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,438,258
App. No.
15/414,002
Granted
Oct 8, 2019
Kind
B2
Abstract

A method, non-transitory computer readable medium and apparatus for generating graphical chromophore maps are disclosed. For example, the method includes receiving an image of a customer from a mobile endpoint device of the customer, wherein the image is taken via the mobile endpoint device of the customer, converting RGB values of the image into a spectral representation, performing a constrained independent component analysis (ICA) on the spectral representation to obtain three or more independent components that are ordered, generating a first graphical chromophore map of a first independent component of the three or more independent components that are ordered and a second graphical chromophore map of a second independent component of the three or more independent components that are ordered and transmitting the first graphical chromophore map and the second graphical chromophore map to the mobile endpoint device of the customer for display.

Claims (44)

1. A method, comprising:

receiving, by a processor, an image of a customer from a mobile endpoint device of the customer, wherein the image is taken via the mobile endpoint device of the customer;

converting, by the processor, red, green and blue (RGB) values of the image into a spectral representation;

performing, by the processor, a constrained independent component analysis (ICA) on the spectral representation to obtain three independent components that are ordered, wherein the three independent components are ordered by the constrained ICA by adding a distance component to the constrained ICA, wherein the distance component minimizes a distance between a spectral vector associated with one of the three independent components and a vector of a mixing matrix associated with the one of the three independent components, wherein the spectral vector is calculated during a training phase;

generating, by the processor, a first graphical chromophore map of a first independent component of the three independent components that are ordered and a second graphical chromophore map of a second independent component of the three independent components that are ordered; and

transmitting, by the processor, the first graphical chromophore map and the second graphical chromophore map to the mobile endpoint device of the customer for display.

2. The method of claim 1 , wherein the image is of a face of the customer.

3. The method of claim 2 , further comprising:

extracting, by the processor, one or more facial regions of the face.

4. The method of claim 3 , wherein the first graphical chromophore map displays the first independent component in the one or more facial regions and the second graphical chromophore map displays the second independent component in the one or more facial regions.

5. The method of claim 1 , wherein the three independent components that are ordered comprise a melanin component, a hemoglobin component and a shading component.

6. The method of claim 1 , wherein the constrained ICA analysis provides a mixing matrix, wherein each row of the mixing matrix comprises a plurality of wavelengths and each column of the mixing matrix comprises one of the three independent components and a weight vector of the three independent components.

7. The method of claim 6 , wherein the generating the first graphical chromophore map, comprises:

setting, by the processor, weight values for all independent components except the first independent component to zero; and

inverting, by the processor, the weight values of the first independent component for the plurality of wavelengths into corresponding RGB values.

8. The method of claim 6 , wherein the generating the second graphical chromophore map, comprises:

setting, by the processor, weight values for all independent components except the second independent component to zero; and

inverting, by the processor, the weight values of the second independent component for the plurality of wavelengths into corresponding RGB values.

9. A non-transitory computer-readable medium storing a plurality of instructions, which when executed by a processor, cause the processor to perform operations, the operations comprising:

receiving an image of a customer from a mobile endpoint device of the customer, wherein the image is taken via the mobile endpoint device of the customer;

converting red, green and blue (RGB) values of the image into a spectral representation;

performing a constrained independent component analysis (ICA) on the spectral representation to obtain three independent components that are ordered, wherein the three independent components are ordered by the constrained ICA by adding a distance component to the constrained ICA, wherein the distance component minimizes a distance between a spectral vector associated with one of the three independent components and a vector of a mixing matrix associated with the one of the three independent components, wherein the spectral vector is calculated during a training phase;

generating a first graphical chromophore map of a first independent component of the three independent components that are ordered and a second graphical chromophore map of a second independent component of the three independent components that are ordered; and

transmitting the first graphical chromophore map and the second graphical chromophore map to the mobile endpoint device of the customer for display.

10. The non-transitory computer-readable medium of claim 9 , wherein the image is of a face of the customer.

11. The non-transitory computer-readable medium of claim 10 , further comprising:

extracting one or more facial regions of the face.

12. The non-transitory computer-readable medium of claim 11 , wherein the first graphical chromophore map displays the first independent component in the one or more facial regions and the second graphical chromophore map displays the second independent component in the one or more facial regions.

13. The non-transitory computer-readable medium of claim 9 , wherein the three independent components that are ordered comprise a melanin component, a hemoglobin component and a shading component.

14. The non-transitory computer-readable medium of claim 9 , wherein the constrained ICA analysis provides a mixing matrix, wherein each row of the mixing matrix comprises a plurality of wavelengths and each column of the mixing matrix comprises one of the three independent components and a weight vector of the three independent components.

15. The non-transitory computer-readable medium of claim 14 , wherein the generating the first graphical chromophore map, comprises:

setting weight values for all independent components except the first independent component to zero; and

inverting the weight values of the first independent component for the plurality of wavelengths into corresponding RGB values; and

wherein generating the second graphical chromophore map, comprises:

setting weight values for all independent components except the second independent component to zero; and

inverting the weight values of the second independent component for the plurality of wavelengths into corresponding RGB values.

16. A method, comprising:

receiving, by a processor, a mobile selfie image of a face of a customer from a mobile endpoint device of the customer, wherein the mobile selfie image is taken via the mobile endpoint device of the customer;

extracting, by the processor, facial features from the mobile selfie image, the facial features comprising a mouth, cheeks, a nose and a forehead of the customer;

converting, by the processor, red, green and blue (RGB) values of the facial features into a spectral representation;

performing, by the processor, a constrained independent component analysis (ICA) on the spectral representation to obtain a shading component, a melanin component, and a hemoglobin component, wherein the constrained ICA is performed using an additional distance component that orders the shading component, the melanin component and the hemoglobin component, wherein the additional distance component minimizes a distance between a spectral vector associated with one of the shading component, the melanin component and the hemoglobin component and a vector of a mixing matrix associated with the one of the shading component, the melanin component and the hemoglobin component, wherein the spectral vector is calculated during a training phase;

generating, by the processor, a melanin graphical chromophore map based on a first inversion of only the melanin component into corresponding RGB values for each pixel that comprise the facial features from the mobile selfie image;

generating, by the processor, a hemoglobin graphical chromophore map based on a second inversion of only the hemoglobin component into corresponding RGB values for the each pixel that comprise the facial features from the mobile selfie image; and

transmitting, by the processor, the melanin graphical chromophore map and the hemoglobin graphical chromophore map to the mobile endpoint device of the customer for display.

Assignments (11)
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2018
From: XEROX CORPORATION
To: PROCTER & GAMBLE COMPANY
Reel/Frame 045473/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2017
From: MATTS, PAUL JONATHAN; PURWAR, ANKUR
To: XEROX CORPORATION
Reel/Frame 043451/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: POLANIA CABRERA, LUISA FERNANDA; BALA, RAJA
To: XEROX CORPORATION
Reel/Frame 041145/0858 →
Continuity (2)
Provisional Application 62311175 · Mar 21, 2016
Related Publication 20170270349A1 · Sep 21, 2017