IP Library Granted Patent US 10,255,482
Granted Patent B2
US 10,255,482 · App. 15/414,189 · Granted Apr 9, 2019

Interactive display for facial skin monitoring

Inventors: Stephen C. Morgana (Rochester, NY); Raja Bala (Pittsford, NY); Matthew Adam Shreve (Webster, NY); Luisa Fernanda Polania Cabrera (Webster, NY); Paul Jonathan Matts (Surrey, GB); Ankur Purwar (Sunglade, SG)
Assignee: The Procter & Gamble Company
G06K9/00255G06K9/00275H04N1/00222H04N1/00244H04N5/23219H04N5/23222H04N5/23293H04N2201/0084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,255,482
App. No.
15/414,189
Granted
Apr 9, 2019
Kind
B2
Abstract

A method, non-transitory computer readable medium and apparatus for generating an interactive image of facial skin of a user that is displayed via a mobile endpoint device of the user are disclosed. For example, the method includes displaying a guide to position a face of the user, capturing an image of the face of the user, transmitting the image to a facial skin analysis server for analyzing one or more parameters of the facial skin of the user, receiving the interactive image of the face of the user that includes metadata associated with the one or more parameters of the facial skin that were analyzed by the facial skin analysis server, and displaying the interactive image of the face of the user.

Claims (42)

1. A method for generating an interactive image of facial skin of a user that is displayed via a mobile endpoint device of the user, comprising:

displaying, by a processor, a guide to position a face of the user;

capturing, by the processor, an image of the face of the user, wherein the guide is changed from an outline of a face of a generic model to an outline that corresponds to a shape of the face of the user based on the image of the face of the user that is captured for subsequent images that are captured of the face of the user;

transmitting, by the processor, the image to a facial skin analysis server for analyzing one or more parameters of the facial skin of the user, wherein the one or more parameters of the facial skin of the user comprises one or more graphical chromophore maps and a texture based upon a chromophore separation performed on the image of the face of the user;

receiving, by the processor, the interactive image of the face of the user that includes metadata associated with the one or more parameters of the facial skin that were analyzed by the facial skin analysis server; and

displaying, by the processor, the interactive image of the face of the user.

2. The method of claim 1 , wherein the capturing comprises capturing a plurality of different images of the face of the user, wherein each one of the plurality of different images is captured at a different exposure setting.

3. The method of claim 1 , further comprising:

detecting, by the processor, a plurality of different facial regions in the image of the face of the user before the transmitting.

4. The method of claim 3 , further comprising:

receiving, by the processor, a contextual input about a skin condition associated with one or more of the plurality of different facial regions.

5. The method of claim 4 , wherein the metadata includes a response to the contextual input for the one or more of the plurality of different facial regions.

6. The method of claim 1 , wherein the one or more parameters of the facial skin of the user comprise wrinkles that are identified from the image of the face of the user.

7. The method of claim 1 , wherein the one or more parameters of the facial skin of the user comprise pores that are identified from the image of the face of the user.

8. The method of claim 1 , wherein the interactive image provides selectable facial regions of the face for a detailed visualization of a facial region that is selected.

9. The method of claim 8 , wherein the detailed visualization comprises magnifying the facial region that is selected.

10. The method of claim 8 , wherein the detailed visualization comprises changing the facial region that is selected from a black and white image to a color image.

11. The method of claim 8 , wherein the detailed visualization of the facial region that is selected comprises displaying the one or more parameters from the metadata that are associated with facial region that is selected.

12. A non-transitory computer-readable medium storing a plurality of instructions, which when executed by a processor, cause the processor to perform operations for generating an interactive image of facial skin of a user that is displayed via a mobile endpoint device of the user, the operations comprising:

displaying a guide to position a face of the user;

capturing an image of the face of the user;

transmitting the image to a facial skin analysis server for analyzing one or more parameters of the facial skin of the user, wherein the one or more parameters of the facial skin of the user comprises one or more graphical chromophore maps and a texture based upon a chromophore separation performed on the image of the face of the user;

receiving the interactive image of the face of the user that includes metadata associated with the one or more parameters of the facial skin that were analyzed by the facial skin analysis server;

displaying the interactive image of the face of the user;

changing the guide from an outline of a face of a generic model to an outline that corresponds to a shape of the face of the user based on the image of the face of the user that was captured; and

displaying the guide that is changed with the outline that corresponds to the shape of the face of the user to capture subsequent images of the face of the user.

13. The non-transitory computer-readable medium of claim 12 , further comprising:

detecting a plurality of different facial regions in the image of the face of the user before the transmitting.

14. The non-transitory computer-readable medium of claim 13 , further comprising:

receiving a contextual input about a skin condition associated with one or more of the plurality of different facial regions.

15. The non-transitory computer-readable medium of claim 14 , wherein the metadata includes a response to the contextual input for the one or more of the plurality of different facial regions.

16. The non-transitory computer-readable medium of claim 12 , wherein the interactive image provides selectable facial regions of the face for a detailed visualization of a facial region that is selected.

17. The non-transitory computer-readable medium of claim 16 , wherein the detailed visualization of the facial region that is selected comprises displaying the one or more parameters from the metadata that are associated with facial region that is selected.

18. A method for generating an interactive image of facial skin of a user that is displayed via a mobile endpoint device of the user, the method comprising:

displaying, by a processor, an outline over an image capture preview to position a face of the user, wherein the outline has a shape that is similar to the face of the user based off a previously captured image of the face of the user;

capturing, by the processor, an image of the face of the user;

identifying, by the processor, a plurality of facial regions of the face of the user in the image;

transmitting, by the processor, the image and the plurality of facial regions of the face of the user that is identified to a facial skin analysis server for analyzing one or more parameters of the facial skin of each one of the plurality of facial regions of the user, wherein the one or more parameters of the facial skin of the user comprises one or more graphical chromophore maps and a texture based upon a chromophore separation performed on the image of the face of the user;

receiving, by the processor, the interactive image of the face of the user that includes metadata associated with each one of the plurality of facial regions of the user, wherein the metadata comprises the one or more parameters of the facial skin that were analyzed by the facial skin analysis server for a respective facial region of the plurality of facial regions;

displaying, by the processor, the interactive image of the face of the user;

receiving, by the processor, a selection of a facial region of the plurality of facial regions on the interactive image of the face; and

generating, by the processor, a detailed visualization of the facial region that is selected that includes the one or more parameters of the facial skin associated with the facial region that is selected from the metadata.

Assignments (11)
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2018
From: XEROX CORPORATION
To: PROCTER & GAMBLE COMPANY
Reel/Frame 045473/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2017
From: MATTS, PAUL JONATHAN; PURWAR, ANKUR
To: XEROX CORPORATION
Reel/Frame 043724/0901 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: MORGANA, STEPHEN C.; BALA, RAJA; SHREVE, MATTHEW ADAM; POLANIA CABRERA, LUISA FERNANDA
To: XEROX CORPORATION
Reel/Frame 041144/0963 →
Continuity (2)
Provisional Application 62311200 · Mar 21, 2016
Related Publication 20170270348A1 · Sep 21, 2017
Cited By (2)
US 12,366,038 US 12,369,843