IP Library Granted Patent US 10,264,250
Granted Patent B2
US 10,264,250 · App. 15/414,147 · Granted Apr 16, 2019

Method and apparatus for determining spectral characteristics of an image captured by a camera on a mobile endpoint device

Inventors: Martin Sidney Maltz (Rochester, NY); Raja Bala (Pittsford, NY); Paul Jonathan Matts (Surrey, GB); Ankur Purwar (Sunglade, SG)
Assignee: The Procter & Gamble Company
H04N17/002G06K7/1417G06Q30/0207A45D2044/007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,264,250
App. No.
15/414,147
Granted
Apr 16, 2019
Kind
B2
Abstract

A method, non-transitory computer readable medium and apparatus for determining spectral characteristics of an image captured by a camera on a mobile endpoint device are disclosed. For example, the method includes receiving the image of a color calibration card comprising a plurality of color patches and a quick response (QR) code, wherein each one of the plurality of color patches has a known spectral reflectance, determining spectral characteristics from the image of the color calibration card, wherein the spectral characteristics are used to analyze additional images that are received from the camera on the mobile endpoint device and transmitting an activation signal to activate an incentive associated with the QR code to the mobile endpoint device in response to receiving the image of the color calibration card.

Claims (32)

1. A method for determining spectral characteristics of an image captured by a camera on a mobile endpoint device, comprising:

receiving, by a processor, the image of a color calibration card comprising a plurality of color patches and a quick response (QR) code, wherein each one of the plurality of color patches has a known spectral reflectance;

determining, by the processor, the spectral characteristics from the image of the color calibration card, wherein the spectral characteristics are used to analyze additional images that are received from the camera on the mobile endpoint device; and

transmitting, by the processor, an activation signal to the mobile endpoint device that changes a Boolean value stored in a memory of the mobile endpoint device from a value of false to a value of true to allow operation of a mobile skin care application executed on the mobile endpoint device and to activate an incentive associated with the QR code to the mobile endpoint device in response to receiving the image of the color calibration card.

2. The method of claim 1 , wherein the plurality of color patches comprise a first set of color patches for an overall color calibration and a second set of color patches for a fine tuning color calibration.

3. The method of claim 2 , wherein the second set of color patches comprise a range of colors associated with skin colors.

4. The method of claim 3 , wherein the second set of color patches are different for different types of people.

5. The method of claim 1 , wherein the incentive comprises a discount for a future purchase that is stored on the mobile endpoint device.

6. The method of claim 1 , wherein the incentive comprises a link to a webpage that provides a tip on using a product that was purchased with the color calibration card.

7. The method of claim 1 , wherein the image is taken via a mobile skin care application on the mobile endpoint device.

8. The method of claim 1 , wherein the spectral characteristics comprise an illuminant used for the image and a camera spectral sensitivity.

9. The method of claim 1 , further comprising:

receiving, by the processor, a subsequent image of a customer associated with the mobile endpoint device;

analyzing, by the processor, the subsequent image using the spectral characteristics determined from the image of the color calibration card; and

analyzing, by the processor, the subsequent image to determine a facial skin health of the customer.

10. A color calibration card for determining spectral characteristics of an image captured by a camera on a mobile endpoint device, comprising:

a plurality of color patches, wherein each one of the plurality of color patches has a known spectral reflectance, wherein the plurality of color patches comprise a first set of colors for an overall color calibration and a second set of colors for a fine tuning color calibration, wherein the second set of color patches comprise a range of colors associated with skin colors;

a quick response code comprising a link to an incentive that is activated after an image of the color calibration card is received by a facial skin analysis server; and

one or more alignment marks.

11. The color calibration card of claim 10 , wherein the second set of color patches are different for different types of people.

12. The color calibration card of claim 10 , wherein the incentive comprises a discount for a future purchase that is stored on the mobile endpoint device.

13. The color calibration card of claim 10 , wherein the incentive comprises a link to a webpage that provides a tip on using a product that was purchased with the color calibration card.

14. The color calibration card of claim 10 , comprising a white backing with a known response.

15. The color calibration card of claim 10 , wherein the one or more alignment marks align with corresponding marks that are displayed on a mobile endpoint device of a customer.

16. The color calibration card of claim 10 , wherein the plurality of color patches are located around the QR code.

17. A method for determining spectral characteristics of an image captured by a camera on a mobile endpoint device, comprising:

executing, by a processor, a mobile skin care application on the mobile endpoint device, wherein the mobile skin care application will not operate until the image of a color calibration card is transmitted to a facial skin analysis server;

prompting, by the processor, a customer to align one or more alignment marks of the color calibration card with one or more corresponding marks displayed on the mobile endpoint device, wherein the color calibration card comprises a plurality of color patches and a quick response (QR) code, wherein each one of the plurality of color patches has a known spectral reflectance;

capturing, by the processor, the image of the color calibration card and the QR code;

storing, by the processor, an incentive associated with the QR code in a memory of the mobile endpoint device;

transmitting, by the processor, the image of the color calibration card to the facial skin analysis server to determine spectral characteristics from the image of the color calibration card, wherein the spectral characteristics are used to analyze additional images that are received from the camera of the mobile endpoint device; and

receiving, by the processor, an activation signal from the facial skin analysis server that changes a Boolean value stored in a memory of the mobile endpoint device from a value of false to a value of true to allow operation of the mobile skin care application and to activate the incentive associated with the QR code that is stored in memory.

Assignments (11)
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2018
From: XEROX CORPORATION
To: PROCTER & GAMBLE COMPANY
Reel/Frame 045473/0802 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2017
From: MATTS, PAUL JONATHAN; PURWAR, ANKUR
To: XEROX CORPORATION
Reel/Frame 043451/0215 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: MALTZ, MARTIN S.; BALA, RAJA
To: XEROX CORPORATION
Reel/Frame 041145/0101 →
Continuity (2)
Provisional Application 62311131 · Mar 21, 2016
Related Publication 20170272741A1 · Sep 21, 2017
Cited By (1)
US 12,388,948