IP Library Granted Patent US 12,098,956
Granted Patent B2
US 12,098,956 · App. 17/493,519 · Granted Sep 24, 2024

System and method for creation of topical agents with improved image capture

Inventors: Leslie Young Harvill (Half Moon Bay, CA); Shawn Arseneau (Spring, TX)
Assignee: Shiseido Company, Limited
G01J3/50G01J3/0264G01J3/0272G06V10/141G06V10/56G06V10/60G06V40/161G06T2207/30088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,098,956
App. No.
17/493,519
Granted
Sep 24, 2024
Kind
B2
Abstract

A method is described including displaying a user's body portion image on an optical display of a device employed by the user. The device may include an image sensor and the body portion image may be sensed by the sensor. The method includes determining whether a position of the body portion image relative to the sensor is acceptable to allow for recording of the body portion image; determining whether a lighting environment associated with the sensor is acceptable to allow for recording of the body portion image; recording the image using the sensor to provide a recorded image having image data; processing the recorded image to determine lighting model data associated with the lighting environment; and determining reflectance and color characteristics associated with the body portion based on the recorded image and the lighting model data. In one embodiment the optical display has an illuminant and when the lighting environment is not acceptable for recording, the method instructs the user to modify the lighting environment so that illumination of the body portion is less than about 2% of the illumination provided by the illuminant, illuminates the body portion with constant white light using the illuminant and determines whether the illuminated body portion is positioned relative to the sensor to allow for recording of the body portion image by displaying an outline of the body portion on the optical display to position the body portion in view of the sensor. Processing of the image in this case may include direct computation to determine the lighting model.

Claims (43)

1. A method comprising:

displaying an image of a body portion of a user on an optical display of a device employed by the user, wherein the device comprises an image sensor and the image of the body portion of the user is sensed by the sensor;

determining whether a position of the body portion image relative to the sensor is acceptable to allow for recording of the image of the body portion;

determining whether a lighting environment associated with the sensor is acceptable to allow for recording of the image of the body portion;

recording the image using the sensor to provide a recorded image having image data;

processing the recorded image to determine lighting model data associated with the lighting environment; and

determining reflectance and color characteristics associated with the body portion of the user based on the recorded image and the lighting model data.

2. The method of claim 1 wherein determining whether the position of the body portion relative to the sensor is acceptable for recording the image of the body portion comprises displaying a colored light on the optical display.

3. The method of claim 1 wherein determining whether the position of the body portion relative to the sensor is acceptable for recording the image of the body portion comprise displaying a lighted outline of the body portion on the optical display.

4. The method of claim 1 wherein determining whether the position of the body portion relative to the sensor is acceptable for recording the image of the body portion comprises actuating a tactile or an audible indicator on the device.

5. The method of claim 1 wherein determining whether that the lighting environment is acceptable for recording the image of the body portion comprises displaying a colored light on the optical display.

6. The method of claim 1 wherein determining that the lighting environment is acceptable for recording the image of the body portion comprises displaying a lighted outline of the body portion.

7. The method of claim 1 wherein determining that the lighting environment is acceptable for recording the image of the body portion comprises actuating a tactile or an audible indicator on the device.

8. The method of claim 1 wherein determining the lighting model comprises:

measuring exposure data associated with the device;

determining data describing a relationship between an illuminant on the device and an aperture of the image sensor;

determining data describing a relationship between the lighting environment and the image sensor; and

determining data describing a relationship between the image sensor, the illuminant and a surface of the body portion.

9. The method of claim 1 further comprising:

determining a customized cosmetic formulation based in part on the reflectance and color characteristics.

10. The method of claim 1 wherein the optical display comprises an illuminant;

wherein illumination of the body portion by the lighting environment is less than about 2% of the illumination provided by the illuminant; and wherein processing the recorded image to determine the lighting model data comprises direct computation.

11. The method of claim 1 wherein the optical display comprises an illuminant;

wherein illumination of the body portion by the lighting environment is between about 2% and 10% of the illumination provided by the illuminant; and wherein processing the recorded image to determine the lighting model data comprises performing image filtering.

12. The method of claim 1 wherein the optical display comprises an illuminant;

wherein illumination of the body portion by the lighting environment is between about 10% and 25% of the illumination provided by the illuminant; and wherein processing the recorded image to determine the lighting model data comprises performing a statistical estimate of bilateral symmetry.

13. The method of claim 1 wherein the optical display comprises an illuminant;

wherein illumination of the body portion by the lighting environment is between about 25% and 40% of the illumination provided by the illuminant; and wherein processing the recorded image to determine the lighting model data comprises employing a machine learning technique.

14. The method of claim 1 wherein the optical display comprises an illuminant;

and wherein when it is determined that the lighting environment associated with the sensor is not acceptable for recording the representation of the body portion, the method further comprises:

instructing the user to modify the lighting environment so that the illumination of the body portion is less than about 2% of the illumination provided by the illuminant;

illuminating the body portion with constant white light using the illuminant; and

determining whether the illuminated body portion is positioned relative to the sensor to allow for recording of the image of the body portion by displaying on the optical display an outline of the body portion of the user to position the body portion within view of the sensor;

wherein processing the recorded image to determine the lighting model data comprises direct computation.

15. A system comprising:

one or more processors and non-transitory memory;

machine-readable instructions stored in the memory that, upon execution by the one or more processors, cause the system to carry out operations comprising:

displaying an image of a body portion of a user on an optical display of a device employed by the user, wherein the device comprises an image sensor and the image of the body portion of the user is sensed by the sensor;

determining whether a position of the body portion image relative to the sensor is acceptable to allow for recording of the image of the body portion;

determining whether a lighting environment associated with the sensor is acceptable to allow for recording of the image of the body portion;

recording the image using the sensor to provide a recorded image having image data;

processing the recorded image to determine lighting model data associated with the lighting environment; and

determining reflectance and color characteristics associated with the body portion of the user based on the recorded image and the lighting model data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: ARSENEAU, SHAWN
To: SHISEIDO AMERICAS CORPORATION
Reel/Frame 058506/0178 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2021
From: SHISEIDO AMERICAS CORPORATION
To: SHISEIDO COMPANY, LIMITED
Reel/Frame 058600/0443 →
Continuity (5)
Continuation PCTIB2020000271 · Apr 3, 2020
Provisional Application 62951970 · Dec 20, 2019
Provisional Application 62859676 · Jun 10, 2019
Provisional Application 62831667 · Apr 9, 2019
Related Publication 20220026276A1 · Jan 27, 2022
Cited By (1)
US 12,499,506