IP Library › Granted Patent US 12,569,187
Granted Patent B2
US 12,569,187 · App. 17/931,107 · Granted Mar 10, 2026

Selecting skin care products based on skin condition scanning

Inventors: Prasad Tendulkar (Foster City, CA); Nelly Mensah (San Francisco, CA); Anna Teresa Nicholas (Hazelton, PA); Jillian Bertone (Lafayette, CA); Lisa Zhu (Belmont, CA); Jennifer Stokes (Seattle, WA); Witono Liujanto (San Ramon, CA); Aaron Oelckers (Pleasant Hill, CA); Marc McCotter (Hana, HI); Harsha Huddar (Livermore, CA); Fiona Kavanagh (San Francisco, CA); Amit Adiraju Narasimha (Santa Clara, CA); Naroju Janardhan (San Ramon, CA)
Assignee: Sephora USA, Inc.
A61B5/441A45D44/005A61B5/0064A61B5/442G06Q30/0621G06Q30/0631G06Q30/0633G06T7/0012G06T7/90G06V10/26G06V10/56G06V10/764G06V10/774G06V10/776G06V10/82G06V40/10A45D2044/007G06Q30/01G06Q30/0641G06T2200/24G06T2207/20081G06T2207/30088G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,569,187
App. No.
17/931,107
Granted
Mar 10, 2026
Kind
B2
Abstract

Skin condition scanning allows one to more easily find products that match the condition of their skin. Based on a skin condition scan, a person can view products appropriate for their skin condition such as skin type, oiliness or oil balance, fine lines or wrinkles, or hydration, of a combination. A scanning device is used to scan two or more locations of a person's skin. For example, three different locations of the face can be scanned, such as the forehead and cheek and near the eyes. The scan determines a skin condition result for the person's skin.

Claims (47)

1 . A method comprising:

providing a scanning device, wherein the scanning device comprises a smartphone and a sensor assembly, the smartphone comprises one or more camera lenses on a back side of the smartphone, the sensor assembly comprises a client side, a device side opposing the client side, and one or more lenses on the client side, the device side of the sensor assembly is attached to the back side of the smartphone so as to allow the one or more camera lenses and the one or more lenses, and the scanning device further comprises a scanner display on a front side of the smartphone, so that while the client side of the sensor assembly on which the one or more lenses are located is placed directly against a customer's skin of a customer, the scanner display remains visible on the front side, and the scanning device is configured to determine a final skin guide result;

after the client side being placed directly against the customer's skin at a first location, using the scanning device to perform a first scan to generate a first intermediate result reflective of the first location, wherein a final skin guide result for the customer is unavailable for display on the scanner display after the first scan and before a second scan has been performed;

after the client side being placed directly against the customer's skin at a second location, using the scanning device to perform the second scan to generate a second intermediate result reflective of the second location, wherein the first intermediate result and the second intermediate result are stored on the smartphone;

using the first and second intermediate results to determine the final skin guide result that is reflective of the first and the second locations; and

displaying the final skin guide result on the scanner display, wherein the final skin guide result comprises an indication of a skin type.

2 . The method of claim 1 wherein the, the final skin guide result further comprises a separate indication of one or more skin type characteristics leading to the indication of the skin type as well as one or more programmatically determined results that respectively correspond to the one or more skin type characteristics, and the skin type has a string or char data type, and the final skin guide result comprises an indication of a degree of oiliness of the customer's skin.

3 . The method of claim 1 wherein the final skin guide result comprises an indication of a pore size of the customer's skin.

4 . The method of claim 1 wherein the final skin guide result comprises an indication of a degree of lines or wrinkles on the customer's skin.

5 . The method of claim 1 wherein the final skin guide result comprises an indication of a degree of hydration of the customer's skin.

6 . The method of claim 1 , further comprising:

after being placed directly against the customer's skin at a third location, using the scanning device to perform a third scan to generate a third intermediate result reflective of the third location,

instead of the using only the first and second intermediate results to calculate the final skin guide result that is reflective of first and second locations, using the first, second, and third intermediate results to calculate the final skin guide result that is reflective of the first, the second, and the third locations.

7 . The method of claim 1 wherein the scanning device determines the final skin guide result based at least in part on three or more scans.

8 . The method of claim 1 , further comprising:

providing a server, accessible by the scanning device that comprises a customer database configured to store a plurality of customer skin guide results associated with a plurality of customer identifiers.

9 . The method of claim 8 comprising:

at the customer database, receiving from the scanning device a first skin guide result and a first customer identifier; and

updating the customer database to store the first skin guide result associated with the first customer identifier.

10 . The method of claim 9 wherein each of the plurality of customer identifiers comprises at least one e-mail address.

11 . The method of claim 10 wherein for the first customer identifier, from the server, sending to the at least one e-mail address corresponding to the first customer identifier the final skin guide result.

12 . The method of claim 1 wherein using the scanning device to perform the first scan comprises:

emitting a first light of a first wavelength and performing a first scan during the first scan while the customer's skin at the first location is exposed to the first light; and

emitting a second light of a second wavelength and performing a separate scan during the first scan while the customer's skin at the first location is exposed to the second light,

wherein the second wavelength is different from the first wavelength.

13 . The method of claim 12 wherein the first wavelength is an ultraviolet light.

14 . The method of claim 1 wherein the scanning device comprises the smartphone, the sensor assembly is positioned adjacent the one or more camera lenses of the smartphone, and the sensor assembly further comprises two or more light-emitting diodes and a lens aligned with the camera.

15 . The method or claim 1 , further comprising:

displaying, on the scanner display, a recommendation for one or more cosmetic products for improving a skin type characteristic for the indication of the skin type.

16 . The method or claim 1 , further comprising:

displaying, on the scanner display, the indication of the skin type, wherein the indication comprises a first indication of the skin type and a second indication of the skin type, the first indication of the skin type is determined based at least in part upon a result of the first scan and the second scan, and the second indication is displayed based at least in part upon an input by the customer.

17 . A computer program product comprising a non-transitory computer readable storage medium having stored thereupon a sequence of instructions which, when executed by a microprocessor, causes the microprocessor to execute a set of acts, the set of acts comprising:

providing a scanning device, wherein the scanning device comprises a smartphone and a sensor assembly, the smartphone comprises one or more camera lenses on a back side of the smartphone, the sensor assembly comprises a client side, a device side opposing the client side, and one or more lenses on the client side, the device side of the sensor assembly is attached to the back side of the smartphone so as to allow the one or more camera lenses and the one or more lenses, and the scanning device further comprises a scanner display on a front side of the smartphone, so that while the client side of the sensor assembly on which the one or more lenses are located is placed directly against a customer's skin of a customer, the scanner display remains visible on the front side, and the scanning device is configured to determine a final skin guide result;

after being placed directly against the customer's skin at a first location, using the scanning device to perform a first scan to generate a first intermediate result reflective of the first location, wherein the final skin guide result for the customer is unavailable for display on the scanner display after the first scan and before a second scan has been performed;

after being placed directly against the customer's skin at a second location, using the scanning device to perform the second scan to generate a second intermediate result reflective of the second location, wherein the first intermediate result and the second intermediate result are stored on the smartphone;

using the first and second intermediate results to determine the final skin guide result that is reflective of the first and the second locations; and

displaying the final skin guide result on the scanner display, wherein the final skin guide result comprises an indication of a skin type.

18 . A method comprising:

providing a scanning device comprising a smartphone, wherein the scanning device comprises a smartphone and a sensor assembly, the smartphone comprises one or more camera lenses on a back side of the smartphone, the sensor assembly comprises a client side, a device side opposing the client side, and one or more lenses on the client side, the device side of the sensor assembly is attached to the back side of the smartphone so as to allow the one or more camera lens of the smartphone and the one or more lenses of the sensory assembly, and the scanning device further comprises a scanner display on a front side of the smartphone, so that while the client side of the sensor assembly on which the one or more sensors are located is directed at a customer's skin of a customer, the display remains visible on the first side, and the scanning device is configured to determine a final skin condition result;

while the one or more sensors of the sensor assembly and the one or more camera lens of the smartphone are pointed toward the customer's skin at a first location, using the at least one camera lens of the smartphone and at least one lens of the sensor assembly to perform a first scan to generate a first intermediate result reflective of the first location, wherein a final skin condition result for the customer is unavailable for display on the display after the first scan and before a second scan has been performed;

while the at least one camera lens and the at least one lens are pointed toward the customer's skin at a second location, using the at least one camera lens of the smartphone and the at least one lens of the sensor assembly to perform the second scan to generate a second intermediate result reflective of the second location, wherein the first intermediate result and the second intermediate result are stored on the smartphone;

using the first and second intermediate results to determine the final skin condition result that is reflective of the first and second locations; and

displaying the final skin condition result on the scanner display, wherein the final skin condition result comprises at least one of an indication of a skin type, a degree of oiliness or oil balance of the customer's skin, a pore size of the customer's skin, a degree of lines or wrinkles on the customer's skin, or a degree of hydration of the customer's skin, or any combination thereof.

19 . The method of claim 18 wherein the first scan comprises a magnified view of the customer's skin at the first location.

20 . The method of claim 18 wherein the final skin condition result does not comprise an indication of a skin tone or skin color of the customer.

21 . The method of claim 18 wherein the light-emitting diodes comprise a first light-emitting diode that emits light of a first wavelength, a second light-emitting diode that emits light of a second wavelength, and the first wavelength is different from the second wavelength.

22 . The method or claim 21 wherein the first wavelength comprises ultraviolet light.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2025
From: TENDULKAR, PRASAD; MENSAH, NELLY; BERTONE, JILLIAN; ZHU, LISA; STOKES, JENNIFER; LIUJANTO, WITONO; OELCKERS, AARON; MCCOTTER, MARC; HUDDAR, HARSHA; KAVANAGH, FIONA; NARASIMHA, AMIT ADIRAJU; JANARDHAN, NAROJU; NICHOLAS, ANNA TERESA
To: SEPHORA USA, INC.
Reel/Frame 072468/0703 →
Continuity (2)
Provisional Application 63261060 · Sep 9, 2021
Related Publication 20230177586A1 · Jun 8, 2023
References Cited (88)
US 4648718A · Sadamitsu et al. · 1987 [cited by applicant]
US 4989079A · Ito · 1991 [cited by applicant]
US 5483339A · Van Aken et al. · 1996 [cited by applicant]
US 6297420B1 · Heincke · 2001 [cited by applicant]
US 6437866B1 · Flynn · 2002 [cited by applicant]
US 6522977B2 · Corrigan et al. · 2003 [cited by applicant]
US 6603550B1 · Flynn et al. · 2003 [cited by applicant]
US 7180524B1 · Axelrod · 2007 [cited by applicant]
US 7738032B2 · Kollias et al. · 2010 [cited by applicant]
US 8182091B2 · Foster · 2012 [cited by applicant]
US 8564778B1 · Igarashi · 2013 [cited by applicant]
US 9019296B1 · Abraham · 2015 [cited by applicant]
US 9064279B1 · Tuan et al. · 2015 [cited by applicant]
US 9519927B1 · Tuan et al. · 2016 [cited by applicant]
US 10045820B2 · Youngquist · 2018 [cited by examiner]
US 10387937B1 · Tuan · 2019 [cited by examiner]
US 20020036778A1 · Wagner et al. · 2002 [cited by applicant]
US 20020059248A1 · Farchione · 2002 [cited by applicant]
US 20020062263A1 · Katou · 2002 [cited by applicant]
US 20020065452A1 · Bazin et al. · 2002 [cited by applicant]
US 20030058261A1 · Challa et al. · 2003 [cited by applicant]
US 20030065578A1 · Peyrelevade et al. · 2003 [cited by applicant]
US 20030065636A1 · Peyrelevade · 2003 [cited by applicant]
US 20030149504A1 · Iwaki et al. · 2003 [cited by applicant]
US 20030151611A1 · Turpin et al. · 2003 [cited by applicant]
US 20030235544A1 · Kishida et al. · 2003 [cited by applicant]
US 20040010333A1 · Baker · 2004 [cited by applicant]
US 20050146531A1 · Rice et al. · 2005 [cited by applicant]
US 20060022994A1 · Hussie · 2006 [cited by applicant]
US 20060066629A1 · Norlander et al. · 2006 [cited by applicant]
US 20060095297A1 · Virik · 2006 [cited by applicant]
US 20060178904A1 · Aghassian et al. · 2006 [cited by applicant]
US 20060179045A1 · Grinsfelder et al. · 2006 [cited by applicant]
US 20060253176A1 · Caruso · 2006 [cited by applicant]
US 20060278589A1 · Peponis · 2006 [cited by applicant]
US 20060289374A1 · Alderman · 2006 [cited by applicant]
US 20070058858A1 · Harville · 2007 [cited by applicant]
US 20070058860A1 · Harville et al. · 2007 [cited by applicant]
US 20070071314A1 · Bhatti et al. · 2007 [cited by applicant]
US 20080003547A1 · Woolfe et al. · 2008 [cited by applicant]
US 20080046410A1 · Lieb · 2008 [cited by applicant]
US 20080079843A1 · Pote et al. · 2008 [cited by applicant]
US 20080194928A1 · Bandic et al. · 2008 [cited by applicant]
US 20080281728A1 · Gomez · 2008 [cited by applicant]
US 20080311061A1 · Heuer · 2008 [cited by applicant]
US 20100020095A1 · Reynolds et al. · 2010 [cited by applicant]
US 20100183528A1 · Maloney et al. · 2010 [cited by applicant]
US 20100185064A1 · Bandic et al. · 2010 [cited by applicant]
US 20100322878A1 · Stella et al. · 2010 [cited by applicant]
US 20110093361A1 · Morales · 2011 [cited by applicant]
US 20110106650A1 · Stone · 2011 [cited by applicant]
US 20110184837A1 · Biro · 2011 [cited by applicant]
US 20110246284A1 · Chaikin et al. · 2011 [cited by applicant]
US 20120045121A1 · Youngman et al. · 2012 [cited by applicant]
US 20120096380A1 · Wagner · 2012 [cited by applicant]
US 20120123759A1 · Cho et al. · 2012 [cited by applicant]
US 20120203668A1 · Howard et al. · 2012 [cited by applicant]
US 20120253224A1 · Mir et al. · 2012 [cited by applicant]
US 20120269743A1 · Smith et al. · 2012 [cited by applicant]
US 20130092805A1 · Funk et al. · 2013 [cited by applicant]
US 20130100008A1 · Marti · 2013 [cited by examiner]
US 20130117137A1 · Klein et al. · 2013 [cited by applicant]
US 20130177137A1 · Eichhorn et al. · 2013 [cited by applicant]
US 20130250322A1 · Kawabata et al. · 2013 [cited by applicant]
US 20130300761A1 · Ahmed · 2013 [cited by applicant]
US 20140323873A1 · Cummins et al. · 2014 [cited by applicant]
US 20150356661A1 · Rousay · 2015 [cited by applicant]
US 20180360709A1 · Rabe · 2018 [cited by applicant]
US 20190038211A1 · Rattner · 2019 [cited by applicant]
US 20190125249A1 · Rattner et al. · 2019 [cited by applicant]
US 20190318505A1 · LaSalle et al. · 2019 [cited by applicant]
US 20200056943A1 · Douglas-Sydnor · 2020 [cited by applicant]
US 20200226657A1 · Ji et al. · 2020 [cited by applicant]
US 20220138972A1 · Rattner et al. · 2022 [cited by applicant]
US 20220192506A1 · Lightsey · 2022 [cited by examiner]
WO 2012065037A1 · 2012 [cited by applicant]
WO 2015126988A1 · 2015 [cited by applicant]
WO 2017181293A1 · 2017 [cited by applicant]
Marianna Naturals Corp. Innovates Personalized Online Shopping Experience Through Strategic New Partnership with Perfect Corp's YouCam Technology. GlobeNewswire Sep. 9, 2020: NA. (Year: 2020). [cited by examiner]
How Sephora is leveraging AR and AI to transform retail and help customers buy cosmetics. ADN Rayome. TechRepublic, Feb. 2018 (Year: 2018). [cited by examiner]
Alexander, Antoinette, “Virtual Mirror Kiosks Make Beauty Shopping ‘EZ’,” 2009, Drug Store News, Feb. 9, 2009; vol. 31, No. 2, 66 pages. [cited by applicant]
Weisstein, Eric W., “Subset,” MATHWORLD, retrieved from http://mathworld.wolfram.com/Subset.html, dated May 16, 2013, retrieved from the Internet Archive on Jul. 12, 2015, 1 page. [cited by applicant]
Hastie, Trevor, et al., “The Elements of Statistical Learning Data Mining, Inference, and Prediction,” Springer Series in Statistics, 2nd ed., Chapters 14.3-14.6 and 16, Jan. 13, 2017, retrieved from https://hastie.su.d… [cited by applicant]
Goodfellow, Ian, et al., “Deep Learning,” MIT Press book, 2016, Part I, Chapters 7 and 10, Part III, Chapters 14 and 20, retrieved from https://www.deeplearningbook.org/ 196 pages. [cited by applicant]
PCT International Search Report and the Written Opinion of the International Searching Authority for International Application PCT/US2022/043155 dated Mar. 26, 2023, 14 pgs. [cited by applicant]
Molnar, Christoph, “Interpretable Machine Learning—A Guide for Making Black Box Models Explainable,” Aug. 26, 2021, Chapters 4.1 and 5, retrieved from https://web.archive.org/web/20210828033303/https://christophm.github… [cited by applicant]
How Sephora is leveraging AR and Al to transform retail and help customers buy cosmetics. ADN Rayome. TechRepublic, Feb. 2018 (Year: 2018). [cited by applicant]
Chanel's new app helps you “try on” the perfect lipstick shade. Whitbread, Louise. The Independent (Online) London: Independent Digital News & Media. (Feb. 22, 2021) (Year: 2021). [cited by applicant]