IP Library › Granted Patent US 12,282,986
Granted Patent B2
US 12,282,986 · App. 16/982,956 · Granted Apr 22, 2025

Mobile terminal and cosmetics automatic recognition system

Inventors: Hae Young Hwang (Seoul, KR); Bok Hyun Pack (Seoul, KR)
Assignee: LG HOUSEHOLD & HEALTH CARE LTD.
G06T11/60G06F3/14G06K7/10366G06K19/0723G06Q30/0631H04M1/72403G06F3/0482G06T2200/24H04M2242/28H04M2242/30H04M2250/04H04M2250/10H04M2250/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,986
App. No.
16/982,956
Granted
Apr 22, 2025
Kind
B2
Abstract

The present invention relates to a mobile terminal and a cosmetics automatic recognition system capable of recognizing cosmetics located nearby and recommending a make-up method using the recognized cosmetics. The present invention may comprise a mobile terminal including: an RFID reader unit configured to recognize cosmetics through an RFID tag attached to a cosmetic and receive cosmetic information from the recognized RFID tag and from cosmetics having an RFID tag which stores cosmetic information attached thereto; a control unit configured to generate a cosmetics list consisting of at least one cosmetic recognized by the RFID reader unit; and a display unit configured to display the cosmetics list.

Claims (66)

1. A mobile terminal comprising:

an input unit configured to receive a makeup recommendation command;

a display unit configured to display a makeup recommendation result according to the makeup recommendation command, and a makeup simulation image according to the makeup recommendation result; and

a control unit configured to:

display a cosmetic change guide to change at least one of cosmetics included in the makeup recommendation result to a cosmetic recognized by receiving cosmetic information from a radio-frequency identification (RFID) tag of the cosmetic as existing within a set recognition range,

receive a cosmetic change command for the makeup recommendation result, and

change the makeup simulation image based on a change of the makeup recommendation result,

wherein the cosmetic information received from the RFID tag includes a recognition date at which the cosmetic is recognized and at least two of a name, an image, a category, a manufacturer, one or more properties, a manufacture date or an expiration date of the cosmetic calculated based on the recognition date of the cosmetic,

wherein the control unit is further configured to:

display the makeup recommendation result and the makeup simulation image using the received cosmetic information, which includes possessed cosmetic information and non-possessed cosmetic information, and

wherein the non-possessed cosmetic information includes purchase information or sales information of each cosmetic.

2. The mobile terminal of claim 1 , wherein the control unit is further configured to:

display the makeup simulation image by combining a facial image and a background image, and

acquire differently the background image according to user information or environment information.

3. The mobile terminal of claim 2 , wherein the control unit is further configured to acquire the background image considering at least one or more of a place, brightness, or an illumination color based on at least one or more of a place of a schedule included in the user information, a time period of the schedule included in the user information, or weather information included in the environment information.

4. The mobile terminal of claim 2 , wherein, when a schedule at a first place is registered in the user information, the control unit is further configured to acquire an image of the first place as the background image.

5. The mobile terminal of claim 2 , wherein, when a schedule in a first time period is registered in the user information, the control unit is further configured to acquire an image having brightness corresponding to the first time period as the background image.

6. The mobile terminal of claim 2 , wherein, when weather information is received as part of the environment information, the control unit is further configured to acquire an image according to the weather information as the background image.

7. The mobile terminal of claim 1 , further comprising:

a camera configured to photograph a face of a user,

wherein the control unit is further configured to acquire a facial image by applying makeup according to the makeup recommendation result to the face photographed by the camera.

8. The mobile terminal of claim 1 , wherein the control unit controls the display unit to display an icon to change a type of makeup in a state that the makeup simulation image is displayed.

9. The mobile terminal of claim 8 , further comprising:

a short-distance communication module configured to recognize the cosmetic through short-distance communication, and receive the cosmetic information of the recognized cosmetic,

wherein the control unit is further configured to control the display unit to display the makeup recommendation result based on the recognized cosmetic recognized via the short-distance communication module.

10. The mobile terminal of claim 8 , wherein the control unit is further configured to receive a cosmetic change command to change a type of the at least one cosmetics or the makeup order included in the makeup recommendation result.

11. The mobile terminal of claim 1 , wherein, when displaying the cosmetic change guide, the control unit is further configured to suggest purchase of new cosmetics.

12. The mobile terminal of claim 1 , wherein, when a selected makeup type is super simple makeup, the control unit is further configured to display a makeup method that uses less than a preset number of the at least one cosmetics as the makeup recommendation result.

13. The mobile terminal of claim 1 , wherein, when a selected makeup type is makeup that specifies a time period, the control unit is further configured to display a makeup method in consideration of the specified time period as the makeup recommendation result.

14. The mobile terminal of claim 13 , wherein the control unit is further configured to display a makeup method in consideration of user information or environment information related to the specified time period as the makeup recommendation result.

15. The mobile terminal of claim 1 , wherein the cosmetic is recognized as existing by an identification tag attached to the cosmetic.

16. The mobile terminal of claim 1 , wherein the control unit is further configured to display a period imminent icon for the cosmetic for which a remaining usage period of the cosmetic is less than a preset period based on the manufacture date.

17. The mobile terminal of claim 1 , wherein the control unit is further configured to display a no-use suggestion icon for restricting use of the cosmetic based on the expiration date of the cosmetic.

18. A cosmetics automatic recognition system comprising:

a server;

a radio-frequency identification (RFID) reader unit configured to recognize a cosmetic by receiving cosmetic information from the RFID tags of the cosmetic; and

a mobile terminal configured to receive information from the server,

wherein the mobile terminal comprises:

an input unit configured to receive a makeup recommendation command;

a display unit configured to display a makeup recommendation result according to the makeup recommendation command, and a makeup simulation image according to the makeup recommendation result; and

a control unit configured to:

display a cosmetic change guide to change at least one of cosmetics included in the makeup recommendation result to the cosmetic recognized by receiving the cosmetic information from the RFID tag of the cosmetic as existing within a set recognition range,

receive a cosmetic change command for the makeup recommendation result, and

change the makeup simulation image based on a change of the makeup recommendation result,

wherein the cosmetic information received from the RFID tag includes a recognition date at which the cosmetic is recognized and at least two of a name, an image, a category, a manufacturer, one or more properties, a manufacture date or an expiration date of the cosmetic calculated based on the recognition date of the cosmetic,

wherein the control unit is further configured to:

display the makeup recommendation result and the makeup simulation image using the received cosmetic information, which includes possessed cosmetic information and non-possessed cosmetic information, and

wherein the non-possessed cosmetic information includes purchase information or sales information of each cosmetic.

19. The cosmetics automatic recognition system of claim 18 ,

wherein the mobile terminal further comprises a short-distance communication module, and

wherein the display unit is further configured to:

display the makeup recommendation result based on at least one cosmetic recognized via the short-distance communication module, and

display the makeup simulation image by calculating a makeup application result according to the makeup recommendation result.

20. The cosmetics automatic recognition system of claim 18 , wherein the cosmetic is recognized as existing by an identification tag attached to the cosmetic.

21. A non-transitory computer readable recording medium having stored thereon computer readable instructions, which when executed, cause at least one processor to execute, a makeup recommending method comprising:

receiving a makeup recommendation command;

displaying a makeup recommendation result according to the makeup recommendation command; and

displaying a makeup simulation image according to the makeup recommendation result,

wherein the makeup recommending method further comprises:

displaying a cosmetic change guide to change at least one of cosmetics included in the makeup recommendation result to a cosmetic recognized by receiving cosmetic information from a radio-frequency identification (RFID) tag of the cosmetic as existing within a set recognition range,

receiving a cosmetic change command for the makeup recommendation result, and

changing the makeup simulation image based on a change of the makeup recommendation result,

wherein the cosmetic information received from the RFID tag includes a recognition date at which the cosmetic is recognized and at least two of a name, an image, a category, a manufacturer, one or more properties, a manufacture date or an expiration date of the cosmetic calculated based on the recognition date of the cosmetic,

wherein the makeup recommendation result and the makeup simulation image are displayed using the received cosmetic information, the received cosmetic information including possessed cosmetic information and non-possessed cosmetic information, and

wherein the non-possessed cosmetic information includes purchase information or sales information of each cosmetic.

22. The non-transitory computer readable recording medium of claim 21 , wherein the cosmetic is recognized as existing by an identification tag attached to the cosmetic.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2020
From: HWANG, HAE YOUNG; PACK, BOK HYUN
To: LG HOUSEHOLD & HEALTH CARE LTD.
Reel/Frame 053844/0194 →
Priority Claims (1)
KR 10-2018-0047286 · Apr 24, 2018 · national
Continuity (1)
Related Publication 20210019926A1 · Jan 21, 2021
References Cited (56)
US 9603437B2 · Nguyen et al. · 2017 [cited by applicant]
US 9984281B2 · Tomita et al. · 2018 [cited by applicant]
US 10373348B2 · Sugaya · 2019 [cited by applicant]
US 10623633B2 · Tanaka · 2020 [cited by applicant]
US 20080215625A1 · Veitch · 2008 [cited by examiner]
US 20120217254A1 · Cho · 2012 [cited by examiner]
US 20120223956A1 · Saito et al. · 2012 [cited by applicant]
US 20160000209A1 · Yamanashi et al. · 2016 [cited by applicant]
US 20160055566A1 · Otani · 2016 [cited by examiner]
US 20160128450A1 · Saito et al. · 2016 [cited by applicant]
US 20160292901A1 · Li · 2016 [cited by examiner]
US 20160357578A1 · Kim · 2016 [cited by examiner]
US 20170178220A1 · Chong et al. · 2017 [cited by applicant]
US 20170219279A1 · Chae · 2017 [cited by examiner]
US 20170256040A1 · Grauer · 2017 [cited by examiner]
US 20190122015A1 · Huang · 2019 [cited by examiner]
US 20190197736A1 · Sugaya · 2019 [cited by examiner]
US 20190295151A1 · Ghadar · 2019 [cited by examiner]
CN 101779218A · 2010 [cited by applicant]
CN 202028378U · 2011 [cited by applicant]
CN 104380339A · 2015 [cited by applicant]
CN 105138648A · 2015 [cited by applicant]
CN 105210110A · 2015 [cited by applicant]
CN 106108523A · 2016 [cited by applicant]
CN 106575446A · 2017 [cited by applicant]
CN 107111861A · 2017 [cited by applicant]
CN 107273837A · 2017 [cited by applicant]
CN 107431757A · 2017 [cited by applicant]
JP 200292132A · 2002 [cited by applicant]
JP 2004326532A · 2004 [cited by applicant]
JP 200648393A · 2006 [cited by applicant]
JP 2006244118A · 2006 [cited by applicant]
JP 2007213623A · 2007 [cited by applicant]
JP 2010199756A · 2010 [cited by applicant]
JP 2012181688A · 2012 [cited by applicant]
JP 2014166218A · 2014 [cited by applicant]
JP 2014191813A · 2014 [cited by applicant]
JP 2017211998A · 2017 [cited by applicant]
KR 1020070076164A · 2007 [cited by applicant]
KR 1020070092650A · 2007 [cited by applicant]
KR 1020090005641A · 2009 [cited by applicant]
KR 1020110127396A · 2011 [cited by applicant]
KR 2020120005631U · 2012 [cited by applicant]
KR 1020140061604A · 2014 [cited by applicant]
KR 1020150093930A · 2015 [cited by applicant]
KR 101632542B1 · 2016 [cited by applicant]
KR 1020160142742A · 2016 [cited by applicant]
KR 1020170030446A · 2017 [cited by applicant]
KR 101741409B1 · 2017 [cited by applicant]
WO WO2018008138A1 · 2018 [cited by applicant]
WO WO2018012136A1 · 2018 [cited by applicant]
WO WO2018012222A1 · 2018 [cited by applicant]
WO WO2018025402A1 · 2018 [cited by applicant]
International Search Report (PCT/ISA/210) issued in PCT/KR2019/002990, dated Jun. 25, 2019. [cited by applicant]
Hideki Konta et al., “A study of RFID field testing Intended for cosmetic,” 2006 IEICE Communications Society Conference, Kanazawa University, Kanazawa, Sep. 19-22, 2006, pp. 2-5 (4 pages), with English translation. [cited by applicant]
“Realistic makeup system based on 3D facial avatar,” ETRI, [online], 2014, URL: <https://itec.etri.re.kr/itec/sub02/sub02_01.do>, 24 pages total, with an English translation. [cited by applicant]