IP Library › Granted Patent US 11,423,696
Granted Patent B2
US 11,423,696 · App. 17/007,938 · Granted Aug 23, 2022

Method for recognizing face using intelligent electronic device

Inventor: Sungil Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G06V40/171G06N3/04G06V40/165G06V40/172G06V40/178H04L9/3231
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,696
App. No.
17/007,938
Granted
Aug 23, 2022
Kind
B2
Abstract

According to an embodiment, a method for recognizing a user's face using an intelligent electronic device comprises obtaining a face area from the user's face captured and obtaining face information from the face area, comparing the obtained face information with a default cluster, selecting whether to extract a face vector from the face information according to a result of the comparison, determining an age variation state for the user's face based on the extracted face vector, and upon determining that the face vector is in the age variation state for the user's face, extracting a face feature vector from the face vector and configuring an expanded cluster by adding the face feature vector to the default cluster. According to the disclosure, the intelligent electronic device may be related to artificial intelligence (AI) modules, unmanned aerial vehicles (UAVs), robots, augmented reality (AR) devices, virtual reality (VR) devices, and 5G service-related devices.

Claims (57)

1. A method for recognizing a user's face using an intelligent electronic device, the method comprising:

obtaining a face area from the user's face captured and obtaining face information from the face area;

obtaining a face feature based on the face information;

comparing the obtained face feature with a default cluster;

selecting whether to extract a face vector from the face feature based on a result of the comparison;

determining an age variation state for the user's face based on the extracted face vector; and

upon determining that the face vector is in the age variation state for the user's face, extracting a face feature vector from the face vector and configuring an expanded cluster by adding the face feature vector to the default cluster,

wherein the determining the age variation state includes:

extracting feature values from the face vector;

inputting the feature values to an artificial neural network (ANN) classifier to identify the age variation state; and

determining the age variation state from the artificial neural network, and

wherein the feature values are values by which the age variation state is identified.

2. The method of claim 1 , wherein the face information includes position information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, ratio information for an interval of the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, and shape information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear.

3. The method of claim 1 , wherein the default cluster is configured based on the face feature extracted from position information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, ratio information for an interval of the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, and shape information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear.

4. The method of claim 1 , wherein comparing the obtained face information with the default cluster includes:

recognizing or terminating the user's face when the face information is within the default cluster; and

extracting the face vector from the face information when the face information is out of the default cluster.

5. The method of claim 1 , further comprising:

configuring the expanded cluster includes generating a face image for interpolation based on the face feature vector.

6. The method of claim 1 , wherein configuring the expanded cluster includes generating a mid cluster by predicting the age variation state for the user's face based on the default cluster and the expanded cluster.

7. The method of claim 1 , further comprising receiving, from a network, downlink control information (DCI) used for scheduling transmission of the obtained face information, and

wherein the face information is transmitted to the network based on the DCI.

8. The method of claim 7 , further comprising performing an initial access procedure with the network based on a synchronization signal block (SSB),

wherein the face information is transmitted to the network via a physical uplink shared channel (PUSCH), and

wherein demodulation-reference signals (DM-RSs) of the SSB and the PUSCH are quasi co-located (QCL) for QCL type D.

9. The method of claim 7 , further comprising:

controlling a transceiver to transmit the face information to an artificial intelligence (AI) processor included in the network; and

controlling the transceiver to receive AI-processed information from the AI processor,

wherein the AI-processed information includes information resultant from determining the age variation state.

10. An intelligent electronic device, comprising:

a camera; and

a processor receiving a user's face captured by the camera,

wherein the processor:

obtains a face area from the user's face, obtains face information from the face area, obtain a face feature based on the face information, compares the obtained face feature with a preconfigured default cluster, and selects whether to extract a face vector from the face feature based on a result of the comparison; and

determines an age variation state for the user's face based on the extracted face vector and, upon determining that the face vector is in the age variation state for the user's face, and configures an expanded cluster by adding a face feature vector to the default cluster,

wherein the determining of the age variation state by the processor includes:

extracting feature values from the face vector;

inputting the feature values to an artificial neural network (ANN) classifier to identify the age variation state; and

determining the age variation state from the artificial neural network, and

wherein the feature values are values by which the age variation state is identified.

11. The intelligent electronic device of claim 10 , wherein the face information includes position information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, ratio information for an interval of the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, and shape information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear.

12. The intelligent electronic device of claim 10 , wherein the default cluster is configured based on the face feature extracted from position information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, ratio information for an interval of the user's eye, nose, mouth, eyebrow, forehead, chin, and ear, and shape information for the user's eye, nose, mouth, eyebrow, forehead, chin, and ear.

13. The intelligent electronic device of claim 10 , wherein the processor:

recognizes or terminates the user's face when the face information is within the default cluster; and

extracts the face vector from the face information when the face information is out of the default cluster.

14. The intelligent electronic device of claim 10 , wherein the processor generates a face image for interpolation based on the face feature vector.

15. The intelligent electronic device of claim 10 , wherein the processor generates a mid cluster by predicting the age variation state for the user's face based on the default cluster and the expanded cluster.

16. The intelligent electronic device of claim 10 , further comprising a transceiver,

wherein the processor receives, from a network via the transceiver, downlink control information (DCI) used for scheduling transmission of the obtained face information, and

wherein the face information is transmitted to the network via the transceiver based on the DCI.

17. The intelligent electronic device of claim 16 , wherein the processor performs an initial access procedure with the network based on a synchronization signal block (SSB) via the transceiver,

wherein the face information is transmitted to the network via a physical uplink shared channel (PUSCH), and

wherein demodulation-reference signals (DM-RSs) of the SSB and the PUSCH are quasi co-located (QCL) for QCL type D.

18. The intelligent electronic device of claim 16 , wherein the processor:

controls the transceiver to transmit the face information to an artificial intelligence (AI) processor included in the network; and

controls the transceiver to receive AI-processed information from the AI processor, and

wherein the AI-processed information includes information resultant from determining the age variation state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2020
From: KIM, SUNGIL
To: LG ELECTRONICS INC.
Reel/Frame 053661/0792 →
Priority Claims (1)
KR 10-2019-0169548 · Dec 18, 2019 · national
Continuity (1)
Related Publication 20210192186A1 · Jun 24, 2021