IP Library › Granted Patent US 10,922,533
Granted Patent B2
US 10,922,533 · App. 16/146,947 · Granted Feb 16, 2021

Method for face-to-unlock, authentication device, and non-volatile storage medium

Inventor: Keqing Chen (Beijing, CN)
Assignees: BEIJING KUANGSHI TECHNOLOGY CO., LTD.; MEGVII (BEIJING) TECHNOLOGY CO., LTD.
G06K9/00315G06F21/32G06K9/00281G06K9/00288
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,922,533
App. No.
16/146,947
Granted
Feb 16, 2021
Kind
B2
Abstract

The disclosure provides method for face-to-unlock, authentication device, and non-volatile storage medium. The method for face-to-unlock includes: obtaining to-be-verified expression data of a to-be-verified expression of a to-be-verified object; comparing the to-be-verified expression data with pre-stored expression data to obtain a comparison result; and in the case where the comparison result indicates that the to-be-verified expression data matches the pre-stored expression data, releasing the lock.

Claims (51)

1. A method for face-to-unlock, comprising:

obtaining to-be-verified expression data of a to-be-verified expression of a to-be-verified object;

comparing the to-be-verified expression data with pre-stored expression data to obtain a comparison result; and

in the case where the comparison result indicates that the to-be-verified expression data matches the pre-stored expression data, releasing the lock,

wherein the to-be-verified expression data and the pre-stored expression data include a three-dimensional point coordinate sequence of a plurality of landmarks on a face.

2. The method for face-to-unlock according to claim 1 ,

wherein obtaining to-be-verified expression data of a to-be-verified expression of a to-be-verified object comprises:

instructing a to-be-verified object to make a to-be-verified expression;

acquiring a facial image that includes the to-be-verified expression of the to-be-verified object;

obtaining, from the facial image, a three-dimensional point coordinate sequence of a plurality of landmarks on the face of the to-be-verified object at the time of making the to-be-verified expression; and

storing the three-dimensional point coordinate sequence.

3. The method for face-to-unlock according to claim 2 , wherein comparing the to-be-verified expression data with pre-stored expression data to obtain a comparison result comprises:

establishing an affine transformation model of the to-be-verified expression data and the pre-stored expression data;

obtaining, via the affine transformation model, a plurality of affine transformation points of a plurality of landmarks from the to-be-verified expression data; and

comparing the plurality of affine transformation points of the to-be-verified expression data with a plurality of pre-stored points of the pre-stored expression data to obtain the comparison result;

wherein the affine transformation model of the to-be-verified expression data and the pre-stored expression data is established by using an optimal affine transformation method.

4. The method for face-to-unlock according to claim 3 , wherein comparing the plurality of affine transformation points of the to-be-verified expression data with a plurality of pre-stored points of the pre-stored expression data to obtain the comparison result comprises:

determining a plurality of deviations between the plurality of affine transformation points and the plurality of pre-stored points corresponding thereto;

obtaining a total deviation between the plurality of affine transformation points and the plurality of pre-stored points corresponding thereto according to the plurality of deviations; and

in the case where the total deviation is less than a predetermined first threshold, the comparison result indicates that the to-be-verified expression data matches the pre-stored expression data.

5. The method for face-to-unlock according to claim 4 , wherein obtaining a total deviation between the plurality of affine transformation points and the plurality of pre-stored points corresponding thereto according to the plurality of deviations comprises:

obtaining deviation weights of the plurality of landmarks in the to-be-verified expression data, which deviation weights are endowed according to different regions which the plurality of landmarks are located on the face; and

weight-summing the plurality of deviations between the plurality of affine transformation points and the plurality of pre-stored points corresponding thereto according to the deviation weights, thereby obtaining the total deviation between the plurality of affine transformation points and the plurality of pre-stored points corresponding thereto.

6. The method for face-to-unlock according to claim 1 , wherein

obtaining to-be-verified expression data of a to-be-verified expression of a to-be-verified object comprises: obtaining a plurality of to-be-verified expression data of a plurality of to-be-verified expressions, wherein the plurality of to-be-verified expressions constitute at least one expression action, the plurality of to-be-verified expression data constitute to-be-verified expression action data;

comparing the to-be-verified expression data with pre-stored expression data to obtain a comparison result comprises: comparing the to-be-verified expression action data with pre-stored expression action data to obtain the comparison result;

in the case where the comparison result indicates that the to-be-verified expression action data matches the pre-stored expression action data, releasing the lock,

the to-be-verified expression action data and the pre-stored expression action data include a point coordinate matrix of a plurality of landmarks on a face that changes with time.

7. The method for face-to-unlock according to claim 6 , wherein in the case where the to-be-verified expression action of the to-be-verified object includes a plurality of to-be-verified expressions, the to-be-verified expression action data and the pre-stored expression action data are denoted by at least a two-dimensional point coordinate matrix of a plurality of landmarks on the face that changes with time.

8. The method for face-to-unlock according to claim 6 , wherein comparing the to-be-verified expression action data with pre-stored expression action data to obtain the comparison result comprises:

establishing an affine transformation model of the to-be-verified expression action data and the pre-stored expression action data according to a time relationship;

obtaining, via the affine transformation model, an affine transformation point matrix of a landmark coordinate matrix of the to-be-verified expression action data;

comparing the affine transformation point matrix with a pre-stored point matrix of the pre-stored expression action data to obtain the comparison result;

wherein the affine transformation model of the to-be-verified expression action data and the pre-stored expression action data is established by using an optimal affine transformation method according to a time relationship.

9. The method for face-to-unlock according to claim 8 , wherein comparing the affine transformation point matrix with a pre-stored point matrix of the pre-stored expression action data to obtain the comparison result comprises:

determining deviations of respective corresponding points between the affine transformation point matrix and the pre-stored point matrix; and

obtaining the comparison result according to the deviations of respective corresponding points between the affine transformation point matrix and the pre-stored point matrix.

10. The method for face-to-unlock according to claim 8 , wherein in the case where the to-be-verified expression action of the to-be-verified object includes a plurality of to-be-verified expressions, comparing the affine transformation point matrix with a pre-stored point matrix of the pre-stored expression action data to obtain the comparison result comprises:

determining deviations of respective corresponding points between at least the two-dimensional affine transformation point matrix and at least the two-dimensional pre-stored point matrix; and

obtaining the comparison result according to the deviations of respective corresponding points between at least the two-dimensional affine transformation point matrix and at least the two-dimensional pre-stored point matrix.

11. The method for face-to-unlock according to claim 9 , wherein obtaining the comparison result according to the deviations of respective corresponding points between the affine transformation point matrix and the pre-stored point matrix comprises:

determining second thresholds corresponding to the deviations of respective corresponding points; and

obtaining, based on the second thresholds corresponding to the deviations of respective corresponding points, a matching value of the to-be-verified expression action data and the pre-stored expression action data;

in the case where the matching value is greater than a third threshold, the comparison result indicates that the to-be-verified expression action data matches the pre-stored expression action data.

12. The method for face-to-unlock according to claim 11 , the second thresholds corresponding to the deviations of respective corresponding points are different;

wherein in the case where the to-be-verified expression action of the to-be-verified object includes at least two to-be-verified expressions, a plurality of second thresholds of a plurality of corresponding points that correspond to the at least one to-be-verified expression are made smaller than a fourth threshold.

13. The method for face-to-unlock according to claim 11 , wherein in the case where the to-be-verified expression action data of the to-be-verified object includes at least two to-be-verified expression actions, a plurality of second thresholds of a plurality of corresponding points that correspond to the at least one to-be-verified expression action are made smaller than a fourth threshold.

14. An authentication device, comprising:

a processor adapted to implement respective instructions; and

a memory adapted to store a plurality of instructions, the instructions being adapted to be loaded by the processor and execute the method for face-to-unlock according to claim 1 .

15. A computer-readable non-volatile storage medium storing computer program instructions for performing the method for face-to-unlock according to claim 1 , when the computer executes the program instructions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2018
From: CHEN, KEQING
To: BEIJING KUANGSHI TECHNOLOGY CO., LTD.; MEGVII (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 047083/0088 →
Priority Claims (1)
CN 2017 1 0993345 · Oct 23, 2017 · national
Continuity (1)
Related Publication 20190122034A1 · Apr 25, 2019