IP Library › Granted Patent US 11,182,589
Granted Patent B2
US 11,182,589 · App. 16/655,235 · Granted Nov 23, 2021

Methods and apparatuses for determining face image quality, electronic devices, and computer storage media

Inventors: Lifei Xu (Shenzhen, CN); Chendi Yu (Shenzhen, CN); Wenzhi Liu (Shenzhen, CN)
Assignee: SHENZHEN SENSETIME TECHNOLOGY CO., LTD.
G06K9/00228G06T7/62G06T7/70G06T11/20G06T2207/30201G06T2207/30244G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,182,589
App. No.
16/655,235
Granted
Nov 23, 2021
Kind
B2
Abstract

A methods for determining face image quality includes: obtaining pose angle information and/or size information of a face in an image; and obtaining quality information of the face in the image on the basis of the pose angle information and/or the size information of the face.

Claims (79)

1. A method for determining face image quality, comprising:

obtaining at least one of pose angle information of a face in an image or size information of the face; and

obtaining quality information of the face in the image on the basis of at least one of the pose angle information of the face or the size information of the face,

wherein the obtaining the pose angle information of the face in the image comprises:

obtaining a face detection bounding box in the image and key point coordinates of the face determined according to the face detection bounding box; and

obtaining, according to the key point coordinates of the face, the pose angle information of the face, the pose angle information of the face comprising a yaw angle of the face and a pitch angle of the face;

wherein the method further comprises:

obtaining a confidence score of the key point coordinates of the face, the confidence score of the key point coordinates being used for indicating accuracy of the key point coordinates of the face;

after obtaining the score of the pose angle of the face, the method further comprises:

correcting the score of the pose angle of the face by using the confidence score of the key point coordinates; and

the obtaining, according to the score of the pose angle of the face and the score of the face size, a quality score of the face in the image comprises:

obtaining, according to the corrected score of the pose angle of the face and the score of the face size, the quality score of the face in the image.

2. The method according to claim 1 , wherein the obtaining a face detection bounding box in the image and key point coordinates of the face determined according to the face detection bounding box comprises:

performing face detection on the image;

obtaining the face detection bounding box; and

performing key point positioning on the face in the face detection bounding box;

obtaining the key point coordinates of the face.

3. The method according to claim 1 , wherein the obtaining the size information of the face comprises:

obtaining, according to a size of the face detection bounding box, the size information of the face, the size of the face detection bounding box comprising at least one of length of the face detection bounding box or width of the face detection bounding box.

4. The method according to claim 1 , wherein the obtaining quality information of the face in the image on the basis of at least one of the pose angle information of the face or the size information of the face comprises:

obtaining, according to the pose angle information of the face, a score of a pose angle of the face;

obtaining, according to the size information of the face, a score of a face size; and

obtaining, according to the score of the pose angle of the face and the score of the face size, a quality score of the face in the image.

5. The method according to claim 4 , wherein the obtaining a score of a pose angle of the face according to the pose angle information of the face comprises:

obtaining, according to the yaw angle and pitch angle of the face, a score Q yaw of the yaw angle yaw of the face and a score Q pitch of the pitch angle (“pitch”) of the face by calculation.

6. The method according to claim 4 , wherein the obtaining, according to the size information of the face, a score of a face size comprises:

obtaining the score of the face size on the basis of at least one of length, width, or area of the face detection bounding box, the area of the face detection bounding box being obtained by a product of the length and width of face detection bounding box.

7. The method according to claim 6 , wherein the obtaining the score of the face size on the basis of at least one of length, width, or area of the face detection bounding box comprises:

selecting a smaller value min in the length and width of the face detection bounding box; and

obtaining, according to the smaller value min, the score Q rect of the face size by calculation.

8. The method according to claim 4 , wherein the obtaining, according to the score of the pose angle of the face and the score of the face size, a quality score of the face in the image comprises:

obtaining, according to a score of the yaw angle and a weight of the score of the yaw angle, a score of the pitch angle and a weight of the score of the pitch angle, and the score of the face size and a weight of the score of the face size, the quality score of the face in the image by calculation.

9. The method according to claim 8 , wherein the weight of the score of the yaw angle is greater than the weight of the score of the pitch angle and the weight of the score of the face size.

10. The method according to claim 1 , wherein the correcting the score of the pose angle of the face by using the confidence score of the key point coordinates comprises:

determining a correction parameter a for the score Q yaw of the yaw angle (“yaw”) of the face and the score Q pitch of the pitch angle (“pitch”) of the face by using the confidence score of the key point coordinates, and

respectively calculating product of the correction parameter a and the Q yaw as well as product of the correction parameter a and the Q pitch , the product of the correction parameter a and the Q yaw being used as a corrected score of the yaw angle and the product of the correction parameter a and the Q pitch being used as a corrected score of the pitch angle;

wherein in the case that the confidence score of the key point coordinates is smaller than a predetermined value, a value of the a is a first value, in the case that the confidence score of the key point coordinates is greater than or equal to the predetermined value, the value of the a is a second value, and the first value is smaller than the second value.

11. The method according to claim 1 , wherein the obtaining at least one of pose angle information of a face in an image or size information of the face and obtaining quality information of the face in the image on the basis of at least one of the pose angle information of the face or the size information of the face comprises:

obtaining at least one of: pose angle information of a face in at least one image in multiple images or size information of the face; and

obtaining quality information of the face in the at least one image in multiple images on the basis of at least one of the pose angle information of the face or the size information of the face;

the method further comprises: selecting, according to the quality information of the face in the at least one image in multiple images, at least one image with high face quality for face detection.

12. An electronic device, comprising:

a processor; and

a memory for storing instructions executable by the processor;

wherein execution of the instructions by the processor causes the processor to perform:

obtaining at least one of pose angle information of a face in an image or size information of the face; and

obtaining quality information of the face in the image on the basis of at least one of the pose angle information of the face or the size information of the face,

wherein the obtaining the pose angle information of the face in the image comprises:

obtaining a face detection bounding box in the image and key point coordinates of the face determined according to the face detection bounding box; and

obtaining, according to the key point coordinates of the face, the pose angle information of the face, the pose angle information of the face comprising a yaw angle of the face and a pitch angle of the face;

wherein execution of the instructions by the processor further causes the processor to perform:

obtaining a confidence score of key point coordinates of the face, the confidence score of the key point coordinates being used for indicating accuracy of the key point coordinates of the face;

after obtaining the score of the pose angle of the face, the processor is further caused to perform:

correcting the score of the pose angle of the face by using the confidence score of the key point coordinates; and

the obtaining, according to the score of the pose angle of the face and the score of the face size, a quality score of the face in the image comprises:

obtaining, according to the corrected score of the pose angle of the face and the score of the face size, the quality score of the face in the image.

13. The electronic device according to claim 12 ,

wherein the obtaining the size information of the face comprises:

obtaining, according to a size of the face detection bounding box, the size information of the face, the size of the face detection bounding box comprising at least one of length of the face detection bounding box or width of the face detection bounding box.

14. The electronic device according to claim 13 , wherein the obtaining quality information of the face in the image on the basis of at least one of the pose angle information of the face or the size information of the face comprises:

obtaining, according to the pose angle information of the face, a score of a pose angle of the face;

obtaining, according to the size information of the face, a score of a face size; and

obtaining, according to the score of the pose angle of the face and the score of the face size, a quality score of the face in the image.

15. The electronic device according to claim 14 , wherein the obtaining, according to the size information of the face, a score of a face size comprises:

obtaining the score of the face size on the basis of at least one of length, width, or area of the face detection bounding box, the area of the face detection bounding box being obtained by a product of the length and width of face detection bounding box.

16. The electronic device according to claim 14 , wherein the obtaining, according to the score of the pose angle of the face and the score of the face size, a quality score of the face in the image comprises:

obtaining, according to a score of the yaw angle and a weight of the score of the yaw angle, a score of the pitch angle and a weight of the score of the pitch angle, and the score of the face size and a weight of the score of the face size, the quality score of the face in the image by calculation, wherein the weight of the score of the yaw angle is greater than the weight of the score of the pitch angle and the weight of the score of the face size.

17. A non-transitory computer storage medium, configured to store computer-readable instructions, wherein execution of the instructions by the processor causes the processor to perform:

obtaining at least one of pose angle information of a face in an image or size information of the face; and

obtaining quality information of the face in the image on the basis of at least one of the pose angle information of the face or the size information of the face,

wherein the obtaining the pose angle information of the face in the image comprises:

obtaining a face detection bounding box in the image and key point coordinates of the face determined according to the face detection bounding box; and

obtaining, according to the key point coordinates of the face, the pose angle information of the face, the pose angle information of the face comprising a yaw angle of the face and a pitch angle of the face;

wherein execution of the instructions by the processor further causes the processor to perform:

obtaining a confidence score of key point coordinates of the face, the confidence score of the key point coordinates being used for indicating accuracy of the key point coordinates of the face;

after obtaining the score of the pose angle of the face, the processor is further caused to perform:

correcting the score of the pose angle of the face by using the confidence score of the key point coordinates; and

the obtaining, according to the score of the pose angle of the face and the score of the face size, a quality score of the face in the image comprises:

obtaining, according to the corrected score of the pose angle of the face and the score of the face size, the quality score of the face in the image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2019
From: XU, LIFEI; YU, CHENDI; LIU, WENZHI
To: SHENZHEN SENSETIME TECHNOLOGY CO., LTD.
Reel/Frame 051327/0377 →
Priority Claims (1)
CN 201710405232.9 · May 31, 2017 · national
Continuity (2)
Continuation PCTCN2018087915 · May 22, 2018
Related Publication 20200050835A1 · Feb 13, 2020
Cited By (1)
US 12,711,776