IP Library Granted Patent US 9,977,951
Granted Patent B2
US 9,977,951 · App. 15/255,468 · Granted May 22, 2018

Picture ranking method, and terminal

Inventors: Zhuolin Jiang (Shenzhen, CN); Qiang Yang (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
G06K9/00288G06F17/30247G06K9/00268G06K9/00677G06K9/66G06N99/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,977,951
App. No.
15/255,468
Granted
May 22, 2018
Kind
B2
Abstract

Embodiments of the present disclosure disclose a picture ranking method and a terminal. The picture ranking method comprises acquiring pictures stored in a terminal, detecting whether the pictures are first-type pictures, where the first-type picture refers to a picture including a human face, and when the pictures are first-type pictures, ranking the pictures according to a social relation model, or when the pictures are not first-type pictures, ranking the pictures according to a preset rule.

Claims (68)

1. A picture ranking method, comprising:

acquiring, by a processor in a terminal, stored pictures from a memory in the terminal;

detecting, from the stored pictures, first-type pictures, second-type pictures, or both the first-type pictures and the second-type pictures, wherein the first-type pictures refer to pictures that comprise at least one human face, and wherein the second-type pictures refer to pictures that do not comprise a human face;

ranking the first pictures according to identity features of the first contacts when the first-type pictures are detected and information about first contacts corresponding to at least some first pictures of the first-type pictures is acquired, wherein the identity features are acquired using a social relation model, wherein the identity features indicate social relation categories selected for the first contacts, and wherein the social relation categories selected for the first contacts identify different types of social relations between the first contacts and a user of the terminal; and

ranking the second-type pictures according to a first preset rule when the second-type pictures are detected.

2. The method according to claim 1 , wherein, when the first-type pictures are detected and information about second contacts corresponding to at least some second pictures of the first-type pictures is not acquired, the method further comprises:

cluster grouping the second pictures to generate one or more cluster groups of the second pictures based on similarities of human faces in the second pictures; and

ranking the cluster groups according to a second preset rule that is different than the first preset rule.

3. The method according to claim 1 , wherein the first preset rule includes time points or locations associated with the second-type pictures.

4. The method according to claim 1 , wherein before ranking the first pictures according to the identity features, the method further comprises:

acquiring interaction statistics between each of the first contacts and the user;

selecting, based on the interaction statistics, the social relation categories for the first contacts from a plurality of categories that includes a friend category, a relative category, a classmate category, and a customer category; and

training the social relation model using stored profile pictures of the first contacts and the social relation categories selected for the first contacts.

5. The method according to claim 4 , wherein training the social relation model using the stored profile pictures of the first contacts and the social relation categories selected for the first contacts comprises:

extracting profile picture data of the first contacts; and

annotating the profile picture data using the social relation categories selected for the first contacts to obtain the social relation model.

6. The method according to claim 1 , wherein ranking the first pictures according to the identity features further comprises:

acquiring, using the social relation model, information about the first contacts corresponding to the first pictures, wherein the information about the first contacts corresponding to the first pictures comprises the identity features selected for the first contacts;

adding the first pictures to a recognized face group when the information about the first contacts corresponding to the first pictures is successfully acquired; and

ranking the first pictures in the recognized face group according to the identity features.

7. The method according to claim 2 , wherein ranking the cluster groups according to the second preset rule comprises:

adding the second pictures to an unrecognized face group; and

performing clustering ranking on the second pictures in the unrecognized face group according to the second preset rule.

8. The method according to claim 1 , wherein before detecting the first-type pictures, the second-type pictures, or both the first-type pictures and the second-type pictures, the method further comprises:

extracting a feature value of a stored human face image;

learning the feature value of the stored human face image using a machine learning method; and

establishing a facial recognition model.

9. The picture ranking method according to claim 8 , wherein detecting the first-type pictures comprises:

extracting feature values of the stored pictures;

performing a matching between the feature values of the stored pictures and the facial recognition model; and

determining that the first-type pictures are the first-type pictures when a result of the matching is higher than a first preset value.

10. The picture ranking method according to claim 8 , wherein detecting the second-type pictures comprises:

extracting feature values of the stored pictures;

performing a matching between the feature values of the stored pictures and the facial recognition model; and

determining that the second-type pictures are not the first-type pictures when a result of the matching is not higher than a first preset value.

11. A terminal, comprising:

a memory configured to store stored pictures;

a processor coupled to the memory and configured to:

acquire the stored pictures from the memory;

detect, from the stored pictures, first-type pictures, second-type pictures, or both the first-type pictures and the second-type pictures, wherein the first-type pictures refer to pictures that comprise at least one human face, and wherein the second-type pictures refer to pictures that do not comprise a human face;

rank the first pictures according to identity features of the first contacts when the first-type pictures are detected and information about first contacts corresponding to at least some first pictures of the first-type pictures is acquired, wherein the identity features are acquired using a social relation model, wherein the identity features indicate social relation categories selected for the first contacts, and wherein the social relation categories selected for the first contacts identify different types of social relations between the first contacts and a user of the terminal; and

rank the second-type pictures according to a first preset rule when the second-type pictures are detected.

12. The terminal according to claim 11 , wherein the processor is further configured to train the social relation model using stored profile pictures of the first contacts and the social relation categories selected for the first contacts.

13. The terminal according to claim 11 , wherein the processor is further configured to:

extract profile picture data of the first contacts; and

annotate the profile picture data using the social relation categories selected for the first contacts to obtain the social relation model.

14. The terminal according to claim 11 , wherein the processor is further configured to:

acquire, using the social relation model, information about the first contacts corresponding to the first pictures, wherein the information about the first contacts corresponding to the first pictures comprises the identity features of the first contacts;

add the first pictures to a recognized face group, and

rank the first pictures in the recognized face group according to the identity features when the information about the first contacts corresponding to the first pictures is successfully acquired.

15. The terminal according to claim 11 , wherein, when the first-type pictures are detected and information about second contacts corresponding to at least some second pictures of the first-type pictures is not acquired, the processor is further configured to:

add the second pictures to an unrecognized face group; and

perform clustering ranking on the second pictures in the unrecognized face group according to a second preset rule that is different than the first preset rule.

16. The terminal according to claim 11 , wherein the processor is further configured to:

extract a feature value of a stored human face image;

learn the feature value of the stored human face image using a machine learning method;

establish a facial recognition model; and

detect whether the stored pictures are the first-type pictures according to the facial recognition model.

17. The terminal according to claim 16 , wherein the processor is further configured to:

extract feature values of the stored pictures;

perform a matching between the feature values of the stored pictures and the facial recognition model; and

determine that the first-type pictures are the first-type pictures when a result of the matching is higher than a first preset value.

18. The terminal according to claim 16 , wherein the processor is further configured to:

extract feature values of the stored pictures;

perform a matching between the feature values of the stored pictures and the facial recognition model; and

determine that the second-type pictures are not the first-type pictures when a result of the matching is not higher than a first preset value.

19. The method according to claim 2 , wherein ranking the cluster groups according to the second preset rule includes ranking the cluster groups based on a quantity of pictures in each of the cluster groups, wherein the social relation model includes nodes for the user and the first contacts, wherein the social relation model further comprises connection lines between the user and the first contacts, and wherein each of the connection lines is indicative of a social relation category selected for a contact of the first contacts corresponding to the connection line.

20. The method according to claim 4 , wherein the interaction statistics for each of the first contacts includes a quantity of contact times between the contact and the user, a time point of one or more communications between the contact and the user, and content of one or more short message service messages between the contact and the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2016
From: JIANG, ZHUOLIN; YANG, QIANG
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 039621/0761 →
Priority Claims (1)
CN 2014 1 0090640 · Mar 12, 2014 · national
Continuity (2)
Continuation PCTCN2014089469 · Oct 24, 2014
Related Publication 20160371541A1 · Dec 22, 2016