IP Library › Granted Patent US 10,282,597
Granted Patent B2
US 10,282,597 · App. 15/359,192 · Granted May 7, 2019

Image classification method and device

Inventors: Tao Zhang (Beijing, CN); Fei Long (Beijing, CN); Zhijun Chen (Beijing, CN)
Assignee: XIAOMI INC.
G06K9/00288G06K9/00228G06K9/6222
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,282,597
App. No.
15/359,192
Filed
Nov 22, 2016
Granted
May 7, 2019
Kind
B2
Art Unit
2662
USPC
382/118
Abstract

The present disclosure relates to an image classification and clustering method and device. Two images containing human faces may be classified into one cluster or different clusters based on a cluster merging threshold adaptively determined according to the combinational face poses in the two images. The adaptive cluster merging threshold help reduce false positive and false negative classification of human face containing images into clusters.

Claims (62)

1. An image classification method, comprising:

acquiring two images including a first image depicting a first face and a second image depicting a second face;

calculating a similarity between the first face and the second face;

determining the calculated similarity is greater than a preset similarity threshold value;

determining a first face pose information for the first image, the first face pose information including a first orientation value of the first face;

determining a second face pose information for the second image, the second face pose information including a second orientation value of the second face, wherein both the first face pose information and the second face pose information are selected from a pre-established face pose classification mode;

determining, based on the first face pose information and the second face pose information, an angular face relationship between the first face and the second face;

determining an adaptive target cluster merging threshold value based on the angular face relationship; and

clustering the first image and the second image into a same, or different, cluster according to the determined adaptive target cluster merging threshold value.

2. The method of claim 1 , wherein determining the adaptive target cluster merging threshold value comprises:

acquiring a preset cluster merging threshold value;

determining the angular face relationship indicates that the first image and the second image both contain side-view face poses; and

increasing the preset cluster merging threshold value and using the increased preset cluster merging threshold value as the adaptive target cluster merging threshold value.

3. The method of claim 1 , wherein determining the adaptive target cluster merging threshold value comprises:

acquiring a preset cluster merging threshold value;

determining the angular face relationship indicates that the first image and the second image contain face poses of different angles; and

decreasing the preset cluster merging threshold value and using the decreased preset cluster merging threshold value as the adaptive target cluster merging threshold value.

4. The method of claim 1 , wherein determining the adaptive target cluster merging threshold value comprises:

acquiring a preset cluster merging threshold value;

determining the angular face relationship indicates that the first image and the second image both contain front view face poses; and

using the preset cluster merging threshold value as the adaptive target cluster merging threshold value.

5. The method of claim 1 , wherein clustering the first image and the second image comprises:

calculating a cluster merging value;

determining the calculated cluster merging value is greater than the adaptive target cluster merging threshold value; and

determining that the first image and the second image belong to a same cluster.

6. A terminal, comprising:

a processor; and

a memory in communication to the processor for storing instructions executable by the processor;

wherein the processor is configured to:

acquire two images including a first image depicting a first face and a second image depicting a second face;

calculate a similarity between the first face and the second face;

determine the calculated similarity is greater than a preset similarity threshold value;

determine a first face pose information for the first image, the first face pose information including a first orientation value of the first face;

determine a second face pose information for the second image, the second face pose information including a second orientation value of the second face, wherein both the first face pose information and the second face pose information are selected from a pre-established face pose classification mode;

determine, based on the first face pose information and the second face pose information, an angular face relationship between the first face and the second face;

determine an adaptive target cluster merging threshold value based on the angular face relationship; and

cluster the first image and the second image into a same, or different, cluster according to the determined adaptive target cluster merging threshold value.

7. The terminal of claim 6 , wherein, to determine the adaptive target cluster merging threshold value, the processor is further configured to:

acquire a preset cluster merging threshold value;

determine the angular face relationship indicates that the first image and the second image both contain side view face poses; and

increase the preset cluster merging threshold value according and use the increased preset cluster merging threshold value as the adaptive target cluster merging threshold value.

8. The terminal of claim 6 , wherein, to determining the adaptive target cluster merging threshold value, the processor is further configured to:

acquire a preset cluster merging threshold value;

determine the angular face relationship indicates that the first image and the second image contain face poses of different angles; and

decrease the preset cluster merging threshold value and use the decreased preset cluster merging threshold value as the adaptive target cluster merging threshold value.

9. The terminal of claim 6 , wherein, to determining the adaptive target cluster merging threshold value, the processor is further configured to:

acquire a preset cluster merging threshold value;

determine the angular face relationship indicates that the first image and the second image both contain front view face poses; and

use the preset cluster merging threshold value as the adaptive target cluster merging threshold value.

10. The terminal of claim 6 , wherein, to cluster the first image and the second image, the processor is further configured to:

calculate a cluster merging value;

determine the calculated cluster merging value is greater than the adaptive target cluster merging threshold value; and

determine the first image and the second image belong to a same cluster.

11. A non-transitory computer readable storage medium comprising instructions, wherein the instructions, when executed by a processor in a terminal device, cause the terminal device to:

acquire two images including a first image depicting a first face and a second image depicting a second face;

calculate a similarity between the first face and the second face;

determine the calculated similarity is greater than a preset similarity threshold value:

determine a first face pose information for the first image, the first face pose information including a first orientation value of the first face;

determine a second face pose information for the second image, the second face pose information including a second orientation value of the second face, wherein both the first face pose information and the second face pose information are selected from a pre-established face pose classification mode;

determine, based on the first face pose information and the second face pose information, an angular face relationship between the first face and the second face;

determine a adaptive target cluster merging threshold value based on the angular face relationship; and

cluster the first image and the second image into a same, or different, cluster according to the determined adaptive target cluster merging threshold value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: ZHANG, TAO; LONG, FEI; CHEN, ZHIJUN
To: XIAOMI INC.
Reel/Frame 040404/0853 →
Priority Claims (1)
CN 2015 1 0846109 · Nov 27, 2015 · national
Continuity (1)
Related Publication 20170154208A1 · Jun 1, 2017