IP Library › Granted Patent US 10,013,600
Granted Patent B2
US 10,013,600 · App. 15/195,537 · Granted Jul 3, 2018

Digital image processing method and apparatus, and storage medium

Inventors: Zhijun Chen (Beijing, CN); Tao Zhang (Beijing, CN); Pingze Wang (Beijing, CN)
Assignee: Xiaomi Inc.
G06K9/00288G06F17/30256G06F17/30268G06K9/00295G06K9/00677G06K9/6267G06T11/60G06K2009/00328G06K2209/27G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,013,600
App. No.
15/195,537
Granted
Jul 3, 2018
Kind
B2
Abstract

The present disclosure is related to a digital image processing method and apparatus for generating a description of contents depicted in a digital image based on at least one or more of identity information of a person depicted in the digital image and digital image information.

Claims (68)

1. A method for generating a description based on content identified from a digital image by a mobile communication device, comprising:

identifying a face depicted in a digital image corresponding to a user;

determining identity information of a person corresponding to the identified face, the identity information comprising at least one of a name of the person and a relationship between the person and the user;

acquiring digital image information of the digital image, the digital image information comprising at least one of a digital image capturing time and a digital image capturing location; and

identifying an object in the digital image;

acquiring a name of the object identified in the digital image; and

generating a description of the digital image according to the identity information, the digital image information, and at least one of the name of the object, a weather information acquired for a day the digital image was captured, or a news event acquired for the digital image capturing time and the digital image capturing location.

2. The method of claim 1 , wherein determining the identity information corresponding to the identified face comprises:

acquiring a personal information database through a communication network shared with the mobile communication device, the personal information database including correspondence relationships between facial recognition information and personal identities;

comparing the identified face with the facial recognition information in the personal information database to identify facial recognition information in the personal information database which matches the identified face; and

acquiring the identity information corresponding to the facial recognition information in the personal information database which matches the identified face.

3. The method of claim 1 , wherein determining the identity information corresponding to the identified face comprises:

acquiring contact information corresponding to the user, the contact information including head portrait digital images and personal identities of contacts corresponding to the user;

comparing the identified face with the head portrait digital images of the contacts to identify a head portrait digital image of a contact which includes a face that matches the recognized face; and

acquiring a personal identity corresponding to the head portrait digital image of the contact which includes the face that matches the recognized face.

4. The method of claim 1 , wherein generating the description of the digital image according to the identity information and the digital image information comprises:

generating the description of the digital image according to the identity information, the digital image information, and the name of the object.

5. The method of claim 1 , further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

6. The method of claim 2 , further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

7. The method of claim 3 , further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

8. The method of claim 4 , further comprising:

grouping digital images of the user; and

generating a description of each group of digital images according to a description of each digital image in the group of digital images.

9. The method of claim 5 , wherein grouping the digital images of the user comprises:

grouping the digital images according to at least one of the following factors: digital image capturing times of the digital images, digital image capturing locations of the digital images and faces in the digital images.

10. The method of claim 9 , further comprising:

displaying the group of digital images and the description of each group of digital images upon reception of a browsing command input by the user.

11. The method of claim 10 , wherein displaying the grouping and the description of each group of digital images comprises:

displaying the digital images in each group of digital images and the descriptions of the digital images in a slideshow manner.

12. A digital image processing apparatus, comprising:

a processor; and

a memory configured to store instructions executable by the processor,

wherein the processor is configured to execute the instructions to:

identify a face depicted in a digital image corresponding to a user;

determine identity information of a person corresponding to the identified face, the identity information comprising at least one of a name of the person and a relationship between the person and the user;

acquire digital image information of the digital image, the digital image information comprising at least one of a digital image capturing time and a digital image capturing location;

identify an object in the digital image;

acquire a name of the object identified in the digital image;

generate a description of the digital image according to the identity information, the digital image information, and at least one of the name of the object, a weather information acquired for a day the digital image was captured, or a news event acquired for the digital image capturing time and the digital image capturing location.

13. The apparatus of claim 12 , wherein the processor is further configured to execute the instructions to:

acquire a personal information database through a communication network shared with the apparatus, the personal information database including correspondence relationships between facial recognition information and personal identities;

compare the identified face with the facial recognition information in the personal information database to identify facial recognition information in the personal information database which matches the identified face; and

acquire the identity information corresponding to the facial recognition information in the personal information database which matches the identified face.

14. The apparatus of claim 12 , wherein the processor is further configured to execute the instructions to:

acquire contact information corresponding to the user, the contact information including head portrait digital images and personal identities of contacts corresponding to the user;

compare the identified face with the head portrait digital images of the contacts to identify a head portrait digital image of a contact which includes a face that matches the recognized face; and

acquire a personal identity corresponding to the head portrait digital image of the contact which includes the face that matches the recognized face.

15. The apparatus of claim 12 , wherein the processor is further configured to execute the instructions to:

generate the description of the digital image according to the identity information, the digital image information, and the name of the object.

16. The apparatus of claim 12 , wherein the processor is further configured to execute the instructions to:

group digital images of the user; and

generate a description of each group of digital images according to a description of each digital image in the group of digital images.

17. The apparatus of claim 16 , wherein the processor is further configured to execute the instructions to: group the digital images according to at least one of the following factors: digital image capturing times of the digital images, digital image capturing locations of the digital images and faces in the digital images.

18. The apparatus of claim 17 , wherein the processor is further configured to execute the instructions to: display the group of digital images and the description of each group of digital images upon reception of a browsing command input by the user.

19. The apparatus of claim 18 , wherein the processor is further configured to: display the digital images in each group of digital images and the descriptions of the digital images in a slideshow manner.

20. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of a mobile device, cause a mobile communication device to:

identify a face depicted in a digital image corresponding to a user;

determine identity information of a person corresponding to the identified face, the identity information comprising at least one of a name of the person and a relationship between the person and the user;

acquire digital image information of the digital image, the digital image information comprising at least one of a digital image capturing time and a digital image capturing location;

identify an object in the digital image;

acquire a name of the object identified in the digital image;

generate a description of the digital image according to the identity information, the digital image information, and at least one of the name of the object, a weather information acquired for a day the digital image was captured, or a news event acquired for the digital image capturing time and the digital image capturing location.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2016
From: CHEN, ZHIJUN; ZHANG, TAO; WANG, PINGZE
To: XIAOMI INC.
Reel/Frame 039032/0646 →
Priority Claims (1)
CN 2015 1 0813140 · Nov 20, 2015 · national
Continuity (1)
Related Publication 20170147869A1 · May 25, 2017
Cited By (1)
US 12,190,636