IP Library Granted Patent US 11,580,971
Granted Patent B2
US 11,580,971 · App. 16/840,716 · Granted Feb 14, 2023

Photo album management method, storage medium and electronic device

Inventor: Fengshuo Hu (Beijing, CN)
Assignee: BOE TECHNOLOGY GROUP CO., LTD.
G10L15/22G06V40/165G06V40/169G06V40/172G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,580,971
App. No.
16/840,716
Granted
Feb 14, 2023
Kind
B2
Abstract

The present disclosure provides a photo album management method. The method includes obtaining voice search information from a user, performing intent recognition on the voice search information to obtain an intent recognition result which indicates an intent of the user for a photo album, obtaining a voiceprint feature from the voice search information to determine identity information of the user, sending the intent recognition result and the identity information of the user, and opening the photo album according to the intent recognition result and the identity information.

Claims (50)

1. A photo album management method applied to a client, wherein the method comprises:

obtaining voice search information from a user, and performing intent recognition on the voice search information to obtain an intent recognition result which indicates an intent of the user for a photo album;

obtaining a voiceprint feature from the voice search information to determine identity information of the user; and

sending the intent recognition result and the identity information of the user, and opening the photo album according to the intent recognition result and the identity information,

wherein, before obtaining voice search information from the user, the method further comprises:

obtaining voice information of one or more users whose voice information is to be uploaded, and extracting a voiceprint feature of the voice information;

obtaining at least one image and identity information of the one or more users whose voice information is to be uploaded, and associating the extracted voiceprint feature, the at least one image, and the identity information; and

uploading the associated voiceprint feature, the at least one image, and the identity information.

2. The photo album management method according to claim 1 , wherein, after opening the photo album according to the intent recognition result and the identity information, the method further comprises:

receiving a target album image which is determined according to the intent recognition result; and

displaying the target album image to the user.

3. The photo album management method according to claim 2 , wherein the target album image comprises an album image having a target face attribute.

4. The photo album management method according to claim 1 , wherein performing intent recognition on the voice search information to obtain an intent recognition result, comprises:

performing voice recognition processing on the voice search information to obtain text search information corresponding to the voice search information; and

performing natural language understanding processing on the text search information to obtain the intent recognition result.

5. The photo album management method according to claim 1 , wherein obtaining a voiceprint feature from the voice search information to determine identity information of the user, comprises:

calculating voiceprint similarity information between the voiceprint feature obtained from the voice search information and at least one of voiceprint features of the one or more users; and

if voiceprint similarity information between the voiceprint feature obtained from the voice search information and one of voiceprint features of the one or more users is greater than a first threshold, determining the one of voiceprint features as a target voiceprint feature, obtaining target identity information associated with the target voiceprint feature, and determining the target identity information as the identity information of the user who outputs the voice search information.

6. A photo album management method applied to a server, wherein the method comprises:

receiving an intent recognition result and identity information of a user who outputs voice search information, and determining a target user whose photos are to be viewed according to the intent recognition result and the identity information;

performing face recognition on a photo album using a face recognition algorithm to obtain a target album image of the target user; and

sending the target album image to a client which displays the target album image,

wherein, before receiving the intent recognition result and the identity information of the user who outputs the voice search information, the method further comprises:

receiving identity information, voiceprint features, and at least one image which are respectively associated to one or more users and are uploaded by a client; and

storing the received identity information, voiceprint feature, and at least one image.

7. The photo album management method according to claim 6 , wherein:

the intent recognition result comprises a face attribute intent result which indicates what face attribute is desired; and

the method further comprises:

performing face attribute detection on the target album image to obtain a target album image with a target attribute that satisfies the face attribute intent result; and

sending the target album image with the target attribute to the client so that the client displays the target album image with the target attribute before the user who outputs voice search information.

8. The photo album management method according to claim 7 , wherein performing face attribute detection on the target album image to obtain a target album image with a target attribute that satisfies the face attribute intent result comprises:

performing the face attribute detection on the target album image to obtain target face attribute information that satisfies the face attribute intent result according to preset face attribute information; and

determining a target album image comprising the target face attribute information as the target album image with the target attribute.

9. The photo album management method according to claim 6 , wherein storing the identity information, voiceprint feature, and at least one image comprises:

determining the received identity information as preset identity information associated with the one or more users and storing the identity information;

determining the voiceprint features respectively associated with the one or more users as preset voiceprint features and storing the voiceprint features; and

determining the at least one image respectively associated with the one or more users as at least one preset image and storing the at least one image.

10. The photo album management method according to claim 9 , wherein determining the at least one image respectively associated with the one or more family members as at least one preset image and storing the image comprises:

performing face attribute detection on the at least one preset image to obtain preset face attribute information; and

associating the preset face attribute information with the at least one preset image and storing the preset face attribute information and the at least one preset image.

11. The photo album management method according to claim 10 , wherein the preset face attribute information comprises: preset head attribute information, preset face age information, preset face score information, and preset facial emotion information.

12. The photo album management method according to claim 11 , further comprising:

receiving a subsequently uploaded image, and matching the subsequently uploaded image against the at least one preset image;

obtaining a matched preset image, and obtaining preset face attribute information, preset identity information and a preset voiceprint feature associated with the matched preset image; and

determining the preset face attribute information, the preset identity information and the preset voiceprint feature as the preset face attribute information, the preset identity information and the preset voiceprint feature associated with the subsequently uploaded image, and storing the preset face attribute information, the preset identity information and the preset voiceprint feature.

13. A non-transitory computer-readable storage medium having stored thereon a computer program, wherein, when the computer program is executed by at least one hardware processor, the photo album management method according to claim 1 is implemented.

14. An electronic device, comprising:

at least one hardware processor; and

a memory for storing program instructions executable by the at least one hardware processor;

wherein the at least one hardware processor is configured to execute the photo album management method according to claim 1 by executing the program instructions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2020
From: HU, FENGSHUO
To: BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 053454/0882 →
Priority Claims (1)
CN 201910816156.X · Aug 30, 2019 · national
Continuity (1)
Related Publication 20210065706A1 · Mar 4, 2021