IP Library Granted Patent US 10,853,660
Granted Patent B2
US 10,853,660 · App. 16/509,289 · Granted Dec 1, 2020

Method and apparatus for retrieving similar video and storage medium

Inventors: Yuanyuan Zhang (Shenzhen, CN); Qun Yu (Shenzhen, CN); Fei Zhan (Shenzhen, CN); Xiao Hua (Shenzhen, CN); Wengsan Cheong (Shenzhen, CN); Lei Xiong (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G06K9/00744G06F16/5846G06F16/5866G06K9/00758G06K9/6256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,853,660
App. No.
16/509,289
Granted
Dec 1, 2020
Kind
B2
Abstract

Embodiments of this application disclose a method for retrieving similar videos performed at a computing device. The computing device obtains video information of a video for which similar videos are to be retrieved, the video information including a video tag and a video title, and trains the video information by using a preset text depth representation model, to convert the video information into a word vector. After selecting, from a video library according to a preset knowledge graph, videos matching the video information, to obtain a first candidate video set, the computing device screens, in the video library, videos similar to the video information according to the word vector, to obtain a second candidate video set and then determines a similar video for the video information from the first candidate video set and the second candidate video set.

Claims (83)

1. A method for retrieving similar videos performed at a computing device having one or more processors and memory storing a plurality of programs to be executed by the one or more processors, the method comprising:

obtaining video information of a video for which similar videos are to be retrieved, the video information comprising a video tag and a video title;

selecting, from a video library according to a preset knowledge graph, videos matching the video information, to obtain a first candidate video set;

training the video information by using a preset text depth representation model, to convert the video information into a word vector;

screening, in the video library, videos similar to the video information according to the word vector, to obtain a second candidate video set; and

determining a similar video for the video information from the first candidate video set and the second candidate video set.

2. The method according to claim 1 , wherein the determining a similar video for the video information from the first candidate video set and the second candidate video set comprises:

scoring each video in the first candidate video set, to obtain a first score value;

scoring each video in the second candidate video set, to obtain a second score value;

respectively calculating weighted values of the first score value and the corresponding second score value, to obtain a comprehensive score value of each video; and

determining a video whose comprehensive score value is greater than a preset score value as the similar video for the video information.

3. The method according to claim 1 , wherein the training the video information by using a preset text depth representation model, to convert the video information into a word vector comprises:

performing word segmentation on the video tag and the video title, to obtain video text after word segmentation; and

training the video text after word segmentation by using the preset text depth representation model, to obtain a word vector of the video text after word segmentation; and

the screening, in the video library, videos similar to the video information according to the word vector, to obtain a second candidate video set further comprises:

screening, in the video library, the videos similar to the video information according to the word vector of the video text after word segmentation, to obtain the second candidate video set.

4. The method according to claim 3 , wherein the screening, in the video library, the videos similar to the video information according to the word vector of the video text after word segmentation, to obtain the second candidate video set comprises:

calculating similarity between the video information and each video in the video library according to the word vector of the video text after word segmentation; and

selecting videos whose similarity is higher than a preset threshold, to obtain the second candidate video set.

5. The method according to claim 3 , further comprising:

before training the video text after word segmentation by using the preset text depth representation model:

obtaining a preset corpus set and performing word segmentation on a sentence in the corpus set; and

learning a preset original model according to a sentence after word segmentation, to obtain the text depth representation model.

6. The method according to claim 1 , wherein the selecting, from a video library according to a preset knowledge graph, videos matching the video information, to obtain a first candidate video set comprises:

extracting an entity word from the video tag and the video title, to obtain a seed; and

selecting, from the video library according to the preset knowledge graph, videos matching the seed, to obtain the first candidate video set.

7. The method according to claim 6 , wherein the selecting, from the video library according to the preset knowledge graph, videos matching the seed, to obtain the first candidate video set comprises:

selecting an entity word having a strong association relationship with the seed according to the preset knowledge graph as a candidate word; and

selecting, from the video library, videos whose video information comprises the candidate word, to obtain the first candidate video set.

8. The method according to claim 7 , wherein the selecting an entity word having a strong association relationship with the seed according to the preset knowledge graph as a candidate word comprises:

mapping the seed onto entity words in a preset entity library, the entity library being established according to the preset knowledge graph;

determining relationship degrees between the seed and the entity words in the entity library; and

selecting an entity word whose relationship degree is less than or equal to a set value as the candidate word.

9. The method according to claim 8 , further comprising:

before mapping the seed onto entity words in a preset entity library,

setting a basic thesaurus;

obtaining Internet information according to the basic thesaurus and performing non-entity word cleaning on the Internet information; and

constructing a triple relationship between the entity words according to the basic thesaurus and cleaned Internet information, to obtain the preset entity library.

10. A computing device comprising one or more processors, memory coupled to the one or more processors and a plurality of programs stored in the memory that, when executed by the one or more processors, cause the computing device to perform a plurality of operations comprising:

obtaining video information of a video for which similar videos are to be retrieved, the video information comprising a video tag and a video title;

selecting, from a video library according to a preset knowledge graph, videos matching the video information, to obtain a first candidate video set;

training the video information by using a preset text depth representation model, to convert the video information into a word vector;

screening, in the video library, videos similar to the video information according to the word vector, to obtain a second candidate video set; and

determining a similar video for the video information from the first candidate video set and the second candidate video set.

11. The computing device according to claim 10 , wherein the determining a similar video for the video information from the first candidate video set and the second candidate video set comprises:

scoring each video in the first candidate video set, to obtain a first score value;

scoring each video in the second candidate video set, to obtain a second score value;

respectively calculating weighted values of the first score value and the corresponding second score value, to obtain a comprehensive score value of each video; and

determining a video whose comprehensive score value is greater than a preset score value as the similar video for the video information.

12. The computing device according to claim 10 , wherein the training the video information by using a preset text depth representation model, to convert the video information into a word vector comprises:

performing word segmentation on the video tag and the video title, to obtain video text after word segmentation; and

training the video text after word segmentation by using the preset text depth representation model, to obtain a word vector of the video text after word segmentation; and

the screening, in the video library, videos similar to the video information according to the word vector, to obtain a second candidate video set further comprises:

screening, in the video library, the videos similar to the video information according to the word vector of the video text after word segmentation, to obtain the second candidate video set.

13. The computing device according to claim 12 , wherein the screening, in the video library, the videos similar to the video information according to the word vector of the video text after word segmentation, to obtain the second candidate video set comprises:

calculating similarity between the video information and each video in the video library according to the word vector of the video text after word segmentation; and

selecting videos whose similarity is higher than a preset threshold, to obtain the second candidate video set.

14. The computing device according to claim 10 , wherein the selecting, from a video library according to a preset knowledge graph, videos matching the video information, to obtain a first candidate video set comprises:

extracting an entity word from the video tag and the video title, to obtain a seed; and

selecting, from the video library according to the preset knowledge graph, videos matching the seed, to obtain the first candidate video set.

15. The computing device according to claim 14 , wherein the selecting, from the video library according to the preset knowledge graph, videos matching the seed, to obtain the first candidate video set comprises:

selecting an entity word having a strong association relationship with the seed according to the preset knowledge graph as a candidate word; and

selecting, from the video library, videos whose video information comprises the candidate word, to obtain the first candidate video set.

16. The computing device according to claim 15 , wherein the selecting an entity word having a strong association relationship with the seed according to the preset knowledge graph as a candidate word comprises:

mapping the seed onto entity words in a preset entity library, the entity library being established according to the preset knowledge graph;

determining relationship degrees between the seed and the entity words in the entity library; and

selecting an entity word whose relationship degree is less than or equal to a set value as the candidate word.

17. A non-transitory computer readable storage medium storing a plurality of machine readable instructions in connection with a computing device having one or more processors, wherein the plurality of machine readable instructions, when executed by the one or more processors, cause the computing device to perform a plurality of operations including:

obtaining video information of a video for which similar videos are to be retrieved, the video information comprising a video tag and a video title;

selecting, from a video library according to a preset knowledge graph, videos matching the video information, to obtain a first candidate video set;

training the video information by using a preset text depth representation model, to convert the video information into a word vector;

screening, in the video library, videos similar to the video information according to the word vector, to obtain a second candidate video set; and

determining a similar video for the video information from the first candidate video set and the second candidate video set.

18. The non-transitory computer readable storage medium according to claim 17 , wherein the selecting, from a video library according to a preset knowledge graph, videos matching the video information, to obtain a first candidate video set comprises:

extracting an entity word from the video tag and the video title, to obtain a seed; and

selecting, from the video library according to the preset knowledge graph, videos matching the seed, to obtain the first candidate video set.

19. The non-transitory computer readable storage medium according to claim 18 , wherein the selecting, from the video library according to the preset knowledge graph, videos matching the seed, to obtain the first candidate video set comprises:

selecting an entity word having a strong association relationship with the seed according to the preset knowledge graph as a candidate word; and

selecting, from the video library, videos whose video information comprises the candidate word, to obtain the first candidate video set.

20. The non-transitory computer readable storage medium according to claim 19 , wherein the selecting an entity word having a strong association relationship with the seed according to the preset knowledge graph as a candidate word comprises:

mapping the seed onto entity words in a preset entity library, the entity library being established according to the preset knowledge graph;

determining relationship degrees between the seed and the entity words in the entity library; and

selecting an entity word whose relationship degree is less than or equal to a set value as the candidate word.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2020
From: ZHANG, YUANYUAN; YU, QUN; ZHAN, FEI; HUA, XIAO; CHEONG, WENGSAN; XIONG, LEI
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 052397/0045 →
Priority Claims (1)
CN 2017 1 0331203 · May 11, 2017 · national
Continuity (2)
Continuation PCTCN2018084580 · Apr 26, 2018
Related Publication 20190332867A1 · Oct 31, 2019
Cited By (1)
US 12,579,797