IP Library › Granted Patent US 11,984,140
Granted Patent B2
US 11,984,140 · App. 17/677,981 · Granted May 14, 2024

Matching method, terminal and readable storage medium

Inventor: Henggang Wu (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
G11B27/031G10L15/22G10L15/30G10L25/57H04N21/4394
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,984,140
App. No.
17/677,981
Granted
May 14, 2024
Kind
B2
Abstract

A matching method, a terminal and a non-transitory computer-readable storage medium are provided. The matching method includes extracting audio clips from an integrated video clip, the integrated video clip being obtained by integrating a plurality of original video clips. The matching method further includes acquiring recognition data of the audio clips, the recognition data including subtitle data, a start time of the subtitle data and an end time of the subtitle data. The matching method further includes matching the subtitle data to the integrated video clip based on the start time and the start time of the recognition data, to obtain a recommend video.

Claims (81)

1. A matching method, applied to a terminal, the method comprising:

extracting one or more audio clips from an integrated video clip, wherein the integrated video clip is obtained by integrating a plurality of original video clips, with repeating parts of the plurality of original video clips merged;

acquiring recognition data of the extracted audio clips, the recognition data comprising subtitle data, a start time of the subtitle data and an end time of the subtitle data; and

matching the subtitle data to the integrated video clip based on the start time and the start time of the recognition data, to obtain a recommended video;

wherein the matching the subtitle data to the integrated video clip based on the start time and the start time of the recognition data, to obtain a recommended video, comprises:

matching the recognition data with the plurality of original video clips, to load, into each of the original video clips, a part of the subtitle data that matches a start time and an end time of the original video clip; and

generating the recommended video according to the plurality of original video clips into which the subtitle data has been loaded.

2. The matching method as claimed in claim 1 , wherein before the extracting one or more audio clips from an integrated video clip, the method further comprises:

identifying the repeating parts in all the original video clips;

determining any one of identical repeating parts of all the original video clips as a to-be-integrated part until the operation of determining the to-be-integrated part is performed for all the repeating parts, to obtain at least one to-be-integrated part; and

generating the integrated video clip, by integrating the at least one to-be-integrated part and other parts of the original video clips excepting the repeating parts.

3. The matching method as claimed in claim 2 , wherein the extracting one or more audio clips from an integrated video clip comprises:

extracting an initial audio clip from the integrated video clip; and

cutting the initial audio clip according to a limited duration, to generate the audio clips of the integrated video clip.

4. The matching method as claimed in claim 3 , wherein the cutting the initial audio clip according to a limited duration to generate the audio clips of the integrated video clip, comprises:

identifying a point of silence in the initial audio clip; and

cutting the initial audio clip according to the point of silence and the limited duration, to generate the audio clips of the integrated video clip.

5. The matching method as claimed in claim 1 , wherein the acquiring recognition data of the audio clips comprises:

invoking a file upload interface to upload the audio clips to a cloud server;

receiving the recognition data returned from the cloud server, the recognition data being obtained by processing at the cloud server; and

saving the recognition data in a temporary queue.

6. The matching method as claimed in claim 2 , wherein the identifying the repeating parts in all the original video clips comprises:

acquiring source paths of all the original video clips, and acquiring the start time and the end time of each of the original video clips in a respective source video; and

determining the repeating parts, according to the source paths, the start times, and the end times of the original video clips.

7. The matching method as claimed in claim 1 , wherein the matching method further comprises:

determining a time interval between two of the original video clips, according to source paths, the start times, and the end times of the original video clips; and

integrating the two original video clips into one original video clip, upon determining that the time interval between the two original video clips is less than a predetermined value.

8. The matching method as claimed in claim 3 , wherein the matching method further comprises:

converting a format of the initial audio clip into a restricted format.

9. The matching method as claimed in claim 4 , wherein the identifying a point of silence in the initial audio clip comprises:

determining, as the point of silence, an initial point of a preset period of time during which an intensity of an audio signal of the initial audio clip is less than a predetermined intensity value.

10. The matching method as claimed in claim 6 , wherein the determining the repeating parts according to the source paths, the start times, and the end times of the original video clips, comprises:

acquiring durations of two of the original video clips based on the start times and the end times of the two original video clips, upon determining that the source paths of the two original video clips are the same; and

determining overlapping parts of the two original video clips as the repeating parts, upon determining, based on the acquired durations of the two original video clips, that the two original video clips overlap.

11. A terminal, comprising a processor, wherein the processor is configured to:

extract one or more audio clips from an integrated video clip, wherein the integrated video clip is obtained by integrating a plurality of original video clips, with repeating parts of the plurality of original video clips merged;

acquire recognition data of the audio clips, the recognition data comprising subtitle data, a start time of the subtitle data and an end time of the subtitle data; and

match the subtitle data to the integrated video clip based on the start time and the start time of the recognition data, to obtain a recommended video, comprising:

matching the recognition data with the plurality of original video clips, to load, into each of the original video clips, a part of the subtitle data that matches a start time and an end time of the original video clip; and

generating the recommended video according to the plurality of original video clips into which the subtitle data has been loaded.

12. The terminal as claimed in claim 11 , wherein the processor is further configured to:

identify the repeating parts in all the original video clips;

determine any one of identical repeating parts of all the original video clips as a to-be-integrated part until the operation of determining the to-be-integrated part is performed for all the repeating parts, to obtain at least one to-be-integrated part; and

generate the integrated video clip, by integrating the at least one to-be-integrated part and other parts of the original video clips excepting the repeating parts.

13. The terminal as claimed in claim 12 , wherein the processor is further configured to:

extract an initial audio clip from the integrated video clip;

identify a point of silence in the initial audio clip; and

cut the initial audio clip according to the point of silence and a limited duration, to generate the audio clips of the integrated video clip.

14. The terminal as claimed in claim 11 , wherein the terminal further comprises a memory, and the processor is further configured to:

invoke a file upload interface to upload the audio clips to a cloud server;

receive the recognition data returned from the cloud server, the recognition data being obtained by processing at the cloud server; and

save the recognition data in a temporary queue of the memory.

15. The terminal as claimed in claim 12 , wherein the processor is further configured to:

acquire source paths of all the original video clips, and acquire the start time and the end time of each of the original video clips in a respective source video; and

determine the repeating parts, according to the source paths, the start times, and the end times of the original video clips.

16. The terminal as claimed in claim 11 , wherein the processor is further configured to:

determine a time interval between two of the original video clips, according to source paths, the start times, and the end times of the original video clips; and

integrate the two original video clips into one original video clip, upon determining that the time interval between the two original video clips is less than a predetermined value.

17. A non-transitory computer-readable storage medium storing computer-executable instructions thereon, wherein when being executed by one or more processors, the computer-executable instructions cause the one or more processors to execute a matching method comprising:

extracting one or more audio clips from an integrated video clip, wherein the integrated video clip is obtained by integrating a plurality of original video clips, with repeating parts of the plurality of original video clips merged;

acquiring recognition data of the audio clips, the recognition data comprising subtitle data, a start time of the subtitle data and an end time of the subtitle data; and

matching the subtitle data to the integrated video clip based on the start time and the start time of the recognition data, to obtain a recommended video;

wherein the matching the subtitle data to the integrated video clip based on the start time and the start time of the recognition data, to obtain a recommended video, comprises:

matching the recognition data with the plurality of original video clips, to load, into each of the original video clips, a part of the subtitle data that matches a start time and an end time of the original video clip; and

generating the recommended video according to the plurality of original video clips into which the subtitle data has been loaded.

18. The computer-readable storage medium as claimed in claim 17 , wherein the acquiring recognition data of the audio clips comprises:

invoking a file upload interface to upload the audio clips to a cloud server;

receiving the recognition data returned from the cloud server, the recognition data being obtained by processing at the cloud server; and

saving the recognition data in a temporary queue.

19. The computer-readable storage medium as claimed in claim 17 , wherein the extracting one or more audio clips from an integrated video clip comprises:

extracting an initial audio clip from the integrated video clip;

identifying a point of silence in the initial audio clip; and

cutting the initial audio clip according to the point of silence and a limited duration, to generate the audio clips of the integrated video clip.

20. The computer-readable storage medium as claimed in claim 17 , wherein before the extracting one or more audio clips from an integrated video clip, the method further comprises:

identifying the repeating parts in all the original video clips;

determining any one of identical repeating parts of all the original video clips as a to-be-integrated part until the operation of determining the to-be-integrated part is performed for all the repeating parts, to obtain at least one to-be-integrated part; and

generating the integrated video clip, by integrating the at least one to-be-integrated part and other parts of the original video clips excepting the repeating parts;

wherein the identifying the repeating parts in all the original video clips comprises:

acquiring source paths of all the original video clips, and acquiring a start time and an end time of each of the original video clips in a respective source video;

acquiring durations of two of the original video clips based on the start times and the end times of the two original video clips, upon determining that the source paths of the two original video clips are the same; and

determining overlapping parts of the two original video clips as the repeating parts, upon determining, based on the acquired durations of the two original video clips, that the two original video clips overlap.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2022
From: WU, HENGGANG
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 059234/0441 →
Priority Claims (1)
CN 201910843913.2 · Sep 6, 2019 · national
Continuity (2)
Continuation PCTCN2020106521 · Aug 3, 2020
Related Publication 20220180899A1 · Jun 9, 2022