IP Library Granted Patent US 9,071,815
Granted Patent B2
US 9,071,815 · App. 13/590,478 · Granted Jun 30, 2015

Method, apparatus and computer program product for subtitle synchronization in multimedia content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,071,815
App. No.
13/590,478
Granted
Jun 30, 2015
Kind
B2
Abstract

In accordance with an example embodiment a method, apparatus and computer program product are provided. The method comprises receiving a request for synchronization of a subtitle text data with multimedia content. The method also comprises accessing summarization data associated with at least a portion of the multimedia content. The summarization data comprises text data generated from at least the portion of the multimedia content. The text data is compared with at least a portion of the subtitle text data for determining presence of the text data in the subtitle text data. The subtitle text data is synchronized with the multimedia content based on the determination of the presence of the text data in at least the portion of the subtitle text data.

Claims (42)

1. A method comprising:

receiving a request for synchronization of subtitle text data with multimedia content;

accessing summarization data associated with at least a portion of the multimedia content, the summarization data comprising text data generated from at least the portion of the multimedia content;

comparing the text data with at least a portion of the subtitle text data for determining presence of the text data in the subtitle text data; and

synchronizing the subtitle text data with the multimedia content based on the determination of the presence of the text data in at least the portion of the subtitle text data,

wherein the text data is generated by converting audio data associated with at least the portion of the multimedia content into the text data, and further comprising

determining an accuracy index associated with the text data, the accuracy index indicative of an accuracy of the conversion of the audio data into the text data,

where the determined accuracy index comprises a part of the summarization data in conjunction with the text data that is associated with at least the portion of the multimedia content; and

selecting at least the portion of the multimedia content from the multimedia content based on the accuracy index of the text data associated with at least the portion of the multimedia content.

2. The method as claimed in claim 1 , wherein at least the portion of the multimedia content comprises a beginning of a scene of the multimedia content.

3. The method as claimed in claim 1 , wherein comparing the text data with at least the portion of the subtitle text data comprises performing a search in at least the portion of the subtitle text data for the text data in a current time frame, the current time frame being determined based on a time stamp associated with the text data.

4. The method as claimed in claim 1 , wherein comparing the text data with at least the portion of the subtitle text data comprises performing a search in at least the portion of the subtitle text data for determining a presence of the text data during a time frame.

5. The method as claimed in claim 4 , wherein the time frame is associated with a variable width, and wherein the variable width of the time frame is expanded if the text data is determined to be absent in at least the portion of the subtitle text data.

6. The method as claimed in claim 1 , wherein synchronizing the subtitle text data with the multimedia content comprises offsetting at least the portion of the subtitle text data with a gap between the text data and at least the portion of the subtitle text data on the determination of the presence of the text data in at least the portion of the subtitle text data.

7. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

receive a request for synchronization of subtitle text data with multimedia content;

access summarization data associated with at least a portion of the multimedia content, the summarization data comprising text data generated from at least the portion of the multimedia content;

compare the text data with at least a portion of the subtitle text data for determining presence of the text data in the subtitle text data; and

synchronize the subtitle text data with the multimedia content based on the determination of the presence of the text data in at least the portion of the subtitle text data,

wherein the text data is generated by converting audio data associated with at least the portion of the multimedia content into the text data, and wherein the apparatus is further caused, at least in part, to

determine an accuracy index associated with the text data, the accuracy index indicative of an accuracy of the conversion of the audio data into the text data,

where the determined accuracy index comprises a part of the summarization data in conjunction with the text data that is associated with at least the portion of the multimedia content; and

select at least the portion of the multimedia content from the multimedia content based on the accuracy index of the text data associated with at least the portion of the multimedia content.

8. The apparatus as claimed in claim 7 , wherein at least the portion of the multimedia content comprises a beginning of a scene of the multimedia content.

9. The apparatus as claimed in claim 7 , wherein the apparatus is further caused, at least in part, to compare the text data with at least the portion of the subtitle text data by performing a search in at least the portion of the subtitle text data for the text data in a current time frame, the current time frame being determined based on a time stamp associated with the text data.

10. The apparatus as claimed in claim 7 , wherein the apparatus is further caused, at least in part, to compare the text data with at least the portion of the subtitle text data by performing a search in at least the portion of the subtitle text data for determining presence of the text data during a time frame.

11. The apparatus as claimed in claim 10 , wherein the time frame is associated with a variable width, and wherein the apparatus is further caused, at least in part, to expand the variable width of the time frame when the text data is determined to be absent in at least the portion of the subtitle text data.

12. The apparatus as claimed in claim 7 , wherein the apparatus is further caused, at least in part, to synchronize the subtitle text data with the multimedia content by offsetting at least the portion of the subtitle text data with a gap between the text data and at least the portion of the subtitle text data on the determination of the presence of the text data in at least the portion of the subtitle text data.

13. A computer program product comprising at least one non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium comprising a set of instructions, which, when executed by one or more processors, cause an apparatus at least to perform:

receive a request for synchronization of subtitle text data with multimedia content;

access summarization data associated with at least a portion of the multimedia content, the summarization data comprising text data generated from at least the portion of the multimedia content;

compare the text data with at least a portion of the subtitle text data for determining presence of the text data in the subtitle text data; and

synchronize the subtitle text data with the multimedia content based on the determination of the presence of the text data in at least the portion of the subtitle text data,

wherein the text data is generated by converting audio data associated with at least the portion of the multimedia content into the text data, and wherein the apparatus is further caused, at least in part, to

determine an accuracy index associated with the text data, the accuracy index indicative of an accuracy of the conversion of the audio data into the text data,

where the determined accuracy index comprises a part of the summarization data in conjunction with the text data that is associated with at least the portion of the multimedia content; and

select at least the portion o f the multimedia content from the multimedia content based on the accuracy index of the text data associated with at least the portion of the multimedia content.

14. The computer program product as claimed in claim 13 , wherein the apparatus is further caused, at least in part, to perform: compare the text data with at least the portion of the subtitle text data by performing a search in at least the portion of the subtitle text data for the text data in a current time frame, the current time frame being determined based on a time stamp associated with the text data.

15. The computer program product as claimed in claim 13 , wherein the apparatus is further caused, at least in part, to perform: compare the text data with at least the portion of the subtitle text data by performing a search in at least the portion of the subtitle text data for determining a presence of the text data during a time frame.

16. The computer program product as claimed in claim 13 , wherein the apparatus is further caused, at least in part, to perform: synchronize the subtitle text data with the multimedia content by offsetting at least the portion of the subtitle text data with a gap between the text data and at least the portion of the subtitle text data on the determination of the presence of the text data in at least the portion of the subtitle text data.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jun 3, 2021
From: TERRIER SSC, LLC
To: WSOU INVESTMENTS, LLC
Reel/Frame 056526/0093 →
SECURITY INTEREST Recorded Jun 1, 2021
From: WSOU INVESTMENTS, LLC
To: OT WSOU TERRIER HOLDINGS, LLC
Reel/Frame 056990/0081 →
RELEASE OF SECURITY INTEREST Recorded May 21, 2019
From: OCO OPPORTUNITIES MASTER FUND, L.P. (F/K/A OMEGA CREDIT OPPORTUNITIES MASTER FUND LP
To: WSOU INVESTMENTS, LLC
Reel/Frame 049246/0405 →
SECURITY INTEREST Recorded May 20, 2019
From: WSOU INVESTMENTS, LLC
To: BP FUNDING TRUST, SERIES SPL-VI
Reel/Frame 049235/0068 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2017
From: NOKIA TECHNOLOGIES OY
To: WSOU INVESTMENTS, LLC
Reel/Frame 043953/0822 →
SECURITY INTEREST Recorded Sep 21, 2017
From: WSOU INVESTMENTS, LLC
To: OMEGA CREDIT OPPORTUNITIES MASTER FUND, LP
Reel/Frame 043966/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035313/0801 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2012
From: PALAKSHAMURTHY, CHETHAN; PATIL, SUJAY
To: NOKIA CORPORATION
Reel/Frame 029321/0262 →