IP Library Granted Patent US 8,781,824
Granted Patent B2
US 8,781,824 · App. 12/983,027 · Granted Jul 15, 2014

Offline generation of subtitles

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,781,824
App. No.
12/983,027
Granted
Jul 15, 2014
Kind
B2
Abstract

One embodiment described herein may take the form of a system or method for generating subtitles (also known as “closed captioning”) of an audio component of a multimedia presentation automatically for one or more stored presentations. In general, the system or method may access one or more multimedia programs stored on a storage medium, either as an entire program or in portions. Upon retrieval, the system or method may perform an analysis of the audio component of the program and generate a subtitle text file that corresponds to the audio component. In one embodiment, the system or method may perform a speech recognition analysis on the audio component to generate the subtitle text file.

Claims (66)

1. A method for generating subtitles for a multimedia presentation comprising:

receiving, at a receiver device, a multimedia presentation from a distribution system;

buffering, at the receiver device, the multimedia presentation on a storage medium;

retrieving at least one portion of the multimedia presentation from the storage medium, the at least one portion comprising an audio component and a video component;

performing speech recognition analysis, at the receiver device while the receiver device is otherwise idle, on the audio component to generate text corresponding to the audio component of the at least one portion of the multimedia presentation;

integrating the generated text into a subtitle text file associated with the multimedia presentation; and

displaying the integrated multimedia presentation with the generated subtitle text file as subtitles to the presentation.

2. The method of claim 1 further comprising:

analyzing the multimedia presentation to determine whether the multimedia presentation includes subtitles corresponding to the audio component prior to performing the speech recognition analysis.

3. The method of claim 1 further comprising:

generating one or more time indicators corresponding to time indicators included in the multimedia presentation; and

linking the one or more time indicators to the subtitle text file to synch the generated text with the multimedia presentation.

4. The method of claim 1 further comprising:

generating one or more flags corresponding to flags included in the multimedia presentation;

linking the one or more flags to portions of the subtitle text file;

analyzing the multimedia presentation for the flags included in the presentation; and

upon encountering a flag in the presentation, accessing the portion of the subtitle text file corresponding to the encountered flag.

5. The method of claim 4 further comprising:

communicating the multimedia presentation and the portion of the subtitle text file to a display device to display the presentation.

6. The method of claim 1 further comprising:

storing the subtitle text file in the storage medium; and

linking the subtitle text file to the multimedia presentation such that accessing the multimedia presentation includes accessing the subtitle text file.

7. The method of claim 1 wherein the integrating operation comprises encoding the subtitle text file into the video portion of the presentation.

8. The method of claim 1 further comprising:

performing a plurality of iterations of the speech recognition analysis on the at least one portion of the multimedia presentation;

maintaining the generated text from the plurality of iterations of analysis; and

comparing the generated text from the plurality of iterations of analysis to determine a most likely generated text.

9. The method of claim 1 further comprising:

applying a noise reducing process to the audio component prior to performing speech recognition analysis on the audio component.

10. A receiver for a distribution system comprising:

a microprocessor; and

a computer readable storage medium, the computer readable storage medium storing a computer-executable code that, when executed by the microprocessor, causes the receiver to perform the operations of:

storing, at the receiver, a received multimedia presentation on a storage medium associated with the receiver, the multimedia presentation comprising a video component and an audio component;

analyzing, at the receiver, the received multimedia presentation while it is stored on the storage medium to determine whether the multimedia presentation includes subtitles corresponding to the audio component;

retrieving at least one portion of the multimedia presentation from the storage medium if it is determined that the multimedia presentation does not include subtitles corresponding to the audio component;

performing speech recognition analysis, utilizing the receiver, on the audio component to generate text corresponding to the audio component of the at least one portion of the multimedia presentation while the receiver is otherwise idle;

integrating the generated text into a subtitle text file associated with the multimedia presentation; and

after the speech recognition analysis is complete, transmitting the integrated multimedia presentation and subtitle text file to a display device for display of the presentation with subtitles.

11. The receiver of claim 10 further comprising:

an input/output interface configured to receive the multimedia presentation from a distribution system.

12. The receiver of claim 10 further comprising:

a display interface, the display interface configured to communicate with the display device and wherein the computer-executable code further causes the receiver to perform the operation of:

utilizing the display interface to communicate the multimedia presentation and subtitle text file to the display device for display.

13. The receiver of claim 10 further comprising:

a network interface in communication with a network, wherein the computer-executable code further causes the receiver to perform the operation of:

communicating the subtitle text file to the network though the network interface for storage on the network.

14. The receiver of claim 13 wherein the computer-executable code further causes the receiver to perform the operations of:

storing the subtitle text file in the storage medium; and

linking the subtitle text file to the multimedia presentation such that accessing the multimedia presentation includes accessing the subtitle text file.

15. A method for generating subtitles for a plurality of multimedia presentations, the method comprising:

receiving at a receiver device a plurality of multimedia presentations from a distribution system;

storing the plurality of multimedia presentations on a storage medium;

retrieving to the receiver device at least one portion of a first multimedia presentation from the storage medium, the at least one portion comprising an audio component and a video component;

performing speech recognition analysis, utilizing the receiving device, on the audio component to generate text corresponding to the audio component of the at least one portion of the first multimedia presentation, wherein the speech recognition analysis is performed while the receiving device is otherwise idle;

integrating the generated text into a subtitle text file associated with the first multimedia presentation;

receiving a request, at the receiver device, for playback of the first multimedia presentation from the storage medium; and

displaying the integrated multimedia presentation with the generated subtitle text file as subtitles to the presentation during playback.

16. The method of claim 15 further comprising:

retrieving at least one portion of a second multimedia presentation from the storage medium, the at least one portion of the second multimedia presentation comprising an audio component and a video component;

performing speech recognition analysis on the audio component of the at least one portion of the second multimedia presentation to generate text corresponding to the audio component of the at least one portion; and

integrating the generated text into a subtitle text file associated with the second multimedia presentation.

17. The method of claim 15 wherein the at least one portion of the first multimedia presentation is retrieved at least partially based on the date the first multimedia presentation was stored.

18. The method of claim 15 wherein the at least one portion of the first multimedia presentation is retrieved at least partially based on the content of the first multimedia presentation.

19. The method of claim 15 wherein the at least one portion of the first multimedia presentation is retrieved at least partially based on a preference of a user to a receiver of a distribution system.

20. The method of claim 15 further comprising:

communicating the first multimedia presentation and the subtitle text file associated with the first multimedia presentation to a display device upon receipt of an input from a user to a receiver of a distribution system.

Assignments (6)
SECURITY INTEREST Recorded Nov 30, 2021
From: DISH BROADCASTING CORPORATION; DISH NETWORK L.L.C.; DISH TECHNOLOGIES L.L.C.
To: U.S. BANK, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 058295/0293 →
CONVERSION Recorded Aug 7, 2018
From: ECHOSTAR TECHNOLOGIES L.L.C.
To: DISH TECHNOLOGIES L.L.C.
Reel/Frame 046737/0610 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2017
From: ECHOSTAR UK HOLDINGS LIMITED
To: ECHOSTAR TECHNOLOGIES INTERNATIONAL CORPORATION
Reel/Frame 041672/0080 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2017
From: ECHOSTAR TECHNOLOGIES INTERNATIONAL CORPORATION
To: ECHOSTAR TECHNOLOGIES L.L.C.
Reel/Frame 041674/0954 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 17, 2014
From: ELDON TECHNOLOGY LIMITED
To: ECHOSTAR UK HOLDINGS LIMITED
Reel/Frame 034650/0050 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2011
From: MOUNTAIN, DALE LLEWELYN
To: ELDON TECHNOLOGY LIMITED
Reel/Frame 025984/0473 →