IP Library Granted Patent US 8,478,592
Granted Patent B2
US 8,478,592 · App. 12/180,583 · Granted Jul 2, 2013

Enhancing media playback with speech recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,478,592
App. No.
12/180,583
Granted
Jul 2, 2013
Kind
B2
Abstract

A method for enhancing a media file to enable speech-recognition of spoken navigation commands can be provided. The method can include receiving a plurality of textual items based on subject matter of the media file and generating a grammar for each textual item, thereby generating a plurality of grammars for use by a speech recognition engine. The method can further include associating a time stamp with each grammar, wherein a time stamp indicates a location in the media file of a textual item corresponding with a grammar. The method can further include associating the plurality of grammars with the media file, such that speech recognized by the speech recognition engine is associated with a corresponding location in the media file.

Claims (54)

1. A method for enhancing a media file to enable speech-recognition of spoken navigation commands, comprising:

receiving a plurality of textual items relating to the subject matter of the media file;

generating at least one grammar comprising one or more grammar entries, wherein the one or more grammar entries comprise grammar entries that are generated for at least some of the plurality of the textual items, and comprise a word or word sequence recognizable by a speech recognition engine;

for each of the grammar entries corresponding to content in the media file, determining one or more time stamps for the grammar entry, each time stamp indicating a location in the media file of content corresponding to the grammar entry; and

via a computer processor, locating content in the media file during playback of the media file by

(a) receiving speech input from a user,

(b) recognizing the speech input using the speech recognition engine and the at least one grammar to produce a speech recognition result corresponding at least in part to a recognized grammar entry of the at least one grammar, and

(c) identifying one or more locations in the media file by identifying the one or more time stamps determined for the recognized grammar entry and the current time position of the media file at playback when the user input is received, wherein upon identifying the location in the media file a media controller navigates to the time stamp identified and presents the media file to the user at the identified timestamp location.

2. The method of claim 1 , wherein the step of receiving a plurality of textual items further comprises:

receiving textual data provided by a computer via a data connection and generating a plurality of textual items based on the textual data.

3. The method of claim 1 , wherein the step of receiving a plurality of textual items further comprises:

receiving textual data provided by a user via a user input device and generating a plurality of textual items based on the textual data.

4. The method of claim 3 , wherein the step of receiving a plurality of textual items further comprises:

receiving textual data that has been organized into categories based on content of the textual items.

5. The method of claim 1 , further comprising:

storing the at least one grammar and the media file on removable media.

6. The method of claim 1 , further comprising:

storing the at least one grammar in a remote location on a network;

embedding a link in a media file to the remote location of the at least one grammar; and

storing the media file on removable media.

7. A non-transitory computer-readable storage medium storing computer usable program code for enhancing a media file to enable speech-recognition of spoken navigation commands, comprising:

computer usable program code for receiving a plurality of textual items relating to the subject matter of the media file;

computer usable program code for generating at least one grammar one or more grammar entries, wherein the one or more grammar entries comprise grammar entries that are generated for at least some of the plurality of the textual items and comprise a word or word sequence recognizable by a speech recognition engine;

computer usable program code for, for each of the grammar entries corresponding to content in the media file, determining one or more time stamps for the grammar entry, each time stamp indicating a location in the media file of content corresponding to the grammar entry; and

computer usable program code for locating content in the media file during playback of the media file by

(a) receiving speech input from a user,

(b) recognizing the speech input using the speech recognition engine and the at least one grammar to produce a speech recognition result corresponding at least in part to a recognized grammar entry of the at least one grammar, and

(c) identifying one or more locations in the media file by identifying the one or more time stamps determined for the recognized grammar entry and the current time position of the media file at playback when the user input is received, wherein upon identifying the location in the media file a media controller navigates to the time stamp identified and presents the media file to the user at the identified timestamp location.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the computer usable program code for receiving a plurality of textual items further comprises:

computer usable program code for receiving textual data provided by a computer via a data connection and generating a plurality of textual items based on the textual data.

9. The non-transitory computer-readable storage medium of claim 7 , wherein the computer usable program code for receiving a plurality of textual items further comprises:

computer usable program code for receiving textual data provided by a user via a user input device and generating a plurality of textual items based on the textual data.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the computer usable program code for receiving a plurality of textual items further comprises:

computer usable program code for receiving textual data that has been organized into categories based on content of the textual items.

11. The non-transitory computer-readable storage medium of claim 7 , further comprising:

computer usable program code for storing the at least one grammar and the media file on removable media.

12. The non-transitory computer-readable storage medium of claim 7 , further comprising:

computer usable program code for storing the at least one grammar in a remote location on a network;

computer usable program code for embedding a link in a media file to the remote location of the at least one grammar; and

computer usable program code for storing the media file on removable media.

13. A computer system for enhancing a media file to enable speech-recognition of spoken navigation commands, comprising:

a processor configured for:

receiving a plurality of textual items relating to the subject matter of the media file;

generating at least one grammar comprising one or more grammar entries, wherein the one or more grammar entries comprise grammar entries that are generated for at least some of the plurality of the textual items and comprise word or word sequence recognizable by a speech recognition engine;

receiving speech input from a user; and

recognizing the speech input using the speech recognition engine and the at least one grammar to produce a speech recognition result corresponding at least in part to a recognized grammar entry of the at least one grammar; and

a repository for storing:

a grammar file including the at least one grammar, wherein one or more time stamps are determined for each of the grammar entries that correspond to content in the media file, and wherein each time stamp indicates a location in the media file of content corresponding to the grammar entry; and

a link for locating content in the media file during playback of the media file by identifying one or more locations in the media file by identifying the one or more time stamps determined for the selected recognized grammar entry and the current time position of the media file at playback when the user input is received, wherein upon identifying the location in the media file a media controller navigates to the time stamp identified and presents the media file to the user at the identified timestamp location.

14. The computer system of claim 13 , wherein each textual item comprises text describing events of the media file.

15. The computer system of claim 14 , wherein the media file comprises a video file.

16. The computer system of claim 15 , wherein a time stamp includes an hour, minute and second indicator.

17. The computer system of claim 13 , further comprising removable media for storing the grammar file and the media file.

18. The computer system of claim 13 , further comprising removable media for storing the media file including a link to a remote location of the grammar file.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2009
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 022689/0317 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2008
From: PATEL, PARITOSH D.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 021303/0614 →