IP Library Granted Patent US 10,932,005
Granted Patent B2
US 10,932,005 · App. 16/151,128 · Granted Feb 23, 2021

Speech interface

Inventors: Adam Jordan (El Cerrito, CA); Scott Lynn Maddux (San Francisco, CA); Tim Plowman (Berkeley, CA); Victoria Stanbach (Santa Cruz, CA); Jody Williams (San Carlos, CA)
Assignee: PROMPTU SYSTEMS CORPORATION
H04N21/47G06F3/16G06Q30/0271G06Q30/0631G10L13/00G10L15/22G10L21/06H04N21/4221H04N21/42203H04N21/4316H04N21/4622H04N21/472H04N21/475H04N21/478H04N21/4781H04N21/4782H04N21/4788H04N21/47202H04N21/47211H04N21/47214H04N21/482H04N21/4826H04N21/4828H04N21/4852H04N21/812H04N21/8173G10L2015/221G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,932,005
App. No.
16/151,128
Granted
Feb 23, 2021
Kind
B2
Abstract

A system ( 100 ) for enabling a user to select media content in an entertainment environment, comprising a remote control device ( 110 ) having a set of user-activated keys and a speech activation circuit adapted to enable a speech signal; a speech engine ( 160 ) comprising a speech recognizer ( 170 ); an application wrapper ( 180 ) configured to recognize substantive meaning in the speech signal; and a media content controller ( 190 ) configured to select media content. Every function that can be executed by activation of the user-activated keys can also be executed by the speech engine ( 160 ) in response to the recognized substantive meaning.

Claims (174)

1. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

every function of the entertainment environment that can be executed by activation of the user activated keys can also be executed by the speech engine in response to the recognized substantive meaning; and

results of the user pressing an up-channel key can be replicated by the speech engine in response to the recognized substantive meaning.

2. The system of claim 1 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

3. The system of claim 1 , wherein the media content controller provides user feedback.

4. The system of claim 1 , further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

5. The system of claim 1 , wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

6. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

every function of the entertainment environment that can be executed by activation of the user activated keys can also be executed by the speech engine in response to the recognized substantive meaning; and

results of the user pressing a down-channel key can be replicated by the speech engine in response to the recognized substantive meaning.

7. The system of claim 6 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

8. The system of claim 6 , wherein the media content controller provides user feedback.

9. The system of claim 6 , further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

10. The system of claim 6 , wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

11. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

every function of the entertainment environment that can be executed by activation of the user activated keys can also be executed by the speech engine in response to the recognized substantive meaning; and

results of the user pressing an up-volume key can be replicated by the speech engine in response to the recognized substantive meaning.

12. The system of claim 11 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

13. The system of claim 11 , wherein the media content controller provides user feedback.

14. The system of claim 11 , further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

15. The system of claim 11 , wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

16. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

every function of the entertainment environment that can be executed by activation of the user activated keys can also be executed by the speech engine in response to the recognized substantive meaning; and

results of the user pressing a down-volume key can be replicated by the speech engine in response to the recognized substantive meaning.

17. The system of claim 16 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

18. The system of claim 16 , wherein the media content controller provides user feedback.

19. The system of claim 16 , further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

20. The system of claim 16 , wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

21. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

every function of the entertainment environment that can be executed by activation of the user activated keys can also be executed by the speech engine in response to the recognized substantive meaning; and

results of the user programming a programmable key can be replicated by the speech engine in response to the recognized substantive meaning.

22. The system of claim 21 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

23. The system of claim 21 , wherein the media content controller provides user feedback.

24. The system of claim 21 , further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

25. The system of claim 21 , wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

26. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

every function of the entertainment environment that can be executed by activation of the user activated keys can also be executed by the speech engine in response to the recognized substantive meaning; and

a transmitter within the remote control device forwards the speech signal from the remote control device to the speech engine without modifying the speech signal.

27. The system of claim 26 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

28. The system of claim 26 , wherein the media content controller provides user feedback.

29. The system of claim 26 , further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

30. The system of claim 26 , wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

31. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

the media content controller provides user navigation functions for navigating among entertainment applications, said entertainment applications including at least one of an interactive television program guide or video on demand.

32. The system of claim 31 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

33. The system of claim 31 , wherein the media content controller provides user feedback.

34. The system of claim 31 further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

35. The system of claim 31 wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

36. A system for enabling a user to select media content in an entertainment environment, said system comprising:

a remote control device comprising:

a set of user activated keys adapted to execute functions of the entertainment environment;

a microphone for receiving user speech; and

coupled to the microphone, a speech activation circuit adapted to enable a speech signal;

coupled to the remote control device, a speech engine comprising

a speech recognizer configured to receive the speech signal, and

an application wrapper configured to recognize substantive meaning embodied in the speech signal, and output commands for enabling selection of media content when substantive meaning is recognized, wherein at least one of:

a) the application wrapper provides a binary indication denoting whether or not substantive meaning has been successfully recognized in the speech signal, the indication being a visual indication comprising a list of possible matches associated with the speech signal; or

b) the speech recognizer is configured to transcribe the speech signal into textual information represented by binary streams; and

coupled to the speech engine, a media content controller configured to receive commands representing the recognized substantive meaning, to select media content, and to use selected media content in the entertainment environment; wherein:

results of the user programming a programmable key can be replicated by the speech engine in response to the recognized substantive meaning.

37. The system of claim 36 , wherein the speech engine provides to the user visual indications responsive to the speech signal.

38. The system of claim 36 , wherein the media content controller provides user feedback.

39. The system of claim 36 , further comprising, coupled to the speech recognizer, a visual display configured to display at least one of the following visual feedback messages:

an indication of push-to-talk button stuck; or

an indication of processing too long.

40. The system of claim 36 , wherein:

the entertainment environment comprises a display;

the system is configured to enable text on the display to be selected by activation of the user activated keys; and

the system is further configured to enable text on the display to be selected by the speech engine in response to recognized substantive meaning.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2018
From: PLOWMAN, TIM
To: AGILETV CORPORATION
Reel/Frame 047083/0199 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2018
From: JORDAN, ADAM; MADDUX, SCOTT LYNN; STANBACH, VICTORIA; WILLIAMS, JODY
To: PROMPTU SYSTEMS CORPORATION
Reel/Frame 047083/0764 →
CHANGE OF ADDRESS OF ASSIGNEE Recorded Oct 5, 2018
From: PROMPTU SYSTEMS CORPORATION
To: PROMPTU SYSTEMS CORPORATION
Reel/Frame 047199/0275 →
CHANGE OF NAME Recorded Oct 5, 2018
From: AGILETV CORPORATION
To: PROMPTU SYSTEMS CORPORATION
Reel/Frame 047201/0042 →
Continuity (9)
Division 15392994 · Dec 28, 2016
Continuation 14572596 · Dec 16, 2014
Continuation 14029729 · Sep 17, 2013
Division 13786998 · Mar 6, 2013
Division 13179294 · Jul 8, 2011
Continuation 11933191 · Oct 31, 2007
Division 10260906 · Sep 30, 2002
Provisional Application 60327207 · Oct 3, 2001
Related Publication 20190037277A1 · Jan 31, 2019