IP Library Granted Patent US 6,999,931
Granted Patent B2
US 6,999,931 · App. 10/061,398 · Granted Feb 14, 2006

Spoken dialog system using a best-fit language model and best-fit grammar

Assignee: Intel Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 6,999,931
App. No.
10/061,398
Granted
Feb 14, 2006
Kind
B2
Abstract

A spoken dialog system using a best-fit language model and a spoken dialog system using best-fit grammar are disclosed. A spoken dialog system implementing both a best-fit language model and best-fit grammar is further disclosed. Regarding the language model, likelihood scores from a large vocabulary continuous speech recognition (“LVCSR”) module are used to select the best-fit language model among a general task language model and dialog-state dependent language models. Based on the chosen language model, a dialog manager can implement different strategies to improve general dialog performance and recognition accuracy. Regarding grammar, the best-fit grammar method improves performance and user experience of dialog systems by choosing the best-fit grammar among a general purpose grammar and dialog-state dependent sub-grammars. Based on the selected grammar pattern, the dialog system can choose from varying dialog strategies, resulting in an increase in user acceptance of spoken dialog systems.

Claims (89)

1. A spoken dialog system using a best-fit language model, comprising:

a dialog manager, coupled to a language model selector, that provides to the language model selector a current dialog state;

the language model selector, coupled to a plurality of dialog-state dependent language models, that selects one of the plurality of dialog-state dependent language models;

the plurality of dialog-state dependent language models that are interpolated from a general-task language model;

a large vocabulary continuous speech recognizer, coupled to the dialog manager and the language model selector, that receives input speech and generates a first hypothesis result for the input speech with a likelihood score, based on the selected dialog-state dependent language model;

the general-task language model, coupled to the large vocabulary continuous speech recognizer, that enables the large vocabulary continuous speech recognizer to generate a second hypothesis with a second likelihood score; and

a plurality of dialog strategies based on the language model system, coupled to the dialog manager.

2. The spoken dialog system of claim 1 , wherein the language model selector selects one of the plurality of dialog-state dependent language models based on the current dialog state.

3. The spoken dialog system of claim 1 , wherein an end result is chosen from the higher value of the first likelihood score and the second likelihood score.

4. The spoken dialog system of claim 1 , wherein the dialog manager deploys a plurality of various dialog components to improve dialog performance.

5. A spoken dialog system using best-fit grammar, comprising:

a dialog manager, coupled to a grammar selector, that provides to the grammar selector a dialog state, the dialog state being dependent upon a user's utterances;

the grammar selector, coupled to a plurality of dialog-state dependent sub-grammars, that selects one of the plurality of dialog-state dependent sub-grammars;

the plurality of dialog-state dependent sub-grammars, that contain a plurality of speech patterns;

a speech recognition module, coupled to the dialog manager and the grammar selector, that receives input speech;

a general-purpose grammar, coupled to the grammar selector, that contains patterns of general user responses; and

a plurality of dialog strategies based on the selected grammar system, coupled to the dialog manager, to enhance dialog performance.

6. The spoken dialog system of claim 5 , wherein the grammar selector chooses one of the plurality of dialog-state dependent sub-grammars based on the current dialog state.

7. The spoken dialog system of claim 5 , wherein the dialog manager commands the grammar selector to use the general-purpose grammar, if the selected dialog-state dependent sub-grammar fails to provide a matching pattern to the input speech.

8. The spoken dialog system of claim 5 , wherein each of the plurality of dialog-state dependent sub-grammars is specific to at least one of a defined sub-task.

9. The spoken dialog system of claim 5 , wherein a speech understanding module, coupled to the dialog manager and the grammar selector, receives a word sequence generated by the speech recognition module.

10. The spoken dialog system of claim 5 , wherein the dialog manager deploys a plurality of various dialog components to improve dialog performance.

11. A spoken dialog system implementing a best-fit language model, comprising a computer readable medium and a computer readable program code stored on the computer readable medium having instructions to:

receive a current dialog state from a dialog manager;

select a dialog-state dependent language model from a plurality of dialog-state dependent language models based on the current dialog state;

generate a first hypothesis result for input speech with a first likelihood score;

generate a second hypothesis result for input speech with a second likelihood score;

select a best-fit language model from the higher value of the first likelihood score and the second likelihood score; and

implement dialog strategies, based on the best-fit language model, to improve dialog performance.

12. The spoken dialog system of claim 11 , wherein the instructions are provided to a language model selector to select the dialog-state dependent language model.

13. The system of claim 12 , wherein the instructions are provided to a large vocabulary continuous speech recognizer to receive input speech and generate the first hypothesis result based on the selected dialog-state dependent language model.

14. The system of claim 13 , wherein the instructions are provided to the large vocabulary continuous speech recognizer from a general-task language model to generate the second hypothesis result.

15. The system of claim 11 , wherein the instructions are provided to the dialog manager to implement at least one of a plurality of dialog strategies to further improve accuracy and enhance dialog performance.

16. A spoken dialog system implementing best-fit grammar, comprising a computer readable medium and a computer readable program code stored on the computer readable medium having instructions to:

receive a dialog state from a dialog manager, the dialog state being dependent upon a user's utterances;

select one of a plurality of dialog-state dependent sub-grammars based on the current dialog state;

select a general-purpose grammar, if the chosen dialog-state dependent sub-grammar fails to provide a matching pattern of input speech; and

implement dialog strategies, based on one of the dialog-state dependent sub-grammar and the general-purpose grammar, to improve dialog performance.

17. The spoken dialog system of claim 16 , wherein the instructions are provided to a grammar selector to select one of the plurality of dialog-state dependent sub-grammars.

18. The spoken dialog system of claim 16 , wherein the instructions are provided from the dialog manager to the grammar selector to select the general-purpose grammar that contains patterns of general user responses.

19. The spoken dialog system of claim 16 , wherein each of the plurality of dialog-state dependent sub-grammars is specific to at least one defined task.

20. The system of claim 16 , wherein the instructions are provided to the dialog manager to implement at least one of a plurality of dialog strategies to further improve accuracy and enhance dialog performance.

21. A method of implementing a best-fit language model in a spoken dialog system, comprising:

receiving a current dialog state from a dialog manager;

choosing a dialog-state dependent language model from a plurality of dialog-state dependent language models based on the current dialog state;

calculating a first hypothesis result for input speech with a first likelihood score;

calculating a second hypothesis result for input speech with a second likelihood score;

choosing a best-fit language model from the higher value of the first likelihood score and the second likelihood score; and

deploying dialog strategies, based on the best-fit language model, to improve dialog performance.

22. The method of claim 21 , wherein a language model selector chooses the dialog-state dependent language model.

23. The method of claim 21 , wherein a large vocabulary continuous speech recognizer receives input speech and calculates the first hypothesis result based on the selected dialog-state dependent language model and calculates the second hypothesis result from input speech from a general-task language model.

24. The method of claim 23 , wherein an end result is selected from the greater value of the first likelihood score and the second likelihood score.

25. A method of implementing a best-fit grammar model in a spoken dialog system, comprising:

receiving a current dialog state from a dialog manager, the current dialog state being dependent upon a user's utterances;

choosing one of a plurality of dialog-state dependent sub-grammars based on the current dialog state;

choosing a general-purpose grammar, if the chosen dialog-state dependent sub-grammar fails to provide a matching pattern of input speech; and

employing dialog strategies, based on one of the dialog-state dependent sub-grammar and the general-purpose grammar, to improve dialog performance.

26. The method of claim 25 , wherein a grammar selector chooses one of the plurality of dialog-state dependent sub-grammars.

27. The method of claim 25 , wherein the grammar selector chooses the general-purpose grammar that contains patterns of general speech.

28. The method of claim 25 , wherein the dialog manager employs at least one of a plurality of dialog strategies to further enhance dialog performance and improve recognition accuracy.

29. A spoken dialog system using a best-fit language model and best-fit grammar, comprising:

a dialog manager, coupled to a language model selector and a grammar selector, that provides to the language model selector and to the grammar selector a current dialog state;

the language model selector, coupled to a plurality of dialog-state dependent language models, that selects one of the plurality of dialog-state dependent language models;

the grammar selector, coupled to a plurality of dialog-state dependent sub-grammars, that contain a plurality of speech patterns;

the plurality of dialog-state dependent language models that are interpolated from a general-task language model;

the plurality of dialog-state dependent sub-grammars that contain a plurality of speech patterns;

a large vocabulary continuous speech recognizer, coupled to the dialog manager and the language model selector and a language understanding module, that receives input speech and generates a first hypothesis result for the input speech with a likelihood score, based on the selected dialog-state dependent language model;

the language understanding module, coupled to the dialog manager and to the grammar selector and to large vocabulary continuous speech recognizer, that extracts critical information from a word sequence generated by the large vocabulary continuous speech recognizer;

the general-task language model, coupled to the large vocabulary continuous speech recognizer, that enables the large vocabulary continuous speech recognizer to generate a second hypothesis with a second likelihood score;

a general-purpose grammar, coupled to the grammar selector, that contains patterns of general user responses; and

a plurality of dialog strategies based on the language model system and a plurality of dialog strategies based on the selected grammar system, coupled to the dialog manager.

30. The spoken dialog system of claim 29 , wherein an end result is chosen from the higher value of the first likelihood score and the second likelihood score.

31. The spoken dialog system of claim 29 , wherein the dialog manager commands the grammar selector to use the general-purpose grammar, if the selected dialog-state dependent sub-grammar fails to provide a matching pattern to the input speech.

32. A spoken dialog system implementing a best-fit language model and best-fit grammar, comprising a computer readable medium and a computer readable program code stored on the computer readable medium having instructions to:

receive a current dialog state from a dialog manager;

select a dialog-state dependent language model from a plurality of dialog-state dependent language models based on the current dialog state;

select a dialog-state dependent sub-grammar from a plurality of dialog-state dependent sub-grammars based on the current dialog state;

select a general-purpose grammar, if the chosen dialog-state dependent sub-grammar fails to provide a matching pattern of input speech;

generate a first hypothesis result for input speech with a first likelihood score;

generate a second hypothesis result for input speech with a second likelihood score;

select a best-fit language model from the higher value of the first likelihood score and the second likelihood score; and

implement dialog strategies, based on the best-fit language model and based on one of the dialog-state dependent sub-grammar and the general-purpose grammar.

33. The spoken dialog system of claim 32 , wherein the instructions are provided to a language model selector to select the dialog-state dependent language model.

34. The system of claim 33 , wherein the instructions are provided to a large vocabulary continuous speech recognizer to receive input speech and generate the first hypothesis result based on the selected dialog-state dependent language model.

35. The system of claim 34 , wherein the instructions are provided to the large vocabulary continuous speech recognizer from a general-task language model to generate the second hypothesis result.

36. The system of claim 32 , wherein the instructions are provided to the dialog manager to implement at least one of a plurality of dialog strategies to further improve accuracy and enhance dialog performance.

37. The spoken dialog system of claim 32 , wherein the instructions are provided to a grammar selector to select one of the plurality of dialog-state dependent sub-grammars.

38. The spoken dialog system of claim 32 , wherein the instructions are provided from the dialog manager to the grammar selector to select the general-purpose grammar that contains patterns of general user responses.

39. The spoken dialog system of claim 32 , wherein each of the plurality of dialog-state dependent sub-grammars is specific to at least one defined task.

Assignments (2)
RE-RECORD TO CORRECT THE ASSIGNOR ON R/F 012570/0831 Recorded Sep 6, 2005
From: ZHOU, GUOJUN
To: INTEL CORPORATION
Reel/Frame 016550/0032 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2002
From: ZHOU, GOUJUN
To: INTEL CORPORATION
Reel/Frame 012570/0831 →
Continuity (1)
Related Publication 20030149561A1 · Aug 7, 2003