IP Library Granted Patent US 8,688,451
Granted Patent B2
US 8,688,451 · App. 11/382,789 · Granted Apr 1, 2014

Distinguishing out-of-vocabulary speech from in-vocabulary speech

Inventors: Timothy J. Grost (Clarkston, MI); Rathinavelu Chengalvarayan (Naperville, IL)
Assignee: General Motors LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,688,451
App. No.
11/382,789
Filed
May 11, 2006
Granted
Apr 1, 2014
Kind
B2
Art Unit
2653
USPC
704/255
Abstract

A speech recognition method includes receiving input speech from a user, processing the input speech using a first grammar to obtain parameter values of a first N-best list of vocabulary, comparing a parameter value of a top result of the first N-best list to a threshold value, and if the compared parameter value is below the threshold value, then additionally processing the input speech using a second grammar to obtain parameter values of a second N-best list of vocabulary. Other preferred steps include: determining the input speech to be in-vocabulary if any of the results of the first N-best list is also present within the second N-best list, but out-of-vocabulary if none of the results of the first N-best list is within the second N-best list; and providing audible feedback to the user if the input speech is determined to be out-of-vocabulary.

Claims (38)

1. A speech recognition method comprising the steps of:

(a) receiving input speech from a user via a microphone associated with an automatic speech recognition system;

(b) processing the input speech using a first grammar to obtain parameter values of a first N-best list of vocabulary using at least one processor associated with the automatic speech recognition system;

(c) comparing at least one parameter value of a top result of the first N-best list to at least one predetermined threshold value; and

(d) subsequently processing the input speech using a second grammar to obtain parameter values of a second N-best list of vocabulary, if the compared at least one parameter value is below the at least one predetermined threshold value;

(e) determining the input speech to be in-vocabulary, if any of the results of the first N-best list is also present within the second N-best list, but out-of vocabulary if any of the results of the first N-best list is not within the second N-best list; and

(f) providing audible feedback to the user if the input speech is determined to be out-of-vocabulary.

2. The method of claim 1 , wherein the at least one parameter value is at least one of a confidence score, segment duration, likelihood score, or signal-to-noise ratio.

3. The method of claim 1 , wherein step (d) is disabled if frequency of out-of-vocabulary utterances falls below a predetermined threshold.

4. The method of claim 3 , wherein the top result from step (c) is determined to be the vocabulary contained in the user's speech.

5. The method of claim 1 , wherein step (d) is enabled if the user is a novice to the system.

6. The method of claim 1 , wherein step (d) is enabled for predetermined types of grammar.

7. The method of claim 1 , further comprising the step of creating the second grammar by generating a limited set of vocabulary that includes in-vocabulary within the first grammar.

8. The method of claim 1 , further comprising the step of creating the second grammar by combining two or more other grammars used by a speech recognition system used to implement the method.

9. The method of claim 1 , further comprising the step of creating the second grammar by generating a limited set of vocabulary that does not include in-vocabulary of the first grammar.

10. The method of claim 1 , further comprising the step of creating the second grammar by generating a limited set of vocabulary that does not include triphones or pentaphones of words of the in-vocabulary first grammar.

11. The method of claim 7 , wherein step (e) includes determining the input speech to be in-vocabulary, if one of the top results of the first N-best list is also present within the second N-best list, but out-of-vocabulary if none of the top results of the first N-best list is within the second N-best list.

12. The method of claim 11 , wherein step (e) includes determining the input speech to be in-vocabulary, if the top result of the first N-best list is also present within the second N-best list, but out-of-vocabulary if the top result of the first N-best list is not within the second N-best list.

13. The method of claim 11 , wherein step (e) includes determining the input speech to be in-vocabulary, if the top result of the first N-best list is also present within the top results of the second N-best list, but out-of-vocabulary if the top result of the first N-best list is not within the top results of the second N-best list.

14. The method of claim 1 , wherein the step (f) includes instructing the user to use vocabulary within the first grammar.

15. The method of claim 14 , wherein the step (f) further includes providing a list of acceptable vocabulary within the first grammar.

16. The method of claim 1 , further comprising determining whether latency between steps (b) and (d) falls outside a defined period and, if so, skipping step (d) and redefining the first grammar to also include the second grammar.

17. A speech recognition method for a telematics system that has a speech recognition system, the method comprising the steps of:

(a) receiving input speech from a user to be processed into recognized speech via a microphone associated with an automatic speech recognition system;

(b) processing the input speech using a first grammar to obtain parameter values of a first N-best list of probable vocabulary suggested by a decoder using at least one processor associated with the automatic speech recognition system;

(c) comparing at least one parameter value of a top result of the first N-best list to at least one predetermined threshold value;

(d) subsequently processing the input speech using a second grammar to obtain parameter values of a second N-best list of probable vocabulary suggested by the decoder, if the compared at least one parameter value is below the at least one predetermined threshold value; and

(e) determining the input speech to be in-vocabulary, if any of the results of the first N-best list is also present within the second N-best list, but out-of-vocabulary if none of the results of the first N-best list is within the second N-best list,

wherein the first grammar is different from the second grammar, and the first grammar includes in-vocabulary grammar and the second grammar includes out-of-vocabulary grammar; and

(f) providing audible feedback to the user if the input speech is determined to be out-of-vocabulary.

18. A speech recognition method for a vehicle having a telematics unit with an embedded speech recognition system, the method comprising the steps of:

(a) receiving input speech from a user to be processed into recognized speech via a microphone associated with an automatic speech recognition system;

(b) processing the input speech using a first grammar to obtain parameter values of a first N-best list of probable vocabulary suggested by a decoder using at least one processor associated with the automatic speech recognition system;

(c) comparing at least one parameter value of a top result of the first N-best list to at least one predetermined threshold value, wherein the at least one parameter value is at least one of a confidence score, segment duration, likelihood score, or signal-to-noise ratio;

(d) subsequently processing the input speech using a second grammar to obtain parameter values of a second N-best list of probable vocabulary suggested by the decoder, if the compared at least one parameter value is below the at least one predetermined threshold value;

(e) determining the input speech to be in-vocabulary, if the top result of the first N-best list is also present within the second N-best list, but out-of-vocabulary if the top result of the first N-best list is not within the second N-best list; and

(f) providing audible feedback to the user if the input speech is determined to be out-of-vocabulary,

wherein the first grammar is different from the second grammar, and the first grammar includes in-vocabulary grammar and the second grammar includes out-of-vocabulary grammar.

Assignments (14)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GENERAL MOTORS LLC
Reel/Frame 034183/0436 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GENERAL MOTORS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 025327/0196 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GENERAL MOTORS LLC
Reel/Frame 025315/0162 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025245/0587 →
CHANGE OF NAME Recorded Nov 12, 2009
From: GENERAL MOTORS COMPANY
To: GENERAL MOTORS LLC
Reel/Frame 023504/0691 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GENERAL MOTORS COMPANY
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023155/0849 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2009
From: MOTORS LIQUIDATION COMPANY
To: GENERAL MOTORS COMPANY
Reel/Frame 023148/0248 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GENERAL MOTORS COMPANY
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023155/0814 →
CHANGE OF NAME Recorded Aug 21, 2009
From: GENERAL MOTORS CORPORATION
To: MOTORS LIQUIDATION COMPANY
Reel/Frame 023129/0236 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2009
From: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
To: MOTORS LIQUIDATION COMPANY (F/K/A GENERAL MOTORS CORPORATION)
Reel/Frame 023119/0817 →
RELEASE OF SECURITY INTEREST Recorded Aug 20, 2009
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: MOTORS LIQUIDATION COMPANY (F/K/A GENERAL MOTORS CORPORATION)
Reel/Frame 023119/0491 →
SECURITY AGREEMENT Recorded Apr 16, 2009
From: GENERAL MOTORS CORPORATION
To: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
Reel/Frame 022552/0006 →
SECURITY AGREEMENT Recorded Feb 3, 2009
From: GENERAL MOTORS CORPORATION
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 022191/0254 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2006
From: GROST, TIMOTHY; CHENGALVARAYAN, RATHINAVELU
To: GENERAL MOTORS CORPORATION
Reel/Frame 017605/0488 →
Continuity (1)
Related Publication 20070265849A1 · Nov 15, 2007