IP Library Granted Patent US 7,729,911
Granted Patent B2
US 7,729,911 · App. 11/235,961 · Granted Jun 1, 2010

Speech recognition method and system

Assignee: General Motors LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,729,911
App. No.
11/235,961
Granted
Jun 1, 2010
Kind
B2
Abstract

A speech recognition method comprising the steps of: storing multiple recognition models for a vocabulary set, each model distinguished from the other models in response to a Lombard characteristic, detecting at least one speaker utterance in a motor vehicle, selecting one of the multiple recognition models in response to a Lombard characteristic of the at least one speaker utterance, utilizing the selected recognition model to recognize the at least one speaker utterance; and providing a signal in response to the recognition.

Claims (37)

1. A speech recognition method, comprising:

storing multiple recognition models for a vocabulary set, each model classified according to a Lombard cluster, wherein each model is distinguishable from the other models based on a Lombard characteristic, the Lombard characteristic representing changes in an utterance pitch and volume in the presence of background noise;

detecting at least one speaker utterance in a motor vehicle;

selecting, via a processing device, one of the multiple recognition models in response to a Lombard characteristic of the at least one speaker utterance;

utilizing the selected recognition model to recognize the at least one speaker utterance; and

providing a signal in response to the recognition.

2. The method according to claim 1 , further comprising building the stored multiple recognition models by:

recording utterances from a plurality of persons, wherein at least some of the recorded utterances are made with background noise audible to each person but not included in the recording of the utterances, and wherein the background noise is varied with different recordings to create a Lombard corpus; and

classifying the recorded utterances in response to the Lombard characteristic to create a plurality of classifications.

3. The method according to claim 2 wherein the building further comprises:

convolving data in the Lombard corpus with a response characteristic of a vehicle;

adding noise to the convolved data; and

training the multiple recognition models based on a result of the adding, wherein each recognition model corresponds to one of the plurality of classifications.

4. The method of claim 3 wherein the noise added to the convolved data represents vehicle ambient noise at various operating conditions of the vehicle.

5. The method of claim 2 wherein the Lombard characteristic includes a Lombard level of the background noise.

6. The method of claim 1 wherein the Lombard characteristic includes a curve representing speaker utterances correlated to changing background noise.

7. The method of claim 6 , further comprising storing the detected speaker utterances in a memory by determining a Lombard curve of a plurality of detected speaker utterances, wherein the selecting of the one of the multiple recognition models is in response to the determined Lombard curve.

8. The method of claim 1 wherein the Lombard characteristic includes a partial curve of speaker utterances in response to changing background noise.

9. The method of claim 1 wherein the Lombard characteristic includes a background noise level audible to a speaker during an utterance.

10. The method of claim 1 , further comprising selecting a default model if a model matching the Lombard characteristic of the at least one speaker utterance is not available.

11. The method of claim 1 , further comprising transmitting data responsive to the at least one speaker utterance to a remote station, wherein the selecting of the one of the multiple recognition models is performed at the remote station.

12. The method of claim 11 , further comprising downloading the selected recognition model to an in-vehicle device.

13. The method of claim 11 wherein the recognizing is performed at the remote station.

14. The method of claim 1 wherein the recognizing is performed by an in-vehicle device.

15. A speech recognition system, comprising:

memory containing multiple recognition models for a vocabulary set, each recognition model trained according to a Lombard cluster of utterances, wherein each model is distinguishable from the other models based on a Lombard characteristic, the Lombard characteristic representing changes in an utterance pitch and volume in the presence of background noise;

a sound-detecting device receiving at least one speaker utterance; and

a processing device containing control structure executed to: select one of the multiple recognition models in response to a Lombard characteristic of the at least one speaker utterance; utilize the selected recognition model to recognize the at least one speaker utterance; and provide a signal in response to the recognizing.

16. The system of claim 15 wherein the sound-detecting device is in a motor vehicle.

17. The system of claim 16 wherein the processing device is located at a station remote from the motor vehicle.

18. The system of claim 15 wherein the processing device is integrated into a motor vehicle.

19. A speech recognition system, comprising:

a vocabulary recording subsystem for recording utterances of a desired vocabulary from a plurality of speakers and storing data from the recorded utterances as a corpus, wherein background noise is audible to each speaker but not contained in the recorded utterances;

a mixing device for mixing various background sounds with the recorded utterances; and

a data structure containing at least two models of the desired vocabulary, each of the at least two models classified according to a Lombard cluster, wherein each of the models are responsive to the mixing device, and wherein each of the models is distinguishable from the other based on a Lombard characteristic of at least a portion of the corpus, the Lombard characteristic representing changes in an utterance pitch and volume in the presence of background noise.

20. The speech recognition system of claim 19 wherein at least one copy of the data structure is located in a motor vehicle.

21. The speech recognition system of claim 19 , further comprising a convolving device configured to convolve the recorded utterances with a signal representative of a vehicle acoustic response and to provide the recorded utterances to the mixing device.

Assignments (14)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GENERAL MOTORS LLC
Reel/Frame 034183/0436 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GENERAL MOTORS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 025327/0196 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GENERAL MOTORS LLC
Reel/Frame 025315/0162 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025245/0587 →
CHANGE OF NAME Recorded Nov 12, 2009
From: GENERAL MOTORS COMPANY
To: GENERAL MOTORS LLC
Reel/Frame 023504/0691 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2009
From: MOTORS LIQUIDATION COMPANY
To: GENERAL MOTORS COMPANY
Reel/Frame 023148/0248 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GENERAL MOTORS COMPANY
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023155/0814 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GENERAL MOTORS COMPANY
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023155/0849 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2009
From: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
To: MOTORS LIQUIDATION COMPANY (F/K/A GENERAL MOTORS CORPORATION)
Reel/Frame 023119/0817 →
CHANGE OF NAME Recorded Aug 21, 2009
From: GENERAL MOTORS CORPORATION
To: MOTORS LIQUIDATION COMPANY
Reel/Frame 023129/0236 →
RELEASE OF SECURITY INTEREST Recorded Aug 20, 2009
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: MOTORS LIQUIDATION COMPANY (F/K/A GENERAL MOTORS CORPORATION)
Reel/Frame 023119/0491 →
SECURITY AGREEMENT Recorded Apr 16, 2009
From: GENERAL MOTORS CORPORATION
To: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
Reel/Frame 022552/0006 →
SECURITY AGREEMENT Recorded Feb 3, 2009
From: GENERAL MOTORS CORPORATION
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 022191/0254 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2006
From: VARAYAN, RATHINA VELU CHENGAL; PENNOCK, SCOTT M.
To: GENERAL MOTORS CORPORATION
Reel/Frame 017218/0018 →
Continuity (1)
Related Publication 20070073539A1 · Mar 29, 2007