IP Library Granted Patent US 7,881,929
Granted Patent B2
US 7,881,929 · App. 11/828,093 · Granted Feb 1, 2011

Ambient noise injection for use in speech recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,881,929
App. No.
11/828,093
Granted
Feb 1, 2011
Kind
B2
Abstract

A method of ambient noise injection for use with speech recognition in a production vehicle. The method includes the steps of monitoring audio including user speech, receiving an utterance from the user speech, retrieving vehicle-specific ambient noise, and prepending the vehicle-specific ambient noise to the utterance before pre-processing and decoding the utterance.

Claims (56)

1. A method of ambient noise injection for use with speech recognition in a production vehicle, the method comprising the steps of:

monitoring audio including user speech;

receiving an utterance from the user speech;

retrieving vehicle-specific ambient noise;

prepending the vehicle-specific ambient noise to the utterance before pre-processing and decoding the utterance;

pre-processing the utterance including the vehicle-specific ambient noise; and

decoding the pre-processed utterance including the vehicle-specific ambient noise.

2. The method set forth in claim 1 , wherein the vehicle-specific ambient noise was generated in at least one test vehicle of the same make and model as the production vehicle.

3. The method set forth in claim 1 , wherein the vehicle-specific ambient noise was generated in at least one test vehicle of the same type as the production vehicle.

4. The method set forth in claim 1 , wherein the vehicle-specific ambient noise was generated in at least one test vehicle of the same segment as the production vehicle.

5. The method set forth in claim 1 , wherein the vehicle-specific ambient noise was generated according to a plurality of different vehicle speeds.

6. The method set forth in claim 1 , wherein the vehicle-specific ambient noise was generated according to a plurality of different HVAC settings.

7. The method set forth in claim 1 , wherein the vehicle-specific ambient noise was generated according to a plurality of different vehicle parameters.

8. The method set forth in claim 1 , wherein the vehicle-specific ambient noise is from at least one trailing frame associated with a user utterance preceding the received utterance.

9. The method set forth in claim 1 , wherein the vehicle-specific ambient noise was generated in at least one test vehicle corresponding to the production vehicle and is selected as a proxy for at least one trailing frame associated with a user utterance preceding the received utterance.

10. The method set forth in claim 1 , further comprising the steps of:

identifying at least one speechless frame trailing the utterance;

storing the speechless frame(s);

receiving a subsequent utterance from the user speech;

retrieving the stored speechless frame(s); and

prepending the speechless frame(s) to the subsequent utterance.

11. The method set forth in claim 1 , further comprising:

identifying no speechless frames trailing the utterance;

estimating speech energies in at least one frame trailing the utterance;

comparing the estimated speech energies with speech energies of frames having the vehicle-specific ambient noise, and which are pre-recorded in at least one test vehicle corresponding to the production vehicle;

identifying at least one of the pre-recorded vehicle-specific ambient noise frames having speech energies corresponding to the estimated speech energies;

storing the corresponding pre-recorded vehicle-specific ambient noise frame(s);

receiving a subsequent utterance from the user speech;

retrieving the stored pre-recorded vehicle-specific ambient noise frame(s); and

prepending the retrieved pre-recorded vehicle-specific ambient noise frame(s) to the subsequent utterance.

12. A method of ambient noise injection for speech recognition in a production vehicle, the method comprising the steps of:

initiating a current speech recognition session;

monitoring audio including user speech;

receiving an utterance from the user speech;

determining that the received utterance is a first utterance following the initiation of the current speech recognition session;

retrieving at least one vehicle-specific ambient noise frame from ambient noise frames pre-recorded in a test vehicle corresponding to the production vehicle;

prepending the vehicle-specific ambient noise frame(s) to the utterance(s);

pre-processing the utterance including the ambient noise frame(s); and

decoding the pre-processed utterance including the ambient noise frame(s).

13. The method set forth in claim 12 , further comprising the steps of:

identifying at least one speechless frame trailing the utterance; and

storing the speechless frame(s).

14. The method set forth in claim 13 , further comprising the steps of:

receiving a subsequent utterance from the user speech;

retrieving the stored speechless frame(s); and

prepending the speechless frame(s) to the subsequent utterance.

15. The method set forth in claim 12 , further comprising the steps of:

identifying no speechless frames trailing the utterance;

estimating speech energies in at least one frame trailing the utterance;

comparing the estimated speech energies with speech energies of the pre-recorded ambient noise frames;

identifying at least one of the pre-recorded ambient noise frames having speech energies corresponding to the estimated speech energies; and

storing the corresponding pre-recorded ambient noise frame(s).

16. The method set forth in claim 15 , further comprising the steps of:

receiving a subsequent utterance from the user speech;

retrieving the stored pre-recorded ambient noise frame(s); and

prepending the retrieved pre-recorded ambient noise frame(s) to the subsequent utterance.

Assignments (14)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GENERAL MOTORS LLC
Reel/Frame 034183/0436 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GENERAL MOTORS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 025327/0196 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GENERAL MOTORS LLC
Reel/Frame 025315/0162 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025245/0656 →
CHANGE OF NAME Recorded Nov 12, 2009
From: GENERAL MOTORS COMPANY
To: GENERAL MOTORS LLC
Reel/Frame 023504/0691 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GENERAL MOTORS COMPANY
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023155/0849 →
SECURITY AGREEMENT Recorded Aug 27, 2009
From: GENERAL MOTORS COMPANY
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023155/0814 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2009
From: MOTORS LIQUIDATION COMPANY
To: GENERAL MOTORS COMPANY
Reel/Frame 023148/0248 →
RELEASE OF SECURITY INTEREST Recorded Aug 21, 2009
From: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
To: MOTORS LIQUIDATION COMPANY (F/K/A GENERAL MOTORS CORPORATION)
Reel/Frame 023119/0817 →
CHANGE OF NAME Recorded Aug 21, 2009
From: GENERAL MOTORS CORPORATION
To: MOTORS LIQUIDATION COMPANY
Reel/Frame 023129/0236 →
RELEASE OF SECURITY INTEREST Recorded Aug 20, 2009
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: MOTORS LIQUIDATION COMPANY (F/K/A GENERAL MOTORS CORPORATION)
Reel/Frame 023119/0491 →
SECURITY AGREEMENT Recorded Apr 16, 2009
From: GENERAL MOTORS CORPORATION
To: CITICORP USA, INC. AS AGENT FOR BANK PRIORITY SECURED PARTIES; CITICORP USA, INC. AS AGENT FOR HEDGE PRIORITY SECURED PARTIES
Reel/Frame 022552/0006 →
SECURITY AGREEMENT Recorded Feb 3, 2009
From: GENERAL MOTORS CORPORATION
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 022191/0254 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2008
From: CHENGALVARAYAN, RATHINAVELU; GROST, TIMOTHY J.
To: GENERAL MOTORS CORPORATION
Reel/Frame 020727/0966 →