IP Library Granted Patent US 8,121,837
Granted Patent B2
US 8,121,837 · App. 12/109,151 · Granted Feb 21, 2012

Adjusting a speech engine for a mobile computing device based on background noise

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,121,837
App. No.
12/109,151
Granted
Feb 21, 2012
Kind
B2
Abstract

Methods, apparatus, and products are disclosed for adjusting a speech engine for a mobile computing device based on background noise, the mobile computing device operatively coupled to a microphone, that include: sampling, through the microphone, background noise for a plurality of operating environments in which the mobile computing device operates; generating, for each operating environment, a noise model in dependence upon the sampled background noise for that operating environment; and configuring the speech engine for the mobile computing device with the noise model for the operating environment in which the mobile computing device currently operates.

Claims (46)

1. A method of adjusting a speech engine for a mobile computing device based on background noise, the mobile computing device operatively coupled to a microphone, the method comprising:

determining whether a previously-generated background noise model exists for a current operating environment of the mobile computing device; and

if it is determined that no previously-generated background noise model exists for the current operating environment:

sampling, through the microphone, background noise for the current operating environment,

generating a background noise model based at least in part on the sampled background noise, and

configuring the speech engine for the mobile computing device with the background noise model.

2. The method of claim 1 , wherein the method further comprises detecting a change in an operating environment of the mobile computing device.

3. The method of claim 1 , wherein:

if it is determined that the previously-generated background noise model exists for the current operating environment, configuring the speech engine with the previously-generated background noise model.

4. The method of claim 1 , wherein configuring the speech engine for the mobile computing device with the background noise model for the current operating environment comprises updating a current acoustic model for the speech engine with the background noise model.

5. The method of claim 1 , wherein configuring the speech engine for the mobile computing device with the background noise model for the current operating environment comprises replacing a current acoustic model for the speech engine with another acoustic model already incorporating the background noise model.

6. The method of claim 1 , wherein:

the mobile computing device is implemented as a multimodal device having installed upon it a multimodal application, the multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to the speech engine; and

the method further comprises performing speech recognition for the multimodal application using the speech engine configured for the mobile computing device with the background noise model for the current operating environment.

7. The method of claim 1 , wherein the background noise model comprises a predetermined number of frequency domain components.

8. An apparatus for adjusting a speech engine for a mobile computing device based on background noise, the mobile computing device operatively coupled to a microphone, the apparatus comprising:

a processor configured to:

determine whether a previously-generated background noise model exists for a current operating environment of the mobile computing device; and

if it is determined that no previously-generated background noise model exists for the current operating environment, the processor is further configured to:

sample, through the microphone, background noise for the current operating environment;

generate a background noise model based at least in part on the sampled background noise, and

configure the speech engine for the mobile computing device with the background noise model.

9. The apparatus of claim 8 , wherein the processor is further configured to detect a change in an operating environment of the mobile computing device.

10. The apparatus of claim 8 , wherein:

if it is determined that the previously-generated background model exists for the current operating environment, the processor is further configured to configure the speech engine for the mobile computing device with the previously-generated noise model for the current operating environment.

11. The apparatus of claim 8 , wherein the processor is configured to configure the speech engine for the mobile computing device with the background noise model by updating a current acoustic model for the speech engine with the background noise model.

12. The apparatus of claim 8 , wherein the processor is configured to configure the speech engine for the mobile computing device with the background noise model for the current operating environment by replacing a current acoustic model for the speech engine with another acoustic model already incorporating the background noise model.

13. The apparatus of claim 8 , wherein:

the mobile computing device is implemented as a multimodal device having installed upon it a multimodal application, the multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to the speech engine; and

the processor is configured to perform speech recognition for the multimodal application using the speech engine configured for the mobile computing device with the noise model for the current operating environment.

14. The apparatus of claim 8 , wherein the background noise model comprises a predetermined number of frequency domain components.

15. A computer readable recordable storage medium storing processor-executable instructions that when executed by a processor perform:

determining whether a previously-generated background noise model exists for a current operating environment of a mobile computing device; and

if it is determined that no previously-generated background model exists for the current operating environment:

sampling, through a microphone operatively coupled to the mobile computing device, background noise for the current operating environment,

generating a background noise model based at least in part on the sampled background noise, and

configuring the speech engine for the mobile computing device with the background noise model.

16. The computer readable recordable storage medium of claim 15 , wherein the method further comprises:

detecting a change in an operating environment of the mobile computing device.

17. The computer readable recordable storage medium of claim 15 , wherein:

if it is determined that the previously-generated background model exists for the current operating environment, configuring the speech engine with the previously-generated background noise model.

18. The computer readable recordable storage medium of claim 15 , wherein configuring the speech engine for the mobile computing device with the background noise model for the current operating environment comprises updating a current acoustic model for the speech engine with the background noise model.

19. The computer readable recordable storage medium of claim 15 , wherein configuring the speech engine for the mobile computing device with the background noise model for the current operating environment comprises replacing a current acoustic model for the speech engine with another acoustic model already incorporating the background noise model.

20. The computer readable recordable storage medium of claim 15 , wherein:

the mobile computing device is implemented as a multimodal device having installed upon it a multimodal application, the multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to the speech engine; and

the computer program product comprises computer program instructions capable of performing speech recognition for the multimodal application using the speech engine configured for the mobile computing device with the background noise model for the current operating environment.

Assignments (8)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2009
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 022689/0317 →