IP Library Granted Patent US 10,446,140
Granted Patent B2
US 10,446,140 · App. 16/139,133 · Granted Oct 15, 2019

Method and apparatus for identifying acoustic background environments based on time and speed to enhance automatic speech recognition

Inventor: Mazin Gilbert (Warren, NJ)
Assignee: NUANCE COMMUNICATIONS, INC.
G10L15/20G10L15/07G10L15/08G10L15/26G10L15/30G10L21/0216G10L15/065G11B27/034
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,446,140
App. No.
16/139,133
Granted
Oct 15, 2019
Kind
B2
Abstract

Disclosed are systems, methods, and computer readable media for identifying an acoustic environment of a caller. The method embodiment comprises analyzing acoustic features of a received audio signal from a caller, receiving meta-data information based on a previously recorded speed of the caller, classifying a background environment of the caller based on the analyzed acoustic features and the meta-data, selecting an acoustic model matched to the classified background environment from a plurality of acoustic models, and performing speech recognition as the received audio signal using the selected acoustic model.

Claims (42)

1. A method comprising:

receiving, at a server and over a network, data associated with a speed of a device;

selecting, based at least in part on the data associated with the speed of the device, a background acoustic model from a plurality of acoustic models; and

performing, via the background acoustic model, speech recognition on a received audio signal from the device to yield speech recognition results.

2. The method of claim 1 , further comprising:

classifying a background environment of the device based at least in part on the data associated with the speed of the device, to yield a background environment classification.

3. The method comprising claim 2 , wherein classifying the background environment of the device is further based at least in part on acoustic features of the received audio signal.

4. The method of claim 3 , wherein the acoustic features of the received audio signal comprise one of estimates of background energy, signal-to-noise ratio, and spectral characteristics of the background environment.

5. The method of claim 2 , wherein the background environment classification comprises one of office, airport, street, vehicle, train and home.

6. The method of claim 5 , wherein the background environment is classified based on two levels comprising a first level from a listing of background environments and a second, finer, level based on specific geographic location.

7. The method of claim 1 , where meta-data associated with the received audio signal comprises one of global positioning system coordinates, elevation, automatic number identification information, computing device identification number (comprised of an internet protocol address or MAC address), uniform resource locator address, individual environmental habits, personal profile information, time, and rate of movement.

8. The method of claim 7 , wherein the meta-data comprises personal information associated with a caller using the device and comprises probabilities that the device is in a particular background environment.

9. The method of claim 1 , further comprising:

classifying a first background environment in a call using the device and thereafter classifying a second background environment; and

transitioning from a first acoustic model associated with the first background environment to a second acoustic model associated with the second background environment by:

starting the second acoustic model at an initial state similar to an ending state of the first acoustic model when the first acoustic model and the second acoustic model have similar structure; and

applying a morphing algorithm to the transition from the first acoustic model to the second acoustic model if the first acoustic model and the second acoustic model have dissimilar structures.

10. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

receiving, over a network, data associated with a speed of a device;

selecting, based at least in part on the data associated with the speed of the device, a background acoustic model from a plurality of acoustic models; and

performing, via the background acoustic model, speech recognition on a received audio signal from the device to yield speech recognition results.

11. The system of claim 10 , wherein the computer-readable storage medium stores additional instructions stored which, when executed by the processor, cause the processor to perform operations further comprising:

classifying a background environment of the device based at least in part on the data associated with the speed of the device, to yield a background environment classification.

12. The system comprising claim 11 , wherein classifying the background environment of the device is further based at least in part on acoustic features of the received audio signal.

13. The system of claim 12 , wherein the acoustic features of the received audio signal comprise one of estimates of background energy, signal-to-noise ratio, and spectral characteristics of the background environment.

14. The system of claim 11 , wherein the background environment classification comprises one of office, airport, street, vehicle, train and home.

15. The system of claim 14 , wherein the background environment is classified based on two levels comprising a first level from a listing of background environments and a second, finer, level based on specific geographic location.

16. The system of claim 10 , where meta-data associated with the received audio signal comprises one of global positioning system coordinates, elevation, automatic number identification information, computing device identification number, uniform resource locator address, individual environmental habits, personal profile information, time, and rate of movement.

17. The system of claim 16 , wherein the meta-data comprises personal information associated with a caller using the device and comprises probabilities that the device is in a particular background environment.

18. The system of claim 10 , wherein the computer-readable storage medium stores additional instructions stored which, when executed by the processor, cause the processor to perform operations further comprising:

classifying a first background environment in a call and thereafter classifying a second background environment; and

transitioning from a first acoustic model associated with the first background environment to a second acoustic model associated with the second background environment by:

starting the second acoustic model at an initial state similar to an ending state of the first acoustic model when the first acoustic model and the second acoustic model have similar structure; and

applying a morphing algorithm to the transition from the first acoustic model to the second acoustic model if the first acoustic model and the second acoustic model have dissimilar structures.

19. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

receiving, over a network, data associated with a speed of a device;

selecting, based at least in part on the data associated with the speed of the device, a background acoustic model from a plurality of acoustic models; and

performing, via the background acoustic model, speech recognition on a received audio signal from the device to yield speech recognition results.

20. The computer-readable storage device of claim 19 , wherein the computer-readable storage device stores additional instructions stored which, when executed by the computing device, cause the computing device to perform operations further comprising:

classifying a background environment of the device based at least in part on the data associated with the speed of the device, to yield a background environment classification.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065552/0934 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2019
From: GILBERT, MAZIN
To: AT&T CORP.
Reel/Frame 050035/0595 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2019
From: AT&T CORP.
To: AT&T PROPERTIES, LLC
Reel/Frame 050035/0852 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2019
From: AT&T PROPERTIES, LLC
To: AT&T INTELLECTUAL PROPERTY II, L.P.
Reel/Frame 050035/0923 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2019
From: AT&T INTELLECTUAL PROPERTY II, L.P.
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 050036/0208 →