IP Library Granted Patent US 10,083,687
Granted Patent B2
US 10,083,687 · App. 15/784,653 · Granted Sep 25, 2018

Method and apparatus for identifying acoustic background environments based on time and speed to enhance automatic speech recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,083,687
App. No.
15/784,653
Granted
Sep 25, 2018
Kind
B2
Abstract

Disclosed are systems, methods, and computer readable media for identifying an acoustic environment of a caller. The method embodiment comprises analyzing acoustic features of a received audio signal from a caller, receiving meta-data information based on a previously recorded time and speed of the caller, classifying a background environment of the caller based on the analyzed acoustic features and the meta-data, selecting an acoustic model matched to the classified background environment from a plurality of acoustic models, and performing speech recognition as the received audio signal using the selected acoustic model.

Claims (39)

1. A method comprising:

selecting a background acoustic model for a device from a plurality of acoustic models based at least in part on a speed of the device; and

performing, via the background acoustic model operating on the device, speech recognition on a received audio signal from a user of the device.

2. The method of claim 1 , further comprising:

classifying a background environment of the device based at least in part on the speed of the device, to yield a background environment classification.

3. The method comprising claim 2 , wherein classifying the background of the device is further based at least in part on acoustic features of the received audio signal.

4. The method of claim 3 , wherein the acoustic features of the received audio signal comprise one of estimates of background energy, signal-to-noise ratio, and spectral characteristics of the background environment.

5. The method of claim 2 , wherein the background environment classification comprises one of office, airport, street, vehicle, train and home.

6. The method of claim 5 , wherein the background environment is classified based on two levels comprising a first level from a listing of background environments and a second, finer, level based on specific geographic location.

7. The method of claim 1 , where meta-data associated with the received audio signal comprises one of global positioning system coordinates, elevation, automatic number identification information, computing device identification number (comprised of an internet protocol address or MAC address), uniform resource locator address, individual environmental habits, personal profile information, time, and rate of movement.

8. The method of claim 7 , wherein the meta-data comprises personal information associated with a caller and comprises probabilities that the device is in a particular background environment.

9. The method of claim 1 , further comprising:

classifying a first background environment in a call and thereafter classifying a second background environment; and

transitioning from a first acoustic model associated with the first background environment to a second acoustic model associated with the second background environment by:

starting the second acoustic model at an initial state similar to an ending state of the first acoustic model when the first acoustic model and the second acoustic model have similar structure; and

applying a morphing algorithm to the transition from the first acoustic model to the second acoustic model if the first acoustic model and the second acoustic model have dissimilar structures.

10. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

selecting a background acoustic model for a device from a plurality of acoustic models based at least in part on a speed of the device; and

performing, via the background acoustic model operating on the device, speech recognition on a received audio signal from a user of the device.

11. The system of claim 10 , wherein the computer-readable storage medium stores additional instructions stored which, when executed by the processor, cause the processor to perform operations further comprising:

classifying a background environment of the device based at least in part on the speed of the device, to yield a background environment classification.

12. The system comprising claim 11 , wherein classifying the background of the device is further based at least in part on acoustic features of the received audio signal.

13. The system of claim 12 , wherein the acoustic features of the received audio signal comprise one of estimates of background energy, signal-to-noise ratio, and spectral characteristics of the background environment.

14. The system of claim 11 , wherein the background environment classification comprises one of office, airport, street, vehicle, train and home.

15. The system of claim 14 , wherein the background environment is classified based on two levels comprising a first level from a listing of background environments and a second, finer, level based on specific geographic location.

16. The system of claim 10 , where meta-data associated with the received audio signal comprises one of global positioning system coordinates, elevation, automatic number identification information, computing device identification number (comprised of an internet protocol address or MAC address), uniform resource locator address, individual environmental habits, personal profile information, time, and rate of movement.

17. The system of claim 16 , wherein the meta-data comprises personal information associated with a caller and comprises probabilities that the device is in a particular background environment.

18. The system of claim 10 , wherein the computer-readable storage medium stores additional instructions stored which, when executed by the processor, cause the processor to perform operations further comprising:

classifying a first background environment in a call and thereafter classifying a second background environment; and

transitioning from a first acoustic model associated with the first background environment to a second acoustic model associated with the second background environment by:

starting the second acoustic model at an initial state similar to an ending state of the first acoustic model when the first acoustic model and the second acoustic model have similar structure; and

applying a morphing algorithm to the transition from the first acoustic model to the second acoustic model if the first acoustic model and the second acoustic model have dissimilar structures.

19. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

selecting a background acoustic model for a device from a plurality of acoustic models based at least in part on a speed of the device; and

performing, via the background acoustic model operating on the device, speech recognition on a received audio signal from a user of the device.

20. The computer-readable storage device of claim 19 , wherein the computer-readable storage device stores additional instructions stored which, when executed by the computing device, cause the computing device to perform operations further comprising:

classifying a background environment of the device based at least in part on the speed of the device, to yield a background environment classification.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065552/0934 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2020
From: GILBERT, MAZIN
To: AT&T CORP.
Reel/Frame 053548/0622 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2020
From: AT&T CORP.
To: AT&T PROPERTIES, LLC
Reel/Frame 053549/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2020
From: AT&T PROPERTIES, LLC
To: AT&T INTELLECTUAL PROPERTY II, L.P.
Reel/Frame 053551/0451 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2020
From: AT&T INTELLECTUAL PROPERTY II, L.P.
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 053551/0848 →