IP Library Granted Patent US 9,837,072
Granted Patent B2
US 9,837,072 · App. 15/595,131 · Granted Dec 5, 2017

System and method for personalization of acoustic models for automatic speech recognition

Inventors: Andrej Ljolje (Morris Plains, NJ); Diamantino Antonio Caseiro (Philadelphia, PA); Alistair D. Conkie (San Jose, CA)
Assignee: Nuance Communications, Inc.
G10L15/07G10L15/04G10L15/083G10L15/14G10L15/22G10L15/28G10L15/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,837,072
App. No.
15/595,131
Granted
Dec 5, 2017
Kind
B2
Abstract

Disclosed herein are methods, systems, and computer-readable storage media for automatic speech recognition. The method includes selecting a speaker independent model, and selecting a quantity of speaker dependent models, the quantity of speaker dependent models being based on available computing resources, the selected models including the speaker independent model and the quantity of speaker dependent models. The method also includes recognizing an utterance using each of the selected models in parallel, and selecting a dominant speech model from the selected models based on recognition accuracy using the group of selected models. The system includes a processor and modules configured to control the processor to perform the method. The computer-readable storage medium includes instructions for causing a computing device to perform the steps of the method.

Claims (43)

1. A method comprising:

starting a current automatic speech recognition session for recognizing speech received from a user via a device;

identifying, via a processor, a group of speech recognition models comprising a speaker independent model and a speaker dependent model;

recognizing the speech via each model in the group of speech recognition models, to yield recognition results;

selecting, based on the recognition results, a dominant speech model from the group of speech recognition models to yield a remainder set of dropped speech recognition models; and

continuously using only the dominant speech model, without applying the remainder set of dropped speech recognition models, to recognize additional speech received from the user.

2. The method of claim 1 , wherein recognizing the speech via each model in the group of speech recognition models is performed in parallel.

3. The method of claim 1 , wherein selecting the dominant speech model from the group of speech recognition models is performed using a heuristic search algorithm.

4. The method of claim 1 , wherein the additional speech received from the user is received during a remainder of the automatic speech recognition session.

5. The method of claim 1 , further comprising dropping a speech model from the group of speech recognition models when recognition accuracy is below a threshold.

6. The method of claim 1 , further comprising selecting the dominant speech model based on the device.

7. The method of claim 6 , further comprising selecting the dominant speech model based on a plurality of users associated with the device.

8. The method of claim 1 , further comprising receiving additional utterances from the device and clustering the additional utterances to generate a new speaker dependent model.

9. The method of claim 1 , further comprising iteratively generating a group of selected models, recognizing the speech, and selecting the dominant speech model, each time a new automatic speech recognition session is initiated.

10. The method of claim 1 , wherein the dominant speech model is associated with a current location of the device for use in future speech dialogs.

11. A system comprising:

a processor; and

a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:

starting a current automatic speech recognition session for recognizing speech received from a user via a device;

identifying a group of speech recognition models comprising a speaker independent model and a speaker dependent model;

recognizing the speech via each model in the group of speech recognition models, to yield recognition results;

selecting, based on the recognition results, a dominant speech model from the group of speech recognition models to yield a remainder set of dropped speech recognition models; and

continuously using only the dominant speech model, without applying the remainder set of dropped speech recognition models, to recognize additional speech received from the user.

12. The system of claim 11 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:

recognizing the speech via each model in the group of speech recognition models in parallel.

13. The system of claim 11 , wherein selecting the dominant speech model from the group of speech recognition models is performed using a heuristic search algorithm.

14. The system of claim 11 , wherein the additional speech received from the user is received during a remainder of the automatic speech recognition session.

15. The system of claim 11 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:

dropping a speech model from the group of speech recognition models when recognition accuracy is below a threshold.

16. The system of claim 11 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:

selecting the dominant speech model based on the device.

17. The system of claim 16 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:

selecting the dominant speech model based on a plurality of users associated with the device.

18. The system of claim 11 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:

receiving additional utterances from the device and clustering the additional utterances to generate a new speaker dependent model.

19. The system of claim 11 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:

iteratively generating a group of selected models, recognizing the speech, and selecting the dominant speech model, each time a new automatic speech recognition session is initiated.

20. A computer-readable storage device having instructions stored which, when executed by a computing device, result in the computing device performing operations comprising:

starting a current automatic speech recognition session for recognizing speech received from a user via a device;

identifying a group of speech recognition models comprising a speaker independent model and a speaker dependent model;

recognizing the speech via each model in the group of speech recognition models, to yield recognition results;

selecting, based on the recognition results, a dominant speech model from the group of speech recognition models to yield a remainder set of dropped speech recognition models; and

continuously using only the dominant speech model, without applying the remainder set of dropped speech recognition models, to recognize additional speech received from the user.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2017
From: LJOLJE, ANDREJ; CASEIRO, DIAMANTINO ANTONIO; CONKIE, ALISTAIR D.
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 044347/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2017
From: AT&T INTELLECTUAL PROPERTY I, L.P.
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 044347/0898 →
Continuity (3)
Continuation 14700324 · Apr 30, 2015
Continuation 12561005 · Sep 16, 2009
Related Publication 20170249937A1 · Aug 31, 2017