IP Library Granted Patent US 10,643,604
Granted Patent B2
US 10,643,604 · App. 16/219,537 · Granted May 5, 2020

Language model customization in speech recognition for speech analytics

Inventors: Tamir Tapuhi (Ashdod, IL); Amir Lev-Tov (Bat-Yam, IL); Avraham Faizakof (Kefar Varburg, IL); Yochai Konig (San Francisco, CA)
G10L15/063G06F40/232G06N3/006G06N20/00G10L15/26G10L15/183G10L2015/0635G10L2015/0636G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,643,604
App. No.
16/219,537
Granted
May 5, 2020
Kind
B2
Abstract

A method for generating a language model for an organization includes: receiving, by a processor, organization-specific training data; receiving, by the processor, generic training data; computing, by the processor, a plurality of similarities between the generic training data and the organization-specific training data; assigning, by the processor, a plurality of weights to the generic training data in accordance with the computed similarities; combining, by the processor, the generic training data with the organization-specific training data in accordance with the weights to generate customized training data; training, by the processor, a customized language model using the customized training data; and outputting, by the processor, the customized language model, the customized language model being configured to compute the likelihood of phrases in a medium.

Claims (43)

1. A method for performing voice analytics on interactions with an organization, comprising:

training a customized language model for the organization by:

receiving, by a speech recognition engine, organization-specific training data and generic training data;

computing, by the speech recognition engine, a plurality of similarities between the generic training data and the organization-specific training data;

assigning, by the speech recognition engine, a plurality of weights to the generic training data through partitioning the generic training data into a plurality of partitions in accordance with the computed similarities wherein the computed similarities comprise a fixed set of one or more threshold similarities, associating a partition similarity with each of the partitions, the partition similarity corresponding to the average similarity of the data in the partition, and assigning a desired weight to each partition, the desired weight corresponding to the partition similarity of the partition;

combining, by the speech recognition engine, the generic training data with the organization-specific training data in accordance with the weights to generate customized training data;

training, by the speech recognition engine, the customized language model using the customized training data; and

outputting, by the speech recognition engine, the customized language model, the customized language model being configured to compute a likelihood of phrases in a medium;

receiving, by the speech recognition engine, an input speech from an interaction between a customer and an agent of the organization; and

performing voice analytics on the received input speech.

2. The method of claim 1 , wherein a silhouette score is used to determine a number of the plurality of partitions.

3. The method of claim 1 , wherein a test set of the generic training data and the organization-specific training data empirically determine a number of the plurality of partitions.

4. The method of claim 1 , wherein k-means clustering is used to determine a number of the plurality of partitions.

5. The method of claim 1 , wherein the desired weight of a partition is exponentially decreasing with decreasing partition similarity.

6. The method of claim 1 , wherein the training a customized language model for the organization further comprise:

receiving organization-specific in-medium data;

combining the organization-specific in-medium data with the generic training data and the organization-specific training data to generate the customized training data; and

retraining the language model in accordance with the customized training data.

7. The method of claim 1 , wherein the organization-specific training data comprise at least one of: in-medium data and out-of-medium data.

8. The method of claim 7 , wherein the in-medium data comprise speech recognition transcript text and the out-of-medium data comprise non-speech text.

9. A voice analytics system comprising:

a speech model training system comprising:

a processor; and

memory coupled to the processor and storing instructions that, when executed by the processor, cause the processor to:

receive organization-specific training data and generic training data;

compute a plurality of similarities between the generic training data and the organization-specific training data;

assign a plurality of weights to the generic training data through partitioning the generic training data into a plurality of partitions in accordance with the computed similarities wherein the computed similarities comprise a fixed set of one or more threshold similarities, associating a partition similarity with each of the partitions, the partition similarity corresponding to the average similarity of the data in the partition, and assigning a desired weight to each partition, the desired weight corresponding to the partition similarity of the partition;

combine the generic training data with the organization-specific training data in accordance with the weights to generate customized training data;

train a customized language model using the customized training data; and

output the customized language model, the customized language model being configured to compute the likelihood of phrases in a medium; and

a speech analytics system configured to:

receive an input speech from an interaction between a customer and an agent of the organization; and

perform voice analytics on the received input speech.

10. The speech recognition system of claim 9 , wherein a silhouette score is used to determine a number of the plurality of partitions.

11. The speech recognition system of claim 9 , wherein a test set of the generic training data and the organization-specific training data empirically determine a number of the plurality of partitions.

12. The speech recognition system of claim 9 , wherein k-means clustering is used to determine a number of the plurality of partitions.

13. The speech recognition system of claim 9 , wherein the desired weight of a partition is exponentially decreasing with decreasing partition similarity.

14. The speech recognition system of claim 9 , wherein the memory of the speech training model system further stores instructions that, when executed by the processor, cause the processor to:

receive organization-specific in-medium data;

combine the organization-specific in-medium data with the generic training data and the organization-specific training data to generate the customized training data; and

retrain the language model in accordance with the customized training data.

15. The speech recognition system of claim 9 , wherein the organization-specific training data comprise at least one of: in-medium data and out-of-medium data.

16. The speech recognition system of claim 15 , wherein the in-medium data comprise speech recognition transcript text and the out-of-medium data comprise non-speech text.

Assignments (4)
NOTICE OF SUCCESSION OF SECURITY INTERESTS AT REEL/FRAME 04814/0387 Recorded Feb 5, 2025
From: BANK OF AMERICA, N.A., AS RESIGNING AGENT
To: GOLDMAN SACHS BANK USA, AS SUCCESSOR AGENT
Reel/Frame 070115/0445 →
CHANGE OF NAME Recorded May 13, 2024
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.
To: GENESYS CLOUD SERVICES, INC.
Reel/Frame 067391/0073 →
SECURITY AGREEMENT Recorded Feb 22, 2019
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.; ECHOPASS CORPORATION; GREENEDEN U.S. HOLDINGS II, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 048414/0387 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2018
From: TAPUHI, TAMIR; LEV-TOV, AMIR; FAIZAKOF, AVRAHAM; KONIG, YOCHAI
To: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.
Reel/Frame 047826/0714 →