IP Library Granted Patent US 11,289,077
Granted Patent B2
US 11,289,077 · App. 14/332,115 · Granted Mar 29, 2022

Systems and methods for speech analytics and phrase spotting using phoneme sequences

Inventors: Valentine C. Matula (Granville, OH); Shmuel Shaffer (Palo Alto, CA)
Assignee: Avaya Inc.
G10L15/187G10L25/51G10L2015/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,289,077
App. No.
14/332,115
Granted
Mar 29, 2022
Kind
B2
Abstract

A contact center system can receive audio messages. The system can review audio messages by identifying phoneme strings within the audio messages associated with a characteristic. A phoneme can be a component of spoken language. Identified phoneme strings are used to analyze subsequent audio messages to determine the presence of the characteristic without requiring human analysis. Thus, the identification of phoneme strings then can be used to determine a characteristic of audio messages without transcribing the messages.

Claims (68)

1. A computer-implemented method for determining a characteristic in audio messages, the method comprising:

receiving, by a processor, a first audio message via a network;

partitioning, by the processor, the first audio message into two or more frames;

identifying, by the processor, a first phoneme and a second phoneme in the two or more frames;

producing, by the processor, a first index file by concatenating the two or more frames, wherein the first index file comprises a concatenation of the first and second phonemes;

identifying, by the processor, a first phoneme string in the first index file by comparing the first index file with one or more existing index files, wherein the first phoneme string is associated with a first characteristic;

based on identifying the first phoneme string in the first index file, determining, by the processor, that the first phoneme string indicates the first characteristic;

receiving, by the processor, a second audio message from a website via the network;

identifying, by the processor, the first phoneme string in the second audio message; and

in response to identifying the first phoneme string in the second audio message, determining, by the processor, that the second audio message indicates the first characteristic.

2. The method as defined in claim 1 , further comprising determining statistical information about the first phoneme string.

3. The method as defined in claim 2 , wherein the statistical information includes a confidence score indicating a degree of confidence that the first phoneme string indicates the first characteristic.

4. The method as defined in claim 3 , wherein the first characteristic is associated with one of a positive sentiment and a negative sentiment.

5. The method as defined in claim 3 , further comprising:

determining the confidence score does not reach or cross a predetermined threshold;

receiving a third message; and

in response to determining the confidence score does not reach or cross the predetermined threshold and in response to receiving the third message, re-calculating the confidence score using analysis associated with the third message.

6. The method as defined in claim 1 , wherein the first and second phonemes are associated with the English language.

7. The method as defined in claim 3 , further comprising:

receiving, by the processor, a first set of audio messages;

identifying, by the processor, a second phoneme string in the first set of audio messages, wherein the second phoneme string is associated with a second characteristic;

comparing, by the processor, the second phoneme string in the first set of audio messages with at least two audio messages in a second set of audio messages;

based on the comparing, determining, by the processor, the second phoneme string is absent from the second set of audio messages; and

determining, by the processor, the second characteristic is a new topic present in the first set of audio messages.

8. The method as defined in claim 7 , wherein each of the first and second phoneme strings includes two or more phonemes.

9. The method as defined in claim 8 , further comprising:

analyzing a known negative message; and

identifying phoneme strings in the known negative message.

10. The method as defined in claim 3 , wherein the confidence score is a probability, the method further comprising:

determining the confidence score reaches or crosses a predetermined threshold; and

based on determining the confidence score reaches or crosses the predetermined threshold, signifying the first phoneme string indicates the first characteristic.

11. The method as defined in claim 10 , wherein each of the first and second audio messages includes two or more phonemes.

12. A non-transitory computer-readable storage medium having stored thereon computer-readable processor-executable instructions configured to cause one or more processors of a computing system to execute a method, the method comprising:

receiving a first audio message via a network;

partitioning the first audio message into two or more frames;

identifying a first phoneme and a second phoneme in the two or more frames;

producing a first index file by concatenating the two or more frames, wherein the first index file comprises a concatenation of the first and second phonemes;

identifying a first phoneme string in the first index file by comparing the first index file with one or more existing index files, wherein the first phoneme string is associated with a first characteristic;

based on identifying the first phoneme string in the first index file, determining, by the processor, that the first phoneme string indicates the first characteristic;

receiving, by the processor, a second audio message from a website via the network;

identifying the first phoneme string, associated with the first characteristic, in the second audio message;

identifying, by the processor, the first phoneme string in the second audio message; and

in response to identifying the first phoneme string in the second audio message, determining that the second audio message indicates the first characteristic.

13. The computer readable storage medium as defined in claim 12 , further comprising instructions to determine statistical information about the first phoneme string, wherein the statistical information includes a confidence score indicating a degree of confidence that the first phoneme string indicates the first characteristic.

14. The computer readable storage medium as defined in claim 13 , the method further comprising:

determining the confidence score reaches or crosses a predetermined threshold;

based on determining the confidence score reaches or crosses the predetermined threshold, signifying the first phoneme string indicates the first characteristic.

15. The computer readable storage medium as defined in claim 13 , wherein each of the first audio message and the second audio message includes two or more phonemes.

16. The computer readable storage medium as defined in claim 12 , wherein the first phoneme string comprises two or more phonemes.

17. A communication system comprising:

a dialog system operable to determine an agent routing for an audio message, wherein the dialog system comprises a processing component operable to receive and analyze audio messages, wherein the processing component comprises:

a phoneme identifier operable to:

receive a first audio message via a network;

partition the first audio message into two or more frames;

identify a first phoneme and a second phoneme in the two or more frames; and

produce a first index file by concatenating the two or more frames, wherein the first index file comprises a concatenation of the first and second phonemes;

a phoneme string identifier in communication with the phoneme identifier, wherein the phoneme string identifier is operable to:

identify a first phoneme string in the first index file by comparing the first index file with one or more existing index files, wherein the first phoneme string is associated with a first characteristic; and

based on identifying the first phoneme string in the first index file, determine that the first phoneme string indicates the first characteristic; and

a message characteristic identifier operable to:

receive a second audio message from a website via the network;

identify the first phoneme string in the second audio message; and

in response to identifying the first phoneme string in the second audio message, determine that the second audio message indicates the first characteristic.

18. The communication system as defined in claim 17 , further comprising a statistics analyzer operable to determine statistical information about the first phoneme string, wherein the statistical information includes a confidence score indicating a degree of confidence that the first phoneme string indicates the first characteristic.

19. The communication system as defined in claim 18 , wherein the statistics analyzer is further operable to:

determine the confidence score reaches or crosses a predetermined threshold; and

based on determining the confidence score reaches or crosses the predetermined threshold, signify that the first phoneme string indicates the first characteristic.

20. The communication system as defined in claim 18 , wherein the first characteristic is one of a positive sentiment and a negative sentiment.

Assignments (17)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2014
From: MATULA, VALENTINE C; SHAFFER, SHMUEL
To: AVAYA INC.
Reel/Frame 033317/0495 →
Continuity (1)
Related Publication 20160019882A1 · Jan 21, 2016