IP Library Granted Patent US 11,277,516
Granted Patent B2
US 11,277,516 · App. 17/135,354 · Granted Mar 15, 2022

System and method for AB testing based on communication content

Inventors: Michael C. Dwyer (Fort Myers, FL); Erik A. Strand (Fort Myers, FL); Scott R. Wolf (Fort Myers, FL); Frank Salinas (Fort Myers, FL); Jeffrey A. Gallino (Lexington, MA); Scott A. Kendrick (Fort Myers, FL); Shaoyu Xue (Valrico, FL)
Assignee: CallMiner, Inc.
H04M3/5175G06F21/6254G06F40/279G06F40/30G10L15/02G10L15/1815G10L15/26G10L15/30G10L25/72H04M3/42221H04M3/5191G10L2015/088H04M2203/301H04M2203/303H04M2203/401H04M2203/551H04M2203/6009
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,277,516
App. No.
17/135,354
Granted
Mar 15, 2022
Kind
B2
Abstract

Systems and methods include identifying sets of communications using AB testing based on a difference in metadata values between the sets for a first type of metadata, determining at least one similarity between communications in a first set based on metadata values of a second type of metadata, determining at least one similarity between the communications in the second set based on metadata values of the second type of metadata or a third type of metadata, comparing the at least one similarity from the first set to the at least one similarity of the second set to identify differences in metadata values or types of metadata, and determining, based on the differences, a suggested action for an agent for a future communication with respect to at least one of a desired script, a target phrase, or a desired acoustic characteristic.

Claims (19)

1. A method, executed by a computer-based communications analytics facility, comprising:

performing an analysis of acoustic characteristics and language characteristics of a plurality of communications between customers and agents;

assigning respective metadata values to communications of the plurality of communications based on the analysis of the acoustic characteristics and the language characteristics, wherein each metadata value relates to a type of metadata comprising at least one of: a category of a communication, an overall call performance, a score, a successful sale, a successful upselling, a script, a word, a phrase, a tone, a satisfaction, a dissatisfaction, a duration of the communication, a duration of silence, an agitation level, a compliment, an agent, an agent group, or an agent ownership;

identifying at least a first set of communications and a second set of communications of the plurality of communications using AB testing based on a difference in metadata values between the first set and the second set for a first type of metadata;

determining at least one similarity between the communications in the first set based on metadata values of a second type of metadata;

determining at least one similarity between the communications in the second set based on metadata values of the second type of metadata or a third type of metadata;

comparing the at least one similarity from the first set to the at least one similarity of the second set to identify differences in metadata values or types of metadata; and

determining, based on the differences, a suggested action for an agent for a future communication with respect to at least one of a desired script, a target phrase, or a desired acoustic characteristic.

2. The method of claim 1 , wherein the first type of metadata relates to an agent score.

3. The method of claim 1 , wherein the first type of metadata relates to an agent success with respect to sales.

4. The method of claim 3 , wherein the second type of metadata relates to words of the communications.

5. The method of claim 1 , wherein the first set of communications is associated with use of a first script by one or more agents and the second set of communications is associated with use of a second script by the one or more agents.

6. The method of claim 5 , wherein the second type of metadata relates to an agent score of the one or more agents using the first script.

7. The method of claim 5 , wherein the second type of metadata relates to a successful sale of the one or more agents.

8. The method of claim 5 , wherein the third type of metadata is used to determine the at least one similarity between the communications in the second set, and wherein the third type of metadata relates to an agent score of the one or more agents using the second script.

9. The method of claim 1 , wherein multiple factors are used to determine multiple similarities between the communications in the first set.

10. The method of claim 1 , wherein multiple factors are used to determine multiple similarities between the communications in the second set.

11. The method of claim 1 , wherein the plurality of communications is filtered according to a time frame.

12. The method of claim 1 , wherein the first set of communications is based on a first group of agents and the second set of communications is based on a second group of agents.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2023
From: DWYER, MICHAEL C; STRAND, ERIK A; WOLF, SCOTT R; SALINAS, FRANK; GALLINO, JEFFREY A; KENDRICK, SCOTT A; XUE, SHAOYU
To: CALLMINER, INC.
Reel/Frame 063341/0580 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2021
From: DWYER, MICHAEL C.; STRAND, ERIK A.; WOLF, SCOTT R.; SALINAS, FRANK; GALLINO, JEFFREY A.; KENDRICK, SCOTT A.; XUE, SHAOYU
To: CALLMINER, INC.
Reel/Frame 055048/0970 →
Continuity (6)
Continuation 16386499 · Apr 17, 2019
Continuation 15194742 · Jun 28, 2016
Continuation 14592510 · Jan 8, 2015
Provisional Application 62005857 · May 30, 2014
Provisional Application 61924909 · Jan 8, 2014
Related Publication 20210120126A1 · Apr 22, 2021
Cited By (5)
US 12,219,093 US 12,375,604 US 12,489,844 US 12,489,846 US 12,525,232