IP Library › Granted Patent US 10,931,825
Granted Patent B2
US 10,931,825 · App. 16/172,086 · Granted Feb 23, 2021

Contact center interaction routing using machine learning

Inventors: Ambareesh Revanur (Bangalore, IN); Manigandan Ms (Bangalore, IN); Sateesh Kumar Potturu Naga Venkata (Bangalore, IN)
Assignee: Cisco Technology, Inc.
H04M3/5232H04M3/5175
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,931,825
App. No.
16/172,086
Granted
Feb 23, 2021
Kind
B2
Abstract

A computer system routes contact center interactions. Interactions between contact center agents and contact center queries that are received at a contact center are monitored. A ranking model is trained according to the categories of the contact center queries and the interaction scores of each handled query using machine learning. The ranking model is tested according to various metrics to ensure that the ranking model ranks the agents according to one or more selected business outcomes. A net score may be determined for each contact center agent for each query category based on a predicted interaction score and one or more non-interaction features. Incoming queries may then be routed to an appropriate contact center agent based on the category of the incoming query. Embodiments may further include a method and program product for routing contact center interactions in substantially the same manner described above.

Claims (40)

1. A computer-implemented method comprising:

at a contact center control server associated with a contact center that includes a plurality of agent terminals at which contact center agents serve contact center queries:

monitoring over time interactions between contact center agents and contact center queries received at the contact center;

training a ranking model according to one or more contact center query categories and corresponding interaction scores of each contact center query, wherein an interaction score corresponds to a resolution of a contact center interaction, and wherein the ranking model utilizes machine learning to score each contact center agent for a given contact center query;

testing the ranking model using one or more test metrics to determine that the ranking model ranks the plurality of agents according to one or more selected business outcomes;

determining a net score for each contact center agent for each contact center query category according to a predicted interaction score and one or more non-interaction features of each query, wherein the net score is based on the predicted interaction score multiplied by a value based on a customer wait time, an agent idle time in seconds, an average customer satisfaction score for a given agent in a last hour, and an average customer satisfaction score for the given agent for a given sentiment; and

routing each incoming contact center query to a contact center agent according to the net score of the contact center agent for the contact center query category of the incoming contact center query.

2. The method of claim 1 , wherein the one or more test metrics comprise one or more of: a normalized discounted cumulative gain metric, and an F1 score.

3. The method of claim 1 , wherein the one or more non-interaction features further comprise one or more of: average customer satisfaction scores by hour, and average customer satisfaction scores by sentiment.

4. The method of claim 1 , wherein the one or more selected business outcomes include one or more of a call duration, a customer satisfaction score, and contact center agent idle time.

5. The method of claim 1 , wherein routing comprises routing an incoming query to a contact center agent every n seconds or when m incoming queries arrive.

6. The method of claim 1 , further comprising updating the ranking model to provide latent information for one or more agents.

7. The method of claim 1 , wherein updating the ranking model comprises comparing the ranking model against an older model to determine that the older model is outperformed.

8. The method of claim 1 , wherein the predicted interaction score is generated by the ranking model.

9. An apparatus comprising:

one or more computer processors;

one or more computer readable storage media;

program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising instructions to, on behalf of a contact center control server associated with a contact center that includes a plurality of agent terminals at which contact center agents serve contact center queries:

monitor over time interactions between contact center agents and contact center queries received at the contact center;

train a ranking model according to one or more contact center query categories and corresponding interaction scores of each contact center query, wherein an interaction score corresponds to a resolution of a contact center interaction, and wherein the ranking model utilizes machine learning to score each contact center agent for a given contact center query;

test the ranking model using one or more test metrics to determine that the ranking model ranks the plurality of agents according to one or more selected business outcomes;

determine a net score for each contact center agent for each contact center query category according to a predicted interaction score and one or more non-interaction features of each query, wherein the net score is based on the predicted interaction score multiplied by a value based on a customer wait time, an agent idle time in seconds, an average customer satisfaction score for a given agent in a last hour, and an average customer satisfaction score for the given agent for a given sentiment; and

route each incoming contact center query to a contact center agent according to the net score of the contact center agent for the contact center query category of the incoming contact center query.

10. The apparatus of claim 9 , wherein the one or more test metrics comprise one or more of: a normalized discounted cumulative gain metric, and an F1 score.

11. The apparatus of claim 9 , wherein the one or more non-interaction features further comprise one or more of: average customer satisfaction scores by hour, and average customer satisfaction scores by sentiment.

12. The apparatus of claim 9 , wherein the one or more selected business outcomes include one or more of a call duration, a customer satisfaction score, and contact center agent idle time.

13. The apparatus of claim 9 , wherein routing comprises routing an incoming query to a contact center agent every n seconds or when m incoming queries arrive.

14. One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor, cause the processor to:

at a contact center control server associated with a contact center that includes a plurality of agent terminals at which contact center agents serve contact center queries:

monitor over time interactions between contact center agents and contact center queries received at the contact center;

train a ranking model according to one or more contact center query categories and corresponding interaction scores of each contact center query, wherein an interaction score corresponds to a resolution of a contact center interaction, and wherein the ranking model utilizes machine learning to score each contact center agent for a given contact center query;

test the ranking model using one or more test metrics to determine that the ranking model ranks the plurality of agents according to one or more selected business outcomes;

determine a net score for each contact center agent for each contact center query category according to a predicted interaction score and one or more non-interaction features of each query, wherein the net score is based on the predicted interaction score multiplied by a value based on a customer wait time, an agent idle time in seconds, an average customer satisfaction score for a given agent in a last hour, and an average customer satisfaction score for the given agent for a given sentiment; and

route each incoming contact center query to a contact center agent according to the net score of the contact center agent for the contact center query category of the incoming contact center query.

15. The one or more non-transitory computer readable storage media of claim 14 , wherein the one or more test metrics comprise one or more of: a normalized discounted cumulative gain metric, and an F1 score.

16. The one or more non-transitory computer readable storage media of claim 14 , wherein the one or more non-interaction features further comprise one or more of: average customer satisfaction scores by hour, and average customer satisfaction scores by sentiment.

17. The one or more non-transitory computer readable storage media of claim 14 , wherein routing comprises routing an incoming query to a contact center agent every n seconds or when m incoming queries arrive.

18. The method of claim 1 , wherein the net score comprises a predicted interaction score multiplied by c (cwt+ait+CSAThour+CSATsentiment) , wherein c is a number having a value greater than 1, ait is the agent idle time in seconds, CSAThour is the average customer satisfaction score for a given agent in a last hour, and CSATsentiment is the average customer satisfaction score for the given agent for a given sentiment.

19. The apparatus of claim 9 , wherein the net score comprises a predicted interaction score multiplied by c (cwt+ait+CSAThour+CSATsentiment) , wherein c is a number having a value greater than 1, ait is the agent idle time in seconds, CSAThour is the average customer satisfaction score for a given agent in a last hour, and CSATsentiment is the average customer satisfaction score for the given agent for a given sentiment.

20. The one or more non-transitory computer readable storage media of claim 14 , wherein the net score comprises a predicted interaction score multiplied by c (cwt+ait+CSAThour+CSATsentiment) , wherein c is a number having a value greater than 1, ait is the agent idle time in seconds, CSAThour is the average customer satisfaction score for a given agent in a last hour, and CSATsentiment is the average customer satisfaction score for the given agent for a given sentiment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2018
From: REVANUR, AMBAREESH; MS, MANIGANDAN; VENKATA, SATEESH KUMAR POTTURU NAGA
To: CISCO TECHNOLOGY, INC.
Reel/Frame 047358/0285 →
Continuity (1)
Related Publication 20200137231A1 · Apr 30, 2020
Cited By (1)
US 12,425,518