IP Library Granted Patent US 10,462,300
Granted Patent B2
US 10,462,300 · App. 15/980,995 · Granted Oct 29, 2019

Technologies for monitoring interaction between customers and agents using sentiment detection

Inventors: Alexander G. Dumaine (Durham, NC); Richard J. Walsh (Durham, NC)
H04M3/5232G06K9/00G06K9/00268G06K9/00315G06K9/6267G06Q10/063112G06Q30/016H04M3/5183H04N7/147H04M2201/50H04M2203/2038
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,462,300
App. No.
15/980,995
Granted
Oct 29, 2019
Kind
B2
Abstract

Technologies for monitoring interactions between customers and agents include an interaction management computing device communicatively coupling a customer computing device and an agent computing device to facilitate a support call interaction. The interaction management computing device is configured to receive a video call from a customer and perform a facial recognition analysis of the customer based on images of the customer received with the video call. Additionally, the interaction management computing device is configured to determine a probable emotional state of the customer as a function of the facial recognition analysis of the customer and insert the video call into a service queue as a function of the probable emotional state of the customer. Additional embodiments are described herein.

Claims (46)

1. A method for assigning a video call from a customer from a service queue to an agent, utilizing sentiment detection from interactions between customers and agents, the method comprising:

receiving, by an interaction management computing device, a video call from a customer;

performing, by the interaction management computing device, a facial recognition analysis of the customer based on images of the customer received with the video call;

performing, by the interaction management computing device and subsequent to a determination that an agent is available to receive the video call inserted into a service queue, a facial recognition analysis of the agent based on images of a video stream captured of the agent;

determining, by the interaction management computing device, a probable emotional state of the customer as a function of the facial recognition analysis of the customer;

determining, by the interaction management computing device and subsequent to the determination that the agent is available to receive the video call inserted into a service queue, a present emotional state of the agent as a function of the facial recognition analysis of the agent; and

determining, by the interaction management computing device, whether to transfer the video call to the agent as a function of the determined probable emotional state of the customer and the determined present emotional state of the agent.

2. The method of claim 1 , further comprising:

identifying, by the interaction management computing device, one or more facial features of the customer as a function of the facial recognition analysis of the customer; and

determining, by the interaction management computing device, a classification of the customer as a function of the identified one or more facial features,

wherein determining the probable emotional state of the customer comprises determining the probable emotional state of the customer as a function of the classification of the customer.

3. The method of claim 1 , further comprising retrieving, by the interaction management computing device, a customer interaction profile of the customer, wherein determining whether to transfer the video call to the agent is further determined as a function of historical information included in the customer interaction profile of the customer.

4. The method of claim 1 , further comprising:

transferring, by the interaction management computing device, the video call from the service queue to the agent;

monitoring, by the interaction management computing device, an interaction between the customer and the agent; and

determining, by the interaction management computing device, one or more sentiment scores as a function of the monitored interaction between the customer and the agent.

5. The method of claim 4 , further comprising:

determining, by the interaction management computing device, an updated emotional state of the customer as a function of the facial recognition analysis; and

updating, by the interaction management computing device, one or more of the sentiment scores as a function of the updated emotional state of the customer.

6. The method of claim 4 , further comprising providing, by the interaction management computing device, feedback to the agent as a function of the one or more of the sentiment scores, wherein the feedback is indicative of a present emotional state of the customer or the agent.

7. The method of claim 6 , wherein providing the feedback to the agent comprises providing a visual indicator usable by the agent to perform an action, wherein the action includes at least one of changing an emotional state of the agent and escalating the call to a supervisor.

8. The method of claim 4 , wherein the sentiment scores include an interaction score, an agent happiness score, and a customer happiness score.

9. An interaction management computing device for assigning a video call from a customer from a service queue to an agent, the interaction management computing device comprising:

one or more computer-readable media comprising instructions; and

one or more processors coupled with the one or more computer-readable media and configured to execute the instructions to:

receive a video call from a customer;

perform a facial recognition analysis of the customer based on images of the customer received with the video call;

perform, subsequent to a determination that an agent is available to receive the video call inserted into a service queue, a facial recognition analysis of the agent based on images of a video stream captured of the agent;

determine a probable emotional state of the customer as a function of the facial recognition analysis of the customer;

determine, subsequent to a determination that the agent is available to receive the video call inserted into a service queue, a present emotional state of the agent as a function of the facial recognition analysis of the agent; and

determine whether to transfer the video call to the agent as a function of the determined present emotional state of the agent and the determined probable emotional state of the customer.

10. The interaction management computing device of claim 9 , wherein the one or more processors are further configured to execute the instructions to:

identify one or more facial features of the customer as a function of the facial recognition analysis of the customer; and

determine a classification of the customer as a function of the identified one or more facial features,

wherein to determine the probable emotional state of the customer comprises to determine the probable emotional state of the customer as a function of the classification of the customer.

11. The interaction management computing device of claim 9 , wherein the one or more processors are further configured to execute the instructions to retrieve a customer interaction profile of the customer, wherein to determine whether to transfer the video call to the agent is further determined as a function of historical information included in the customer interaction profile of the customer.

12. The interaction management computing device of claim 9 , wherein the one or more processors are further configured to execute the instructions to:

transfer the video call from the service queue to the agent;

monitor an interaction between the customer and the agent; and

determine one or more sentiment scores as a function of the monitored interaction between the customer and the agent.

13. The interaction management computing device of claim 12 , wherein the one or more processors are further configured to execute the instructions to:

determine an updated emotional state of the customer as a function of the facial recognition analysis; and

update one or more of the sentiment scores as a function of the updated emotional state of the customer.

14. The interaction management computing device of claim 12 , wherein the one or more processors are further configured to execute the instructions to provide feedback to the agent as a function of the one or more of the sentiment scores, wherein the feedback is indicative of a present emotional state of the customer or the agent.

15. The interaction management computing device of claim 14 , wherein to provide the feedback to the agent comprises to provide a visual indicator usable by the agent to perform an action, wherein the action includes at least one of changing an emotional state of the agent and escalating the call to a supervisor.

16. The interaction management computing device of claim 12 , wherein the sentiment scores include an interaction score, an agent happiness score, and a customer happiness score.

Assignments (5)
NOTICE OF SUCCESSION OF SECURITY INTERESTS AT REEL/FRAME 04814/0387 Recorded Feb 5, 2025
From: BANK OF AMERICA, N.A., AS RESIGNING AGENT
To: GOLDMAN SACHS BANK USA, AS SUCCESSOR AGENT
Reel/Frame 070115/0445 →
CHANGE OF NAME Recorded Jun 6, 2024
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.
To: GENESYS CLOUD SERVICES, INC.
Reel/Frame 067646/0448 →
SECURITY AGREEMENT Recorded Feb 22, 2019
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.; ECHOPASS CORPORATION; GREENEDEN U.S. HOLDINGS II, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 048414/0387 →
MERGER Recorded Oct 5, 2018
From: INTERACTIVE INTELLIGENCE GROUP, INC.
To: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.
Reel/Frame 047082/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2018
From: DUMAINE, ALEXANDER G.; WALSH, RICHARD J.
To: INTERACTIVE INTELLIGENCE GROUP, INC.
Reel/Frame 047000/0333 →
Cited By (1)
US 12,282,880