IP Library Granted Patent US 11,785,140
Granted Patent B2
US 11,785,140 · App. 17/029,775 · Granted Oct 10, 2023

Gesture-based call center agent state change control

Inventors: Harsh V. Mendiratta (East Brunswick, NJ); David Chavez (Broomfield, CO); John A. Young (Buntingford, GB)
Assignee: Avaya Management L.P.
H04M3/42374G06F3/017G06F18/21G06F18/22G06V40/20H04M3/5183H04M2203/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,785,140
App. No.
17/029,775
Granted
Oct 10, 2023
Kind
B2
Abstract

Users of a networked communication device may omit updating their availability state, and that of an associated communication device, if the state change is sudden or believed to be of sufficiently short duration. By quickly changing their state, a routing component may more accurately know whether or not a communication routed to the communication device will or will not be answered. By utilizing a camera and gesture processing logic, a user may naturally and quickly update their state without the need to navigate menus or select options with manual, tactile interactions with the communication device.

Claims (79)

1. A system, comprising:

a processor configured with machine-readable instructions maintained in a non-transitory storage;

a camera; and

a network interface to a network; and

wherein the processor performs:

receiving a first image from the camera;

evaluating the first image to determine whether the first image comprises a state update gesture made by a user; and

upon determining that the first image comprises the state update gesture, providing a component, via the network, with a state of the system associated with the state update gesture to cause the system to selectively be excluded or included from receiving communications, comprising exclusion when the state is associated with unavailability or inclusion when the state is associated with availability.

2. The system of claim 1 , wherein the processor performs the evaluating the first image to determine whether the first image comprises the state update gesture made by the user, further comprising:

determining whether the first image comprises a state update gesture made by another party different from the user; and

upon determining that the state update gesture was made by another party, omitting providing the component with the state of the system.

3. The system of claim 1 , wherein the processor performs the evaluating of the first image to determine whether the first image comprises the state update gestures, further comprising:

providing the first image to a neural network trained with a first training set comprising at least one set of state update gestures; and

wherein the neural network determines the first image comprises a state update gesture upon determining that the first image being determined to be more likely than not to match a threshold first image attribute learned from the at least one set of state update gestures.

4. The system of claim 3 , wherein the neural network is trained with a second training set comprising the first training set and a set of non-state update gestures incorrectly identified as state update gestures during training the at least one set of state update gestures.

5. The system of claim 1 , further comprising the processor performing:

upon determining that the first image comprises the state update gesture, further determining a type of state update gesture therefrom;

upon determining that the type of state update gesture is an availability type, providing the component with the state further comprising an available state; and

upon determining that the type of state update gesture is an unavailability type, providing the component with the state further comprising an unavailable state.

6. The system of claim 5 , further comprising:

an output component; and

wherein the processor further performs:

receiving, at a subsequent time to the first image, a second image and wherein the processor previously determined the type of state update gesture associated with the first image is the availability type;

determining whether an erroneous state is present comprising, determining whether the second image comprises at least one of (a) a number of gestures associated with unavailability or (b) a number of gestures, none of which are associated with availability; and

presenting indicia of the erroneous state on an output.

7. The system of claim 5 , further comprising:

an output component; and

wherein the processor further performs:

receiving, at a subsequent time to the first image, a second image and wherein the processor previously determined the type of state update gesture associated with the first image is the unavailability type;

determining whether an erroneous state is present comprising, determining whether the second image comprises at least one of (a) a number of gestures associated with availability or (b) a number of gestures, none of which are associated with unavailability; and

presenting indicia of the erroneous state on an output.

8. The system of claim 1 , wherein the processor further performs:

receiving a second image from the camera, wherein receiving the second image occurs while the system is currently engaged in a communication;

evaluating the second image to determine whether the second image comprises a second state update gesture associated with unavailability; and

upon determining that the second image does comprise the second state update gesture associated with unavailability, perform a suspension action comprising one or more of muting audio provided by the system as a portion of the communication, suspending a video image provided by the system as a portion of the communication, or terminating the communication.

9. The system of claim 8 , wherein the processor further performs:

receiving a third image from the camera, wherein receiving the third image occurs while the system is currently engaged in the communication while performing the suspension action;

evaluating the third image to determine whether the second image comprises a third state update gesture associated with availability; and

upon determining that the second image does comprise the second state update gesture associated with availability, perform a resumption action comprising one or more of unmuting audio provided by the system as the portion of the communication and resuming the video image provided by the system as the portion of the communication.

10. The system of claim 1 , wherein the processor further performs:

causing the system to selectively be excluded from receiving communications when the state is associated with unavailability, further comprising, declining the communication presented by the system to be answered; and

causing the system to selectively be included to receive communications when the state is associated with availability, further comprising, answering the communication presented by the system to be answered.

11. A method, comprising:

receiving a first image of a user from a camera;

evaluating the first image to determine whether the first image comprises a state update gesture made by the user;

upon determining that the first image comprises the state update gesture, providing a component with a state of the user associated with the state update gesture;

upon determining that the state update gestures is associated with unavailability of the user, suspend a communication device associated with the user from being connected any of a number of customer devices; and

upon determining that the state update gestures is associated with availability of the user, enabling the communication device associated with the user to be connected to one of the number of customer devices, via a network, to conduct a communication with a customer associated with the one of the number of customer devices.

12. The method of claim 11 , further comprising:

providing the first image to a neural network trained with a first training set comprising at least one set of state update gestures; and

wherein the neural network determines the first image comprises a state update gesture upon determining the first image being determined to be more likely than not to match a threshold first image attribute learned from the at least one set of state update gestures.

13. The method of claim 12 , wherein the neural network is trained with a second training set comprising the first training set and a set of non-state update gestures incorrectly identified as state update gestures during training the at least one set of state update gestures.

14. The method of claim 11 , further comprising:

upon determining that the first image comprises the state update gesture, further determining a type of state update gesture therefrom;

upon determining that the type of state update gesture is an availability type, providing the component with the state further comprising an available state; and

upon determining that the type of state update gesture is an unavailability type, providing the component with the state further comprising an unavailable state.

15. The method of claim 14 , further comprising:

receiving a second image from the camera, wherein receiving the second image occurs while a system is currently engaged in the communication;

evaluating the second image to determine whether the second image comprises a second state update gesture associated with unavailability; and

upon determining that the second image does comprise the second state update gesture associated with unavailability, perform a suspension action comprising one or more of muting audio provided by the system as a portion of the communication, suspending a video image provided by the system as a portion of the communication, or terminating the communication.

16. The method of claim 14 , wherein a processor further performs:

receiving a third image from the camera, wherein receiving the third image occurs while a system is currently engaged in the communication while performing the suspension;

evaluating the third image to determine whether a second image comprises a third state update gesture associated with availability; and

upon determining that the second image does comprise a second state update gesture associated with availability, perform a resumption action comprising one or more of unmuting audio provided by the system as a portion of the communication and resuming a video image provided by the system as the portion of the communication.

17. The method of claim 11 , further comprising:

causing a system to selectively be excluded from receiving communications when the state is associated with unavailability, further comprising, declining the communication presented by the system to be answered; and

causing the system to selectively be included to receive communications when the state is associated with availability, further comprising, answering the communication presented by the system to be answered.

18. A communication device, comprising:

a processor configured with machine-readable instructions maintained in a non-transitory storage;

a camera; and

a network interface to a network; and

wherein the processor performs:

receiving a first image from the camera;

evaluating the first image to determine whether the first image comprises a state update gesture made by a user; and

upon determining that the first image comprises the state update gesture, setting a state of the communication device associated with the state update gesture to cause the communication device to identified as unavailable and selectively refuse a communication request or cause the communication device to be identified as available and accept the communication request.

19. The communication device of claim 18 , wherein the processor performs the evaluating of the first image to determine whether the first image comprises the state update gestures, further comprising:

providing the first image to a neural network trained with a first training set comprising at least one set of state update gestures; and

wherein the neural network determines the first image comprises a state update gesture upon determining the first image being determined to be more likely than not to match a threshold first image attribute learned from the at least one set of state update gestures.

20. The communication device of claim 19 , wherein the neural network is trained with a second training set comprising the first training set and a set of non-state update gestures incorrectly identified as state update gestures during training the at least one set of state update gestures.

Assignments (6)
INTELLECTUAL PROPERTY SECURITY AGREEMENT – SUPPLEMENT NO. 5 Recorded Jun 3, 2024
From: AVAYA LLC; AVAYA MANAGEMENT L.P.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 067606/0438 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: MENDIRATTA, HARSH V.; CHAVEZ, DAVID; YOUNG, JOHN A.
To: AVAYA MANAGEMENT L.P.
Reel/Frame 053861/0821 →
Continuity (1)
Related Publication 20220094782A1 · Mar 24, 2022