IP Library Granted Patent US 12,289,427
Granted Patent B2
US 12,289,427 · App. 18/350,130 · Granted Apr 29, 2025

System and method of efficient selection of evaluation form

Inventors: Rahul Vyas (Rajasthan, IN); Pankul Gupta (Tarntaran, ID); Mayur Bhalke (Pune, IN); LeAnn Hopkins (Lake Worth/Wellington, FL)
Assignee: NICE LTD.
H04M3/5175G06Q10/06398H04M3/42221H04M2203/402
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,289,427
App. No.
18/350,130
Granted
Apr 29, 2025
Kind
B2
Abstract

Agent evaluation systems and methods, and non-transitory computer readable media, include receiving a recorded interaction between a customer and a contact center agent; retrieving or determining an interaction divergence range for each of a plurality of interaction parameters for the recorded interaction; calculating a form divergence determinant (FDD) score for each of a plurality of evaluation forms, wherein the lower the FDD score, the more suitable an evaluation form is for the recorded interaction; filtering out evaluation forms having an FDD score greater than a predefined threshold; ranking evaluation forms having an FDD score lower than the predefined threshold based on their FDD score; and providing a list of the ranked evaluation forms to a supervisor of the contact center agent.

Claims (56)

1. An agent evaluation system comprising:

a processor and a computer readable medium operably coupled thereto, the computer readable medium comprising a plurality of instructions stored in association therewith that are accessible to, and executable by, the processor, to perform operations which comprise:

receiving a recorded interaction between a customer and a contact center agent;

retrieving or determining an interaction divergence range for each of a plurality of interaction parameters for the recorded interaction;

calculating a form divergence determinant (FDD) score for each of a plurality of evaluation forms, wherein the FDD score is based on a value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms and the interaction divergence range for each of the plurality of interaction parameters for the recorded interaction, and wherein the lower the FDD score, the more suitable an evaluation form is for the recorded interaction;

filtering out evaluation forms having an FDD score greater than a predefined threshold;

ranking evaluation forms having an FDD score lower than the predefined threshold based on their FDD score; and

providing a list of the ranked evaluation forms to a supervisor of the contact center agent.

2. The agent evaluation system of claim 1 , wherein the operations further comprise:

receiving, from the supervisor, a selection of one of the listed evaluation forms; and

in response to the selection, providing the selected evaluation form to the supervisor.

3. The agent evaluation system of claim 1 , wherein the interaction divergence range is determined, and determining the interaction divergence range for each of the plurality of interaction parameters comprises calculating a confidence interval estimate for each of the plurality of interaction parameters.

4. The agent evaluation system of claim 3 , wherein the operations further comprise storing the determined interaction divergence range for each of the plurality of interaction parameters.

5. The agent evaluation system of claim 1 , wherein the operations further comprise receiving evaluation form selection rules from the supervisor, wherein the evaluation form selection rules comprise the value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms.

6. The agent evaluation system of claim 1 , wherein the plurality of interaction parameters comprise two or more of: an interaction category, agent skills, a call reason, a behavioral ranking, an interaction duration, an interaction complexity, an interaction channel type, an agent and customer sentiment, and a customer feedback.

7. The agent evaluation system of claim 1 , wherein calculating the FDD score comprises:

retrieving the value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms;

determining a variation of each value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms from the interaction divergence range for each respective interaction parameter; and

computing a sum of the variations for each of the plurality of evaluation forms.

8. The agent evaluation system of claim 7 , wherein calculating the FDD score further comprises assigning a weight to each of the plurality of interaction parameters, wherein computing the sum of the variations comprises applying the weight to each variation.

9. The agent evaluation system of claim 1 , wherein the operations further comprise receiving the predefined threshold from the supervisor.

10. A method of facilitating agent evaluations, which comprises:

receiving a recorded interaction between a customer and a contact center agent;

retrieving or determining an interaction divergence range for each of a plurality of interaction parameters for the recorded interaction;

calculating a form divergence determinant (FDD) score for each of a plurality of evaluation forms, wherein the FDD score is based on a value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms and the interaction divergence range for each of the plurality of interaction parameters for the recorded interaction, and wherein the lower the FDD score, the more suitable an evaluation form is for the recorded interaction;

filtering out evaluation forms having an FDD score greater than a predefined threshold;

ranking evaluation forms having an FDD score lower than the predefined threshold based on their FDD score; and

providing a list of the ranked evaluation forms to a supervisor of the contact center agent.

11. The method of claim 10 , which further comprises:

receiving, from the supervisor, a selection of one of the listed evaluation forms; and

in response to the selection, providing the selected evaluation form to the supervisor.

12. The method of claim 10 , wherein the interaction divergence range is determined, and determining the interaction divergence range for each of the plurality of interaction parameters comprises calculating a confidence interval estimate for each of the plurality of interaction parameters.

13. The method of claim 10 , which further comprises receiving evaluation form selection rules from the supervisor, wherein the evaluation form selection rules comprise the value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms.

14. The method of claim 10 , wherein the plurality of interaction parameters comprise two or more of: an interaction category, agent skills, a call reason, a behavioral ranking, an interaction duration, an interaction complexity, an interaction channel type, an agent and customer sentiment, and a customer feedback.

15. The method of claim 10 , wherein calculating the FDD score comprises:

retrieving the value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms;

determining a variation of each value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms from the interaction divergence range for each respective interaction parameter;

computing a sum of the variations for each of the plurality of evaluation forms; and

assigning a weight to each of the plurality of interaction parameters, wherein computing the sum of the variations comprises applying the weight to each variation.

16. A non-transitory computer-readable medium having stored thereon computer-readable instructions executable by a processor to perform operations which comprise:

receiving a recorded interaction between a customer and a contact center agent;

retrieving or determining an interaction divergence range for each of a plurality of interaction parameters for the recorded interaction;

calculating a form divergence determinant (FDD) score for each of a plurality of evaluation forms, wherein the FDD score is based on a value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms and the interaction divergence range for each of the plurality of interaction parameters for the recorded interaction, and wherein the lower the FDD score, the more suitable an evaluation form is for the recorded interaction;

filtering out evaluation forms having an FDD score greater than a predefined threshold;

ranking evaluation forms having an FDD score lower than the predefined threshold based on their FDD score; and

providing a list of the ranked evaluation forms to a supervisor of the contact center agent.

17. The non-transitory computer-readable medium of claim 16 , wherein the operations further comprise:

receiving, from the supervisor, a selection of one of the listed evaluation forms; and

in response to the selection, providing the selected evaluation form to the supervisor.

18. The non-transitory computer-readable medium of claim 16 , wherein the interaction divergence range is determined, and determining the interaction divergence range for each of the plurality of interaction parameters comprises calculating a confidence interval estimate for each of the plurality of interaction parameters.

19. The non-transitory computer-readable medium of claim 16 , wherein the plurality of interaction parameters comprise two or more of: an interaction category, agent skills, a call reason, a behavioral ranking, an interaction duration, an interaction complexity, an interaction channel type, an agent and customer sentiment, and a customer feedback.

20. The non-transitory computer-readable medium of claim 16 , wherein calculating the FDD score comprises:

retrieving the value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms;

determining a variation of each value for each of the plurality of interaction parameters associated with each of the plurality of evaluation forms from the interaction divergence range for each respective interaction parameter;

computing a sum of the variations for each of the plurality of evaluation forms; and

assigning a weight to each of the plurality of interaction parameters, wherein computing the sum of the variations comprises applying the weight to each variation.

Assignments (2)
SECURITY INTEREST Recorded Feb 26, 2026
From: NICE LTD; NICE SYSTEMS INC.; NICE SYSTEMS TECHNOLOGIES INC.; INCONTACT, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 074986/0208 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2023
From: VYAS, RAHUL; GUPTA, PANKUL; BHALKE, MAYUR; HOPKINS, LEANN
To: NICE LTD.
Reel/Frame 064323/0215 →