IP Library Granted Patent US 12,288,552
Granted Patent B2
US 12,288,552 · App. 17/478,157 · Granted Apr 29, 2025

Computer systems and computer-based methods for automated caller intent prediction

Inventors: Vivedha Elango (Chennai, IN); Soundararajan Dhakshinamoorthy (Chennai, IN); Srividya Thyagarajan (Chennai, IN); Ninad D. Sathaye (Bangalore, IN); Gregory J. Boss (Saginaw, MI); Santhosh Kumar Gopynadhan (Chennai, IN)
Assignee: Optum, Inc.
G10L15/1815G06F40/279G06F40/30G06N5/022G06N5/04G06Q30/016G10L15/22G10L25/63H04M3/51G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,288,552
App. No.
17/478,157
Granted
Apr 29, 2025
Kind
B2
Abstract

An automated system and corresponding method is configured to predict a call duration of a customer service interaction between a caller and a customer-service agent of a call center, based at least in part on information provided orally by the caller to the automated system. The automated system transcribes the orally provided information, preprocesses the transcribed data, adds feature enrichment data to supplement the transcribed data, and executes a machine-learning model to predict the caller's intent. If the predicted caller's intent does not have an adequate confidence score associated therewith, the system requests additional data from the caller, and supplements the original data with newly provided data, and again determines a predicted call intent. This process may iterate until the confidence score satisfies applicable confidence criteria prior to utilizing two additional machine-learning models to predict a call duration of the interaction between the caller and a customer-service agent.

Claims (89)

1. A system comprising:

at least one memory; and

one or more processors communicatively coupled to the at least one memory, the one or more processors configured to:

receive audio input for an active call from a caller;

generate transcription data of the audio input;

extract one or more keywords from the transcription data;

determine, by processing the one or more keywords using a machine-learning intent model, a call intent corresponding to the active call;

execute an interaction-time prediction model at least in part by:

identifying an identity of a customer service agent assigned to the active call;

determining, by processing the call intent using a first machine-learning time model, an unadjusted time duration estimate associated with the call intent,

determining, by processing agent data corresponding to the identity of the customer service agent assigned to the active call using a second machine-learning time model, an interaction time adjustment duration, and

determining, by combining the unadjusted time duration estimate and the interaction time adjustment duration, an interaction-time prediction; and

transmit, to a user device of the caller, an output for display via the user device of the caller indicating the interaction-time prediction and a selectable option for the caller to request a call-back at a later time based on calendar data associated with the caller.

2. The system of claim 1 , wherein the one or more processors are further configured to extract the one or more keywords from the transcription data at least in part by executing a term-frequency, inverse-document frequency (TF-IDF) algorithm to identify keywords within a corpus of historical training data, wherein the historical training data comprises historical transcription data generated during a plurality of historical calls.

3. The system of claim 1 , wherein using the machine-learning intent model comprises determining, based at least in part on the one or more keywords, the call intent and a corresponding call intent score at least in part by:

executing a first iteration of the machine-learning intent model based at least in part on initial audio input provided by the caller to generate a first iteration call intent and corresponding first iteration call intent score;

determining whether the first iteration call intent score satisfies one or more inquiry criteria;

upon determining that the first iteration call intent score satisfies one or more inquiry criteria, determining one or more inquiries based at least in part on a knowledge graph stored in a graph database;

presenting an audio output of the one or more inquiries;

receiving additional audio input in response to presenting the audio output of the one or more inquiries;

executing a second iteration of the machine-learning intent model based at least in part on the additional audio input to generate a second iteration call intent and a corresponding second iteration call intent score; and

iterating the machine-learning intent model until a generated call intent score satisfies the one or more inquiry criteria.

4. The system of claim 1 , wherein the one or more processors are further configured to execute the interaction-time prediction model at least in part by:

determining, by processing the call intent using an empathy analysis model, an empathy time; and

adding the empathy time to the unadjusted time duration estimate.

5. The system of claim 1 , wherein the first machine-learning time model comprises a different machine-learning model type than the second machine-learning time model.

6. The system of claim 5 , wherein the first machine-learning time model comprises a multiple-linear regression model and a regression tree model, and the second machine-learning time model comprises a multiple-linear regression model.

7. The system of claim 1 , wherein the second machine-learning time model is configured to generate the interaction time adjustment duration based at least in part on one or more of: attributes of the customer service agent, attributes of the caller, or call center dynamics.

8. The system of claim 1 , wherein the interaction-time prediction is a first interaction-time prediction for continuing the active call, and wherein the one or more processors are further configured to:

execute a second-iteration of the interaction-time prediction model to generate a second interaction-time prediction for a callback occurring at a defined future time.

9. The system of claim 1 , wherein the one or more processors are further configured to receive feature enrichment data stored in the at least one memory, and the interaction-time prediction model executes the first machine-learning time model and the second machine-learning time model based at least in part on the feature enrichment data.

10. The system of claim 1 , wherein the one or more processors are further configured to receive the audio input at least in part by receiving audio input of a virtual assistant representing the caller, and wherein using the second machine-learning time model comprises determining the interaction time adjustment duration based at least in part on the identity of the customer service agent assigned to the active call and an effectiveness quality measure of the virtual assistant.

11. A computer-implemented method comprising:

receiving, by one or more processors, audio input for an active call from a caller;

generating transcription data of the audio input;

extracting, by the one or more processors, one or more keywords from the transcription data;

determining, by processing the one or more keywords using a machine-learning intent model, a call intent corresponding to the active call;

executing, by the one or more processors, an interaction-time prediction model at least in part by:

identifying an identity of a customer service agent assigned to the active call;

determining, by processing the call intent using a first machine-learning time model, an unadjusted time duration estimate associated with the call intent,

determining, by processing agent data corresponding to the identity of the customer service agent assigned to the active call using a second machine-learning time model, an interaction time adjustment duration, and

determining, by combining the unadjusted time duration estimate and the interaction time adjustment duration, an interaction-time prediction; and

transmitting, by the one or more processors and to a user device of the caller, an output for display via the user device of the caller indicating the interaction-time prediction and a selectable option for the caller to request a call-back at a later time based on calendar data associated with the caller.

12. The computer-implemented method of claim 11 , wherein extracting the one or more keywords from the transcription data comprises executing a term-frequency, inverse-document frequency (TF-IDF) algorithm to identify keywords within a corpus of historical training data, wherein the historical training data comprises historical transcription data generated during a plurality of historical calls.

13. The computer-implemented method of claim 11 , wherein using the machine-learning intent model comprises determining, based at least in part on the one or more keywords, the call intent and a corresponding call intent score at least in part by:

executing a first iteration of the machine-learning intent model based at least in part on initial audio input provided by the caller to generate a first iteration call intent and corresponding first iteration call intent score;

determining whether the first iteration call intent score satisfies one or more inquiry criteria;

upon determining that the first iteration call intent score satisfies the one or more inquiry criteria, determining one or more inquiries based at least in part on a knowledge graph stored in a graph database;

presenting an audio output of the one or more inquiries;

receiving additional audio input in response to presenting the audio output of the one or more inquiries;

executing a second iteration of the machine-learning intent model based at least in part on the additional audio input to generate a second iteration call intent and a corresponding second iteration call intent score; and

iterating the machine-learning intent model until a generated call intent score satisfies the one or more inquiry criteria.

14. The computer-implemented method of claim 11 , wherein executing the interaction-time prediction model further comprises executing an empathy analysis model based at least in part on the call intent to determine an empathy time; and

wherein using the first machine-learning time model further comprises adding the empathy time to the unadjusted time duration estimate.

15. The computer-implemented method of claim 11 , wherein the first machine-learning time model comprises a different machine-learning model type than the second machine-learning time model.

16. The computer-implemented method of claim 15 , wherein the first machine-learning time model comprises a multiple-linear regression model and a regression tree model, and the second machine-learning time model comprises a multiple-linear regression model.

17. The computer-implemented method of claim 11 , wherein the second machine-learning time model is configured to generate the interaction time adjustment duration based at least in part on one or more of: attributes of the customer service agent, attributes of the caller, or call center dynamics.

18. The computer-implemented method of claim 11 , wherein the interaction-time prediction is a first interaction-time prediction for continuing the active call, and wherein the computer-implemented method further comprises:

executing a second-iteration of the interaction-time prediction model to generate a second interaction-time prediction for a callback occurring at a defined future time.

19. The computer-implemented method of claim 11 , further comprising: receiving feature enrichment data, and the interaction-time prediction model executes the first machine-learning time model and the second machine-learning time model based at least in part on the feature enrichment data.

20. The computer-implemented method of claim 11 , wherein receiving the audio input further comprises receiving audio input of a virtual assistant representing the caller, and wherein using the second machine-learning time model comprises determining the interaction time adjustment duration based at least in part on the identity of the customer service agent assigned to the active call and an effectiveness quality measure of the virtual assistant.

21. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions configured to:

receive audio input for an active call from a caller;

generate transcription data of the audio input;

extract one or more keywords from the transcription data;

determine, by processing the one or more keywords using a machine-learning intent model, a call intent corresponding to the active call;

execute an interaction-time prediction model at least in part by:

identifying an identity of a customer service agent assigned to the active call;

determining, by processing the call intent using a first machine-learning time model, an unadjusted time duration estimate associated with the call intent,

determining, by processing agent data corresponding to the identity of the customer service agent assigned to the active call using a second machine-learning time model, an interaction time adjustment duration, and

determining, by combining the unadjusted time duration estimate and the interaction time adjustment duration, an interaction-time prediction; and

transmit, to a user device of the caller, an output for display via the user device of the caller indicating the interaction-time prediction and a selectable option for the caller to request a call-back at a later time based on calendar data associated with the caller.

22. The computer program product of claim 21 , wherein the computer-readable program code portions are further configured to extract the one or more keywords from the transcription data at least in part by executing a term-frequency, inverse-document frequency (TF-IDF) algorithm to identify keywords within a corpus of historical training data, wherein the historical training data comprises historical transcription data generated during a plurality of historical calls.

23. The computer program product of claim 21 , wherein using the machine-learning intent model comprises determining, based at least in part on the one or more keywords, the call intent and a corresponding call intent score at least in part by:

executing a first iteration of the machine-learning intent model based at least in part on initial audio input provided by the caller to generate a first iteration call intent and corresponding first iteration call intent score;

determining whether the first iteration call intent score satisfies one or more inquiry criteria;

upon determining that the first iteration call intent score satisfies the one or more inquiry criteria, determining one or more inquiries based at least in part on a knowledge graph stored in a graph database;

presenting an audio output of the one or more inquiries;

receiving additional audio input in response to presenting the audio output of the one or more inquiries;

executing a second iteration of the machine-learning intent model based at least in part on the additional audio input to generate a second iteration call intent and a corresponding second iteration call intent score; and

iterating the machine-learning intent model until a generated call intent score satisfies the one or more inquiry criteria.

24. The computer program product of claim 21 , wherein the computer-readable program code portions are further configured to execute the interaction-time prediction model at least in part by executing an empathy analysis model based at least in part on the call intent to determine an empathy time; and

wherein using the first machine-learning time model additionally further comprises adding the empathy time to the unadjusted time duration estimate.

25. The computer program product of claim 21 , wherein the first machine-learning time model comprises a different machine-learning model type than the second machine-learning time model.

26. The computer program product of claim 25 , wherein the first machine-learning time model comprises a multiple-linear regression model and a regression tree model, and the second machine-learning time model comprises a multiple-linear regression model.

27. The computer program product of claim 21 , wherein the second machine-learning time model is configured to generate the interaction time adjustment duration based at least in part on one or more of: attributes of the customer service agent, attributes of the caller, or call center dynamics.

28. The computer program product of claim 21 , wherein the interaction-time prediction is a first interaction-time prediction for continuing the active call, and wherein the computer-readable program code portions are further configured to:

execute a second-iteration of the interaction-time prediction model to generate a second interaction-time prediction for a callback occurring at a defined future time.

29. The computer program product of claim 21 , wherein the computer-readable program code portions are further configured to receive feature enrichment data, and the interaction-time prediction model executes the first machine-learning time model and the second machine-learning time model based at least in part on the feature enrichment data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2021
From: ELANGO, VIVEDHA; DHAKSHINAMOORTHY, SOUNDARARAJAN; THYAGARAJAN, SRIVIDYA; SATHAYE, NINAD D.; BOSS, GREGORY J.; GOPYNADHAN, SANTHOSH KUMAR
To: OPTUM, INC.
Reel/Frame 057515/0921 →
Continuity (1)
Related Publication 20230102179A1 · Mar 30, 2023
References Cited (73)
US 7110525B1 · Heller et al. · 2006 [cited by applicant]
US 7411942B1 · Croak et al. · 2008 [cited by applicant]
US 7827047B2 · Anderson et al. · 2010 [cited by applicant]
US 8244566B1 · Coley et al. · 2012 [cited by applicant]
US 8565412B2 · Foster et al. · 2013 [cited by applicant]
US 8750488B2 · Spottiswoode et al. · 2014 [cited by applicant]
US 8792632B2 · Anisimov et al. · 2014 [cited by applicant]
US 8942986B2 · Cheyer et al. · 2015 [cited by applicant]
US 9129290B2 · Kannan et al. · 2015 [cited by applicant]
US 9148512B1 · Kumar · 2015 [cited by examiner]
US 9167095B1 · Selvin et al. · 2015 [cited by applicant]
US 9401992B2 · Srinivas et al. · 2016 [cited by applicant]
US 9712671B2 · Monegan et al. · 2017 [cited by applicant]
US 10270914B2 · Shaffer et al. · 2019 [cited by applicant]
US 10579834B2 · Walia · 2020 [cited by applicant]
US 10614799B2 · Kennewick, Jr. et al. · 2020 [cited by applicant]
US 10714084B2 · Engles et al. · 2020 [cited by applicant]
US 10810274B2 · Thomson · 2020 [cited by examiner]
US 10839432B1 · Konig et al. · 2020 [cited by applicant]
US 10904212B1 · Kaizer · 2021 [cited by examiner]
US 10992808B1 · Dhawan et al. · 2021 [cited by applicant]
US 11558210B2 · Suhail et al. · 2023 [cited by applicant]
US 11798547B2 · Milden · 2023 [cited by applicant]
US 20020191035A1 · Selent · 2002 [cited by applicant]
US 20040029567A1 · Timmins et al. · 2004 [cited by applicant]
US 20070025540A1 · Travis · 2007 [cited by applicant]
US 20070198368A1 · Kannan et al. · 2007 [cited by applicant]
US 20080059265A1 · Biazetti et al. · 2008 [cited by applicant]
US 20080298350A1 · Croak et al. · 2008 [cited by applicant]
US 20080313005A1 · Nessland et al. · 2008 [cited by applicant]
US 20110009096A1 · Rotsztein et al. · 2011 [cited by applicant]
US 20120076283A1 · Ajmera et al. · 2012 [cited by applicant]
US 20130268310A1 · Wilson · 2013 [cited by applicant]
US 20140006082A1 · Harms et al. · 2014 [cited by applicant]
US 20140044243A1 · Monegan et al. · 2014 [cited by applicant]
US 20140086404A1 · Chishti et al. · 2014 [cited by applicant]
US 20140379407A1 · Horton · 2014 [cited by applicant]
US 20150030151A1 · Bellini et al. · 2015 [cited by applicant]
US 20150181038A1 · Fox et al. · 2015 [cited by applicant]
US 20150213512A1 · Spievak · 2015 [cited by examiner]
US 20150347980A1 · White et al. · 2015 [cited by applicant]
US 20150358460A1 · Monegan · 2015 [cited by examiner]
US 20170034349A1 · Uba · 2017 [cited by applicant]
US 20170111505A1 · McGann · 2017 [cited by examiner]
US 20170111509A1 · McGann · 2017 [cited by examiner]
US 20170116177A1 · Walia · 2017 [cited by applicant]
US 20180276723A1 · Kannan · 2018 [cited by applicant]
US 20180309801A1 · Rathod · 2018 [cited by examiner]
US 20200014801A1 · Mohiuddin et al. · 2020 [cited by applicant]
US 20200036544A1 · Suhail et al. · 2020 [cited by applicant]
US 20200257857A1 · Peper · 2020 [cited by examiner]
US 20200274969A1 · Dunn et al. · 2020 [cited by applicant]
US 20200334615A1 · Benjamin · 2020 [cited by examiner]
US 20200342850A1 · Vishnoi · 2020 [cited by examiner]
US 20200374402A1 · Adibi · 2020 [cited by applicant]
US 20210004825A1 · Adibi · 2021 [cited by examiner]
US 20210029248A1 · Scodary · 2021 [cited by examiner]
US 20210103937A1 · Joglekar · 2021 [cited by examiner]
US 20210201238A1 · Sekar et al. · 2021 [cited by applicant]
US 20210273980A1 · Palandurkar et al. · 2021 [cited by applicant]
US 20210280195A1 · Srinivasan · 2021 [cited by examiner]
US 20210350334A1 · Ave et al. · 2021 [cited by applicant]
US 20220182493A1 · Ter · 2022 [cited by examiner]
US 20230090049A1 · Elango et al. · 2023 [cited by applicant]
US 20230376987A1 · Doumar et al. · 2023 [cited by applicant]
Balduino, Ricardo. “AI and Machine Learning To Improve Customer Contact Experience,” Inside Machine Learning, Oct. 29, 2019, (9 pages), (article, online), [Retrieved from the Internet Nov. 1, 2021] <URL: https://medium.… [cited by applicant]
Zhong, Junmei et al. “Predicting Customer Call Intent By Analyzing Phone Call Transcripts Based on CNN For Multi-Class Classification,” arXiv preprint arXiv:1907.03715, Jul. 8, 2019, (12 pages). [cited by applicant]
Parnandi, Avinash et al. “A Comparative Study of Game Mechanics and Control Laws For an Adaptive Physiological Game,” Journal of Multimodal User Interfaces, vol. 9, pp. 31-42, Mar. 2015, DOI: 10.1007/s12193-014-0159-y. [cited by applicant]
NonFinal Office Action for U.S. Appl. No. 17/448,001, dated Mar. 17, 2023, (22 pages), United States Patent and Trademark Office, US. [cited by applicant]
Final Rejection Mailed on Dec. 28, 2023 for U.S. Appl. No. 17/448,001, 19 page(s). [cited by applicant]
Non-Final Rejection Mailed on Jun. 21, 2024 for U.S. Appl. No. 17/448,001, 20 page(s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Dec. 27, 2024 for U.S. Appl. No. 17/448,001, 16 page(s). [cited by applicant]
Supplemental Notice of Allowance and Fees Due (PTOL-85) Mailed on Jan. 13, 2025 for U.S. Appl. No. 17/448,001, 3 page(s). [cited by applicant]
Cited By (1)
US 12,614,543