IP Library › Granted Patent US 12,682,356
Granted Patent B1
US 12,682,356 · App. 18/624,697 · Granted Jul 14, 2026

System and method for managing customer call-backs

Inventors: John Karlen (Springfield, MA); Peng Wang (Springfield, MA); Adam Fox (Springfield, MA); Tam Tran-The (Springfield, MA); Matthew Girard (Springfield, MA); Michael Crough (Springfield, MA)
Assignee: Massachusetts Mutual Life Insurance Company
G06Q30/016G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,682,356
App. No.
18/624,697
Filed
Apr 2, 2024
Granted
Jul 14, 2026
Kind
B1
Examiner
CHEN, WENREN
Art Unit
3626
USPC
705/304
Abstract

System and method for automatically calling back a customer via a predictive model determines a plurality of call-back metrics for a plurality of advisor records. The predictive model is applied to call-back data to identify customers that are likely to require a series of call-backs, and automatically generates a preferred call-back to such customers to reduce this risk. The automated call-back may follow termination of an identified customer's inbound call, or at some time after completion of a previous call interaction of the identified customer with an advisor. In the predictive model, a first compilation of call-back metrics record is representative of an overall likelihood of call-backs associated with each advisor record, and a second compilation of the plurality of call-back metrics is representative of a likelihood of call-backs for each of the plurality of products of the enterprise associated with the advisor record.

Claims (41)

1 . A method comprising:

training, by a processor, a predictive machine learning model using call-back metrics of a set of callers of a set of historical calls, a set of agent records of a set of agents of a call center that participated in the set of historical calls, and time series forecasting, wherein training the predictive machine learning model includes applying regularization for a plurality of iterations;

retrieving, by the processor, data associated with a caller of an inbound call of the call center between the caller and an agent of the call center, the data comprising at least an interaction of the caller with an interactive voice response unit (IVR) during the inbound call and an agent record associated with the agent of the call center;

in response to determining that the inbound call has terminated:

executing, by the processor, a predictive machine learning model, using the data including the interaction with the IVR during the inbound call and the agent record of the agent, to generate output data comprising (i) a call-back signal corresponding to a likelihood of repeated call-backs by the caller, and (ii) an interaction signal representative of a likelihood that the caller will perform a predetermined interaction during a future call-back, as a result of the termination of the inbound call between the caller and the agent;

classifying, by the predictive machine learning model executing via the processor based on the call-back signal determined by the predictive machine learning model, the caller into one of a first call-back group and a second call-back group;

in a first event where the predictive machine learning model classifies the caller into the first call-back group, instructing, by the processor, an automatic calling device in communication with the processor to automatically initiate an electronic communication session between the caller and at least one agent of the call center; and

in a second event where the predictive machine learning model classifies the caller into the second call-back group, instructing, by the processor, the automatic calling device in communication with the processor to automatically execute a subordinate call-back procedure.

2 . The method of claim 1 , wherein the inbound call is terminated based on the caller exercising a call-back option or by abandoning the inbound call.

3 . The method of claim 1 , wherein the data associated with the caller comprises at least one of an interaction of the caller with at least one advisor of an enterprise associated with the call center or call-back data associated with the caller.

4 . The method of claim 1 , wherein the electronic communication session is initiated between the caller and a preferred agent of the call center.

5 . The method of claim 1 , wherein the call-back signal further corresponds to a likelihood that the caller will accept an offer to purchase one of a plurality of products.

6 . The method of claim 1 , wherein the call-back signal further corresponds to a likelihood that the caller will lapse in payments for a purchased product.

7 . The method of claim 1 , wherein the subordinate call-back procedure comprises one or more of automatically calling back with a recorded message of the IVR, automatically calling back for connection to an agent from a pool of unskilled agents, and automatically deferring call-back.

8 . A system for managing customer calls within a call center, the system comprising:

an automatic calling device; and

a processor, in communication with the automatic calling device, the processor configured to:

train a predictive machine learning model using call-back metrics of a set of callers of a set of historical calls, a set of agent records of a set of agents of the call center that participated in the set of historical calls, and time series forecasting, wherein training the predictive machine learning model includes applying regularization for a plurality of iterations;

retrieve data associated with a caller of an inbound call of a call center between the caller and an agent of the call center, the data comprising at least an interaction of the caller with an interactive voice response unit (IVR) during the inbound call and an agent record associated with the agent of the call center;

in response to determining that the inbound call has terminated:

execute the predictive machine learning model, using the data including the interaction with the IVR during the inbound call and the agent record of the agent, to generate output data comprising (i) a call-back signal corresponding to a likelihood of repeated call-backs by the caller, and (ii) an interaction signal representative of a likelihood that the caller will perform a predetermined interaction during a future call-back, as a result of the termination of the inbound call between the caller and the agent;

classify, by the predictive machine learning model executing based on the call-back signal determined by the predictive machine learning model, the caller into one of a first call-back group and a second call-back group;

in a first event where the predictive machine learning model classifies the caller into the first call-back group, instruct the automatic calling device in communication with the processor to automatically initiate an electronic communication session between the caller and at least one agent of the call center; and

in a second event where the predictive machine learning model classifies the caller into the second call-back group, instruct the automatic calling device in communication with the processor to automatically execute a subordinate call-back procedure.

9 . The system of claim 8 , wherein the inbound call is terminated based on the caller exercising a call-back option or by abandoning the inbound call.

10 . The system of claim 8 , wherein the data associated with the caller comprises at least one of an interaction of the caller with at least one advisor of an enterprise associated with the call center or call-back data associated with the caller.

11 . The system of claim 8 , wherein the electronic communication session is initiated between the caller and a preferred agent of the call center.

12 . The system of claim 8 , wherein the call-back signal further corresponds to a likelihood that the caller will accept an offer to purchase one of a plurality of products.

13 . The system of claim 8 , wherein the call-back signal further corresponds to a likelihood that the caller will lapse in payments for a purchased product.

14 . The system of claim 8 , wherein the subordinate call-back procedure comprises one or more of automatically calling back with a recorded message of the IVR, automatically calling back for connection to an agent from a pool of unskilled agents, and automatically deferring call-back.

15 . A system comprising:

a computer-readable medium having a set of instructions that when executed cause a processor to:

train a predictive machine learning model using call-back metrics of a set of callers of a set of historical calls, a set of agent records of a set of agents of a call center that participated in the set of historical calls, and time series forecasting, wherein training the predictive machine learning model includes applying regularization for a plurality of iterations;

retrieve data associated with a caller of an inbound call of the call center between the caller and an agent of the call center, the data comprising at least an interaction of the caller with an interactive voice response unit (IVR) during the inbound call and an agent record associated with the agent of the call center;

in response to determining that the inbound call has terminated:

execute the predictive machine learning model, using the data including the interaction with the IVR during the inbound call and the agent record of the agent, to generate output data comprising (i) a call-back signal corresponding to a likelihood of repeated call-backs by the caller, and (ii) an interaction signal representative of a likelihood that the caller will perform a predetermined interaction during a future call-back, as a result of the termination of the inbound call between the caller and the agent;

classify, by the predictive machine learning model executing based on the call-back signal determined by the predictive machine learning model, the caller into one of a first call-back group and a second call-back group;

in a first event where the predictive machine learning model classifies the caller into the first call-back group, instruct an automatic calling device in communication with the processor to automatically initiate an electronic communication session between the caller and at least one agent of the call center; and

in a second event where the predictive machine learning model classifies the caller into the second call-back group, instruct the automatic calling device in communication with the processor to automatically execute a subordinate call-back procedure.

16 . The system of claim 15 , wherein the inbound call is terminated based on the caller exercising a call-back option or by abandoning the inbound call.

17 . The system of claim 15 , wherein the data associated with the caller comprises at least one of an interaction of the caller with at least one advisor of an enterprise associated with the call center or call-back data associated with the caller.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2024
From: KARLEN, JOHN; WANG, PENG; FOX, ADAM; TRAN-THE, TAM; GIRARD, MATTHEW; CROUGH, MICHAEL
To: MASSACHUSETTS MUTUAL LIFE INSURANCE COMPANY
Reel/Frame 066983/0081 →
Continuity (1)
Continuation 16525268 · Jul 29, 2019
References Cited (173)
US 5519773A · Dumas et al. · 1996 [cited by applicant]
US 6185558B1 · Bowman et al. · 2001 [cited by applicant]
US 6236977B1 · Verba et al. · 2001 [cited by applicant]
US 6611590B1 · Lu et al. · 2003 [cited by applicant]
US 6862574B1 · Srikant et al. · 2005 [cited by applicant]
US 6879683B1 · Fain et al. · 2005 [cited by applicant]
US 6970554B1 · Peterson et al. · 2005 [cited by applicant]
US 6975720B1 · Crook · 2005 [cited by applicant]
US 7023979B1 · Wu et al. · 2006 [cited by applicant]
US 7035811B2 · Gorenstein · 2006 [cited by applicant]
US 7047206B1 · Schultze · 2006 [cited by applicant]
US 7228284B1 · Vaillancourt et al. · 2007 [cited by applicant]
US 7275083B1 · Seibel et al. · 2007 [cited by applicant]
US 7340410B1 · Vaillancourt et al. · 2008 [cited by applicant]
US 7580870B1 · Chang · 2009 [cited by applicant]
US 8000989B1 · Kiefhaber · 2011 [cited by examiner]
US 8155297B1 · Dhir et al. · 2012 [cited by applicant]
US 8311863B1 · Kemp · 2012 [cited by applicant]
US 8355934B2 · Virdhagriswaran · 2013 [cited by applicant]
US 8386639B1 · Galvin · 2013 [cited by examiner]
US 8515736B1 · Duta · 2013 [cited by applicant]
US 8548843B2 · Folk et al. · 2013 [cited by applicant]
US 8571951B2 · Diana et al. · 2013 [cited by applicant]
US 8577014B2 · Brandt et al. · 2013 [cited by applicant]
US 8582750B2 · Lee et al. · 2013 [cited by applicant]
US 8781092B2 · Noble, Jr. · 2014 [cited by applicant]
US 8805734B2 · Diana et al. · 2014 [cited by applicant]
US 8929537B2 · Chishti et al. · 2015 [cited by applicant]
US 9055148B2 · Sri et al. · 2015 [cited by applicant]
US 9077804B2 · Kannan et al. · 2015 [cited by applicant]
US 9160851B2 · Kugler et al. · 2015 [cited by applicant]
US 9263038B2 · Flaks et al. · 2016 [cited by applicant]
US 9582786B2 · Gubin et al. · 2017 [cited by applicant]
US 9635181B1 · Mcgann et al. · 2017 [cited by applicant]
US 9680996B2 · Kumar et al. · 2017 [cited by applicant]
US 9805734B2 · Sugiyama · 2017 [cited by applicant]
US 9911131B1 · Ross et al. · 2018 [cited by applicant]
US 9916538B2 · Zadeh et al. · 2018 [cited by applicant]
US 10229370B1 · Merritt · 2019 [cited by applicant]
US 10235628B1 · Merritt · 2019 [cited by applicant]
US 10257355B1 · Merritt · 2019 [cited by examiner]
US 10257357B1 · Merritt · 2019 [cited by applicant]
US 10346750B1 · Merritt · 2019 [cited by applicant]
US 10395184B1 · Merritt · 2019 [cited by applicant]
US 10402723B1 · Silberman et al. · 2019 [cited by applicant]
US 10412224B1 · Merritt · 2019 [cited by applicant]
US 10540593B1 · Merritt · 2020 [cited by applicant]
US 10547748B1 · Merritt · 2020 [cited by applicant]
US 10565529B1 · Merritt · 2020 [cited by applicant]
US 10582060B1 · Merritt · 2020 [cited by applicant]
US 10769538B1 · Merritt · 2020 [cited by applicant]
US 10909463B1 · Merritt · 2021 [cited by applicant]
US 11176461B1 · Merritt · 2021 [cited by applicant]
US 11551108B1 · Merritt · 2023 [cited by applicant]
US 20020035504A1 · Dver et al. · 2002 [cited by applicant]
US 20020082892A1 · Raffel et al. · 2002 [cited by applicant]
US 20020128885A1 · Evans · 2002 [cited by applicant]
US 20020138492A1 · Kil · 2002 [cited by applicant]
US 20020141561A1 · Duncan et al. · 2002 [cited by applicant]
US 20040081311A1 · Thompson · 2004 [cited by applicant]
US 20040143473A1 · Tivey et al. · 2004 [cited by applicant]
US 20040143476A1 · Kapadia et al. · 2004 [cited by applicant]
US 20040143482A1 · Tivey et al. · 2004 [cited by applicant]
US 20040143483A1 · Tivey et al. · 2004 [cited by applicant]
US 20040143484A1 · Kapadia et al. · 2004 [cited by applicant]
US 20050108064A1 · Castleman et al. · 2005 [cited by applicant]
US 20050125334A1 · Masella et al. · 2005 [cited by applicant]
US 20050135593A1 · Becerra et al. · 2005 [cited by applicant]
US 20050195966A1 · Adar et al. · 2005 [cited by applicant]
US 20060041500A1 · Diana et al. · 2006 [cited by applicant]
US 20060155642A1 · Pettersen · 2006 [cited by applicant]
US 20060200360A1 · Razletovskiy · 2006 [cited by applicant]
US 20060229896A1 · Rosen et al. · 2006 [cited by applicant]
US 20060265259A1 · Diana et al. · 2006 [cited by applicant]
US 20070027746A1 · Grabowich · 2007 [cited by applicant]
US 20070136164A1 · Roti et al. · 2007 [cited by applicant]
US 20070174108A1 · Monster · 2007 [cited by applicant]
US 20080120129A1 · Seubert et al. · 2008 [cited by applicant]
US 20080162258A1 · Kala et al. · 2008 [cited by applicant]
US 20080184270A1 · Cole et al. · 2008 [cited by applicant]
US 20080201204A1 · Rose et al. · 2008 [cited by applicant]
US 20080201205A1 · Rose et al. · 2008 [cited by applicant]
US 20080294501A1 · Rennich · 2008 [cited by applicant]
US 20090190744A1 · Xie et al. · 2009 [cited by applicant]
US 20090190745A1 · Xie et al. · 2009 [cited by applicant]
US 20090190749A1 · Xie et al. · 2009 [cited by applicant]
US 20090190750A1 · Xie et al. · 2009 [cited by applicant]
US 20090232294A1 · Xie et al. · 2009 [cited by applicant]
US 20090234710A1 · Belgaied Hassine et al. · 2009 [cited by applicant]
US 20100030578A1 · Siddique et al. · 2010 [cited by applicant]
US 20100054453A1 · Stewart · 2010 [cited by applicant]
US 20100114573A1 · Huang et al. · 2010 [cited by applicant]
US 20100306249A1 · Hill et al. · 2010 [cited by applicant]
US 20110153449A1 · Hite · 2011 [cited by applicant]
US 20110196776A1 · Rash et al. · 2011 [cited by applicant]
US 20110225082A1 · Diana et al. · 2011 [cited by applicant]
US 20110258016A1 · Barak et al. · 2011 [cited by applicant]
US 20110258067A1 · Rowell · 2011 [cited by applicant]
US 20110307257A1 · Pereg et al. · 2011 [cited by applicant]
US 20120053986A1 · Cardno et al. · 2012 [cited by applicant]
US 20120066065A1 · Switzer · 2012 [cited by applicant]
US 20120072232A1 · Frankham et al. · 2012 [cited by applicant]
US 20120166445A1 · Chakrabarti et al. · 2012 [cited by applicant]
US 20120203584A1 · Mishor et al. · 2012 [cited by applicant]
US 20130006916A1 · Mcbride et al. · 2013 [cited by applicant]
US 20130031081A1 · Vijayaraghavan et al. · 2013 [cited by applicant]
US 20130054480A1 · Ross et al. · 2013 [cited by applicant]
US 20130080362A1 · Chang et al. · 2013 [cited by applicant]
US 20130085805A1 · Krusar · 2013 [cited by applicant]
US 20130215116A1 · Siddique et al. · 2013 [cited by applicant]
US 20130218634A1 · Hills et al. · 2013 [cited by applicant]
US 20130236002A1 · Jennings et al. · 2013 [cited by applicant]
US 20130332204A1 · Fiori et al. · 2013 [cited by applicant]
US 20140025871A1 · Kanai · 2014 [cited by applicant]
US 20140058831A1 · Duva et al. · 2014 [cited by applicant]
US 20140149178A1 · Hedges · 2014 [cited by applicant]
US 20140149339A1 · Title et al. · 2014 [cited by applicant]
US 20140153703A1 · Desai et al. · 2014 [cited by applicant]
US 20140180974A1 · Kennel et al. · 2014 [cited by applicant]
US 20140201126A1 · Zadeh et al. · 2014 [cited by applicant]
US 20140229406A1 · Puzis et al. · 2014 [cited by applicant]
US 20140249872A1 · Stephan · 2014 [cited by examiner]
US 20140257871A1 · Christensen et al. · 2014 [cited by applicant]
US 20140279722A1 · Singh et al. · 2014 [cited by applicant]
US 20140289005A1 · Laing et al. · 2014 [cited by applicant]
US 20140324529A1 · Bliss · 2014 [cited by applicant]
US 20150046219A1 · Shavlik · 2015 [cited by applicant]
US 20150154524A1 · Borodow et al. · 2015 [cited by applicant]
US 20150189088A1 · Surridge et al. · 2015 [cited by applicant]
US 20160036976A1 · Odinak et al. · 2016 [cited by applicant]
US 20160065735A1 · Pott et al. · 2016 [cited by applicant]
US 20160071117A1 · Duncan · 2016 [cited by applicant]
US 20160132892A1 · Zhou et al. · 2016 [cited by applicant]
US 20160203498A1 · Das et al. · 2016 [cited by applicant]
US 20160261742A1 · Offen et al. · 2016 [cited by applicant]
US 20160300252A1 · Frank et al. · 2016 [cited by applicant]
US 20160337795A1 · Nachman et al. · 2016 [cited by applicant]
US 20160352900A1 · Bell et al. · 2016 [cited by applicant]
US 20170124581A1 · Wilson et al. · 2017 [cited by applicant]
US 20170140313A1 · Nandi et al. · 2017 [cited by applicant]
US 20170140387A1 · Nandi · 2017 [cited by examiner]
US 20170186018A1 · Nandi et al. · 2017 [cited by applicant]
US 20170214797A1 · Dhir et al. · 2017 [cited by applicant]
US 20170223190A1 · Mandel et al. · 2017 [cited by applicant]
US 20170243137A1 · Mandel et al. · 2017 [cited by applicant]
US 20190034963A1 · George et al. · 2019 [cited by applicant]
US 20190095785A1 · Sarkar · 2019 [cited by examiner]
US 20200013068A1 · Pony et al. · 2020 [cited by applicant]
EP 2109302B1 · 2009 [cited by applicant]
EP 2109302B2 · 2010 [cited by applicant]
WO WO2007112411A2 · 2007 [cited by applicant]
WO WO2009065052A1 · 2009 [cited by applicant]
N. Mehrbod, A. Grilo and A. Zutshi, “Caller-Agent Pairing in Call Centers Using Machine Learning Techniques with Imbalanced Data,” 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC),… [cited by examiner]
“scikit-learn: machine learning in Python”, GitHub, retrieved Aug. 27, 2021 from URL: https://github.com/scikit-learn/scikit-learn (5 pages). [cited by applicant]
Barga, R., Fontama, V., Tok, W. H., & Cabrera-Cordon, L. (2015). Predictive analytics with Microsoft Azure machine learning (pp. 221-241 ). Berkely, CA: Apress. (Year: 2015). [cited by applicant]
Bernier, “Interactive Voice Response”, Genesys, retrieved Oct. 3, 2017 from URL: http://www.genesys.com/solutions/customer-engagement/inbound/intelligent-voice-response (3 pages). [cited by applicant]
Bernier, “Speech & Text Analytics”, Genesys, retrieved Oct. 3, 2017 from URL: http://genesis.com/solutions/employee-engagement/workforce-optimization/workforce-planning/speech-text-analytics (4 pages). [cited by applicant]
Cody et al., “The integration of business intelligence and knowledge management”, IBM Systems Journal, vol. 41, No. 4, Jul. 12, 2002, pp. 697-713, retrieved from URL: https://pdfs.semanticscholar.org/3803/109409dd7822c6… [cited by applicant]
Costa, Sara, “Call Flow”, Talkdesk Support, Jan. 18, 2018, retrieved May 11, 2018 from URL: https://support.talkdesk.com/hc/en-us/articles/206196766-Call-Flow (6 pages). [cited by applicant]
Florez-Lopez et al., “Marketing Segmentation Through Machine Learning Models: An Approach Based on Customer Relationship Management and Customer Profitability Accounting”, Social Science Computer Review, Oct. 8, 2008, p… [cited by applicant]
Gayle, Sanford, “The Marriage of Market Basket Analysis to Predictive Modeling”, 2000, pp. 1-6, retrieved from URL: http://ai.stanford.edu/~ronnyk/WEBKDD2000/papers/gayle.pdf (6 pages). [cited by applicant]
Golbeck, Jennifer Ann, “Computing and applying trust in web-based social networks”, Dissertation, 2005 (199 pages). [cited by applicant]
Guestrin, Carlos, “Unsupervised learning or Clustering-K-means Gaussian mixture models”, Apr. 4, 2007, retrieved from URL: http://www.cs.cmu.edu/-guestrin/Class/10701-S07/Slides/clustering.pdf (67 pages). [cited by applicant]
Jutla et al., “Enabling and Measuring Electronic Customer Relationship Management Readiness,” Proceedings of the 34th Hawaii International Conference on System Sciences—2001; <http://www.computer.org/csdl/proceedings/ni… [cited by applicant]
Kim et al., “Customer Targeting: A Neural Network Approach Guided by Genetic Algorithms”, Feb. 1, 2005, retrieved from URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.2.697&rep=rep1 &type=pdf (31 pages). [cited by applicant]
Lin et al., “Combining ranking concept and social network analysis to detect collusive groups in online auctions”, Expert Systems with Applications, vol. 30, Issue 10, pp. 9079-9086 (8 pages). [cited by applicant]
Motta et al., “Forecasting in multi-skill call centers: A multi-agent multi-service (MAMS) approach: research in progress”, 2013 Fifth International Conference on Service Science and Innovation {ICSSI), Oct. 24, 2013, r… [cited by applicant]
Python Home Page, retrieved Aug. 27, 2021 from URL: https://www.python.org/ (3 pages). [cited by applicant]
Shen et al., Forecasting Time Series of Inhomogenous Poisson Processes with Application to Call Center Workforce Management, The Annals of Applied Statistics, <https://www.unc.edu/-haipeng/publication/poissonSVD.pdf>, J… [cited by applicant]
Stepanov et al., “Automatic Summarization of Call-center Conversations”, Conference: IEEE Automatic Speech Recognition and Understanding Workshop (ASRU 2015), Dec. 2015, retrieved from URL: https://www.researchgate.net/… [cited by applicant]
Wang et al., “Recommending trusted online auction sellers using social network analysis.” Expert Systems with Applications 34.3, 2008, pp. 1666-1679 (14 pages). [cited by applicant]
Yang et al., “A Method for Web Service Discovery and Dynamic Composition Based on Service Chain”, Germany, Springer Verlag, 2012, (2 pages). [cited by applicant]
Yankov et al., “Evaluation of Explore-Exploit Policies in Multi-result Ranking Systems”, Apr. 28, 2015, retrieved from URL: https://arxiv.org/pdf/1504.07662.pdf (9 pages), Mar. 17, 2025. [cited by applicant]