IP Library Granted Patent US 8,068,595
Granted Patent B2
US 8,068,595 · App. 11/981,860 · Granted Nov 29, 2011

System and method for providing a multi-modal communications infrastructure for automated call center operation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,068,595
App. No.
11/981,860
Granted
Nov 29, 2011
Kind
B2
Abstract

A multi-modal call is accepted from a caller through a telephony interface, which accommodates multi-modal calls including at least one of verbal speech and text messaging. Incoming speech in the multi-modal call is converted into transcribed text. Incoming text messaging is matched with the transcribed text. The multi-modal call is automatically assigned through a session manager to a session under operation of a live agent. The transcribed text and incoming text messaging are progressively processed during the session through an agent application by performing a customer support scenario interactively monitored and controlled by the live agent.

Claims (71)

1. A system for providing a multi-modal communications infrastructure for automated call center operation, comprising:

a telephony interface configured to accept a multi-modal call from a caller;

a messaging server configured to automatically assign the multi-modal call through a session manager to a session under operation of a live agent;

a speech recognition module configured to convert incoming speech from the caller into transcribed text;

a text message processor configured to match incoming text messaging originating from the caller simultaneously with the incoming speech, with the transcribed text during the session that is on-going; and

an agent console configured to progressively process the transcribed text and the incoming text messaging during the session through an agent application by performing a customer support scenario interactively monitored and controlled by the live agent.

2. A method for providing a multi-modal communications infrastructure for automated call center operation, comprising:

accepting a multi-modal call from a caller through a telephony interface and automatically assigning the multi-modal call through a session manager to a session under operation of a live agent;

receiving voice communications and text messages that simultaneously originate from the caller;

converting incoming speech from the voice communications in the multi-modal call into transcribed text;

matching at least one of the text messages from the caller with the transcribed text of the incoming speech during the session that is on-going; and

progressively processing the transcribed text and the incoming text messaging during the session through an agent application by performing a customer support scenario interactively monitored and controlled by the live agent.

3. A system according to claim 1 , further comprising:

a database configured to store the incoming text messaging as a log entry and to match the log entry with a stored copy of the transcribed text.

4. A system according to claim 1 , further comprising:

a caller identification module configured to assign a caller identification to the incoming text messaging; and

the messaging server configured to forward the incoming text messaging to the live agent based on the caller identification.

5. A system according to claim 1 , further comprising:

a post-processing module configured to perform post-processing on the incoming text messaging.

6. A system according to claim 1 , further comprising:

an identification module configured to flag the incoming text messaging as verbatim caller data; and

a database configured to store the flagged incoming text messaging.

7. A system according to claim 1 , wherein the live agent processes the incoming speech by listening to the multi-modal call and by performing an action comprising at least one of annotating and manually transcribing the incoming speech.

8. A method according to claim 2 , further comprising:

storing the incoming text messaging as a log entry; and

matching the log entry with a stored copy of the transcribed text.

9. A method according to claim 2 , further comprising:

assigning a caller identification to the incoming text messaging; and

forwarding the text messaging to the live agent based on the caller identification.

10. A method according to claim 2 , further comprising:

performing post-processing on the incoming text messaging.

11. A method according to claim 2 , further comprising:

flagging the incoming text messaging as verbatim caller data; and

storing the flagged incoming text messaging.

12. A method according to claim 2 , further comprising:

processing, by the live agent, the incoming speech by listening to the multi-modal call; and

performing an action comprising at least one of annotating and manually transcribing the incoming speech.

13. A system for providing service provisioning to a caller through multi-modal communication, comprising:

a message server configured to assign an incoming multi-modal call from a caller to a call session having a unique caller identification and which is managed by an agent;

a telephony interface configured to receive verbal speech communication from the caller during the call session;

a speech recognition module configured to convert the verbal speech to transcribed text and further configured to provide the transcribed text to the agent;

a text gateway configured to receive incoming text messages originating from the caller simultaneously with the verbal speech communication;

an identification module configured to assign the unique caller identification to each incoming text message and further configured to provide the incoming text messages to the agent based on the unique caller identification; and

a text-to-speech engine configured to receive outgoing text messages from the agent and further configured to convert the outgoing text messages into an outgoing stream of synthesized speech that is presented to the caller.

14. A system according to claim 13 , further comprising:

a communication interface configured to receive the verbal speech communication and the incoming text messages into a call center through separate streams of communication and further configured to pair the verbal speech communication and the incoming text messages, comprising:

a caller identification module configured to assign the unique caller identification to the verbal speech communication; and

a call match module configured to match the unique caller identification of the verbal speech communication and the incoming text messages to the caller session.

15. A system according to claim 13 , further comprising:

a database configured to store the transcribed text and the incoming text messages to a call log.

16. A system according to claim 13 , further comprising:

a caller information module configured to receive the multi-modal call from a mobile communication device, further configured to obtain caller information from the mobile communication device comprising locational data, and further configured to analyze the locational data to determine a location of the caller.

17. A method for providing service provisioning to a caller through multi-modal communication, comprising:

assigning an incoming multi-modal call from a caller to a call session having a unique caller identification and which is managed by an agent; and

providing service provisioning to the caller during the multi-modal call, comprising:

receiving verbal speech communication and text messages that simultaneously originate from the caller during the call session and converting the verbal speech to transcribed text;

providing the transcribed text to the agent;

assigning the unique caller identification to each incoming text message;

providing the incoming text messages to the agent based on the unique caller identification; and

receiving outgoing text messages from the agent and converting the outgoing text messages into an outgoing stream of synthesized speech that is presented to the caller.

18. A method according to claim 17 , further comprising:

receiving the verbal speech communication and the incoming text messages into a call center through separate streams of communication; and

pairing the verbal speech communication and the incoming text messages, comprising:

assigning the unique caller identification to the verbal speech communication; and

matching the unique caller identification of the verbal speech communication and the incoming text messages to the caller session.

19. A method according to claim 17 , further comprising:

storing the transcribed text and the incoming text messages to a call log.

20. A method according to claim 17 , further comprising:

receiving the multi-modal call from a mobile communication device;

obtaining caller information from the mobile communication device comprising locational data; and

analyzing the locational data to determine a location of the caller.

Assignments (18)
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 46204/0465) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063691/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 46202/0467) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063695/0145 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 46204/FRAME 0525 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; INTELLISIST, INC.
Reel/Frame 063456/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
ABL SUPPLEMENT NO. 1 Recorded May 22, 2018
From: INTELLISIST, INC.
To: CITIBANK N.A., AS COLLATERAL AGENT
Reel/Frame 046204/0525 →
ABL INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 22, 2018
From: INTELLISIST, INC.
To: CITIBANK N.A., AS COLLATERAL AGENT
Reel/Frame 046204/0418 →
TERM LOAN SUPPLEMENT NO. 1 Recorded May 22, 2018
From: INTELLISIST, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 046204/0465 →
TERM LOAN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 22, 2018
From: INTELLISIST, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 046202/0467 →
RELEASE OF SECURITY INTEREST Recorded Mar 12, 2018
From: PACIFIC WESTERN BANK, AS SUCCESSOR IN INTEREST TO SQUARE 1 BANK
To: INTELLISIST, INC.
Reel/Frame 045567/0639 →
RELEASE OF SECURITY INTEREST Recorded Jul 6, 2016
From: SILICON VALLEY BANK
To: INTELLISIST, INC.
Reel/Frame 039266/0902 →
SECURITY INTEREST Recorded Oct 23, 2015
From: INTELLISIST, INC.
To: PACIFIC WESTERN BANK (AS SUCCESSOR IN INTEREST BY MERGER TO SQUARE 1 BANK)
Reel/Frame 036942/0087 →
SECURITY INTEREST Recorded Mar 28, 2014
From: INTELLISIST, INC.
To: SILICON VALLEY BANK
Reel/Frame 032555/0516 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2010
From: ODINAK, GILAD; SUTHERLAND, ALASTAIR
To: INTELLISIST, INC.
Reel/Frame 025213/0654 →