IP Library › Granted Patent US 11,606,462
Granted Patent B2
US 11,606,462 · App. 17/406,389 · Granted Mar 14, 2023

Integration of human agent and automated tools for interactive voice response (IVR) systems

Inventors: Ravisha Andar (Plano, TX); Ramakrishna R. Yannam (The Colony, TX); Ashwini Patil (Richardson, TX); Priyank R. Shah (Plano, TX)
Assignee: Bank of America Corporation
H04M3/4936G06F40/40H04M3/42382H04M3/4933
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,606,462
App. No.
17/406,389
Granted
Mar 14, 2023
Kind
B2
Abstract

When a caller initiates a conversation with an interactive voice response (“IVR”) system, the caller may be transferred to a live agent. Apparatus and methods are provided for integrating automated tools and artificial intelligence (“AI”) into the interaction with the IVR system. The automated tools and AI may track the conversation to decipher when to transfer the caller to the agent. The agent may determine which machine generated responses are appropriate for the caller. AI may be leveraged to suggest responses for both caller and agent while they are interacting with each other. The agent may transfer back the caller to the IVR system along with the appropriate machine generated response to maintain efficiency and shorten time of human agent interaction.

Claims (84)

1. A method for leveraging artificial intelligence to integrate human and machine responses within an interactive voice response (“IVR”) system, the method comprising:

receiving an initiation of a conversation with a human caller and an artificial intelligence (“AI”) engine, the conversation comprising a request from the human caller;

providing, to the AI engine, voice inputs generated by the human caller;

tracking a length of time of the conversation with the human caller and the AI engine;

tracking responses provided by the AI engine;

automatically terminating the conversation at the IVR system when:

the length of time of the conversation is equal to a first pre-determined amount of time; and

a text message from the AI agent is received at a mobile device of the human caller, the text message including a hyperlink and a selection of the hyperlink; and

immediately after receipt of the text message, a delay in receiving voice inputs is detected, a length of the delay being a period of time that is equal to or greater than a second pre-determined amount of time;

automatically transferring the human caller and the voice inputs to a human agent when:

the length of time of the conversation is equal to the first pre-determined amount of time; and

a satisfactory response to the request has not yet been provided by the AI engine, the satisfactory response comprising a response that triggers the delay of the receipt of voice inputs from the human caller of the second pre-determined amount of time; and

continuing the conversation with the human caller and the human agent;

continuously providing a voice-to-text rendition of the continuing conversation on a display screen, the display screen positioned within proximity of the human agent;

based on the continuing conversation:

receiving a selected response provided by the human agent based on the determination of a type of request; and

transferring back the human caller to the AI engine to provide the selected response to the human caller; and

wherein, when the selected response provided by the AI engine to the human caller is not the satisfactory response, changing a background-color on the display screen to alert the human agent.

2. The method of claim 1 wherein simultaneous to the continuing conversation, continuing to provide the voice inputs generated by the human caller to the AI engine.

3. The method of claim 1 wherein prior to providing the voice inputs to the AI engine, processing the voice inputs using natural language processing (“NLP”).

4. The method of claim 1 wherein the first pre-determined amount of time is a length of time equal to or greater than 25 seconds.

5. The method of claim 1 wherein the tracking further comprises tracking sequences of utterances within the conversation and when the human caller repeats a sequence of utterances more than one time, automatically transferring the human caller to the human agent.

6. The method of claim 1 wherein the tracking further comprises monitoring a decibel level of a voice of the human caller and when the decibel level reaches a level greater than 60 decibels, automatically transferring the human caller to the human agent.

7. The method of claim 1 wherein when the selected response provided is not the satisfactory response, transferring back the human caller to the human agent to complete the conversation.

8. The method of claim 1 wherein the human caller's delay is a delay due to the selection of the hyperlink provided by the AI engine in the text-message in response to the conversation.

9. The method of claim 1 wherein when the selected response provided by the AI engine to the human caller is not the satisfactory response, transmitting an alert to the human agent on the display screen.

10. An interactive voice response system (“IVR”) comprising:

a telephony server configured to:

receive an initiation of a conversation submitted by a human caller using a communication network, the conversation comprising voice inputs associated with a request, the voice inputs generated by the human caller;

provide an interface for the human caller to interact with an artificial intelligence (“AI”) engine over the communication network; and

transmit to the human caller, over the communication network, responses to the voice inputs generated by the AI engine; and

an application server hosting the AI engine configured to:

receive, continuously, from the telephony server, the voice inputs generated by the human caller and the responses to the voice inputs generated by the AI engine;

generate a machine interpretation of the voice inputs;

monitor the voice inputs by:

tracking a length of time of the voice inputs generated by the human caller; and

monitoring the responses to the voice inputs generated by the AI engine; and

wherein:

the application server is configured to terminate the conversation when:

the length of time is equal to a first pre-determined amount of time; and

a text message from the AI agent is received at a mobile device of the human caller, the text message including a hyperlink and a selection of the hyperlink; and

immediately after receipt of the text message, a delay in receiving voice inputs is detected, a length of the delay being a period of time that is equal to or greater than a second pre-determined amount of time;

the application server is configured to transfer the human caller to a human agent when:

the length of time is equal to the first pre-determined amount of time; and

a satisfactory response to the request has not yet been provided by the AI engine;

the application server, upon transferring, is configured to:

transmit an instruction to the telephony server to automatically transfer the human caller to a human agent;

link a terminal accessible by the human agent to the application server;

transmit to the human agent, the machine interpretation of the voice inputs and the responses generated by the AI engine;

continue the conversation, via the terminal, between the human caller and the human agent;

simultaneous to the continuing of the conversation, continue to provide the voice inputs generated by the human caller to the AI engine; and

based on the continuing conversation and the machine interpretation of the voice inputs, determine by the human agent, the request of the human caller, the request being associated with the voice inputs generated by the human caller.

11. The system of claim 10 wherein the application server is further configured to continuously provide to the human agent, a voice-to-text rendition of the continuing conversation on a display screen, the display screen positioned within proximity of the human agent.

12. The system of claim 11 wherein following the determination of the request of the human caller, the application server is further configured to:

receive, from the human agent, a selected response associated with the request, the selected response being the satisfactory response;

pause the terminal linking the human agent; and

provide, by the AI engine, the selected response to the human caller.

13. The system of claim 12 wherein when the selected response provided by the AI engine to the human caller is not the satisfactory response, the application server is configured to transmit an alert to the human agent on the display screen.

14. The system of claim 12 wherein when the selected response provided by the AI engine to the human caller is not the satisfactory response, the application server is configured to change a background-color on the display screen to alert the human agent.

15. The system of claim 10 wherein the first pre-determined amount of time is a length of time equal to or greater than 25 seconds.

16. The system of claim 10 wherein the tracking further comprises tracking sequences of utterances from the voice inputs and when the human caller repeats a sequence of utterances more than one time, transmit an instruction to the telephony server to automatically transfer the human caller to the human agent.

17. A method for leveraging artificial intelligence to integrate human and machine responses within an interactive voice response (“IVR”) system, the method comprising:

receiving an initiation of a conversation with a human caller and an artificial intelligence (“AI”) engine, the conversation comprising a request from the human caller;

providing, to the AI engine, voice inputs generated by the human caller;

tracking:

sequences of utterances extracted from the voice inputs; and

responses provided by the AI engine;

automatically terminating the conversation at the IVR system when:

the length of time is equal to a first pre-determined amount of time; and

a text message from the AI agent is received at a mobile device of the human caller, the text message including a hyperlink and a selection of the hyperlink; and

immediately after receipt of the text message, a delay in receiving voice inputs is detected, a length of the delay being a period of time that is equal to or greater than a second pre-determined amount of time;

automatically transferring the human caller and the voice inputs to a human agent when:

a sequence of utterances from the sequences of utterances is determined to be repeated more than once; and

a satisfactory response to the request has not yet been provided by the AI engine, the satisfactory response comprising a response that triggers the delay of the human caller of the second pre-determined amount of time;

continuing the conversation with the human caller and the human agent;

based on the continuing conversation and the voice inputs, determining, by the human agent, a type of request;

receiving a selected response provided by the human agent based on the determination of the type of request;

transferring back the human caller to the AI engine to provide the selected response to the human caller; and

wherein, when the selected response provided by the AI engine is not the satisfactory response, the method comprises:

transmitting an alert to the human agent on a display screen positioned within proximity of the human agent;

transferring back the human caller to the human agent; and

completing the conversation via the human agent.

18. The method of claim 17 wherein when at least two or more utterances within the sequence of utterances is repeated in a subsequent sequence of utterances, automatically transferring the human caller to the human agent.

19. The method of claim 17 wherein simultaneous to the continuing conversation, continuing to provide the voice inputs generated by the human caller to the AI engine.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: ANDAR, RAVISHA; YANNAM, RAMAKRISHNA R.; PATIL, ASHWINI; SHAH, PRIYANK R.
To: BANK OF AMERICA CORPORATION
Reel/Frame 057228/0557 →
Continuity (2)
Continuation 16908893 · Jun 23, 2020
Related Publication 20210400138A1 · Dec 23, 2021
Cited By (6)
US 12,294,709 US 12,363,303 US 12,382,105 US 12,425,585 US 12,526,407 US 12,621,445