IP Library › Granted Patent US 11,297,181
Granted Patent B2
US 11,297,181 · App. 16/847,023 · Granted Apr 5, 2022

Dynamic user interface during a voice call session

Inventors: Brad M. Johnson (Raleigh, NC); Adrian X. Rodriguez (Durham, NC); David Steiner (Raleigh, NC); Neil A. Girard (Pittsboro, NC)
Assignee: Toshiba Global Commerce Solutions Holdings Corporation
H04M3/5141G06F9/453G06T19/006G10L15/26H04M3/5191
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,297,181
App. No.
16/847,023
Granted
Apr 5, 2022
Kind
B2
Abstract

Method, computer program product, and system for augmenting a voice call with a user interface to provide a user visual access to a guided solution. The user interface is generated based on information such as a spoken language string received from a user using a user device with a display. The user interface including user interface elements for the guided solution is provided to the user via the display of the user device such that the user proceeds through the guided solution using the user interface during the voice call.

Claims (99)

1. A method comprising:

receiving, during a voice call session with a voice call system, a spoken language string from a user via the voice call session, wherein the voice call system provides ongoing automated voice based guidance to the user during voice call session;

generating, at the voice call system, a user interface comprising at least one user interface element for a guided solution for the voice call session based on the spoken language string;

providing, during the voice call session, the user interface to a user device for display in order to augment the voice call session, wherein the user device is associated with the user; and

guiding the user through the guided solution via the voice call session and the user interface.

2. The method of claim 1 , further comprising:

receiving a plurality of user interactions via the voice call session and the user interface;

storing the plurality of user interactions in a user interaction database; and

updating one or more guided solutions based on the plurality of user interactions in the user interaction database.

3. The method of claim 1 , further comprising:

determining an operator for the voice call session is available;

determining a progress of the user through the voice call session and the guided solution; and

providing the determined progress to the operator; and

connecting the user to the operator.

4. The method of claim 1 , wherein the user interface comprises an augmented reality interface and wherein generating the user interface further comprises:

receiving an image from the user;

processing the image to identify one or more guided solutions for the image;

determining based on the processed image and the spoken language string an augmentation user interface element to augment the image from the user; and

providing the augmentation user interface element to the user.

5. The method of claim 1 , wherein providing the user interface to the user comprises:

initiating a user interface application on a user device; and

transmitting the user interface to the user device, wherein transmitting the user interface to the user device causes the user device to render the user interface and the at least one user interface element on a display of the user device.

6. The method of claim 1 , further comprising:

determining the voice call session may be terminated;

providing an indication of a termination in the user interface;

terminating the voice call session; and

continuing guidance of the user through the guided solution via the user interface.

7. The method of claim 1 , further comprising:

receiving a voice call session request from the user;

prior to an initiation of the voice call session, determining, based on call identification factors in the voice call session request, a pre-call guided solution is available;

selecting the pre-call guided solution based on call identification factors;

generating a pre-call user interface comprising at least one pre-call user interface element using the pre-call guided solution; and

providing the pre-call user interface to the user prior to initiating the voice call session.

8. A system comprising:

one or more computer processors;

a memory containing program code which, when executed by the one or more computer processors, performs an operation comprising:

receiving, during a voice call session with the system, a spoken language string from a user via the voice call session, wherein the voice call system provides ongoing automated voice based guidance to the user during voice call session;

generating, at the system, a user interface comprising at least one user interface element for a guided solution for the voice call session based on the spoken language string;

providing, during the voice call session, the user interface to a user device for display in order to augment the voice call session, wherein the user device is associated with the user; and

guiding the user through the guided solution via the voice call session and the user interface.

9. The system of claim 8 , wherein the operation further includes:

receiving a plurality of user interactions via the voice call session and the user interface;

storing the plurality of user interactions in a user interaction database; and

updating one or more guided solutions based on the plurality of user interactions in the user interaction database.

10. The system of claim 8 , wherein the operation further includes:

determining an operator for the voice call session is available;

determining a progress of the user through the voice call session and the guided solution; and

providing the determined progress to the operator; and

connecting the user to the operator.

11. The system of claim 8 , wherein the user interface comprises an augmented reality interface and wherein generating the user interface further comprises:

receiving an image from the user;

processing the image to identify one or more guided solutions for the image;

determining based on the processed image and the spoken language string an augmentation user interface element to augment the image from the user; and

providing the augmentation user interface element to the user.

12. The system of claim 8 , wherein providing the user interface to the user comprises:

initiating a user interface application on a user device; and

transmitting the user interface to the user device, wherein transmitting the user interface to the user device causes the user device to render the user interface and the at least one user interface element on a display of the user device.

13. The system of claim 8 , wherein the operation further includes:

determining the voice call session may be terminated;

providing an indication of a termination in the user interface;

terminating the voice call session; and

continuing guidance of the user through the guided solution via the user interface.

14. The system of claim 8 , wherein the operation further includes:

receiving a voice call session request from the user;

prior to an initiation of the voice call session, determining, based on call identification factors in the voice call session request, a pre-call guided solution is available;

selecting the pre-call guided solution based on call identification factors;

generating a pre-call user interface comprising at least one pre-call user interface element using the pre-call guided solution; and

providing the pre-call user interface to the user prior to initiating the voice call session.

15. A computer program product comprising:

a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation that includes:

receiving, during a voice call session with a voice call system, a spoken language string from a user via the voice call session, wherein the voice call system provides ongoing automated voice based guidance to the user during voice call session;

generating, at the voice call system, a user interface comprising at least one user interface element for a guided solution for the voice call session based on the spoken language string;

providing, during the voice call session, the user interface to a user device for display in order to augment the voice call session, wherein the user device is associated with the user; and

guiding the user through the guided solution via the voice call session and the user interface.

16. The computer program product of claim 15 , wherein the operation further includes:

receiving a plurality of user interactions via the voice call session and the user interface;

storing the plurality of user interactions in a user interaction database; and

updating one or more guided solutions based on the plurality of user interactions in the user interaction database.

17. The computer program product of claim 15 , wherein the operation further includes:

determining an operator for the voice call session is available;

determining a progress of the user through the voice call session and the guided solution; and

providing the determined progress to the operator; and

connecting the user to the operator.

18. The computer program product of claim 15 , wherein the user interface comprises an augmented reality interface and wherein generating the user interface further comprises:

receiving an image from the user;

processing the image to identify one or more guided solutions for the image;

determining based on the processed image and the spoken language string an augmentation user interface element to augment the image from the user; and

providing the augmentation user interface element to the user.

19. The computer program product of claim 15 , wherein the operation further includes:

determining the voice call session may be terminated;

providing an indication of a termination in the user interface;

terminating the voice call session; and

continuing guidance of the user through the guided solution via the user interface.

20. The computer program product of claim 15 , wherein the operation further includes:

receiving a voice call session request from the user;

prior to an initiation of the voice call session, determining, based on call identification factors in the voice call session request, a pre-call guided solution is available;

selecting the pre-call guided solution based on call identification factors;

generating a pre-call user interface comprising at least one pre-call user interface element using the pre-call guided solution; and

providing the pre-call user interface to the user prior to initiating the voice call session.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE PREVIOUSLY RECORED ASSIGNMENT WHICH WAS MISSING ON OF FOUR INVENTOR SIGNATURES PREVIOUSLY RECORDED AT REEL: 052380 FRAME: 0819. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 21, 2020
From: JOHNSON, BRAD M.; RODRIGUEZ, ADRIAN X.; STEINER, DAVID; GIRARD, NEIL A.
To: TOSHIBA GLOBAL COMMERCE SOLUTIONS HOLDINGS CORPORATION
Reel/Frame 054822/0293 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2020
From: JOHNSON, BRAD M.; RODRIGUEZ, ADRIAN X.; STEINER, DAVID; GIRARD, NEIL A.
To: TOSHIBA GLOBAL COMMERCE SOLUTIONS HOLDINGS CORPORATION
Reel/Frame 052380/0819 →
Continuity (1)
Related Publication 20210320999A1 · Oct 14, 2021
Cited By (2)
US 12,641,178 US 12,750,443