IP Library › Granted Patent US 12,430,096
Granted Patent B2
US 12,430,096 · App. 17/898,799 · Granted Sep 30, 2025

Virtual assistant multi-modal functionality

Inventors: Alex Heath Misiaszek (Cornelius, NC); Michael Anthony Dascola (Raleigh, NC); Christopher Detzi (Chapel Hill, NC); Gabriel Sheridan (Iron Station, NC)
Assignee: Truist Bank
G06F3/167G10L15/083G10L15/22G10L15/08G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,430,096
App. No.
17/898,799
Granted
Sep 30, 2025
Kind
B2
Abstract

A process for receiving, through a virtual assistant application, a first modality input related to a transaction profile. The process may involve identifying utterances from the first modality input. The process may further involve adjust a transaction service schema based on utterances identified from the first modality input and responding, through the virtual assistant application, with a first output derived from the transaction service schema. The process may further involve receiving, through the virtual assistant application, a second modality input related to the transaction profile. The process may then involve identifying utterances from the second modality input. The process may then involve adjusting the transaction service schema based on utterances identified from the second modality input. The process may conclude with responding, through the virtual assistant application, with a second output derived from the transaction service schema.

Claims (50)

1. A non-transitory computer-readable medium comprising instructions that are executable by a processing device for causing the processing device to perform operations comprising:

receiving, through a virtual assistant application, a first modality input from a first user device associated with a user, the first modality input being in a first communication mode, and the first modality input being related to a transaction profile;

identifying utterances from the first modality input;

adjusting a transaction service schema based on the utterances identified from the first modality input;

transmitting, by the virtual assistant application and to the first user device associated with the user, a first output derived from the transaction service schema;

receiving, through the virtual assistant application and in response to the first output, a second modality input from a second user device associated with the user, the second modality input being in a second communication mode, the second modality input being related to the transaction profile, and the second communication mode being different from the first communication mode;

identifying utterances from the second modality input;

adjusting the transaction service schema based on the utterances identified from the second modality input; and

transmitting, by the virtual assistant application and to the second user device associated with the user, a second output derived from the transaction service schema.

2. The non-transitory computer-readable medium of claim 1 , wherein the first output comprises a graphical user interface object, wherein the operations further comprise outputting, via the virtual assistant application, the graphical user interface object on the second user device associated with the user, and wherein the second modality input is a user selection of the graphic user interface object.

3. The non-transitory computer-readable medium of claim 1 , wherein a modality of the first output and a modality of the second output are based on at least a satisfaction indicator and a fluency indicator generated from user interactions with the virtual assistant application.

4. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise:

deriving the first output and the second output from the transaction service schema, wherein the first output and the second output comprise separate modalities.

5. The non-transitory computer-readable medium of claim 1 , the operations further comprising receiving the second modality input by a graphical user interface input.

6. The non-transitory computer-readable medium of claim 1 , wherein the first communication mode and the second communication mode are selected from a group consisting of: a touchscreen gesture input, an interaction with a graphical user interface (GUI) object, a photographic input, a video input, a button input, an accelerometer input, and a gyroscope input.

7. The non-transitory computer-readable medium of claim 1 , wherein the operations further comprise:

terminating the transaction service schema by the second modality input.

8. A computer-implemented method comprising:

receiving, through a virtual assistant application, a first modality input from a first user device associated with a user, the first modality input being in a first communication mode, and the first modality input being related to a transaction profile;

identifying utterances from the first modality input;

adjusting a transaction service schema based on the utterances identified from the first modality input;

transmitting, by the virtual assistant application and to the first user device associated with the user, a first output derived from the transaction service schema;

receiving, through the virtual assistant application and in response to the first output, a second modality input from a second user device associated with the user, the second modality input being in a second communication mode, the second modality input being related to the transaction profile, and the second communication mode being different from the first communication mode;

identifying utterances from the second modality input;

adjusting the transaction service schema based on the utterances identified from the second modality input; and

transmitting, by the virtual assistant application and to the second user device associated with the user, a second output derived from the transaction service schema.

9. The computer-implemented method of claim 8 , wherein the first output comprises a graphical user interface object, wherein the computer-implemented method further comprises outputting, via the virtual assistant application, the graphical user interface object on the second user device associated with the user, and wherein the second modality input is a user selection of the graphic user interface object.

10. The computer-implemented method of claim 8 , wherein a modality of the first output and a modality of the second output are based on at least a satisfaction indicator and a fluency indicator.

11. The computer-implemented method of claim 8 , further comprising:

deriving the first output from the transaction service schema; and

deriving the second output from the transaction service schema, wherein the first output and the second output comprise separate modalities.

12. The computer-implemented method of claim 8 , wherein the first communication mode and the second communication mode are selected from a group consisting of: a touchscreen gesture input, an interaction with a graphical user interface (GUI) object, a photographic input, a video input, a button input, an accelerometer input, and a gyroscope input.

13. The computer-implemented method of claim 8 , further comprising:

terminating the transaction service schema by the second modality input.

14. A system comprising:

a processor; and

a non-transitory computer-readable medium comprising instructions that are executable by a processing device to perform operations comprising:

receiving, through a virtual assistant application, a first modality input from a first user device associated with a user, the first modality input being in a first communication mode, and the first modality input being related to a transaction profile;

identifying utterances from the first modality input;

adjusting a transaction service schema based on the utterances identified from the first modality input;

transmitting, by the virtual assistant application and to the first user device associated with the user, a first output derived from the transaction service schema;

receiving, through the virtual assistant application and in response to the first output, a second modality input from a second user device associated with the user, the second modality input being in a second communication mode, the second modality input being related to the transaction profile, and the second communication mode being different from the first communication mode;

identifying utterances from the second modality input;

adjusting the transaction service schema based on the utterances identified from the second modality input; and

transmitting, by the virtual assistant application and to the second user device associated with the user, a second output derived from the transaction service schema.

15. The system of claim 14 , wherein the first output comprises a graphical user interface object, wherein the operations further comprise outputting, via the virtual assistant application, the graphical user interface object on the second user device associated with the user, and wherein the second modality input is a user selection of the graphic user interface object.

16. The system of claim 14 , wherein a modality of the first output and a modality of the second output are based on at least a satisfaction indicator and a fluency indicator generated from user interactions with the virtual assistant application.

17. The system of claim 14 , wherein the operations further comprise:

deriving the first output and the second output from the transaction service schema, wherein the first output and the second output comprise separate modalities.

18. The system of claim 14 , wherein the first communication mode and the second communication mode are selected from a group consisting of a touchscreen gesture input, an interaction with a graphical user interface (GUI) object, a photographic input, a video input, a button input, an accelerometer input, a gyroscope input, or any combination thereof.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2022
From: MISIASZEK, ALEX HEATH; DASCOLA, MICHAEL ANTHONY; DETZI, CHRISTOPHER; SHERIDAN, GABRIEL
To: TRUIST BANK
Reel/Frame 060940/0712 →
Continuity (1)
Related Publication 20240069859A1 · Feb 29, 2024
References Cited (2)
US 10795640B1 · Knight · 2020 [cited by examiner]
US 10809876B2 · Brown · 2020 [cited by examiner]