IP Library › Granted Patent US 12,093,655
Granted Patent B1
US 12,093,655 · App. 17/398,683 · Granted Sep 17, 2024

Systems and methods for communication prosthetic

Inventors: Dennis E. Montenegro (Concord, CA); Christopher Rotchford (San Francisco, CA)
Assignee: Wells Fargo Bank, N.A.
G06F40/35G06F3/0484G10L15/22G06F40/58G10L2015/225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,655
App. No.
17/398,683
Granted
Sep 17, 2024
Kind
B1
Abstract

A system includes a computing system that includes a network interface coupled to a processing circuit configured to receive a first input feed from a first user device and a second input feed from a second user device and to provide a first communication interface to the first user via the first user device and a second communication interface to the second user via the second user device. The first communication interface comprises video of the second user and a second user avatar. The second communication interface comprises video of the first user and a first user avatar. The processing circuit further monitors the input feeds, analyzes the first input feed using an artificial intelligence model to identify a condition of the first user, and provides the second user a notification via the first user avatar regarding the first user based on the condition of the first user.

Claims (52)

1. A system comprising:

a computing system comprising a network interface and a processing circuit, the network interface structured to facilitate communication with two or more user devices via a network, the processing circuit comprising a processor and a memory storing instructions that, when executed by the processor, cause the processing circuit to:

receive a first input feed from a first user device and a second input feed from a second user device, wherein the first input feed comprises video and audio of a first user, and wherein the second input feed comprises video and audio of a second user;

provide a first communication interface to the first user via the first user device and a second communication interface to the second user via the second user device, wherein the first communication interface comprises the video of the second user and a second user avatar, and wherein the second communication interface comprises the video of the first user and a first user avatar;

monitor the first input feed and the second input feed;

analyze the first input feed using an artificial intelligence model to identify a condition of the first user; and

provide the second user a notification, on the second communication interface via the first user avatar, to inform the second user of the condition of the first user identified using the artificial intelligence model.

2. The system of claim 1 wherein the instructions, when executed by the processor, further cause the processing circuit to:

provide, by the second user avatar, the first user with first conversation information regarding the second user based on a second user profile via the first user device; and

provide, by the first user avatar, the second user with second conversation information regarding the first user based on a first user profile via the second user device.

3. The system of claim 1 , wherein the first communication interface and the second communication interface further comprise a conversation indicator.

4. The system of claim 1 , wherein the first communication interface further comprises the first user avatar, and the second communication interface further comprises the second user avatar.

5. The system of claim 1 , wherein the instructions, when executed by the processor, further cause the processing circuit to:

provide, prior to or concurrent with providing the notification, an indication that the first user avatar or the second user avatar will interject.

6. The system of claim 1 , wherein the artificial intelligence model is trained based on test results from the first user and communication between the first user and the first user avatar.

7. The system of claim 1 , wherein the artificial intelligence model is a first artificial intelligence model, and wherein the second input feed is analyzed using a second artificial intelligence model.

8. The system of claim 1 , wherein the instructions, when executed by the processor, further cause the processing circuit to:

determine that the first user has misunderstood the second user;

determine an intended message of the second user; and

output, on the first user device via the second user avatar, the intended message of the second user.

9. The system of claim 1 , wherein the notification is at least one of a textual notification or an audio notification.

10. The system of claim 1 , wherein the first user avatar displays an intended sentiment of the first user and the second user avatar displays an intended sentiment of the second user.

11. The system of claim 1 , wherein the instructions, when executed by the processor, further cause the processing circuit to:

train the artificial intelligence model based on the first input feed and the second input feed.

12. A system comprising:

a computing system comprising a network interface and a processing circuit, the network interface structured to facilitate communication with two or more user devices via a network, the processing circuit comprising a processor and a memory storing instructions that, when executed by the processor, cause the processing circuit to:

receive a first input feed from a first user device and a second input feed from a second user device, wherein the first input feed comprises video and audio of a first user, and wherein the second input feed comprises video and audio of a second user;

provide a first communication interface to the first user via the first user device and a second communication interface to the second user via the second user device, wherein the first communication interface comprises the video of the second user and a second user avatar, and wherein the second communication interface comprises the video of the first user and a first user avatar;

monitor the first input feed and the second input feed;

analyze the first input feed using an artificial intelligence model to determine that the first user has misunderstood the second user; and

output, on the first user device via the second user avatar, an intended message of the second user to assist the first user in understanding the second user.

13. The system of claim 12 , wherein the instructions, when executed by the processor, further cause the processing circuit to:

dynamically translate the audio of the first user based on a determined language spoken of the second user; and

provide, via the second user device, a translation of the audio of the first user to the second user.

14. The system of claim 12 , wherein the instructions, when executed by the processor, further cause the processing circuit to:

provide, prior to outputting the intended message, an indication that the second user avatar will interject.

15. The system of claim 12 , wherein the first communication interface further comprises the first user avatar, and the second communication interface further comprises the second user avatar.

16. The system of claim 12 , wherein the first communication interface and the second communication interface further comprise a conversation indicator.

17. The system of claim 12 , wherein the instructions, when executed by the processor, further cause the processing circuit to:

analyze non-verbal cues of the first user using a first trained artificial intelligence model and non-verbal cues of the second user using a second trained artificial intelligence model; and

provide at least one of the first user a notification via the second user avatar regarding the second user and the second user a notification via the first user avatar regarding the first user, wherein the notification indicates at least one of a sentiment, lack of understanding, and lack of attention.

18. A system comprising:

a computing system comprising a network interface and a processing circuit, the network interface structured to facilitate communication with two or more user devices via a network, the processing circuit comprising a processor and a memory storing instructions that, when executed by the processor, cause the processing circuit to:

receive a first input feed from a first user device and a second input feed from a second user device, wherein the first input feed comprises video and audio of a first user, and wherein the second input feed comprises video and audio of a second user;

provide a first communication interface to the first user via the first user device and a second communication interface to the second user via the second user device, wherein the first communication interface comprises the video of the second user and a second user avatar, and wherein the second communication interface comprises the video of the first user and a first user avatar;

monitor the first input feed and the second input feed;

analyze the first input feed using an artificial intelligence model to determine a confidence level regarding the first user's understanding of the second user;

output, on the second user device, an indication of the confidence level, wherein the confidence level indicates a likelihood of the second user avatar interjecting to reconcile the first user's understanding of the second user; and

output, on the first user device via the second user avatar and after outputting the indication of the confidence level, an intended message of the second user based on the confidence level falling below a threshold.

19. The system of claim 18 , wherein the indication is an image that changes color based on the first user's understanding of the second user.

20. The system of claim 19 , wherein the indication changes from a first color to a second color to indicate a higher likelihood of the second user avatar interjecting.

21. The system of claim 19 , wherein the indication changes from a first color to a second color to indicate that the second user avatar is going to interject.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2022
From: MONTENEGRO, DENNIS E.; ROTCHFORD, CHRISTOPHER
To: WELLS FARGO BANK, N.A.
Reel/Frame 061823/0207 →
Cited By (1)
US 12,394,159