IP Library › Granted Patent US 12,267,372
Granted Patent B2
US 12,267,372 · App. 18/185,338 · Granted Apr 1, 2025

Enabling permissible interactions with applications shared during audio-visual communication sessions

Inventors: Lee Adcock (Midlothian, VA); Vamsi Kavuri (Glen Allen, VA)
Assignee: Capital One Services, LLC
H04L65/4015H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,372
App. No.
18/185,338
Granted
Apr 1, 2025
Kind
B2
Abstract

Methods and systems are described herein for enabling permissible interactions with applications shared during communication sessions. The system may detect, by a communication application on a first device during a communication session, activation of a sharing function on a second device. The sharing function may enable sharing of a shared application via the communication application. The system may determine one or more permissible interactions for the first device to perform with one or more portions of the shared application. Based on user input received by the first device, the system may detect an interaction with a portion of the shared application. The system may determine whether the interaction is a permissible interaction for the shared application. In response to determining that the interaction is permissible, the system may perform an action on the portion of the shared application on the first device.

Claims (79)

1. A system for enabling permissible interactions with applications shared during audio-visual communication session, the system comprising:

one or more processors; and

one or more non-transitory, computer-readable media comprising instructions that, when executed by the one or more processors, cause operations comprising:

detecting, by a communication application on a first client device during a communication session between a plurality of users, an activation of a sharing function on a second client device, the sharing function enabling sharing a view of a shared application via the communication application;

receiving, from the second client device, parameter data associated with the shared application, the parameter data comprising a type of the shared application and activation instructions for activating the shared application on the first client device, wherein the activation instructions comprise an identifier of a file to access with the shared application;

determining, based on the type of the shared application, one or more permissible interactions for the shared application;

upon activation of the shared application according to the activation instructions, detecting, based on a user input received by the first client device, an interaction with the shared application;

generating a dataset comprising, for the shared application, a plurality of entries comprising a plurality of possible interactions with a plurality of portions of the shared application;

inputting, into a machine learning model, the dataset to obtain a plurality of predictions indicating the one or more permissible interactions for the shared application, wherein the machine learning model has been trained to indicate whether interactions with portions of applications are permissible;

determining that the interaction is a permissible interaction of the one or more permissible interactions for the shared application; and

performing, based on determining that the interaction is permissible and according to the interaction, an action on a portion of the plurality of portions of the shared application.

2. The system of claim 1 , wherein the plurality of portions of the shared application are a plurality of visual portions of the shared application.

3. The system of claim 1 , wherein the instructions further cause the one or more processors to perform operations comprising:

determining, based on authentication information associated with the shared application on the first client device, that a different interaction is not permissible;

declining, based on determining that the different interaction is not permissible, to perform a different action on the first client device; and

outputting, via the communication application on the first client device, a message indicating a reason for impermissibility of the different interaction.

4. The system of claim 1 , wherein the instructions further cause the one or more processors to perform operations comprising:

determining that the interaction is an adjustment of the view of the shared application;

adjusting the view, on the first client device, of the shared application based on the interaction; and

transmitting the view to the second client device.

5. A method comprising:

detecting, by a communication application on a first device during a communication session between a plurality of users, an activation of a sharing function on a second device, the sharing function enabling sharing a view of a shared application via the communication application;

receiving, from the second device, parameter data associated with the shared application;

determining, based on the parameter data, one or more permissible interactions for the shared application on the first device to perform with one or more portions of the shared application;

detecting, based on a user input received by the first device, an interaction with a portion of the shared application;

receiving or generating a dataset comprising a plurality of entries for a plurality of interactions;

inputting, into a machine learning model, the dataset to obtain a plurality of predictions indicating the one or more permissible interactions for the shared application, wherein the machine learning model has been trained to indicate whether interactions with portions of applications are permissible;

determining that the interaction is a permissible interaction of the one or more permissible interactions for the shared application; and

performing, based on determining that the interaction is permissible, an action on the portion of the shared application on the first device.

6. The method of claim 5 , wherein the parameter data comprises a type of the shared application and activation instructions for activating the shared application on the first device, and wherein the activation instructions comprise an identifier of a file to access with the shared application.

7. The method of claim 5 , further comprising:

detecting the action by the communication application on the first device; and

determining that the action is to be performed only on the first device.

8. The method of claim 5 , further comprising:

determining that the interaction is an adjustment of the view of the shared application;

adjusting the view, on the first device, of the shared application based on the interaction; and

transmitting the view to the second device.

9. The method of claim 5 , wherein receiving or generating the dataset comprises:

receiving the dataset, wherein the plurality of interactions is interacting with a plurality of portions of a plurality of applications, and wherein each entry comprises an output label indicating whether each interaction of the plurality of interactions with the plurality of portions is permissible, and

wherein determining that the interaction is the permissible interaction comprises:

training, using the dataset, the machine learning model to generate outputs that indicate which of the plurality of interactions are permissible.

10. The method of claim 5 ,

wherein receiving or generating the dataset comprises:

retrieving, from the first device, information identifying the plurality of interactions, wherein the plurality of interactions are with a plurality of portions of the shared application;

generating the dataset based on the information regarding the plurality of interactions.

11. The method of claim 5 , further comprising:

determining, based on authentication information associated with the shared application on the first device, that a different interaction is not permissible;

declining, based on determining that the different interaction is not permissible, to perform a different action; and

outputting, via the communication application on the first device, a message indicating a reason for impermissibility of the different interaction.

12. The method of claim 5 , further comprising:

generating, based on performing the action, an indication of a view of the shared application, wherein the indication is configured to be selected to cause the view of the shared application to be displayed on the first device.

13. A non-transitory, computer-readable medium storing instructions that when executed by one or more processors cause the one or more processors to perform operations comprising:

detecting, by a communication application on a first device during a communication session between a plurality of users, an activation of a sharing function on a second device, the sharing function enabling sharing a view of a shared application via the communication application;

receiving, from the second device, parameter data associated with the shared application;

determining, based on the parameter data, one or more permissible interactions for the shared application on the first device to perform with one or more portions of the shared application;

detecting, based on a user input received by the first device, an interaction with a portion of the shared application;

receiving or generating a dataset comprising a plurality of entries for a plurality of interactions;

inputting, into a machine learning model, the dataset to obtain a plurality of predictions indicating the one or more permissible interactions for the shared application, wherein the machine learning model has been trained to indicate whether interactions with portions of applications are permissible;

determining that the interaction is a permissible interaction of the one or more permissible interactions for the shared application; and

performing, based on determining that the interaction is permissible, an action on the portion of the shared application on the first device.

14. The non-transitory, computer-readable medium of claim 13 , wherein the parameter data comprises a type of the shared application and activation instructions for activating the shared application on the first device, and wherein the activation instructions comprise an identifier of a file to access with the shared application.

15. The non-transitory, computer-readable medium of claim 13 , wherein the instructions cause the one or more processors to perform operations comprising:

detecting the action by the communication application on the first device;

determining that the action is to be performed only on the first device; and

refraining to send the action to the second device.

16. The non-transitory, computer-readable medium of claim 13 , wherein the instructions cause the one or more processors to perform operations comprising:

determining that the interaction is an adjustment of the view of the shared application;

adjusting the view, on the first device, of the shared application based on the interaction; and

transmitting the view to the second device.

17. The non-transitory, computer-readable medium of claim 13 , wherein, to determine that the interaction is the permissible interaction, the instructions cause the one or more processors to perform operations comprising:

training, using the dataset, the machine learning model to generate outputs that indicate the one or more permissible interactions for the shared application.

18. The non-transitory, computer-readable medium of claim 13 , wherein, to determine that the interaction is the permissible interaction, the instructions cause the one or more processors to perform operations comprising:

comparing the interaction with the plurality of predictions.

19. The non-transitory, computer-readable medium of claim 13 , wherein the instructions cause the one or more processors to perform operations comprising:

determining, based on authentication information associated with the shared application on the first device, that a different interaction is not permissible;

declining, based on determining that the different interaction is not permissible, to perform a different action; and

outputting, via the communication application on the first device, a message indicating a reason for impermissibility of the different interaction.

20. The non-transitory, computer-readable medium of claim 13 , wherein the instructions cause the one or more processors to perform operations comprising:

generating, based on performing the action, an indication of a view of the shared application, wherein the indication is configured to be selected to cause the view of the shared application to be displayed on the first device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2023
From: ADCOCK, LEE; KAVURI, VAMSI
To: CAPITAL ONE SERVICES, LLC
Reel/Frame 063008/0294 →
Continuity (1)
Related Publication 20240314180A1 · Sep 19, 2024
References Cited (6)
US 11212326B2 · Faulkner · 2021 [cited by examiner]
US 11424945B1 · Yang · 2022 [cited by examiner]
US 20040179036A1 · Teplov · 2004 [cited by examiner]
US 20130066974A1 · Yoakum · 2013 [cited by examiner]
US 20180367484A1 · Rodriguez · 2018 [cited by examiner]
US 20230328123A1 · Bonnett-Brooks · 2023 [cited by examiner]