System to facilitate interaction during a collaborative screen sharing session
A server device may receive information identifying a user of a first device participating in a screen sharing session with a second device and associate the information identifying the user of the first device with information indicating a sequence of interactions with an application at the first device. The server device may determine one or more user interface elements that correspond to a current view of the application at the first device based on the sequence of interactions, and transmit, to the second device, information identifying the one or more user interface elements that correspond to the current view to permit the second device to reconstruct the current view based on the information identifying the one or more user interface elements that correspond to the current view and stored information related to a plurality of views associated with the application.
1. A method, comprising:
monitoring, by a device, communications between a first device and a second device;
determining, by the device, that a context of the communications relates to at least one user interface element of an application associated with the first device and the second device,
wherein determining that the context of the communications relates to the at least one user interface element comprises:
performing natural language processing on the communications; and
determining, based on a result of the natural language processing, that the context of the communications relates to the at least one user interface element; and
transmitting, by the device, based on determining that the context of the communications relates to the at least one user interface element, and to at least one of the first device or the second device, information indicating the at least one user interface element,
wherein the information indicating the at least one user interface element places a visual emphasis on the at least one user interface element.
2. The method of claim 1 , wherein:
the application is operating on the first device; and
wherein the method further comprises:
providing, to the second device, data defining the at least one user interface element,
the data defining the at least one user interface element causing the second device to reconstruct the at least one user interface element to create a view of the application.
3. The method of claim 2 , wherein the data defining the at least one user interface element comprises computer application code.
4. The method of claim 1 , wherein the communications comprise at least one of:
voice communications, or
text communications.
5. The method of claim 1 , further comprising:
receiving, from the first device, data indicating a current view of the application; and
transmitting, to the second device, data that causes the second device to reconstruct an anonymized version of the current view of the application.
6. The method of claim 1 , further comprising:
identifying an arrangement of a plurality of user interface elements associated with the application; and
transmitting, to the second device, data indicating the arrangement,
the data indicating the arrangement causing the second device to display the arrangement.
7. The method of claim 1 , further comprising:
determining a current focus, for at least one of the first device or the second device, based on:
one or more mouseover events,
one or more touchscreen inputs, or
one or more gaze tracking events; and
providing, to the first device or the second device, information identifying the current focus.
8. A device, comprising:
one or more memories; and
one or more processors communicatively coupled to the one or more memories, configured to:
monitor communications between a first device and a second device;
determine that a context of the communications relates to at least one user interface element of an application associated with the first device and the second device,
wherein the one or more processors, when determining that the context of the communications relates to the at least one user interface element, are configured to:
perform natural language processing on the communications; and
determine, based on a result of the natural language processing, that the context of the communications relates to the at least one user interface element; and
transmit, based on the determination that the context of the communications relates to the at least one user interface element and to at least one of the first device or the second device, information indicating the at least one user interface element,
wherein the information indicating the at least one user interface element places a visual emphasis on the at least one user interface element.
9. The device of claim 8 , wherein:
the application is operating on the first device; and
wherein the one or more processors are further configured to:
provide, to the second device, data defining the at least one user interface element,
the data defining the at least one user interface element causing the second device to reconstruct the at least one user interface element to create a view of the application.
10. The device of claim 9 , wherein the data defining the at least one user interface element comprises computer application code.
11. The device of claim 8 , wherein the communications comprise at least one of:
voice communications, or
text communications.
12. The device of claim 8 , wherein the one or more processors are further configured to:
receive, from the first device, data indicating a current view of the application; and
transmit, to the second device, data that causes the second device to reconstruct an anonymized version of the current view of the application.
13. The device of claim 8 , wherein the one or more processors are further configured to:
identify an arrangement of a plurality of user interface elements associated with the application; and
transmit, to the second device, data indicating the arrangement,
the data indicating the arrangement causing the second device to display the arrangement.
14. The device of claim 8 , wherein the one or more processors are further configured to:
determine a current focus, for at least one of the first device or the second device, based on:
one or more mouseover events,
one or more touchscreen inputs, or
one or more gaze tracking events; and
provide, to the first device or the second device, information identifying the current focus.
15. A non-transitory computer-readable medium storing instructions, the
instructions comprising:
one or more instructions that, when executed by one or more processors, cause the one or more processors to:
monitor communications between a first device and a second device;
determine that a context of the communications relates to at least one user interface element of an application associated with the first device and the second device,
wherein the one or more instructions, that cause the one or more processors to determine that the context of the communications relates to the at least one user interface element, cause the one or more processors to:
perform natural language processing on the communications; and
determine, based on a result of the natural language processing, that the context of the communications relates to the at least one user interface element; and
transmit, based on the determination that the context of the communications relates to the at least one user interface element and to at least one of the first device or the second device, information indicating the at least one user interface element,
wherein the information indicating the at least one user interface element places a visual emphasis on the at least one user interface element.
16. The non-transitory computer-readable medium of claim 15 , wherein:
the application is operating on the first device; and
wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
provide, to the second device, data defining the at least one user interface element,
the data defining the at least one user interface element causing the second device to reconstruct the at least one user interface element to create a view of the application.
17. The non-transitory computer-readable medium of claim 16 , wherein the data defining the at least one user interface element comprises computer application code.
18. The non-transitory computer-readable medium of claim 15 , wherein the communications comprise at least one of:
voice communications, or
text communications.
19. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the one or more processors to:
receive, from the first device, data indicating a current view of the application; and
transmit, to the second device, data that causes the second device to reconstruct an anonymized version of the current view of the application.
20. The non-transitory computer-readable medium of claim 15 , wherein the
one or more instructions, when executed by the one or more processors, further cause
the one or more processors to:
identify an arrangement of a plurality of user interface elements associated with the application; and
transmit, to the second device, data indicating the arrangement,
the data indicating the arrangement causing the second device to display the arrangement.