Web meeting integrations with content management systems
Methods, systems, and computer program products. A virtual canvas is presented in an active area of an online meeting facility that renders participant-specific online virtual canvas interactions raised by a respective plurality of users' devices. Users can see and hear each other's interactions during an virtual canvas session. Annotations include drawings, content object edits, voice annotations, etc. that correspond to a displayed portion of a content object of a content management system (CMS). Based on the interactions and/or inferences made based on those interactions, the virtual canvas system generates commands to be executed by the content management system. Characteristics of interactions between users can be enriched by drawing information from the content management system and using such information in combination with the interactions themselves. The CMS can recommend teams, and action items, and the CMS can provide hints to participants, so as to facilitate more effective engagement between the participants.
1 . A method, comprising:
presenting an online virtual canvas as an active area of an online meeting facility that renders participant-specific online virtual canvas interactions from a respective plurality of user devices in an online meeting;
identifying, at a content management system (CMS), an annotation with respect to a content object, wherein the annotation is created in a second online virtual canvas from a second user device, and the annotation is created in or over the content object uploaded from the content management system CMS for display on a first online virtual canvas by a first user for collaboration on the content object in the online meeting; and
facilitating the participant-specific online virtual canvas interactions over the content object between at least the first online virtual canvas and the second online virtual canvas on the online meeting facility while the content object is hosted by the CMS based at least in part upon a content management system CMS command that is generated based at least in part upon meanings derived from the participant-specific online virtual canvas interactions, facilitating the participant-specific online virtual canvas interactions comprising:
determining, based at least in part upon the meanings derived from the participant- specific online virtual canvas interactions, whether the CMS is to apply a change to the content object or to apply the change to the metadata associated with the content object, wherein the annotation made in the second online virtual canvas results in the change in the CMS with respect to the content object;
when it is determined that the CMS is to apply the change to the content object, generating the CMS command for execution by the CMS at least by performing a first translation task on the annotation to match a first canonical representation of the annotation to the CMS command;
when it is determined that the CMS is to apply the change to the metadata, generating the CMS command at least by performing a second translation task on the annotation to match a second canonical representation of the annotation to the CMS command, wherein the first or second canonical representations of the annotation are matched to the command at least by accessing a data structure having a plurality of canonical representations to perform a lookup operation based on the first or second canonical representation of the annotation, the data structure associating canonical representations of interaction events to respective CMS commands, and the first and the second translation tasks are determined based at least in part upon whether the CMS is to apply the change to the content object or to the metadata;
executing the CMS command at the CMS to apply the change based at least in part upon the annotation received at the CMS; and
uploading data pertaining to at least the change from the CMS to a first user device for the first user to interact with the content object with respect to the annotation on the first online virtual canvas.
2 . The method of claim 1 , wherein the content management system command comprises an instruction to add, into the content management system, a first content object that comprises an agenda, or a second content object that comprises an inferred action item, or a third content object that comprises session summary metrics.
3 . The method of claim 2 , wherein the agenda is derived from a text annotation or speech-to-text annotation from the second user.
4 . The method of claim 1 , wherein the first or the second online virtual canvas is configured to display at least a portion of the content object of the content management system concurrently with display of the annotation.
5 . The method of claim 4 , further comprising:
rendering a live video or audio stream that originates from at least one of the plurality of user devices, or further comprising rendering at least an avatar of either the first user or the second user; and
converting the annotation at least by performing an object recognition operation or an optical character recognition operation on the annotation, wherein
the annotation comprises a hand-drawn sketch that is transmitted from the second online virtual canvas in a form of second electronic signals, and
the second electronic signals are transduced into first electronic signals that are audible or perceivable by the first user on the first online virtual canvas.
6 . The method of claim 1 , wherein the annotation in or over the content object is made using a native application that was provided by the CMS and was used to open the content object.
7 . The method of claim 1 , wherein the annotation in or over the content object is made using a non-native application provided by the online meeting facility.
8 . The method of claim 1 , further comprising: classifying at least some of annotations as being at least one of a comment on a portion of the content object, a highlight of the portion of the content object, or an edit to the portion of the content object.
9 . The method of claim 1 , further comprising: selecting one or more individual ones of annotations as one or more candidate interactions.
10 . The method of claim 9 , further comprising translating at least one of the one or more candidate interactions into one or more commands at least by matching the one or more individual ones of the annotations to corresponding CMS commands.
11 . The method of claim 9 , wherein at least one annotation of the annotations causes the change to one or more collaboration groups, and the change corresponds to adding or removing one or more users from the one or more collaboration groups.
12 . The method of claim 1 , wherein the content management system command comprises an instruction to identify a CMS user who is associated with any of the participant-specific online virtual canvas interactions.
13 . The method of claim 1 , further comprising:
displaying availability of one or more tools on at least one of the respective plurality of user devices, wherein at least one of the one or more tools comprises at least a tool to upload the content object.
14 . The method of claim 1 , wherein at least one of content management system commands comprises an instruction to store, into the content management system, a separate content object that derives from a user device.
15 . The method of claim 1 , further comprising storing at least some virtual canvas assets into persistent storage.
16 . The method of claim 15 , further comprising reanimating a stored virtual canvas session by presenting a representation of at least some of the virtual canvas assets on a display of a user device.
17 . The method of claim 1 , further comprising:
determining, based at least in part upon the meanings derived from the participant-specific online virtual canvas interactions, whether the CMS is to apply the change to a collaboration group for the plurality of user devices, to the content object, or to the metadata; and
when it is determined that the CMS is to apply the change to the collaboration group, generating the CMS command at least by performing a third translation task on the annotation, wherein the third translation task is determined based at least in part upon whether the CMS is to apply the change to the content object, to the metadata, or to the collaboration group, wherein
the annotation made in the second online virtual canvas results in a change in the CMS with respect to the collaboration group, and
a setting of the collaboration group is used to control access to the content object for users in the collaboration group.
18 . A non-transitory computer readable medium having stored thereon a sequence of instructions which, when stored in memory and executed by one or more processors causes the one or more processors to perform a set of acts, the set of acts comprising:
presenting an online virtual canvas as an active area of an online meeting facility that renders participant-specific online virtual canvas interactions from a respective plurality of user devices in an online meeting;
identifying, at a content management system (CMS), an annotation with respect to a content object, wherein the annotation is created in a second online virtual canvas from a second user device, and the annotation is created in or over the content object uploaded from the content management system CMS for display on a first online virtual canvas by a first user for collaboration on the content object in the online meeting; and
facilitating the participant-specific online virtual canvas interactions over the content object between at least the first online virtual canvas and the second online virtual canvas on the online meeting facility while the content object is hosted by the CMS based at least in part upon a content management system CMS command that is generated based at least in part upon meanings derived from the participant-specific online virtual canvas interactions, facilitating the participant-specific online virtual canvas interactions comprising:
determining, based at least in part upon the meanings derived from the participant-specific online virtual canvas interactions, whether the CMS is to apply a change to the content object or to apply the change to the metadata associated with the content object, wherein the annotation made in the second online virtual canvas results in the change in the CMS with respect to the content object;
when it is determined that the CMS is to apply the change to the content object, generating the CMS command for execution by the CMS at least by performing a first translation task on the annotation to match a first canonical representation of the annotation to the CMS command;
when it is determined that the CMS is to apply the change to the metadata, generating the CMS command at least by performing a second translation task on the annotation to match a second canonical representation of the annotation to the CMS command, wherein the first or second canonical representations of the annotation are matched to the command at least by accessing a data structure having a plurality of canonical representations to perform a lookup operation based on the first or second canonical representation of the annotation, the data structure associating canonical representations of interaction events to respective CMS commands, and the first and the second translation tasks are determined based at least in part upon whether the CMS is to apply the change to the content object or to the metadata;
executing the CMS command at the CMS to apply the change based at least in part upon the annotation received at the CMS; and
uploading data pertaining to at least the change from the CMS to a first user device for the first user to interact with the content object with respect to the annotation on the first online virtual canvas.
19 . The non-transitory computer readable medium of claim 18 , wherein the content management system command comprises an instruction to add, into the content management system, a first content object that comprises a stored virtual canvas session.
20 . A system comprising:
a storage medium having stored thereon a sequence of instructions; and
one or more processors that execute the sequence of instructions to cause the one or more processors to perform a set of acts, the set of acts comprising:
presenting an online virtual canvas as an active area of an online meeting facility that renders participant-specific online virtual canvas interactions from a respective plurality of user devices in an online meeting;
identifying, at a content management system (CMS), an annotation with respect to a content object, wherein the annotation is created in a second online virtual canvas from a second user device, and the annotation is created in or over the content object uploaded from the content management system CMS for display on a first online virtual canvas by a first user for collaboration on the content object in the online meeting; and
facilitating the participant-specific online virtual canvas interactions over the content object between at least the first online virtual canvas and the second online virtual canvas on the online meeting facility while the content object is hosted by the CMS based at least in part upon a content management system CMS command that is generated based at least in part upon meanings derived from the participant-specific online virtual canvas interactions, facilitating the participant-specific online virtual canvas interactions comprising:
determining, based at least in part upon the meanings derived from the participant-specific online virtual canvas interactions, whether the CMS is to apply a change to the content object or to apply the change to the metadata associated with the content object, wherein the annotation made in the second online virtual canvas results in the change in the CMS with respect to the content object;
when it is determined that the CMS is to apply the change to the content object, generating the CMS command for execution by the CMS at least by performing a first translation task on the annotation to match a first canonical representation of the annotation to the CMS command;
when it is determined that the CMS is to apply the change to the metadata, generating the CMS command at least by performing a second translation task on the annotation to match a second canonical representation of the annotation to the CMS command, wherein the first or second canonical representations of the annotation are matched to the command at least by accessing a data structure having a plurality of canonical representations to perform a lookup operation based on the first or second canonical representation of the annotation, the data structure associating canonical representations of interaction events to respective CMS commands, and the first and the second translation tasks are determined based at least in part upon whether the CMS is to apply the change to the content object or to the metadata;
executing the CMS command at the CMS to apply the change based at least in part upon the annotation received at the CMS; and
uploading data pertaining to at least the change from the CMS to a first user device for the first user to interact with the content object with respect to the annotation on the first online virtual canvas.
21 . The system of claim 20 , wherein the content management system command comprises an instruction to add, into the content management system, a first content object that comprises a stored virtual canvas session.