Systems and methods for application of context-based policies to video communication content
The disclosed invention provides methods supporting systems that processes video communication(s) provided by an organization subject to internal or external regulations such as a specific financial services firm or a specific consumer product goods company. In various embodiments, video content is analyzed through a pipeline process of multiple extraction scripts, programs, and/or services and processes the content for participant likeness through facial recognition, voice recognition, and voice-to-text and stores the output in a normalized, searchable data store. A policy analysis is performed based on the stored data and external regulatory compliance, internal rules such as acceptable use policies, community-based regulations, or any combination thereof, to determine a risk score.
1 . A method performed by at least one processor for processing data from video communication applications within an organization, the method comprising:
extracting at least one of information or metadata from a video communication originating from the video communication applications, the information or metadata comprising a timestamp associated with the video communication and at least one of extracted video, voice, chat, instant messaging, digital content, or file exchange content contained in the video communication;
evaluating, by the at least one processor, a risk score for the information or metadata by:
classifying the information or metadata based on (i) applying a plurality of rules to the information or metadata, wherein at least one rule of the plurality of rules is derived from first machine learning-based techniques and (ii) at least one of: a regulatory risk, a privacy risk, a risk of loss of trade secret protection, a corporate policy compliance risk, an operational compliance policy, a non-public information risk, an acceptable use risk, or a risk to electronic communication security; and
calculating and assigning, based on the classification of the information or metadata, the risk score to the information or metadata;
causing display, based on the risk score assigned to the information or metadata, of (i) a workflow user interface comprising a plurality of workflow control options for the video communication and (ii) a video player for selection and review of the video communication;
generating and causing display of a notification indicating a risk level for the timestamp associated with the video communication:
receiving, by the workflow user interface, an input comprising a selection of (i) the assigned risk score or (ii) an adjusted risk score; and
applying, based on (i) the assigned risk score or the adjusted risk score and (ii) the classification of the information or metadata, workflow policies to the classified information or metadata.
2 . The method of claim 1 , wherein the information or metadata extracted from the video communication further comprises content selected from the group consisting of audio, text, graphics, still images of objects, still images of people, file-based content, or document-based content exchanged during the video communication.
3 . The method of claim 1 , wherein the information or metadata comprises data extracted from an audio portion of the video communication, the method further comprising:
preparing a transcript of the data extracted from the audio portion of the video communication;
comparing the transcript to a library comprising a plurality of pre-approved scripts;
applying second machine learning-based techniques to analyze and correct errors in the transcript; and
based at least in part on the comparison, at least one of:
identifying non-matching data; or
calculating and assigning the risk score to the information or metadata.
4 . The method of claim 1 , wherein the information or metadata comprises a distinctive image, the method further comprising:
comparing the distinctive image to a library of known object images;
applying second machine learning-based techniques to analyze the distinctive image; and
based at least in part on the comparison, calculating and assigning the risk score to the information or metadata.
5 . The method of claim 4 , further comprising, based at least in part on the comparison, labeling the distinctive image.
6 . The method of claim 1 , further comprising compressing, based on the risk score and compression workflow policies, the information or metadata.
7 . The method of claim 6 , wherein compressing the information or metadata comprises:
selecting a level of compression and a level of encryption.
8 . The method of claim 1 , further comprising storing, based on the risk score and storage workflow policies, the information or metadata.
9 . The method of claim 8 , wherein storing the information or metadata comprises:
determining a storage location, a storage format, and a storage duration.
10 . The method of claim 1 , further comprising redacting non-matching data.
11 . The method of claim 1 , further comprising remediating non-matching data.
12 . The method of claim 1 , wherein the at least one rule of the plurality of rules is derived by applying the first machine learning-based techniques to external research data.
13 . The method of claim 1 , wherein the at least one rule of the plurality of rules is derived by applying the first machine learning-based techniques to user-provided data.
14 . A system for processing data from video communication applications within an organization, the system comprising:
one or more computer systems each comprising one or more processors and a memory, the one or more computer systems being programmed to perform operations comprising:
extracting at least one of information or metadata from a video communication originating from the video communication applications, the information or metadata comprising a timestamp associated with the video communication and at least one of extracted video, voice, chat, instant messaging, digital content, or file exchange content contained in the video communication;
evaluating a risk score for the information or metadata by:
classifying the information or metadata based on (i) applying a plurality of rules to the information or metadata, wherein at least one rule of the plurality of rules is derived from first machine learning-based techniques and (ii) at least one of: a regulatory risk, a privacy risk, a risk of loss of trade secret protection, a corporate policy compliance risk, an operational compliance policy, a non-public information risk, an acceptable use risk, or a risk to electronic communication security; and
calculating and assigning, based on the classification of the information or metadata, the risk score to the information or metadata;
causing display, based on the risk score assigned to the information or metadata, of (i) a workflow user interface comprising a plurality of workflow control options for the video communication and (ii) a video player for selection and review of the video communication;
generating and causing display of a notification indicating a risk level for the timestamp associated with the video communication;
receiving, by the workflow user interface, an input comprising a selection of (i) the assigned risk score or (ii) an adjusted risk score; and
applying, based on (i) the assigned risk score or the adjusted risk score and (ii) the classification of the information or metadata, workflow policies to the classified information or metadata.