Image security using segmentation
Systems and methods may be used for access control. These systems and methods may include using a data processing system to access a video stream, the video stream including an image including a virtual background, segmenting the image into a foreground portion and a background portion to determine whether the foreground portion or the background portion of the image meets a threshold requirement, and outputting an alert in response to determining that the foreground portion or the background portion of the image fails to meet the threshold requirement.
1 . A method performed by a data processing system to determine if a live user is present during a network-based communication session or if an image of a person in a video stream is a pre-recorded virtual background, the method comprising:
using processing circuitry of the data processing system:
identifying, by a data processing system, a video stream showing an image of a first participant of the network-based communication session;
determining, by the data processing system, an identification of a source type of the video stream based on information extracted from metadata associated with the video stream, the source type corresponding to a type of source that generated the video stream;
determining, by the data processing system, based on the determined source type, whether the video stream is live or pre-recorded; and
outputting an alert to a second participant of the network-based communication session in response to determining that the source type indicates the video stream is pre-recorded, the alert indicating that a live user is not present.
2 . The method of claim 1 , wherein the source type indicates that the video stream is live when the source type corresponds to a camera, and the source type indicates that the video stream is pre-recorded when the source type corresponds to a video playback application.
3 . The method of claim 1 , wherein outputting the alert includes generating a warning indication on a user interface of a user device signifying that the video stream is pre-recorded.
4 . The method of claim 1 , further comprising activating a host configured automated service in response to determining that the video stream is pre-recorded, the host configured automated service including at least one of an automated phone call, an automated text message, an automated email message, blocking incoming video at a user device, blocking outgoing video at a user device, prohibiting a voting input from a user device, preventing access to a secure physical location, preventing access to secure digital information, terminating access to secure digital information, rendering a different set of information for display, or requiring additional information.
5 . The method of claim 1 , wherein outputting the alert includes providing the alert for display on a tenant dashboard.
6 . The method of claim 1 , wherein the video stream is output during a live video conferencing session.
7 . The method of claim 1 , wherein the source type identification is determined based on at least one of driver information in the metadata of the video stream, a camera name or a flag in the metadata of the video stream, a connection type of the source, or by comparing information extracted from the metadata to a list of allowed devices.
8 . A non-transitory machine-readable medium, storing instructions for determining if a live user is present during a network-based communication session or if an image of a person in a video stream is a pre-recorded virtual background, the instructions, which when executed, cause the machine to perform operations comprising:
using processing circuitry of the data processing system:
identifying, by a data processing system, a video stream showing an image of a first participant of the network-based communication session;
determining, by the data processing system, an identification of a source type of the video stream based on information extracted from metadata associated with the video stream, the source type corresponding to a type of source that generated the video stream;
determining, by the data processing system, based on the determined source type, whether the video stream is live or pre-recorded; and
outputting an alert to a second participant of the network-based communication session in response to determining that the source type indicates the video stream is pre-recorded, the alert indicating that a live user is not present.
9 . The non-transitory machine-readable medium of claim 8 , wherein the source type indicates that the video stream is live when the source type corresponds to a camera, and the source type indicates that the video stream is pre-recorded when the source type corresponds to a video playback application.
10 . The non-transitory machine-readable medium of claim 8 , wherein outputting the alert includes generating a warning indication on a user interface of a user device signifying that the video stream is pre-recorded.
11 . The non-transitory machine-readable medium of claim 8 , wherein the operations further comprise activating a host configured automated service in response to determining that the video stream is pre-recorded, the host configured automated service including at least one of an automated phone call, an automated text message, an automated email message, blocking incoming video at a user device, blocking outgoing video at a user device, prohibiting a voting input from a user device, preventing access to a secure physical location, preventing access to secure digital information, terminating access to secure digital information, rendering a different set of information for display, or requiring additional information.
12 . The non-transitory machine-readable medium of claim 8 , wherein outputting the alert includes providing the alert for display on a tenant dashboard.
13 . The non-transitory machine-readable medium of claim 8 , wherein the video stream is output during a live video conferencing session.
14 . The non-transitory machine-readable medium of claim 8 , wherein the source type identification is determined based on at least one of driver information in the metadata of the video stream, a camera name or a flag in the metadata of the video stream, a connection type of the source, or by comparing information extracted from the metadata to a list of allowed devices.
15 . A computing device for determining if a live user is present during a network-based communication session or if an image of a person in a video stream is a pre-recorded virtual background, the computing device comprising:
a hardware processor;
a memory, the memory storing instructions, which when executed by the hardware processor cause the computing device to perform operations comprising:
identifying, by a data processing system, a video stream showing an image of a first participant of the network-based communication session;
determining, by the data processing system, an identification of a source type of the video stream based on information extracted from metadata associated with the video stream, the source type corresponding to a type of source that generated the video stream;
determining, by the data processing system, based on the determined source type, whether the video stream is live or pre-recorded; and
outputting an alert to a second participant of the network-based communication session in response to determining that the source type indicates the video stream is pre-recorded, the alert indicating that a live user is not present.
16 . The computing device of claim 15 , wherein the source type indicates that the video stream is live when the source type corresponds to a camera, and the source type indicates that the video stream is pre-recorded when the source type corresponds to a video playback application.
17 . The computing device of claim 15 , wherein outputting the alert includes generating a warning indication on a user interface of a user device signifying that the video stream is pre-recorded.
18 . The computing device of claim 15 , wherein the operations further comprise activating a host configured automated service in response to determining that the video stream is pre-recorded, the host configured automated service including at least one of an automated phone call, an automated text message, an automated email message, blocking incoming video at a user device, blocking outgoing video at a user device, prohibiting a voting input from a user device, preventing access to a secure physical location, preventing access to secure digital information, terminating access to secure digital information, rendering a different set of information for display, or requiring additional information.
19 . The computing device of claim 15 , wherein outputting the alert includes providing the alert for display on a tenant dashboard.
20 . The computing device of claim 15 , wherein the video stream is output during a live video conferencing session.