Systems and methods for user authentication in video communications
Systems and method are provided for authenticating a user of a communication session. A computing device may receive a video frame from a communication session between a first user device and a second user. The computing device may extract at features from the video frame and execute a neural network using the set of features. The neural network may be configured to generate a depth map of a user represented in the video frame. The computing device may authenticate a user of the first user device by matching the depth map to a second depth map associated with an authenticated user. Upon authenticating the user, the computing device may generate a third depth map by merging the depth map with the second depth map. The third depth map may be used to authenticate the user during a subsequent communication session involving the user.
1 . A method comprising:
receiving one or more video frames from a video communication session between a first user device and a second user device, wherein at least one video frame of the one or more video frames includes a representation of a user of the first user device;
extracting, from the at least one video frame, a set of features associated with the user of the first user device;
executing a neural network using the set of features to generate a first depth map of the user of the first user device;
authenticating the user of the first user device based on matching the first depth map with a second depth map associated with an authenticated user; and
generating, in response to authenticating the user, a third depth map by merging the first depth map with the second depth map, the third depth map being usable to authenticate the user of the first user device during a subsequent video communication session involving the user.
2 . The method of claim 1 , wherein the neural network generates the first depth map using monocular depth estimation to determine a distance between one or more positions of the user and a camera that captured the one or more video frames.
3 . The method of claim 1 , wherein the first depth map includes a set of data values associated with a facial feature of the user.
4 . The method of claim 1 , wherein the third depth map is stored in read-only memory.
5 . The method of claim 1 , wherein the third depth map is linked to the second depth map in a digital ledger.
6 . The method of claim 1 , wherein authenticating the user is further based on one or more audio segments from the video communication session and associated with the user.
7 . The method of claim 1 , wherein authenticating the user is further based on metadata of the video communication session.
8 . A system comprising:
one or more processors; and
a non-transitory computer-readable medium storing instructions that when executed by the one or more processors, cause the one or more processors to perform the operations including:
receiving one or more video frames from a video communication session between a first user device and a second user device, wherein at least one video frame of the one or more video frames includes a representation of a user of the first user device;
extracting, from the at least one video frame, a set of features associated with the user of the first user device;
executing a neural network using the set of features to generate a first depth map of the user of the first user device;
authenticating the user of the first user device based on matching the first depth map with a second depth map associated with an authenticated user; and
generating, in response to authenticating the user, a third depth map by merging the first depth map with the second depth map, the third depth map being usable to authenticate the user of the first user device during a subsequent video communication session involving the user.
9 . The system of claim 8 , wherein the neural network generates the first depth map using monocular depth estimation to determine a distance between one or more positions of the user and a camera that captured the one or more video frames.
10 . The system of claim 8 , wherein the first depth map includes a set of data values associated with a facial feature of the user.
11 . The system of claim 8 , wherein the third depth map is stored in read-only memory.
12 . The system of claim 8 , wherein the third depth map is linked to the second depth map in a digital ledger.
13 . The system of claim 8 , wherein authenticating the user is further based on one or more audio segments from the video communication session and associated with the user.
14 . The system of claim 8 , wherein authenticating the user is further based on metadata of the video communication session.
15 . A non-transitory computer-readable medium storing instructions that when executed by one or more processors, cause the one or more processors to perform operations including:
receiving one or more video frames from a video communication session between a first user device and a second user device, wherein at least one video frame of the one or more video frames includes a representation of a user of the first user device;
extracting, from the at least one video frame, a set of features associated with the user of the first user device;
executing a neural network using the set of features to generate a first depth map of the user of the first user device;
authenticating the user of the first user device based on matching the first depth map with a second depth map associated with an authenticated user; and
generating, in response to authenticating the user, a third depth map by merging the first depth map with the second depth map, the third depth map being usable to authenticate the user of the first user device during a subsequent video communication session involving the user.
16 . The non-transitory computer-readable medium of claim 15 , wherein the neural network generates the first depth map using monocular depth estimation to determine a distance between one or more positions of the user and a camera that captured the one or more video frames.
17 . The non-transitory computer-readable medium of claim 15 , wherein the first depth map includes a set of data values associated with a facial feature of the user.
18 . The non-transitory computer-readable medium of claim 15 , wherein the third depth map is stored in read-only memory.
19 . The non-transitory computer-readable medium of claim 15 , wherein the third depth map is linked to the second depth map in a digital ledger.
20 . The non-transitory computer-readable medium of claim 15 , wherein authenticating the user is further based on one or more audio segments from the video communication session and associated with the user.