Graphical representation-based user authentication system and method
A user authentication system comprising one or more cloud server computers storing a user database storing user data associated with a user account and one or more corresponding user graphical representations, and a facial scanning and authentication module connected to the database. The one or more cloud server computers are configured to authenticate a user by performing a facial scanning of the user, including extracting facial feature data from camera data received from a client device and checking the extracted facial feature data for a match against a user graphical representation associated with the user account in the user database. If a matching user graphical representation is found in the checking step, the system provides the user with access to the corresponding user account. Otherwise, the system generates, from the camera data, a new user graphical representation along with a new user account stored in the user database.
1. A user authentication system comprising:
one or more cloud server computers comprising at least one processor and memory storing data and instructions comprising a user database storing user data associated with a user account and one or more user graphical representation configured to visually represent the user within a three-dimensional virtual environment, and a facial scanning and authentication module connected to the database,
wherein the one or more cloud server computers are configured to perform steps comprising:
authenticating a user by performing a facial scanning of the user through the facial scanning and authentication module, wherein the facial scanning comprises extracting facial feature data from live camera feed data received from a client device and checking the extracted facial feature data for a match against the one or more user graphical representation that is configured to visually represent the user within a three-dimensional virtual environment and is associated with the user account in the user database;
in a case in which a matching user graphical representation is found in the checking step, providing the user with access to a three-dimensional virtual environment platform and inserting the user graphical representation into the three-dimensional virtual environment; and
in a case in which the matching user graphical representation is not found in the checking step, generating, from the live camera feed data from which the facial feature data was extracted, a new user graphical representation that is configured to visually represent a new user within a three-dimensional virtual environment along with a new user account, storing the new user account and the new user graphical representation in the user database, providing access to the three-dimensional virtual environment platform, and inserting the new user graphical representation into the three-dimensional virtual environment.
2. The system of claim 1 , wherein the one or more user graphical representations is a user 3D virtual cutout, or a user real-time 3D virtual cutout with a removed background, or a video with removed background, or a video without removed background.
3. The system of claim 2 , wherein the one or more cloud server computers are further configured to animate the matching user graphical representation or the new user graphical representation, and
wherein animating the matching user graphical representation comprises applying machine vision algorithms by the client device or the at least one cloud server computer on the respective user graphical representation for recognizing facial expressions of the user and graphically simulating the facial expressions on the user graphical representation.
4. The system of claim 1 , wherein the one or more cloud server computers are further configured to check a date of the matching user graphical representation and determine whether an update of the matching user graphical representation is required.
5. The system of claim 1 , wherein the one or more cloud server computers are further configured to overlay the new user graphical representation on a third-party source linked to the virtual environment.
6. The system of claim 1 , wherein the generation process of the new user graphical representation takes place asynchronously from user access to the new user account by granting the user access to the new user account while the new user graphical representation is being generated.
7. The system of claim 1 , wherein the one or more cloud server computers are further configured to authenticate the user through login authentication credentials comprising a personal identification number (PIN), or username and password, or a combination thereof.
8. The system of claim 1 , wherein the authenticating is triggered in response to activation of an invitation link sent from by one client device to another client device.
9. The system of claim 1 , wherein the facial scanning uses 3D authentication comprising guiding a user to perform a head movement pattern and extracting 3D face data based on the head movement pattern.
10. The system of claim 9 , wherein the 3D authentication uses one or more deep learning techniques to authenticate the user using the 3D face data.
11. A user authentication method comprising:
providing in memory of one or more cloud server computers a user database storing user data associated with a user account and one or more user graphical representation configured to visually represent the user within a three-dimensional virtual environment, and a facial scanning and authentication module connected to the database;
receiving, from a client device, a request to access the user account;
performing a facial scanning of a user of the client device through the facial scanning and authentication module by extracting facial feature data from live camera feed data captured by at least one camera in communication with the client device;
checking the extracted facial feature data for a match against the one or more user graphical representation that is configured to visually represent the user within a three-dimensional virtual environment and is associated with the user account in the user database;
in a case in which a matching user graphical representation is found in the checking step, providing the user with access to a three-dimensional virtual environment platform and inserting the user graphical representation into the three-dimensional virtual environment; and
in a case in which the matching user graphical representation is not found in the checking step, generating, from the live camera feed data from which the facial feature data was extracted, a new user graphical representation that is configured to visually represent a new user within a three-dimensional virtual environment along with a new user account, storing the new user account and the new user graphical representation in the user database, providing access to the three-dimensional virtual environment platform, and inserting the new user graphical representation into the three-dimensional virtual environment.
12. The method of claim 11 , wherein the one or more user graphical representations is a user 3D virtual cutout, or a user real-time 3D virtual cutout, or a video with removed background, or video without removed background.
13. The method of claim 12 , wherein the one or more cloud server computers are further configured to animate the matching user graphical representation or the new user graphical representation, and wherein animating the matching user graphical representation comprises applying machine vision algorithms by the client device or the at least one cloud server computer on a generated user 3D virtual cutout for recognizing facial expressions of the user and graphically simulating the facial expressions on the user 3D virtual cutout.
14. The method of claim 11 , further comprising, if a matching user graphical representation is found in the checking step:
checking a date of the matching user graphical representation;
determining, based at least in part on the date, whether an update of the matching user graphical representation is required by comparing to corresponding threshold values or security requirements; and
in a positive case where an update of the matching user graphical representation is required, generating a user graphical representation update request.
15. The method of claim 11 , further comprising overlaying the new user graphical representation on a third-party source linked to the virtual environment.
16. The method of claim 11 , wherein the generation process of the new user graphical representation takes place asynchronously from user access to the new user account by granting the user access to the new user account while the new user graphical representation is being generated.
17. The method of claim 11 , further comprising authenticating the user through login authentication credentials comprising username and password.
18. The method of claim 11 , wherein the authenticating is triggered in response to activation of an invitation link.
19. A non-transitory computer readable medium having stored thereon instructions configured to cause at least one server computer comprising a processor and memory to perform steps comprising:
providing in memory of one or more cloud server computers a user database storing user data associated with a user account and one or more user graphical representation configured to visually represent the user within a three-dimensional virtual environment, and a facial scanning and authentication module connected to the database;
receiving, from a client device, a request to access the user account;
performing a facial scanning of a user of the client device through the facial scanning and authentication module by extracting facial feature data from live camera feed data captured by at least one camera in communication with the client device;
checking the extracted facial feature data for a match against the one or more user graphical representation that is configured to visually represent the user within a three-dimensional virtual environment and is associated with the user account in the user database;
in a case in which a matching user graphical representation is found in the checking step, providing the user with access to a three-dimensional virtual environment platform and inserting the user graphical representation into the three-dimensional virtual environment; and
in a case in which the matching user graphical representation is not found in the checking step, generating, from the live camera feed data from which the facial feature data was extracted, a new user graphical representation that is configured to visually represent a new user within a three-dimensional virtual environment along with a new user account, storing the new user account and the new user graphical representation in the user database, providing access to the three-dimensional virtual environment platform, and inserting the new user graphical representation into the three-dimensional virtual environment.
20. The non-transitory computer readable medium of claim 19 , the steps further comprising, if a matching user graphical representation is found in the checking step:
checking a date of the matching user graphical representation;
determining, based at least in part on the date, whether an update of the matching user graphical representation is required; and
in a positive case where an update of the matching user graphical representation is required, generating a user graphical representation update request.