Passive affective and knowledge-based authentication through eye movement tracking
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for authenticating a user based on passive affective and knowledge-based authentication (AKBA). In one aspect, a method includes data associated with eye movements and ocular dynamics of the user are captured with a camera as the user looks at a graphical user interface (GUI) of a device; an AKBA signature of the user is determined based on the captured data; the user is authenticated based on a comparison of the AKBA signature with an AKBA template associated with the user; and an access to a subset of functions of an application is granted.
1. A computer-implemented method for authenticating a user based on passive affective and knowledge-based authentication (AKBA), the method being executed by one or more hardware processors and comprising:
capturing, with a camera, data associated with eye movements and ocular dynamics of the user as the user looks at a graphical user interface (GUI) of a device, wherein a stimulus displayed on the GUI comprises at least one first image relating to at least one of positive preferences, negative preferences, or biographical experiences of the user;
determining an AKBA signature of the user based on the captured data;
authenticating the user based on a comparison of the AKBA signature with an AKBA template associated with the user, wherein the AKBA template is pregenerated based on the user's eye movements and ocular dynamics in response to a preprogrammed visual stimulus comprising at least one second image relating to at least one of the positive preferences, the negative preferences, or the biographical experiences;
authenticating the user further comprises:
generating a similarity score based on the comparison of the AKBA signature with the AKBA template, and
authenticating the user based on the similarity score, wherein the user is authenticated when the similarity score is within a range of a predetermined threshold; and
granting access to a subset of functions of an application in response to authenticating the user based on the comparison of the AKBA signature with the AKBA template.
2. The computer-implemented method of claim 1 , wherein the stimulus displayed on the GUI is configured to gauge true memories of the user.
3. The computer-implemented method of claim 1 , wherein generating the similarity score comprises:
determining a plurality of first scores, wherein each first score is determined based on a comparison of a measurement of a respective feature comprised in the AKBA template and a measurement of a corresponding same feature comprised in the AKBA signature;
determining a respective weight for each of the first scores; and
combining the first scores weighted by their respective weights to determine the similarity score.
4. The computer-implemented method of claim 1 , wherein the AKBA template of the user is pregenerated during an enrollment process.
5. The computer-implemented method of claim 4 , comprising pregenerating the AKBA template of the user during the enrollment process, wherein pregenerating the AKBA template comprises:
querying the user about at least one of the positive preferences, negative preferences, or biographical experiences;
displaying the preprogrammed visual stimulus comprising the at least one second image; and
capturing, with a second camera or with the camera, template data associated with eye movements and ocular dynamics of the user as the user looks at the preprogrammed visual stimulus.
6. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations for authenticating a user based on passive affective and knowledge-based authentication (AKBA) comprising:
capturing, with a camera, data associated with eye movements and ocular dynamics of the user as the user looks at a graphical user interface (GUI) of a device, wherein a stimulus displayed on the GUI comprises at least one first image relating to at least one of positive preferences, negative preferences, or biographical experiences of the user;
determining an AKBA signature of the user based on the captured data;
authenticating the user based on a comparison of the AKBA signature with an AKBA template associated with the user, wherein the AKBA template is pregenerated based on the user's eye movements and ocular dynamics in response to a preprogrammed visual stimulus comprising at least one second image relating to at least one of the positive preferences, the negative preferences, or the biographical experiences;
authenticating the user further comprises:
generating a similarity score based on the comparison of the AKBA signature with the AKBA template, and
authenticating the user based on the similarity score, wherein the user is authenticated when the similarity score is within a range of a predetermined threshold; and
granting access to a subset of functions of an application in response to authenticating the user based on the comparison of the AKBA signature with the AKBA template.
7. The non-transitory, computer-readable medium of claim 6 , wherein the stimulus displayed on the GUI is configured to gauge true memories of the user.
8. The non-transitory, computer-readable medium of claim 6 , wherein generating the similarity score comprises:
determining a plurality of first scores, wherein each first score is determined based on a comparison of a measurement of a respective feature comprised in the AKBA template and a measurement of a corresponding same feature comprised in the AKBA signature;
determining a respective weight for each of the first scores; and
combining the first scores weighted by their respective weights to determine the similarity score.
9. The non-transitory, computer-readable medium of claim 6 , wherein the AKBA template of the user is pregenerated during an enrollment process.
10. The non-transitory, computer-readable medium of claim 9 , wherein the operations comprise pregenerating the AKBA template of the user during the enrollment process, and wherein pregenerating the AKBA comprises:
querying the user about at least one of the positive preferences, negative preferences, or biographical experiences;
displaying the preprogrammed visual stimulus comprising the at least one second image; and
capturing, with a second camera or with the camera, template data associated with eye movements and ocular dynamics of the user as the user looks at the preprogrammed visual stimulus.
11. A computer-implemented system, comprising:
one or more hardware processors; and
one or more computer-readable storage media coupled to the one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform Operations for authenticating a user based on passive affective and knowledge-based authentication (AKBA) comprising:
capturing, with a camera, data associated with eye movements and ocular dynamics of the user as the user looks at a graphical user interface (GUI) of a device, wherein a stimulus displayed on the GUI comprises at least one first image relating to at least one of positive preferences, negative preferences, or biographical experiences of the user;
determining an AKBA signature of the user based on the captured data;
authenticating the user based on a comparison of the AKBA signature with an AKBA template associated with the user, wherein the AKBA template is pregenerated based on the user's eye movements and ocular dynamics in response to a preprogrammed visual stimulus comprising at least one second image relating to at least one of the positive preferences, the negative preferences, or the biographical experiences;
authenticating the user further comprises:
generating a similarity score based on the comparison of the AKBA signature with the AKBA template, and
authenticating the user based on the similarity score, wherein the user is authenticated when the similarity score is within a range of a predetermined threshold; and
granting access to a subset of functions of an application in response to authenticating the user based on the comparison of the AKBA signature with the AKBA template.
12. The computer-implemented system of claim 11 , wherein the stimulus displayed on the GUI is configured to gauge true memories of the user.
13. The computer-implemented system of claim 11 , wherein generating the similarity score comprises:
determining a plurality of first scores, wherein each first score is determined based on a comparison of a measurement of a respective feature comprised in the AKBA template and a measurement of a corresponding same feature comprised in the AKBA signature;
determining a respective weight for each of the first scores; and
combining the first scores weighted by their respective weights to determine the similarity score.
14. The computer-implemented system of claim 11 , wherein the AKBA template of the user is pregenerated during an enrollment process.
15. The computer-implemented system of claim 14 , wherein the operations comprise pregenerating the AKBA template of the user during the enrollment process, and wherein pregenerating the AKBA comprises:
querying the user about at least one of the positive preferences, negative preferences, or biographical experiences;
displaying the preprogrammed visual stimulus comprising the at least one second image; and
capturing, with a second camera or with the camera, template data associated with eye movements and ocular dynamics of the user as the user looks at the preprogrammed visual stimulus.