Screen-analysis based device security
Systems and methods are provided for a content-based security for computing devices. An example method includes identifying content rendered by a mobile application, the content being rendered during a session, generating feature vectors from the content and determining that the feature vectors do not match a classification model. The method also includes providing, in response to the determination that the feature vectors do not match the classification model, a challenge configured to authenticate a user of the mobile device. Another example method includes determining a computing device is located at a trusted location, capturing information from a session, the information coming from content rendered by a mobile application during the session, generating feature vectors for the session, and repeating this until a training criteria is met. The method also includes training a classification model using the feature vectors and authenticating a user of the device using the trained classification model.
1. A method implemented by one or more processors, the method comprising:
identifying a user profile that corresponds to a user and that is active for an electronic device;
determining whether current activity of the electronic device, while the user profile is active for the electronic device, matches the user profile, wherein determining whether the current activity of the electronic device matches the user profile comprises:
processing, using a classification model, features corresponding to interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more features of at least one previous period of interactive user activity indicated by the user profile,
wherein the interactive user activity includes at least application activity occurring on the electronic device during one or more user interactions with the electronic device;
in response to determining the features corresponding to the interactive user activity on the electronic device do not match the one or more features of the at least one previous period of interactive user activity indicated by the user profile:
determining whether the current activity of the electronic device, while the user profile is active for the electronic device, matches an additional user profile, of a plurality of additional user profiles, the additional user profile corresponding to an additional user, wherein determining whether the current activity of the electronic device, while the user profile is active for the electronic device, matches the additional user profile that corresponds to the additional user comprises:
processing, using the classification model, the features corresponding to the interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more additional features of at least one additional previous period of interactive user activity indicated by the additional user profile that corresponds to the additional user; and
in response to determining the current activity of the electronic device matches the additional user profile:
initiating a profile switch, to the additional user profile, at the electronic device.
2. The method of claim 1 , further comprising:
in response to determining the features corresponding to the interactive user activity on the electronic device do not match one or more features of at least one additional previous period of interactive user activity indicated by the additional user profile:
determining whether the current activity of the electronic device, while the user profile is active for the electronic device, matches a further additional user profile, of the plurality of additional user profiles, the further additional user profile corresponding to a further additional user; and
in response to determining the current activity of the user device matches the further additional user profile:
initiating the profile switch, to the further additional user profile, at the electronic device.
3. The method of claim 2 , wherein determining whether the current activity of the electronic device matches the further additional user profile comprises:
processing, using the classification model, the features corresponding to the interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more features of at least one further additional previous period of interactive user activity indicated by the further additional user profile.
4. The method of claim 1 , wherein determining whether the current activity of the electronic device matches the user profile is in response to determining that the current activity at the electronic device corresponds to outlier activity for the user profile.
5. The method of claim 1 , wherein initiating the profile switch at the electronic device comprises:
automatically signing out of the user profile to deactivate the user profile at the electronic device; and
automatically signing in to the additional user profile to activate the additional user profile at the electronic device.
6. The method of claim 1 , wherein initiating the profile switch at the electronic device comprises:
automatically signing out of the user profile to deactivate the user profile at the electronic device; and
causing a sign-in user interface to be visually rendered at the electronic device to enable the additional user to sign-in to the additional user profile.
7. The method of claim 6 , further comprising:
in response to visually rendering the sign-in interface at the electronic device:
receiving, at the electronic device, credentials to sign-in to the additional user profile; and
signing in to the additional user profile based on the credentials.
8. The method of claim 1 , wherein initiating the profile switch at the electronic device comprises:
causing a prompt to be visually rendered at the electronic device to request permission to switch to the additional user profile associated with the additional user.
9. The method of claim 8 , further comprising:
in response to visually rendering the prompt at the electronic device:
receiving, at the electronic device, user input to permit switching to the additional user profile.
10. A system comprising:
at least one processor; and
at least one memory storing instructions that, when executed, cause the at least one processor to:
identify a user profile that corresponds to a user and that is active for an electronic device;
determine whether current activity of the electronic device, while the user profile is active for the electronic device, matches the user profile, wherein the instructions to determine whether the current activity of the electronic device matches the user associated with the user profile comprise instructions to:
process, using a classification model, features corresponding to interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more features of at least one previous period of interactive user activity indicated by the user profile, wherein the interactive user activity includes at least application activity occurring on the electronic device during one or more user interactions with the electronic device;
in response to determining the features corresponding to the interactive user activity on the electronic device do not match the one or more features of the at least one previous period of interactive user activity indicated by the user profile:
determine whether the current activity of the electronic device, while the user profile is active for the electronic device, matches an additional user profile, of a plurality of additional user profiles, the additional user profile corresponding to an additional user, wherein determining whether the current activity of the electronic device, while the user profile is active for the electronic device, matches the additional user profile that corresponds to the additional user comprises:
processing, using the classification model, the features corresponding to the interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more additional features of at least one additional previous period of interactive user activity indicated by the additional user profile that corresponds to the additional user; and
in response to determining the current activity of the electronic device matches the additional user profile:
initiate a profile switch, to the additional user profile, at the electronic device.
11. The system of claim 10 , wherein the instructions further comprise instructions to:
in response to determining the features corresponding to the interactive user activity on the electronic device do not match one or more features of at least one additional previous period of interactive user activity indicated by the additional user profile:
determine whether the current activity of the electronic device, while the user profile is active for the electronic device, matches a further additional user profile, of the plurality of additional user profiles, the further additional user profile corresponding to a further additional user; and
in response to determining the current activity of the user device matches the further additional user profile:
initiate the profile switch, to the further additional user profile, at the electronic device.
12. The system of claim 11 , wherein the instructions to determine whether the current activity of the electronic device matches the further additional user profile comprise instructions to:
process, using the classification model, the features corresponding to the interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more features of at least one further additional previous period of interactive user activity indicated by the further additional user profile.
13. The system of claim 10 , wherein determining whether the current activity of the electronic device matches user profile is in response to determining that the current activity at the electronic device corresponds to outlier activity for the user profile.
14. The system of claim 10 , wherein the instructions to initiate the profile switch at the electronic device comprise instructions to:
automatically sign out of the user profile to deactivate the user profile at the electronic device; and
automatically sign in to the additional user profile to activate the additional user profile at the electronic device.
15. The system of claim 10 , wherein the instructions to initiate the profile switch at the electronic device comprise instructions to:
automatically sign out of the user profile to deactivate the user profile at the electronic device; and
cause a sign-in user interface to be visually rendered at the electronic device to enable the additional user to sign-in to the additional user profile.
16. The system of claim 10 , the instructions to initiate the profile switch at the electronic device comprise instructions to:
cause a prompt to be visually rendered at the electronic device to request permission to switch to the additional user profile associated with the additional user.
17. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to execute the instructions, the instructions causing the at least one processor to:
identify a user profile that corresponds to a user and that is active for an electronic device;
determine whether current activity of the electronic device, while the user profile is active for the electronic device, matches the user profile, wherein the instructions to determine whether the current activity of the electronic device matches the user profile comprise instructions to:
process, using a classification model, features corresponding to interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more features of at least one previous period of interactive user activity indicated by the user profile,
wherein the interactive user activity includes at least application activity occurring on the electronic device during one or more user interactions with the electronic device;
in response to determining the features corresponding to the interactive user activity on the electronic device do not match the one or more features of the at least one previous period of interactive user activity indicated by the user profile:
determine whether the current activity of the electronic device, while the user profile is active for the electronic device, matches an additional user profile, of a plurality of additional user profiles, the additional user profile corresponding to an additional user, wherein determining whether the current activity of the electronic device, while the user profile is active for the electronic device, matches the additional user profile that corresponds to the additional user comprises:
processing, using the classification model, the features corresponding to the interactive user activity on the electronic device to determine whether the features corresponding to the interactive user activity on the electronic device match one or more additional features of at least one additional previous period of interactive user activity indicated by the additional user profile that corresponds to the additional user; and
in response to determining the current activity of the electronic device matches the additional user profile:
initiating a profile switch, to the additional user profile, at the electronic device.