Multi-device user identity validation based on behavioral signal fidelity
Various implementations disclosed herein include devices, systems, and methods that identify users based on input/sensor data. This may involve monitoring user identity using multiple signals from multiple devices (e.g., laptop keyboard, mobile device movement, facial recognition, etc.). The signals may be used to identify the user based on the current circumstances (e.g., signal fidelity). For example, the circumstances may change as one signal degrades and another signal increases in quality.
1 . A method comprising:
at a processor,
receiving a first set of one or more behavioral signals from a first electronic device, wherein the first electronic device and a second electronic device are within a set of electronic devices associated with a user, wherein the first set of one or more behavioral signals are received as the user is starting or increasing use of the second electronic device while using or after using the first electronic device;
determining that the first and second electronic devices satisfy proximity criteria; and
in accordance with the first and second electronic devices satisfying the proximity criteria, determining an aggregate score corresponding to confidence in user identity by:
determining signal-specific-scores comprising a score corresponding to confidence in user identity for each of the one or more behavioral signals of the first set;
determining a fidelity of each of the signal-specific scores based on determining whether a rate of use of an input device associated with the first electronic device exceeds a threshold or determining whether the first electronic device is currently being held;
identifying a subset of the signal-signal specific scores corresponding to high fidelity behavioral signals; and
determining the aggregate score by aggregating only the subset of the signal-specific specific scores corresponding to high fidelity behavioral signals; and
determining a validation state of the second electronic device based on the one or more scores, wherein the validation state is determined based on the aggregate score,
wherein user access on the second electronic device is granted, rejected, or withheld pending additional behavioral signals based on the validation state.
2 . The method of claim 1 , wherein the aggregate score and validation state are determined during a time period during which the second electronic device changes from an idle state to an active state.
3 . The method of claim 2 , wherein:
while the second device is in the idle state, no behavioral signals are received from the second electronic device; and
while the second device is in the active state, one or more behavioral signals are received from the second electronic device.
4 . The method of claim 1 further comprising receiving a second set of one or more behavioral signals from the second electronic device, wherein the first set and the second set correspond to a same time period.
5 . The method of claim 4 , wherein the aggregate score is determined based on the one or more behavioral signals of the second set.
6 . The method of claim 5 , wherein the aggregate score is determined based on the one or more behavioral signals of the first set and the one or more behavioral signals of the second set.
7 . The method of claim 6 , wherein determining the aggregate score comprises:
determining a signal-specific-score for each of the one or more behavioral signals of the first set and the second set;
determining a fidelity of each of the signal-specific scores;
identifying a subset of the signal-specific-scores that satisfy a selection criterion based on the fidelity of each of the signal-specific scores; and
generating the aggregate score by aggregating the subset of signal-specific-scores.
8 . The method of claim 6 , wherein determining the aggregate score comprises:
determining a signal-specific-score for each of the one or more behavioral signals of the first set and the second set;
determining a fidelity of each of the signal-specific scores;
weighting the signal-specific-scores based on the fidelity of each of the signal specific scores; and
generating the aggregate score by aggregating the subset of signal-specific-scores.
9 . The method of claim 1 , wherein the set of devices includes only devices that confirm or inherit a valid identity based on scores determined from available behavioral signals.
10 . The method of claim 1 , wherein the behavior signals include a signal from an input device, a signal from a motion sensor, a signal from an environmental sensor, or a signal from a position sensor.
11 . The method of claim 1 , wherein determining the one or more scores comprises assessing timing of key entry events, mouse position events, touchscreen events, or user hand positions during hand gesturing.
12 . The method of claim 1 further comprising continuing user validation based on behavior signals received simultaneously from both the first electronic device and the second electronic device, wherein the user validation is based on selection or weighting scores associated with behavioral signals from the first electronic device and the second electronic device, wherein the selection or weighting is based on determining changes in signal fidelity of the scores associated with the behavioral signals from the first electronic device and the second electronic device over time.
13 . The method of claim 1 , wherein the fidelity of at least one of the signal specific scores is determined to be high fidelity based on determining that a rate of typing on a keyboard associated with the first electronic device exceeds the threshold.
14 . The method of claim 1 , wherein the fidelity of at least one of the signal specific scores provided by an accelerometer on the first electronic device is determined to be high fidelity based on determining that the first electronic device is currently being held by the user.
15 . The method of claim 1 , wherein the fidelity of at least one of the signal specific scores provided by an accelerometer on the first electronic device is determined to be high fidelity based on determining that the first electronic device is not resting on a surface.
16 . The method of claim 1 , wherein the fidelity of at least one of the signal specific scores corresponding to a photo or video taken by a camera for facial recognition on the first electronic device is determined to be high fidelity based on determining that the photo or video contains the face.
17 . A system comprising:
a non-transitory computer-readable storage medium; and
one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the system to perform operations comprising:
receiving a first set of one or more behavioral signals from a first electronic device, wherein the first electronic device and a second electronic device are within a set of electronic devices associated with a user, wherein the first set of one or more behavioral signals are received as the user is starting or increasing use of the second electronic device while using or after using the first electronic device;
determining that the first and second electronic devices satisfy proximity criteria; and
in accordance with the first and second electronic devices satisfying the proximity criteria, determining an aggregate score corresponding to confidence in user identity by:
determining signal-specific-scores comprising a score corresponding to confidence in user identity for each of the one or more behavioral signals of the first set;
determining a fidelity of each of the signal-specific scores based on determining whether a rate of use of an input device associated with the first electronic device exceeds a threshold or determining whether the first electronic device is currently being held;
identifying a subset of the signal-signal specific scores corresponding to high fidelity behavioral signals; and
determining the aggregate score by aggregating only the subset of the signal-specific specific scores corresponding to high fidelity behavioral signals; and
determining a validation state of the second electronic device based on the one or more scores, wherein the validation state is determined based on the aggregate score,
wherein user access on the second electronic device is granted, rejected, or withheld pending additional behavioral signals based on the validation state.
18 . The system of claim 17 , wherein the aggregate score and validation state are determined during a time period during which the second electronic device changes from an idle state to an active state.
19 . A non-transitory computer-readable storage medium, storing instructions executable via one or more processors to perform operations comprising:
receiving a first set of one or more behavioral signals from a first electronic device, wherein the first electronic device and a second electronic device are within a set of electronic devices associated with a user, wherein the first set of one or more behavioral signals are received as the user is starting or increasing use of the second electronic device while using or after using the first electronic device;
determining that the first and second electronic devices satisfy proximity criteria; and
in accordance with the first and second electronic devices satisfying the proximity criteria, determining an aggregate score corresponding to confidence in user identity by:
determining signal-specific-scores comprising a score corresponding to confidence in user identity for each of the one or more behavioral signals of the first set;
determining a fidelity of each of the signal-specific scores based on determining whether a rate of use of an input device associated with the first electronic device exceeds a threshold or determining whether the first electronic device is currently being held;
identifying a subset of the signal-signal specific scores corresponding to high fidelity behavioral signals; and
determining the aggregate score by aggregating only the subset of the signal-specific specific scores corresponding to high fidelity behavioral signals; and
determining a validation state of the second electronic device based on the one or more scores, wherein the validation state is determined based on the aggregate score,
wherein user access on the second electronic device is granted, rejected, or withheld pending additional behavioral signals based on the validation state.