SYSTEMS AND APPARATUS FOR MULTIFACTOR AUTHENTICATION USING BONE CONDUCTION AND AUDIO SIGNALS
Provided here are systems and method for two-way authentication of a user. In embodiments, the method may include, in response to reception of an audio signal from a user, determining, via a smart device and/or authentication circuitry, whether a corresponding bone conduction signal is received from one of one or more separate wearable devices. The method may include, in response to determination that the corresponding bone conduction signal is received: determining, via the smart device and/or authentication circuitry, whether the audio signal and corresponding conduction signal are consistent. The method may include, in response to a determination that the audio signal and corresponding conduction signal are consistent: verifying, via the smart device, the audio signal; verifying, via the smart device, the corresponding bone conduction signal; and, in response to verification of the audio signal and the corresponding bone conduction signal, authenticating a user.
1 . A system for two-way authentication of a user, the system comprising:
a wearable device including:
a sensor to receive a bone conduction signal based on a user's speech, and
a communication circuitry configured to transmit the bone conduction signal; and
a smart device including:
(a) a microphone configured to receive an audio signal from the user's speech, and
(b) a bone and audio authentication circuitry configured to:
receive the bone conduction signal from the communication circuitry,
analyze the bone conduction signal and the audio signal, and
authenticate the user in response to analysis of the bone conduction signal and the audio signal.
2 . The system of claim 1 , wherein the wearable device comprises one or more of a headphone, a headset, an earbud, a virtual reality (VR) headset, or an augmented reality (AR) headset.
3 . The system of claim 1 , wherein the smart device comprises one or more of a computing device, a smart phone, a tablet, a remote control, a television, a video game entertainment system, a household internet enabled device, a household smart device, a voice controlled intelligent personal assistant device, or a voice controlled intelligent personal vehicle management device.
4 . The system of claim 1 , wherein the bone and audio authentication circuitry, during the analysis of the bone conduction signal and the audio signal, is configured to:
pre-process the bone conduction signal and the audio signal;
generate a bone conduction feature vector and an audio conduction feature vector;
reduce the bone conduction feature vector and the audio conduction feature vector to generate a reduced bone conduction feature vector and a reduced audio conduction feature vector; and
determine, using a trained model, a probability that the reduced bone conduction feature vector and the reduced audio conduction feature vector originate from the user.
5 . The system of claim 4 , wherein the bone and audio authentication circuitry is further configured to, prior to analysis of the bone conduction signal and the audio signal, prompt the user to enroll in relation to the smart device.
6 . The system of claim 5 , wherein enrollment includes speaking a random or specified phrase to the smart device and with the wearable device to thereby generate an enrollment template.
7 . The system of claim 6 , wherein the bone and audio authentication circuitry, during analysis of the bone conduction signal and the audio signal, is configured to:
compare the reduced bone conduction feature vector and the reduced audio conduction feature vector to the enrollment template to determine authentication of the user.
8 . The system of claim 1 , wherein authentication of the user enables the user to access functionality of the smart device.
9 . The system of claim 1 , wherein the smart device is configured to prompt an unauthenticated user to give at least one additional attempt to obtain authentication from the smart device.
10 . The system of claim 1 , wherein an unauthenticated user comprises an attacker, and wherein the smart device is configured to, in response to unauthenticated bone and audio signals, locks access to personal user data.
11 . The system of claim 10 , wherein the smart device is configured to, in response to the unauthenticated bone and audio signals:
lock functionality of the smart device; and
notify the user via a pre-selected alternative form of communication.
12 . A smart device for two-way authentication of a user, the smart device comprising:
a communications interface configured to receive a bone conduction signal from the user via a wearable device;
a microphone configured to receive an audio signal from the user;
a bone and audio authentication circuitry configured to:
analyze the bone conduction signal and the audio signal; and
in response to a score, based on analysis of the bone conduction signal and the audio signal, being greater than or equal to a preselected threshold, authenticate the user.
13 . The smart device of claim 12 , wherein the wearable device receives the bone conduction signal at substantially a same time as the microphone receives the audio signal.
14 . The smart device of claim 13 , wherein the bone and audio authentication circuitry is configured to, prior to analysis, prompt the user to submit an enrollment template or response.
15 . The smart device of claim 14 , wherein the enrollment template or response includes one or more specific phrases to be spoken by the user.
16 . The smart device of claim 15 , wherein the smart device is configured to prompt the user to submit the enrollment template or response for the wearable device.
17 . A system for two-way authentication of a user, the system comprising:
one or more wearable devices, each of the one or more wearable devices including:
a sensor to receive a bone conduction signal based on a user's speech, and
a communication circuitry configured to wirelessly transmit the bone conduction signal; and
a smart device including;
(a) a microphone configured to receive an audio signal from the user's speech, and
(b) bone and audio authentication circuitry configured to:
receive the bone conduction signal from the communication circuitry,
determine, using a consistency evaluation algorithm, a consistency score based on a comparison of the bone conduction signal and the audio signal,
in response to the consistency score being greater than or equal to a predetermined threshold:
determine, using a first verification model, a first probability indicating that the audio signal originates from the user,
determine, using a second verification model, a second probability indicating that the bone conduction signal originates from the user, and
in response to the first probability indicating that the audio signal originates from the user being greater than or equal to a second preselected threshold and the second probability indicating that the bone conduction signal originates from the user being greater than or equal to a third preselected threshold:
authenticate the user based on the analysis of the bone conduction signal and audio signal.
18 . The system of claim 17 , wherein the smart device is configured to, prior to authentication, prompt the user to submit an enrollment response.
19 . The system of claim 18 , wherein the smart device is configured to prompt the user to submit the enrollment response for each of the one or more wearable devices.
20 . The system of claim 19 , wherein the first verification model and the second verification model are trained using data from prior users and using a user's enrollment response.
21 . The system of claim 20 , wherein the user's enrollment response includes one or more bone conduction signals and corresponding one or more audio signals.
22 . The system of claim 21 , wherein the enrollment response further includes an indicator to identify one of the one or more wearable devices corresponding to at least one of the one or more bone conduction signals and at least one of the one or more audio signals.
23 . The system of claim 17 , wherein the smart device is configured to, prior to determination of the consistency score, align the bone conduction signal and the audio signal, and wherein the consistency score is based on the aligned bone conduction signal and audio signal.
24 . A system for two-way authentication of a user, the system comprising:
a wearable device including:
a first sensor to receive a bone conduction signal based on a user's speech, and
a first communication circuitry configured to transmit the bone conduction signal;
a device including:
a second sensor configured to receive an identification signal from a user, and
a second communication circuitry configured to transmit the identification signal; and
an authentication circuitry configured to:
receive the bone conduction signal from the first communication circuitry,
receive the identification signal from the second communication circuitry,
analyze the bone conduction signal and the identification signal, and
authenticate the user in response to analysis of the bone conduction signal and identification signal.
25 . The system of claim 24 , wherein the identification signal includes a signal generated by scanning a badge or identification card.
26 . A smart device for two-way authentication of a user, the smart device comprising:
a communications interface configured to receive a bone conduction signal from a user;
a microphone configured to receive an audio signal from the user;
a bone and audio authentication circuitry configured to:
analyze the bone conduction signal and the audio signal;
in response to a score, based on analysis of the bone conduction signal and the audio signal, being greater than or equal to a preselected threshold, authenticate the user.
27 . The smart device of claim 26 , wherein a wearable devices transmits the bone conduction to the smart device.
28 . The smart device of claim 27 , wherein the bone and audio authentication circuitry is configured to, prior to the analysis, prompt the user to submit an enrollment template or response.
29 . The smart device of claim 28 , wherein the enrollment template or response includes one or more specific phrases to be spoken by the user.
30 . The smart device of claim 29 , wherein the smart device is configured to prompt the user to submit the enrollment template or response for the wearable device.
31 . An authentication device for two-way authentication of a user, the authentication device comprising:
a communications interface configured to receive:
a first signal from a user; and
a second signal from the user, the second signal being a different type of signal than the first signal; and
an authentication circuitry configured to:
analyze the first signal and the second signal; and
in response to a score, based on analysis of the first signal and the second signal, being greater than or equal to a preselected threshold, authenticate the user.
32 . The authentication device of claim 31 , wherein the first signal includes one or more of an audio signal, a bone conduction signal, or signals associated with a badge scan, identification scan, retinal scan, fingerprint scan, facial scan, or gesture scan.
33 . The authentication device of claim 31 , wherein the second signal includes one or more of an audio signal, a bone conduction signal, or signals associated with a badge scan, identification scan, retinal scan, fingerprint scan, facial scan, or gesture scan.
34 . The authentication device of claim 33 , wherein analysis of the first signal and the second signal includes (a) a determination of whether the first signal and the second signal are from the user, and (b) a determination, if the first signal and the second signal are from the user, of the score based on a verification that each of the first signal and the second signal are authentic.
35 . A method for two-way authentication of a user, the method comprising:
in response to reception of an audio signal from a user, determining, via a smart device, whether a corresponding bone conduction signal is received from one of one or more separate wearable devices;
in response to a determination that the corresponding bone conduction signal is received:
determining, via the smart device, whether the audio signal and corresponding conduction signal are consistent;
in response to a determination that the audio signal and corresponding conduction signal are consistent:
verifying, via the smart device, the audio signal;
verifying, via the smart device, the corresponding bone conduction signal;
in response to verification of the audio signal and the corresponding bone conduction signal, authenticating the user.
36 . The method of claim 35 , further comprising, upon authentication of the user, allowing the user to (a) access or utilize the smart device and (b) access data on the smart device.
37 . The method of claim 35 , further comprising, upon authentication of the user, allowing the user to (a) access or utilize the smart device and (b) access data on the smart device associated with the user.
38 . The method of claim 35 , further comprising, upon authentication of the user, allowing the user to (a) access or utilize the smart device and (b) access personal data on the smart device associated with the user.