USER AUTHENTICATION USING COMBINATION OF VOCALIZATION AND SKIN VIBRATION

1 . A method comprising:

detecting, via a microphone array, airborne acoustic waves corresponding to a vocalization of a user;

detecting, via a vibration measurement assembly, vibrations of tissue of the user caused by the vocalization;

generating an authentication dataset based on the detected airborne acoustic waves and the detected vibrations of tissue; and

authenticating the user based in part on the authentication dataset.

2 . The method of claim 1 , wherein generating the authentication dataset using the detected airborne acoustic waves and the detected vibrations of tissue comprises:

generating a transfer function indicating a relationship between amounts of the vibrations of tissue and frequencies of the airborne acoustic waves.

3 . The method of claim 1 , wherein authenticating the user based in part on the authentication dataset comprises:

comparing the authentication dataset with a reference authentication dataset to determine a similarity; and

responsive to determining that the similarity is within a threshold, determining that the user is authentic.

4 . The method of claim 3 , further comprising generating the reference authentication dataset, generating the reference authentication dataset including:

authenticating the user via a different method;

detecting, via the microphone array, airborne acoustic waves corresponding to a vocalization of the user;

detecting, via the vibration measurement assembly, vibrations of tissue of the user caused by the vocalization;

generating an authentication dataset using the detected airborne acoustic waves and the detected vibrations of tissue; and

storing the authentication dataset as the reference authentication dataset.

5 . The method of claim 3 , further comprising receiving the reference authentication dataset from a server.

6 . The method of claim 3 , further comprising:

monitoring, via the microphone array, surrounding airborne acoustic waves;

detecting a wake word uttered by the user based on the monitored surrounding airborne acoustic waves; and

responsive to detecting the wake word,

extracting the airborne acoustic waves associated with the wake word;

extracting the vibrations of tissue of the user associated with the wake word; and

generating the authentication dataset using the vocalization of the user and the vibrations of tissue of the user associated with the wake word.

7 . The method of claim 6 , further comprising responsive to authenticating the user based on the wake word, unlocking a device.

8 . A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed by a processor of a device, causing the device to:

detect, via a microphone array, airborne acoustic waves corresponding to a vocalization of a user;

detect, via a vibration measurement assembly, vibrations of tissue of the user caused by the vocalization;

generate an authentication dataset based on the detected airborne acoustic waves and the detected vibrations of tissue; and

authenticate the user based in part on the authentication dataset.

9 . The non-transitory computer-readable storage medium of claim 8 , further comprises instructions when executed cause the device to:

generate a transfer function indicating a relationship between amounts of the vibrations of tissue and frequencies of the airborne acoustic waves.

10 . The non-transitory computer-readable storage medium of claim 8 , further comprising stored instructions that when executed cause the device to:

compare the authentication dataset with a reference authentication dataset to determine a similarity; and

responsive to determining that the similarity is within a threshold, determine that the user is authentic.

11 . The non-transitory computer-readable storage medium of claim 10 , further comprising stored instructions that when executed cause the device to:

authenticate the user via a different method;

detect, via the microphone array, airborne acoustic waves corresponding to a vocalization of the user;

detect, via the vibration measurement assembly, vibrations of tissue of the user caused by the vocalization;

generate an authentication dataset using the detected airborne acoustic waves and the detected vibrations of tissue; and

store the authentication dataset as the reference authentication dataset.

12 . The non-transitory computer-readable storage medium of claim 10 , further comprising stored instructions that when executed cause the device to receive the reference authentication dataset from a server.

13 . The non-transitory computer-readable storage medium of claim 10 , further comprising stored instructions that when executed cause the device to:

monitor, via the microphone array, surrounding airborne acoustic waves;

detect a wake word uttered by the user based on the monitored surrounding airborne acoustic waves; and

responsive to detecting the wake word,

extract the airborne acoustic waves associated with the wake word;

extract the vibrations of tissue of the user associated with the wake word; and

generate the authentication dataset using the vocalization of the user and the vibrations of tissue of the user associated with the wake word.

14 . The non-transitory computer-readable storage medium of claim 13 , further comprising stored instructions that when executed cause the device to: unlock the device responsive to authenticating the user based on the wake word.

15 . A system comprising:

a microphone array;

a vibration measurement assembly; and

a controller configured to:

detect, by the microphone array, airborne acoustic waves corresponding to a vocalization of a user,

detect, by the vibration measurement assembly, vibrations of tissue of the user caused by the vocalization,

generate an authentication dataset based on the detected airborne acoustic waves and the detected vibrations of tissue, and

authenticate the user based in part on the authentication dataset.

16 . The system of claim 15 , wherein the controller is further configured to:

generate a transfer function indicating a relationship between amounts of the vibrations of tissue and frequencies of the airborne acoustic waves.

17 . The system of claim 15 , wherein the controller is further configured to:

compare the authentication dataset with a reference authentication dataset to determine a similarity; and

responsive to a determination that the similarity is within a threshold, determine that the user is authentic.

18 . The system of claim 17 , wherein the controller is further configured to:

authenticate the user via a different method;

detect, by the microphone array, airborne acoustic waves corresponding to a vocalization of the user;

detect, via the vibration measurement assembly, vibrations of tissue of the user caused by the vocalization;

generate an authentication dataset using the detected airborne acoustic waves and the detected vibrations of tissue; and

store the authentication dataset as the reference authentication dataset.

19 . The system of claim 17 , wherein the controller is further configured to receive the reference authentication dataset from a server.

20 . The system of claim 17 , wherein the controller is further configured to:

monitor, by the microphone array, surrounding airborne acoustic waves;

detect a wake word uttered by the user based on the monitored surrounding airborne acoustic waves; and

responsive to a detection of the wake word,

extract the airborne acoustic waves associated with the wake word,

extract the vibrations of tissue of the user associated with the wake word, and

generate the authentication dataset using the vocalization of the user and the vibrations of tissue of the user associated with the wake word.