Contact transducer based audio enhancement
Contact transducer based audio enhancement (e.g., of sounds from a local area, speech of a user, etc.) is described. An audio system includes a microphone array, a contact transducer, and a controller. The contact transducer is in contact with tissue of the user and can detect tissue-based vibrations generated by the speech of the user. The sounds and the detected vibrations are pre-processed. Input parameters are determined using the pre-processed sounds and vibrations. The audio system analyzes the input parameters to determine one or more signal characteristics. The audio system adjusts one or more sound filters to enhance a signal corresponding to the speech of the user based in part on status of the signal characteristics. The audio system performs an action associated with the enhanced signal corresponding to the speech.
1 . A method comprising:
detecting, via a microphone array of an audio system, sounds from a local area, the sounds from the local area including speech of a user of the audio system;
detecting, via a contact transducer that is in contact with tissue of the user, tissue-based vibrations generated by the speech of the user;
determine, in real-time and based on the sounds detected via the microphone array and the tissue-based vibrations detected by the contact transducer, a state associated with wind noise in the sounds and tissue-based vibrations;
determine, in real-time and based on the sounds detected via the microphone array and the tissue-based vibrations detected by the contact transducer, a state associated with a voice of the user in the sounds and tissue-based vibrations; and
combining, based on the determinations of the states associated with wind noise and the voice of the user, low-frequency components of the tissue-based vibrations detected by the contact transducer with high-frequency components of the sounds detected by the microphone array.
2 . The method of claim 1 , wherein the state associated with wind noise is determined via an inter-channel coherence analysis of the sounds and the tissue-based vibrations.
3 . The method of claim 1 , wherein the state associated with the voice of the user is determined using a spectrum centroid analysis of the tissue-based vibrations.
4 . The method of claim 1 , wherein the combining further comprises attenuating frequency components below a threshold in the sounds detected by the microphone array.
5 . The method of claim 4 , wherein the combining further comprises augmenting missing frequency components in the tissue-based vibrations with corresponding components from the sounds detected by the microphone array.
6 . The method of claim 1 , wherein determining the state associated with wind noise comprises calculating a root-mean-square difference between a first signal representing the sounds detected by the microphone array and a second signal representing the tissue-based vibrations detected by contact transducer.
7 . The method of claim 1 , wherein the combining is performed in response to the state of the voice of the user indicating that speech is present.
8 . The method of claim 1 , wherein the combining comprises adjusting one or more sound filters based on the states associated with wind noise and the voice of the user in the sounds and tissue-based vibrations.
9 . The method of claim 1 , further comprising analyzing an output of the combining to determine a user command.
10 . The method of claim 1 , wherein the contact transducer is configured to be in contact with a head of a user.
11 . An audio system comprising:
a microphone array configured to detect sounds from a local area, the sounds from the local area including a voice of a user of the audio system;
a contact transducer configured to be in contact with a portion of a head of the user, and detect tissue-based vibrations that are generated by the voice of the user; and
a controller configured to:
determine, in real-time and based on the sounds detected via the microphone array and the tissue-based vibrations detected by the contact transducer, a state associated with wind noise in the sounds and tissue-based vibrations;
determine, in real-time and based on the sounds detected via the microphone array and the tissue-based vibrations detected by the contact transducer, a state associated with a voice of the user in the sounds and tissue-based vibrations; and
combine, based on the determinations of the states associated with wind noise and the voice of the user, low-frequency components of the tissue-based vibrations detected by the contact transducer with high-frequency components of the sounds detected by the microphone array.
12 . The audio system of claim 11 , wherein the controller is further configured to determine ed with the wind noise by performing an inter-channel coherence analysis of the sounds and the tissue-based vibrations.
13 . The audio system of claim 11 , wherein the controller is further configured to determine the state associated with the voice of the user via a spectrum centroid analysis of the tissue-based vibrations.
14 . The audio system of claim 11 , wherein the controller is configured to perform the combining of the low-frequency components and the high-frequency components by attenuating frequency components below a threshold in the sounds detected by the microphone array.
15 . The audio system of claim 11 , wherein controller is configured to perform the combining of the low-frequency components and the high-frequency components by augmenting missing frequency components in the tissue-based vibrations with corresponding components from the sounds detected by the microphone array.
16 . A non-transitory computer-readable storage medium comprising memory with executable computer instructions encoded thereon that, when executed by one or more processors of an audio system, cause the audio system to:
detect, via a microphone array of the audio system, sounds from a local area, the sounds from the local area including speech of a user of the audio system;
detect, via a contact transducer that is in contact with tissue of the user, tissue-based vibrations generated by the speech of the user;
determine, in real-time and based on the sounds detected via the microphone array and the tissue-based vibrations detected by the contact transducer, a state associated with wind noise in the sounds and tissue-based vibrations;
determine, in real-time and based on the sounds detected via the microphone array and the tissue-based vibrations detected by the contact transducer, a state associated with a voice of the user in the sounds and tissue-based vibrations; and
combine, based on the determinations of the states associated with wind noise and the voice of the user, low-frequency components of the tissue-based vibrations detected by the contact transducer with high-frequency components of the sounds detected by the microphone array.
17 . The non-transitory computer-readable storage medium of claim 16 , wherein the executable computer instructions cause the audio system to determine the state associated with the wind noise by performing an inter-channel coherence analysis of the sounds and the tissue-based vibrations.
18 . The non-transitory computer-readable storage medium of claim 17 , wherein the executable computer instructions cause the audio system to determine the state associated with the voice of the user by using a spectrum centroid analysis of the tissue-based vibrations.
19 . The non-transitory computer-readable storage medium of claim 16 , wherein the executable computer instructions cause the audio system to combine the low-frequency components and the high-frequency components by attenuating frequency components below a threshold in the sounds detected by the microphone array.
20 . The non-transitory computer-readable storage medium of claim 1 , wherein the executable computer instructions cause the audio system to selectively combine the low-frequency components and the high-frequency components by augmenting missing frequency components in the tissue-based vibrations with corresponding components from the sounds detected by the microphone array.