Wearable device with enhanced noise suppression
Techniques, including devices and systems implementing the techniques, for using enhanced noise suppression to provide optimal denoised output. One example system generally includes a device of a user, a first sensor coupled to the device, a second sensor coupled to the device, and one or more processors coupled to the device. The one or more processors are generally, individually or collectively, configured to receive, at the first sensor, a first audio signal with a first degradation, receive, at the second sensor, a second audio signal with a second degradation, where the first degradation is different than the second degradation, and determine an output audio signal using the first audio signal and the second audio signal.
1 . A system comprising:
a device of a user;
a first sensor coupled to the device;
a second sensor coupled to the device; and
one or more processors coupled to the device, the one or more processors, individually or collectively, being configured to:
receive, at the first sensor, a first audio signal with a first degradation;
receive, at the second sensor, a second audio signal with a second degradation, wherein the first degradation is different than the second degradation; and
determine an output audio signal by using a trained machine-learning model to determine a first mask for the first audio signal and a second mask for the second audio signal, wherein the first mask is configured to at least partially denoise the first audio signal and the second mask is configured to at least partially denoise the second audio signal.
2 . The system of claim 1 , wherein the first sensor comprises a microphone outside the device and the second sensor comprises:
a feedback microphone;
a voice band accelerometer; or
an inertial measurement unit.
3 . The system of claim 1 , wherein the one or more processors, individually or collectively, are further configured to determine the output audio signal by:
applying the first mask to the first audio signal to produce a denoised first audio signal;
applying the second mask to the second audio signal to produce a denoised second audio signal; and
summing the denoised first audio signal and the denoised second audio signal to produce the output audio signal.
4 . A method for audio signal processing in a device of a user, the method comprising:
receiving, at a first sensor coupled to the device, a first audio signal with a first degradation;
receiving, at a second sensor coupled to the device, a second audio signal with a second degradation, wherein the first degradation is different than the second degradation; and
determining an output audio signal by using a trained machine-learning model to determine a first mask for the first audio signal and a second mask for the second audio signal, wherein the first mask is configured to at least partially denoise the first audio signal and the second mask is configured to at least partially denoise the second audio signal.
5 . The method of claim 4 , wherein the second sensor comprises:
a feedback microphone;
a voice band accelerometer; or
an inertial measurement unit.
6 . The method of claim 5 , wherein the first sensor comprises a microphone outside the device.
7 . The method of claim 4 , wherein determining the output audio signal further comprises:
applying the first mask to the first audio signal to produce a denoised first audio signal;
applying the second mask to the second audio signal to produce a denoised second audio signal; and
summing the denoised first audio signal and the denoised second audio signal to produce the output audio signal.
8 . The method of claim 4 , further comprising preprocessing the second audio signal, wherein the preprocessing comprises effectively removing a non-user speech component of the second audio signal.
9 . The method of claim 4 , wherein the first audio signal and the second audio signal each comprise a speech component originating from the user.
10 . The method of claim 4 , wherein the device comprises a wearable device.
11 . A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by one or more processors of a device of a user, cause the device to perform a method for audio signal processing, the method comprising:
receiving, at a first sensor coupled to the device, a first audio signal with a first degradation;
receiving, at a second sensor coupled to the device, a second audio signal with a second degradation, wherein the first degradation is different than the second degradation; and
determining an output audio signal by using a trained machine-learning model to determine a first mask for the first audio signal and a second mask for the second audio signal, wherein the first mask is configured to at least partially denoise the first audio signal and the second mask is configured to at least partially denoise the second audio signal.
12 . The non-transitory computer-readable medium of claim 11 , wherein the first sensor comprises a microphone outside the device and the second sensor comprises:
a feedback microphone;
a voice band accelerometer; or
an inertial measurement unit.
13 . The non-transitory computer-readable medium of claim 11 , wherein determining the output audio signal further comprises:
applying the first mask to the first audio signal to produce a denoised first audio signal;
applying the second mask to the second audio signal to produce a denoised second audio signal; and
summing the denoised first audio signal and the denoised second audio signal to produce the output audio signal.