COMPENSATION FOR FACE COVERINGS IN CAPTURED AUDIO
The technology disclosed herein enables compensation for attenuation caused by face coverings in captured audio. In a particular embodiment, a method includes determining that a face covering is positioned to cover the mouth of a user of a user system. The method further includes receiving audio that includes speech from the user and adjusting amplitudes of frequencies in the audio to compensate for the face covering.
1 . A method comprising:
determining that a face covering is positioned to cover the mouth of a user of a user system;
receiving audio that includes speech from the user; and
adjusting amplitudes of frequencies in the audio to compensate for the face covering.
2 . The method of claim 1 , comprising:
after adjusting the frequencies, transmitting the audio over a communication session between the user system and another user system.
3 . The method of claim 1 , wherein adjusting the amplitudes of the frequencies comprises:
amplifying the frequencies based on attenuation to the frequencies caused by the face covering.
4 . The method of claim 3 , wherein the attenuation indicates that a first set of the frequencies should be amplified by a first amount and a second set of the frequencies should be amplified by a second amount.
5 . The method of claim 1 , comprising:
receiving reference audio that includes reference speech from the user while the mouth is not covered by the face covering.
6 . The method of claim 5 , comprising:
comparing the reference audio to the audio to determine an amount in which the frequencies have been attenuated by the face covering.
7 . The method of claim 5 , comprising:
receiving training audio that includes training speech from the user while the mouth is covered by the face covering, wherein the training speech and the reference speech include words spoken by the user from a same script; and
comparing the reference audio to the training audio to determine an amount in which the frequencies have been attenuated by the face covering.
8 . The method of claim 1 , wherein determining that the face covering is positioned to cover the mouth of the user comprises:
receiving video of the user; and
using face recognition to determine that the mouth is covered.
9 . The method of claim 1 , wherein adjusting the amplitudes of the frequencies comprises:
accessing a profile for the face covering that indicates the frequencies and amounts in which the amplitudes should be adjusted.
10 . The method of claim 1 , comprising:
receiving video of the user; and
replacing the face covering in the video with a synthesized mouth for the user.
11 . An apparatus comprising:
one or more computer readable storage media;
a processing system operatively coupled with the one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media that, when read and executed by the processing system, direct the processing system to:
determine that a face covering is positioned to cover the mouth of a user of a user system;
receive audio that includes speech from the user; and
adjust amplitudes of frequencies in the audio to compensate for the face covering.
12 . The apparatus of claim 11 , wherein the program instructions direct the processing system to:
after adjusting the frequencies, transmit the audio over a communication session between the user system and another user system.
13 . The apparatus of claim 11 , wherein to adjust the amplitudes of the frequencies, the program instructions direct the processing system to:
amplify the frequencies based on attenuation to the frequencies caused by the face covering.
14 . The apparatus of claim 13 , wherein the attenuation indicates that a first set of the frequencies should be amplified by a first amount and a second set of the frequencies should be amplified by a second amount.
15 . The apparatus of claim 11 , wherein the program instructions direct the processing system to:
receive reference audio that includes reference speech from the user while the mouth is not covered by the face covering.
16 . The apparatus of claim 15 , wherein the program instructions direct the processing system to:
compare the reference audio to the audio to determine an amount in which the frequencies have been attenuated by the face covering.
17 . The apparatus of claim 15 , wherein the program instructions direct the processing system to:
receive training audio that includes training speech from the user while the mouth is covered by the face covering, wherein the training speech and the reference speech include words spoken by the user from a same script; and
compare the reference audio to the training audio to determine an amount in which the frequencies have been attenuated by the face covering.
18 . The apparatus of claim 11 , wherein determining that the face covering is positioned to cover the mouth of the user comprises:
receive video of the user; and
use face recognition to determine that the mouth is covered.
19 . The apparatus of claim 11 , wherein adjusting the amplitudes of the frequencies comprises:
access a profile for the face covering that indicates the frequencies and amounts in which the amplitudes should be adjusted.
20 . One or more computer readable storage media having program instructions stored thereon the one or more computer readable storage media that, when read and executed by the processing system, direct the processing system to:
determine that a face covering is positioned to cover the mouth of a user of a user system;
receive audio that includes speech from the user; and
adjust amplitudes of frequencies in the audio to compensate for the face covering.