Method and system for automatic detection and correction of sound caused by facial coverings

1. A computer-implemented method for correcting muffled speech caused by facial coverings, the computer-implemented method comprising:

monitoring a user's speech for speech distortion;

determining that the user's speech is distorted;

comparing one or more current soundwaves of the user's speech to a trained model, wherein the trained model is generated based on examining both unmuffled and muffled speech patterns of a user, information from a profile of a listener, information from a profile of the user, and environmental conditions, for detecting distorted speech associated with the particular type of facial covering to determine that a cause of the user's speech distortion is based, at least in part, on a presence of a particular type of facial covering; and

automatically correcting the speech distortion of the user based, at least in part, on the particular type of facial covering causing the speech distortion, wherein the automatically correcting the speech distortion of the user comprises selecting one or more speech unmuffling policies, based, at least in part, on acoustic signal characteristics of the particular type of facial covering causing the speech distortion, the unmuffled speech patterns of the user, the environmental conditions, the information found in the profile of the user, and the information found in the profile of the listener.

2. The computer-implemented method of claim 1 , wherein determining that the user's speech is distorted based, at least in part, on:

comparing current sound waves of the user's speech to historical sounds waves of the user's speech;

determining that a deviation between the current sound waves of the user's speech and the historical sound waves of the user's speech is above a predetermined threshold; and

determining a degree of distortion of the user's speech, wherein the degree of distortion of the user's speech is based on the information found in the profile of the user, the information found in the profile of the listener, and the acoustic signal characteristics of the particular type of facial covering causing the speech distortion.

3. The computer-implemented method of claim 1 , wherein automatically correcting the speech distortion is further based, at least in part, on:

determining one or more acoustic signal characteristics of the user's historical sound waves; and

modifying any distorted sound waves of the user to incorporate the one or more acoustic signal characteristics of the user's historical sound waves.

4. The computer-implemented method of claim 1 , wherein automatically correcting the speech distortion of the user includes:

comparing current sound waves of the user's speech to historical sound waves of the user's speech using the trained model;

identifying one or more components of the user's current sound waves that deviate from the user's historical sound waves above a predetermined threshold; and

removing the one or more components of the user's current sound waves that deviate from the user's historical sound waves above the predetermined threshold.

5. The computer-implemented method of claim 1 , wherein automatically correcting the speech distortion is further based, at least in part, on:

analyzing one or more quantitative metrics associated with the speech distortion.

6. The computer-implemented method of claim 1 , wherein automatically correcting the speech distortion is further based, at least in part, on:

determining a dominant factor of the speech distortion.

7. The computer-implemented method of claim 1 , wherein the information found in the profile of the user comprises a material a physical barrier is made of, a background environment, age of the user, gender of the user, language of the user, normal speech signals or waveforms of the user, typical or historical speech waveforms of the user, and information on degree of muffling or distortion of speech based on a joint analysis of speech signal characteristics, physical barrier acoustic characteristics, and other environmental factors.

8. The computer-implemented method of claim 1 , wherein the information found in the profile of the listener comprises a likelihood that muffled or distorted speech will cause the listener difficulty in understanding speech, age of the listener, gender of the listener, and language of the listener.

9. The computer-implemented method of claim 1 , wherein the one or more current soundwaves of the user's speech comprise an attenuation or distortion level (SNR), and a counter process signal.

10. A computer program product for correcting muffled speech caused by facial coverings, the computer program product comprising one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions including instructions to:

monitoring a user's speech for speech distortion;

determining that the user's speech is distorted;

comparing one or more current soundwaves of the user's speech to a trained model, wherein the trained model is generated based on examining both unmuffled and muffled speech patterns of a user, information from a profile of a listener, information from a profile of the user, and environmental conditions, for detecting distorted speech associated with the particular type of facial covering to determine that a cause of the user's speech distortion is based, at least in part, on a presence of a particular type of facial covering; and

automatically correcting the speech distortion of the user based, at least in part, on the particular type of facial covering causing the speech distortion, wherein the automatically correcting the speech distortion of the user comprises selecting one or more speech unmuffling policies, based, at least in part, on acoustic signal characteristics of the particular type of facial covering causing the speech distortion, the unmuffled speech patterns of the user, the environmental conditions, the information found in the profile of the user, and the information found in the profile of the listener.

11. The computer program product of claim 10 , wherein the instructions to determine that the user's speech is distorted is based, at least in part, on instructions to:

comparing current sound waves of the user's speech to historical sounds waves of the user's speech;

determining that a deviation between the current sound waves of the user's speech and the historical sound waves of the user's speech is above a predetermined threshold; and

determining a degree of distortion of the user's speech, wherein the degree of distortion of the user's speech is based on the information found in the profile of the user, the information found in the profile of the listener, and the acoustic signal characteristics of the particular type of facial covering causing the speech distortion.

12. The computer program product of claim 10 , wherein the instructions to determine that the user's speech is distorted is based, at least in part, on instructions to:

determine one or more acoustic signal characteristics of the user's historical sound waves; and

modify any distorted sound waves of the user to incorporate the one or more acoustic signal characteristics of the user's historical sound waves.

13. The computer program product of claim 10 , wherein the instructions to automatically correct the speech distortion of the user includes instructions to:

comparing current sound waves of the user's speech to historical sound waves of the user's speech using the trained model;

identifying one or more components of the user's current sound waves that deviate from the user's historical sound waves above a predetermined threshold; and

removing the one or more components of the user's current sound waves that deviate from the user's historical sound waves above the predetermined threshold.

14. The computer program product of claim 10 , wherein the instructions to determine that the user's speech is distorted is based, at least in part, on instructions to:

analyze one or more quantitative metrics associated with the speech distortion.

15. The computer program product of claim 10 , wherein the instructions to determine that the user's speech is distorted is based, at least in part, on instructions to:

determine a dominant factor of the speech distortion.

16. A computer system for correcting muffled speech caused by facial coverings, comprising:

one or more computer processors;

one or more computer-readable storage media, and

computer program instructions, the computer program instructions being stored on the one or more computer readable storage media for execution by the one or more computer processors, the computer program instructions including instructions to:

monitoring a user's speech for speech distortion;

determining that the user's speech is distorted;

comparing one or more current soundwaves of the user's speech to a trained model, wherein the trained model is generated based on examining both unmuffled and muffled speech patterns of a user, information from a profile of a listener, information from a profile of the user, and environmental conditions, for detecting distorted speech associated with the particular type of facial covering to determine that a cause of the user's speech distortion is based, at least in part, on a presence of a particular type of facial covering; and

automatically correcting the speech distortion of the user based, at least in part, on the particular type of facial covering causing the speech distortion, wherein the automatically correcting the speech distortion of the user comprises selecting one or more speech unmuffling policies, based, at least in part, on acoustic signal characteristics of the particular type of facial covering causing the speech distortion, the unmuffled speech patterns of the user, the environmental conditions, the information found in the profile of the user, and the information found in the profile of the listener.

17. The computer system of claim 16 , wherein the instructions to determine that the user's speech is distorted is based, at least in part, on instructions to:

comparing current sound waves of the user's speech to historical sounds waves of the user's speech;

determining that a deviation between the current sound waves of the user's speech and the historical sound waves of the user's speech is above a predetermined threshold; and

determining a degree of distortion of the user's speech, wherein the degree of distortion of the user's speech is based on the information found in the profile of the user, the information found in the profile of the listener, and the acoustic signal characteristics of the particular type of facial covering causing the speech distortion.

18. The computer system of claim 16 , wherein the instructions to determine that the user's speech is distorted is based, at least in part, on instructions to:

determine one or more acoustic signal characteristics of the user's historical sound waves; and

modify any distorted sound waves of the user to incorporate the one or more acoustic signal characteristics of the user's historical sound waves.

19. The computer system of claim 16 , wherein the instructions to automatically correct the speech distortion of the user includes instructions to:

comparing current sound waves of the user's speech to historical sound waves of the user's speech using the trained model;

identifying one or more components of the user's current sound waves that deviate from the user's historical sound waves above a predetermined threshold; and

removing the one or more components of the user's current sound waves that deviate from the user's historical sound waves above the predetermined threshold.

20. The computer system of claim 16 , wherein the instructions to determine that the user's speech is distorted is based, at least in part, on instructions to:

analyze one or more quantitative metrics associated with the speech distortion.