Disturbance detection in video communications
Embodiments disclosed herein provide systems, methods, and computer-readable media for detecting disturbances in a media stream from a participant on a communication. In a particular embodiment, a method provides receiving biometric information indicating a motion of the participant and determining that the motion indicates a visual disturbance in a video component of the first media stream. The method further provides identifying the visual disturbance in the video component of the first media stream and removing the visual disturbance from the video component of the first media stream.
1. A method for detecting disturbances in a first media stream captured of a participant on a communication, the method comprising:
receiving biometric information indicating a motion of the participant, wherein the biometric information is captured by a biometric sensor of a video client system;
determining that the motion indicates an audible disturbance in an audio component of the first media stream, wherein the audio component is captured by a microphone of the video client system;
and
removing the audible disturbance from the audio component.
2. The method of claim 1 , further comprising:
identifying a visual disturbance in a video component of the first media stream; and
using the visual disturbance to confirm the audible disturbance.
3. The method of claim 2 , further comprising:
removing the visual disturbance from the video component of the first media stream.
4. The method of claim 1 , wherein removing the audible disturbance comprises:
replacing the audible disturbance with background noise in the audio component of the first media stream.
5. The method of claim 3 , wherein removing the visual disturbance comprises:
replacing the visual disturbance in the video component with prerecorded frames of the participant that do not include a disturbance.
6. The method of claim 5 , further comprising:
performing visual processing on the video component of the first media stream to ensure a transition to the prerecorded frames does not create a disturbance.
7. The method of claim 1 , further comprising:
determining a disturbance score for the participant based on the audible disturbance.
8. The method of claim 7 , further comprising:
determining the disturbance score based on an amount of disturbances and a frequency of disturbances.
9. The method of claim 1 , further comprising:
providing the participant with feedback concerning the audible disturbance.
10. The method of claim 9 , wherein the feedback includes at least one recommendation for mitigating disturbances.
11. A system for detecting disturbances in a first media stream captured of a participant on a communication, the system comprising:
one or more computer readable storage media;
a processing system operatively coupled with the one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media that, when read and executed by the processing system, direct the processing system to:
receive biometric information indicating a motion of the participant, wherein the biometric information is captured by a biometric sensor of a video client system;
determine that the motion indicates an audible disturbance in an audio component of the first media stream, wherein the audio component is captured by a microphone of the video client system;
and
remove the audible disturbance from the audio component.
12. The system of claim 11 , wherein the program instructions further direct the processing system to:
identify a visual disturbance in a video component of the first media stream; and
use the visual disturbance to confirm the audible disturbance.
13. The system of claim 12 , wherein the program instructions further direct the processing system to:
remove the visual disturbance from the video component of the first media stream.
14. The system of claim 11 , wherein to remove the audible disturbance, the program instructions direct the processing system to:
replace the audible disturbance with background noise in the audio component of the first media stream.
15. The system of claim 13 , wherein to remove the visual disturbance, the program instructions direct the processing system to:
replace the visual disturbance in the video component with prerecorded frames of the participant that do not include a disturbance.
16. The system of claim 15 , wherein the program instructions further direct the processing system to:
perform visual processing on the video component of the first media stream to ensure a transition to the prerecorded frames does not create a disturbance.
17. The system of claim 11 , wherein the program instructions further direct the processing system to:
determine a disturbance score for the participant based on the audible disturbance.
18. The system of claim 17 , wherein the program instructions further direct the processing system to:
determine the disturbance score based on an amount of disturbances and a frequency of disturbances.
19. The system of claim 11 , wherein the program instructions further direct the processing system to:
provide the participant with feedback concerning the audible disturbance.
20. One or more non-transitory computer readable storage media, having instructions stored thereon for detecting disturbances in a first media stream captured of a participant on a communication, the instructions, when read and executed by a processing system, direct the processing system to:
receive biometric information indicating a motion of the participant, wherein the biometric information is captured by a biometric sensor of a video client system;
determine that the motion indicates an audible disturbance in an audio component of the first media stream, wherein the audio component is captured by a microphone of the video client system;
and
remove the audible disturbance from the audio component.