IP Library Granted Patent US 10,469,802
Granted Patent B2
US 10,469,802 · App. 14/823,088 · Granted Nov 5, 2019

Disturbance detection in video communications

Inventors: John F. Buford (Princeton, NJ); Mehmet C. Balasaygun (Freehold, NJ); Keith Ponting (Malvern, GB); Wendy Holmes (Malvern, GB)
Assignee: Avaya Inc.
H04N7/155G06K9/00718G11B27/036H04N7/147H04N7/152G06K2009/00738
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,469,802
App. No.
14/823,088
Granted
Nov 5, 2019
Kind
B2
Abstract

Embodiments disclosed herein provide systems, methods, and computer readable media for detecting disturbances in a media stream from a participant on a communication. In a particular embodiment, a method provides identifying disturbance criteria defining a plurality of audible disturbances, a plurality of visual disturbances, and a plurality of communication disturbances. The method further provides identifying one or more audible disturbances from an audio component of the media stream based on predefined disturbance criteria and identifying one or more visual disturbances from a video component of the media stream based on the disturbance criteria. Additionally, the method provides correlating the audible disturbances with the visual disturbances to determine one or more combined disturbances for the participant based on the disturbance criteria, wherein each of the combined disturbances comprises at least one of the audible disturbances and at least one of the visual disturbances.

Claims (42)

1. A method of detecting disturbances in a first media stream captured of a participant on a communication, the method comprising:

identifying one or more audible disturbances from an audio component of the first media stream based on disturbance criteria defining a plurality of audible disturbances, a plurality of visual disturbances, and a plurality of combined disturbances;

identifying one or more visual disturbances from a video component of the first media stream based on the disturbance criteria;

correlating the audible disturbances with the visual disturbances to determine one or more combined disturbances for the participant based on the disturbance criteria, wherein each of the combined disturbances comprises at least one of the audible disturbances and at least one of the visual disturbances;

for at least one combined disturbance of the combined disturbances, removing the at least one audible disturbance of the at least one combined disturbance from the first media stream before transferring the first media stream to another participant on the communication.

2. The method of claim 1 , further comprising:

receiving biometric information about the participant contemporaneously with the first media stream; and

correlating the biometric information along with the audible disturbances and the visual disturbances to determine the combined disturbances.

3. The method of claim 1 , further comprising:

correlating the audible disturbances with the visual disturbances to determine whether at least one of the audible disturbances and at least one of the visual disturbances were falsely identified.

4. The method of claim 1 , further comprising:

determining a disturbance score for the participant based on the audible, visual, and combined disturbances.

5. The method of claim 4 , wherein factors used when determining the disturbance score comprise one or more of a total amount of disturbances, an amount of disturbances by type of disturbance, and frequency of disturbances.

6. The method of claim 1 , further comprising:

for at least one disturbance of the audible, visual, and combined disturbances, replacing the at least one disturbance in the first media stream with a prerecorded media stream element.

7. The method of claim 1 , further comprising:

for at least one disturbance of the audible, visual, and combined disturbances, inserting a prerecorded media stream element into the first media stream after the at least one disturbance.

8. The method of claim 1 , further comprising:

providing the participant with feedback concerning the audible, visual, and combined disturbances.

9. The method of claim 8 , wherein the feedback includes at least one recommendation for mitigating at least one of the audible, visual, and combined disturbances.

10. A system for detecting disturbances in a first media stream captured of a participant on a communication, the system comprising:

an interface configured to receive an audio component of the first media stream and a video component of the first media stream; and

a processing system configured to:

identify one or more audible disturbances from the audio component of the first media stream based on disturbance criteria defining a plurality of audible disturbances, a plurality of visual disturbances, and a plurality of combined disturbance;

identify one or more visual disturbances from the video component of the first media stream based on the disturbance criteria;

correlate the audible disturbances with the visual disturbances to determine one or more combined disturbances for the participant based on the disturbance criteria, wherein each of the combined disturbances comprises at least one of the audible disturbances and at least one of the visual disturbances; and

for at least one combined disturbance of the combined disturbances, remove the at least one audible disturbance of the at least one combined disturbance from the first media stream before transferring the first media stream to another participant on the communication.

11. The system of claim 10 , further comprising:

the interface configured to receive biometric information about the participant contemporaneously with the first media stream; and

the processing system configured to correlate the biometric information along with the audible disturbances and the visual disturbances to determine the combined disturbances.

12. The system of claim 10 , further comprising:

the processing system configured to correlate the audible disturbances with the visual disturbances to determine whether at least one of the audible disturbances and at least one of the visual disturbances were falsely identified.

13. The system of claim 10 , further comprising:

the processing system configured to determine a disturbance score for the participant based on the audible, visual, and combined disturbances.

14. The system of claim 13 , wherein the processing system is configured to use one or more of a total amount of disturbances, an amount of disturbances by type of disturbance, and frequency of disturbances as factors when determining the disturbance score.

15. The system of claim 10 , further comprising:

the processing system configured to, for at least one disturbance of the audible, visual, and combined disturbances, replace the at least one disturbance in the first media stream with a prerecorded media stream element.

16. The system of claim 10 , further comprising:

the processing system configured to, for at least one disturbance of the audible, visual, and combined disturbances, insert a prerecorded media stream element into the first media stream after the at least one disturbance.

17. The system of claim 10 , further comprising:

the processing system configured to provide the participant with feedback concerning the audible, visual, and combined disturbances.

18. The system of claim 17 , wherein the feedback includes at least one recommendation for mitigating at least one of the audible, visual, and combined disturbances.

Assignments (15)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2015
From: BUFORD, JOHN F.; BALASAYGUN, MEHMET C.; PONTING, KEITH; HOLMES, WENDY
To: AVAYA INC.
Reel/Frame 036296/0438 →