IP Library Granted Patent US 8,867,013
Granted Patent B2
US 8,867,013 · App. 13/588,637 · Granted Oct 21, 2014

System and method for measuring video quality degradation using face detection

Inventors: Anjur S. Krishnakumar (Princeton, NJ); Bengi Karacali-Akyamac (Bridgewater, NJ)
Assignee: Avaya Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,867,013
App. No.
13/588,637
Filed
Aug 17, 2012
Granted
Oct 21, 2014
Kind
B2
Art Unit
2422
USPC
349/180
Abstract

System and method to detect video quality degradation in a video stream received by a telecommunications endpoint, the method including: locating reference features characteristic of content in the received video stream; calculating reduced reference features from the located reference features; receiving reduced reference features of a transmitted video stream, the transmitted video stream corresponding to the received video stream; calculating a distance between the reduced reference features in the received video stream and the reduced reference features of the transmitted video stream; and detecting video quality degradation when the calculated distance exceeds a predetermined threshold.

Claims (100)

1. A method to detect video quality degradation in a video stream received by a telecommunications endpoint, the method comprising:

locating reference features characteristic of content in the received video stream;

calculating, by use of a processor, reduced reference features from the located reference features;

receiving reduced reference features of a transmitted video stream, the transmitted video stream corresponding to the received video stream;

calculating, by use of a processor, a coordinate distance between the reduced reference features in the received video stream and the reduced reference features of the transmitted video stream; and

detecting video quality degradation when the calculated coordinate distance exceeds a predetermined threshold.

2. The method of claim 1 , wherein reference features characteristic of content comprise faces.

3. The method of claim 1 , wherein reduced reference features comprise locations of the reference features.

4. The method of claim 1 , wherein the reduced reference feature comprises a location of a rectangular area surrounding the reference feature.

5. The method of claim 1 , wherein the reduced reference features are calculated at less than a full frame rate of the received video stream.

6. The method of claim 1 , wherein the reduced reference features are calculated at no more than two frames per second.

7. The method of claim 1 , wherein the reduced reference features of the transmitted video stream are received via a communication channel that is separate from a communication channel used to transport the video stream.

8. The method of claim 1 , further comprising:

receiving a frame of the transmitted video stream to the telecommunications endpoint, once per second, via a reliable channel; and

calculating reduced reference features from the transported frame.

9. The method of claim 1 , wherein calculating a coordinate distance comprises calculating the coordinate distance in accordance with the following relationship:

distance

=

log

(

(

x

s

-

x

r

)

2

+

(

y

s

-

y

r

)

2

)

log

(

d

max

)

,

wherein:

(x r , y r ) comprises received coordinates of a reduced reference features in the received video stream;

(x s , y s ) comprises received coordinates of a reduced reference features in the transmitted video stream; and

d max comprises a diagonal resolution size.

10. The method of claim 1 , wherein the video stream originates from a remotely-located camera accessible via a communication path.

11. The method of claim 1 , further comprising: detecting an absence of reference feature from the received video stream.

12. A system to detect video quality degradation in a video stream received by a telecommunications endpoint, the method comprising:

a location module configured to locate reference features characteristic of content in the received video stream;

a processor configured to calculate reduced reference features from the located reference features;

a receiver configured to receive reduced reference features of a transmitted video stream, the transmitted video stream corresponding to the received video stream;

a processor configured to calculate a coordinate distance between the reduced reference features in the received video stream and the reduced reference features of the transmitted video stream; and

a detector configured to detect video quality degradation when the calculated coordinate distance exceeds a predetermined threshold.

13. The system of claim 12 , wherein reference features characteristic of content comprise faces.

14. The system of claim 12 , wherein the reduced reference feature comprises a location of a rectangular area surrounding the reference feature.

15. The system of claim 12 , wherein the reduced reference features are calculated at less than a full frame rate of the received video stream.

16. The system of claim 12 , wherein the reduced reference features are calculated at no more than two frames per second.

17. The system of claim 12 , wherein the reduced reference features of the transmitted video stream are received via a communication channel that is separate from a communication channel used to transport the video stream.

18. The system of claim 12 , wherein the processor is configured to calculate a coordinate distance in accordance with the following relationship:

distance

=

log

(

(

x

s

-

x

r

)

2

+

(

y

s

-

y

r

)

2

)

log

(

d

max

)

,

wherein:

(x r , y r ) comprises received coordinates of a reduced reference features in the received video stream;

(x s , y s ) comprises received coordinates of a reduced reference features in the transmitted video stream; and

d max comprises a diagonal resolution size.

19. The system of claim 12 , wherein the video stream originates from a remotely-located camera accessible via a communication path.

20. The system of claim 12 , further comprising: a detection module configured to detect an absence of reference feature from the received video stream.

Assignments (21)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 029608/0256 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVAYA INC.
Reel/Frame 044891/0801 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 030083/0639 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVAYA INC.
Reel/Frame 045012/0666 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
SECURITY AGREEMENT Recorded Mar 13, 2013
From: AVAYA, INC.
To: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., THE
Reel/Frame 030083/0639 →
SECURITY AGREEMENT Recorded Jan 10, 2013
From: AVAYA, INC.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 029608/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2012
From: KRISHNAKUMAR, ANJUR S.; KARACALI-AKYAMAC, BENGI
To: AVAYA INC.
Reel/Frame 028806/0961 →
Continuity (3)
Provisional Application 61591019 · Jan 26, 2012
Provisional Application 61614617 · Mar 23, 2012
Related Publication 20130194434A1 · Aug 1, 2013