IP Library Granted Patent US 8,520,075
Granted Patent B2
US 8,520,075 · App. 13/151,761 · Granted Aug 27, 2013

Method and apparatus for reduced reference video quality measurement

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,520,075
App. No.
13/151,761
Granted
Aug 27, 2013
Kind
B2
Abstract

Systems and methods of objective video quality measurement that employ a reduced-reference approach to video quality measurement. Such systems and methods of objective video quality measurement can extract information pertaining to one or more features of a target video whose perceptual quality is to be measured, extract information pertaining to one or more features of a reference video, and employ one or more prediction functions involving the target features and the reference features to provide a measurement of the perceptual quality of the target video.

Claims (72)

1. A method of measuring perceptual quality of video, the video being provided over at least one communications channel, the method comprising the steps of:

receiving a target video over the at least one communications channel;

extracting, from the target video, objective information pertaining to one or more target features of the target video;

receiving objective information pertaining to one or more reference features of a reference version of the target video, wherein one or more reference features correspond, respectively, to the one or more target features;

providing an objective measurement of perceptual quality of the reference version of the target video based at least on the objective information pertaining to the one or more reference features;

providing an objective measurement of a predicted differential mean opinion score (DMOS) between at least a portion of the target video and at least a corresponding portion of the reference version of the target video based at least on the objective information pertaining to the one or more reference features and the information pertaining to the one or more target features; and

providing an objective measurement of perceptual quality of the target video, the providing of the objective measurement of perceptual quality of the target video including obtaining a difference between the objective measurement of perceptual quality of the reference version of the target video, and the objective measurement of the predicted DMOS between at least the corresponding portion of the target video and at least the portion of the reference version of the target video.

2. The method of claim 1 wherein providing the objective measurement of perceptual quality of the target video is based at least on one or more prediction functions, each of the one or more prediction functions being a function of one or more of the objective information pertaining to the one or more reference features and the objective information pertaining to the one or more corresponding target features.

3. The method of claim 2 wherein providing the objective measurement of perceptual quality of the target video is based at least on the one or more prediction functions, each of the one or more prediction functions pertaining to a predetermined segment from a corresponding time frame within the target video and the reference version of the target video.

4. The method of claim 2 wherein at least one of the one or more prediction functions is a function of at least one or more objective measurements performable with regard to the target video and the reference version of the target video, and wherein the providing of the objective measurement of perceptual quality of the target video comprises:

normalizing the one or more objective measurements to reflect differences in resolution between the target video and the reference version of the target video.

5. The method of claim 1 wherein the providing of the objective measurement of perceptual quality of the reference version of the target video comprises:

setting the measurement of perceptual quality of the reference version of the target video to a predetermined constant value.

6. The method of claim 1 wherein providing the objective measurement of perceptual quality of the reference version of the target video is based at least on a first prediction function for a predetermined segment from a corresponding time frame within the target video and the reference version of the target video.

7. The method of claim 6 wherein the first prediction function is a function of at least a quantization index for the reference version of the target video.

8. The method of claim 7 wherein the quantization index corresponds to one of a quantization parameter and a quantization scale for the reference version of the target video.

9. The method of claim 8 wherein the quantization parameter corresponds to the H.264 video coding format.

10. The method of claim 8 wherein the quantization scale corresponds to the MPEG-2 video coding format.

11. The method of claim 6 wherein providing the measurement of the predicted DMOS between at least the portion of the target video and at least the portion of the reference version of the target video is based at least on a second prediction function for the predetermined segment from the corresponding time frame within the target video and the reference version of the target video.

12. The method of claim 11 wherein the second prediction function is a function of one or more of (a) an objective measurement of blur in the target video and an objective measurement of blur in the reference version of the target video, (b) an objective measurement of blocking artifacts in the target video and an objective measurement of blocking artifacts in the reference version of the target video, (c) a frame rate for the target video and a frame rate for the reference version of the target video, (d) video motion properties of the target video, (e) frame dropping impairments of the target video, (f) packet loss impairments of the target video, (g) frame freezing impairments of the target video, and (h) ringing impairments of the target video.

13. The method of claim 12 wherein the second prediction function is a linear prediction function.

14. The method of claim 12 wherein the video motion properties include jerkiness motion properties of the target video.

15. The method of claim 11 wherein the providing of the measurement of perceptual quality of the target video comprises:

measuring the perceptual quality of the target video using a third prediction function for the predetermined segment from the corresponding time frame within the target video and the reference version of the target video, the third prediction function being based at least on the first prediction function and the second prediction function.

16. The method of claim 1 wherein the extracting of the information pertaining to the one or more target features of the target video comprises:

performing one or more objective measurements with regard to the target video, the one or more objective measurements including one or more of (a) objective measurements of blur in the target video, (b) objective measurements of blocking artifacts in the target video, and (c) objective measurements of an average quantization index for the target video.

17. The method of claim 1 further comprising:

extracting, from the reference version of the target video, the objective information pertaining to the one or more reference features of the reference version of the target video.

18. The method of claim 17 wherein the extracting of the information pertaining to the one or more reference features of the reference version of the target video comprises:

performing one or more objective measurements with regard to the reference version of the target video, the one or more objective measurements including one or more of (a) objective measurements of blur in the reference version of the target video, (b) objective measurements of blocking artifacts in the reference version of the target video, and (c) objective measurements of an average quantization index for the reference version of the target video.

19. The method of claim 17 wherein the extracting of the information pertaining to the one or more target features of the target video comprises:

performing an objective measurement of blur in the target video, and

wherein the extracting of the information pertaining to the one or more reference features of the reference version of the target video comprises:

performing an objective measurement of blur in the reference version of the target video.

20. The method of claim 19 wherein the providing of the measurement of perceptual quality of the target video comprises:

normalizing the objective measurement of blur in the target video; and

normalizing the objective measurement of blur in the reference version of the target video, thereby reflecting differences in resolution between the target video and the reference version of the target video.

21. The method of claim 2 wherein at least one of the one or more prediction functions includes a plurality of parameter coefficients, and wherein the method further comprises:

determining the plurality of parameter coefficients using at least a multi-variate linear regression technique.

22. The method of claim 2 wherein at least one of the one or more prediction functions is a function of one or more of (a) an average change between a measurement of blur in the target video and a measurement of blur in the reference version of the target video, (b) an average change between a measurement of blocking artifacts in the target video and a measurement of blocking artifacts in the reference version of the target video, (c) an average change between a frame rate for the target video and a frame rate for the reference version of the target video, (d) video motion properties of the target video, (e) frame dropping impairments of the target video, (f) packet loss impairments of the target video, (g) frame freezing impairments of the target video, and (h) ringing impairments of the target video.

23. The method of claim 22 wherein at least one of the one or more prediction functions is a linear prediction function.

24. A video quality measurement system, comprising:

a target feature extractor operative to extract, from a target video, objective information pertaining to one or more target features of the target video; and

a quality assessor operative:

to receive objective information pertaining to one or more reference features of a reference version of the target video, wherein the one or more reference features correspond, respectively, to the one or more target features;

to provide an objective measurement of perceptual quality of the reference version of the target video based at least on the objective information pertaining to the one or more reference features;

to provide an objective measurement of a predicted differential mean opinion score (DMOS) between at least a portion of the target video and at least a corresponding portion of the reference version of the target video based at least on the objective information pertaining to the one or more reference features and the objective information pertaining to the one or more target features; and

to obtain an objective measurement of perceptual quality of the target video as a function of a difference between the objective measurement of perceptual quality of the reference version of the target video, and the measurement of the predicted DMOS between at least the portion of the target video and at least the corresponding portion of the reference version of the target video.

25. The system of claim 24 wherein the quality assessor is further operative to provide the objective measurement of perceptual quality of the target video based at least on one or more prediction functions, each of the one or more prediction functions being a function of one or more of the objective information pertaining to the one or more target features and the objective information pertaining to the corresponding one or more reference features.

26. The system of claim 25 wherein the quality assessor is further operative to provide the objective measurement of perceptual quality of the target video based at least on the one or more prediction functions, each of the one or more prediction functions pertaining to a predetermined segment from a corresponding time frame within the target video and the reference version of the target video.

27. The system of claim 25 wherein at least one of the one or more prediction functions is a function of at least one or more objective measurements performable with regard to the target video and the reference version of the target video, and wherein the quality assessor is further operative to normalize the one or more objective measurements to reflect differences in resolution between the target video and the reference version of the target video.

28. The system of claim 25 wherein at least one of the one or more prediction functions is a function of one or more of (a) an average change between a measurement of blur in the target video and a measurement of blur in the reference version of the target video, (b) an average change between a measurement of blocking artifacts in the target video and a measurement of blocking artifacts in the reference version of the target video, (c) an average change between a frame rate for the target video and a frame rate for the reference version of the target video, (d) video motion properties of the target video, (e) frame dropping impairments of the target video, (f) packet loss impairments of the target video, (g) frame freezing impairments of the target video, and (h) ringing impairments of the target video.

29. The system of claim 28 wherein at least one of the one or more prediction functions is a linear prediction function.

30. A distributed system for measuring perceptual quality of video, the video having one or more features, the one or more features of the video being provided over at least one communications channel, the system comprising:

a target feature extractor operative to extract, from a target video whose perceptual quality is to be measured, objective information pertaining to one or more target features of the target video;

a reference feature extractor operative to extract, from a reference version of the target video, objective information pertaining to one or more reference features of the target video wherein one or more reference features corresponds respectfully to the one or more target features; and

a quality assessor that is geographically remote from the target feature extractor and the reference feature extractor, the quality assessor being operative:

to receive the objective information pertaining to the one or more target features from the target feature extractor over the at least one communications channel;

to receive the objective information pertaining to the one or more reference features from the reference feature extractor over the at least one communications channel;

to provide an objective measurement of a predicted differential mean opinion score (DMOS) between at least a portion of the target video and at least a corresponding portion of the reference version of the target video based at least on the objective information pertaining to the one or more reference features and the objective information pertaining to the one or more target features; and

to obtain an objective measurement of perceptual quality of the target video as a function of a difference between the objective measurement of perceptual quality of the reference version of the target video, and the measurement of the predicted DMOS between at least the portion of the target video and at least the corresponding portion of the reference version of the target video.

31. The system of claim 30 wherein the quality assessor is further operative:

to provide the objective measurement of perceptual quality of the target video based at least on one or more prediction functions involving the objective information pertaining to one or more target features and the one or more reference features.

32. A distributed system for measuring perceptual quality of video, the video having one or more features, the one or more features of the video being provided over at least one communications channel, the system comprising:

a target feature extractor operative to extract, from a target video whose perceptual quality is to be measured, objective information pertaining to one or more target features of the target video;

a reference feature extractor operative to extract, from a reference version of the target video, objective information pertaining to one or more reference features of the target video wherein the one or more reference features correspond, respectively, to the one or more target features; and

a quality assessor that is co-located with the reference feature extractor and geographically remote from the target feature extractor, the quality assessor being operative:

to receive the objective information pertaining to the one or more reference features from the reference feature extractor;

to receive the objective information pertaining to the one or more target features from the target feature extractor over the at least one communications channel;

to provide an objective measurement of a predicted differential mean opinion score (DMOS) between at least a portion of the target video and at least a corresponding portion of the reference version of the target video based at least on the objective information pertaining to the one or more reference features and the objective information pertaining to the one or more target features; and

to obtain an objective measurement of perceptual quality of the target video as a function of a difference between the objective measurement of perceptual quality of the reference version of the target video, and the measurement of the predicted DMOS between at least the portion of the target video and at least the corresponding portion of the reference version of the target video.

33. The system of claim 32 wherein the quality assessor is further operative to provide the objective measurement of perceptual quality of the target video based at least on one or more prediction functions involving the objective information pertaining to the one or more target features and the one or more reference features.

Assignments (6)
SECURITY AGREEMENT Recorded Jun 30, 2015
From: DIALOGIC (US) INC.; DIALOGIC INC.; DIALOGIC US HOLDINGS INC.; DIALOGIC DISTRIBUTION LIMITED; DIALOGIC MANUFACTURING LIMITED; DIALOGIC CORPORATION; DIALOGIC GROUP INC.
To: SILICON VALLEY BANK
Reel/Frame 036037/0165 →
RELEASE OF SECURITY INTEREST Recorded Nov 25, 2014
From: OBSIDIAN, LLC
To: DIALOGIC CORPORATION, F/K/A EICON NETWORKS CORPORATION; DIALOGIC INC.; DIALOGIC (US) INC., F/K/A DIALOGIC INC. AND F/K/A EICON NETWORKS INC.; DIALOGIC DISTRIBUTION LIMITED, F/K/A EICON NETWORKS DISTRIBUTION LIMITED; DIALOGIC MANUFACTURING LIMITED, F/K/A EICON NETWORKS MANUFACTURING LIMITED; DIALOGIC US HOLDINGS INC.; DIALOGIC RESEARCH INC., F/K/A EICON NETWORKS RESEARCH INC.; DIALOGIC JAPAN, INC., F/K/A CANTATA JAPAN, INC.; CANTATA TECHNOLOGY, INC.; EAS GROUP, INC.; SHIVA (US) NETWORK CORPORATION; EXCEL SWITCHING CORPORATION; EXCEL SECURITIES CORPORATION; CANTATA TECHNOLOGY INTERNATIONAL, INC.; BROOKTROUT NETWORKS GROUP, INC.; BROOKTROUT TECHNOLOGY, INC.; SNOWSHORE NETWORKS, INC.; BROOKTROUT SECURITIES CORPORATION
Reel/Frame 034468/0654 →
SUPPLEMENTAL INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 26, 2012
From: DIALOGIC INC.; DIALOGIC CORPORATION; DIALOGIC NETWORKS (ISRAEL) LTD.
To: OBSIDIAN, LLC, AS COLLATERAL AGENT
Reel/Frame 027931/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2012
From: DIALOGIC (US) INC.
To: DIALOGIC CORPORATION
Reel/Frame 027655/0039 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF THE RECEIVING PARTY IDENTIFIED PREVIOUSLY AS "DIALOGIC INC." PREVIOUSLY RECORDED ON REEL 026393 FRAME 0959. ASSIGNOR(S) HEREBY CONFIRMS THE NAME OF THE RECEIVING PARTY SHOULD READ "DIALOGIC (US) INC.". Recorded Feb 1, 2012
From: BHAGAVATHY, SITARAM; BLOOM, JEFFREY A.; ZOU, DEKUN; DING, RAN; WANG, BEIBEI; LIU, TAO; NARVEKAR, NIRANJAN
To: DIALOGIC (US) INC.
Reel/Frame 027634/0920 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2011
From: BHAGAVATHY, SITARAM; BLOOM, JEFFREY A; ZOU, DEKUN; DING, RAN; WANG, BEIBEI; LIU, TAO; NARVEKAR, NIRANJAN
To: DIALOGIC INC.
Reel/Frame 026393/0959 →