IP Library Granted Patent US 8,184,164
Granted Patent B2
US 8,184,164 · App. 11/793,546 · Granted May 22, 2012

Method for measuring multimedia video communication quality

Assignee: Huawei Technologies Co., Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,184,164
App. No.
11/793,546
Granted
May 22, 2012
Kind
B2
Abstract

A method for measuring multimedia communication quality is disclosed. The multimedia video communication quality may be objectively reflected through the embedment and extraction of digital watermark under a precondition that the quality of the multimedia video data is not obviously affected. In the invention, each frame of the multimedia video data is uniformly divided into blocks of equal size and watermark data is embedded in each of the blocks, so that the watermark may be uniformly distributed. The multimedia video data are divided into groups, and the watermark is embedded in a part of the frames with equal interval between the frames in each group to reduce the effect of the watermark on the data. The watermark information is directly embedded in the spatial domain of the original video data. The PSNR of the video data is linearly fitted using the accuracy rate of the recovered watermark relative to the original watermark, and the fitted PSNR is regarded as a measurement indication of the multimedia video communication quality. Post-processing such as smoothing filtering is performed on video frames after watermark extraction to eliminate the effect of the watermark on the multimedia video data quality.

Claims (208)

1. A method for measuring multimedia video communication quality, comprising:

uniformly dividing the multimedia video data frames into blocks of equal size;

embedding an equal amount of the original watermark data in a part of the blocks or all of the blocks at a transmitting side;

transmitting the multimedia video data to a receiving side;

extracting a recovered watermark from the received multimedia video data at the receiving side; and

calculating a distortion degree of the recovered watermark relative to the original watermark,

wherein uniformly dividing the multimedia video data frames into blocks of equal size, and embedding an equal amount of the original watermark data in a part of the blocks or all of the blocks at a transmitting side comprises: dividing the multimedia video data into groups at the transmitting side, each group comprising an equal number of frames, and selecting at least two frames with an equal interval in a same group as embedded frames, uniformly dividing each of the embedded frame into a plurality of blocks of equal size, selecting an equal number of blocks from the plurality of blocks as embedded blocks, and embedding an equal amount of the original watermark data in each of the embedded blocks.

2. The method of claim 1 , further comprising: performing compression coding or data packaging or framing at the transmitting side, and transmitting the data to the receiving side.

3. A method for measuring multimedia video communication quality, comprising:

uniformly dividing the multimedia video data frames into blocks of equal size;

embedding an equal amount of the original watermark data in a part of the blocks or all of the blocks at a transmitting side;

transmitting the multimedia video data to a receiving side;

extracting a recovered watermark from the received multimedia video data at the receiving side; and

calculating a distortion degree of the recovered watermark relative to the original watermark,

wherein each multimedia video data frame comprises M rows×N columns pixels in which the M rows are numbered from 0 to M−1 and the N columns are numbered from 0 to N−1, and uniformly dividing a multimedia video data frame into blocks of equal size comprises:

dividing each multimedia video data frame into m strips numbered from 0 to m−1, the strip i(i=0, 1, . . . , m−2) comprising pixels from row i×k v to row (i+1)×K v −1, and the strip m−1 comprising pixels from row (m−1)×k v to row M−1, wherein m is a minimum integer greater than or equal to M/k v ; if m=M/K v , the strip m−1 comprising zero row of pixels;

dividing the strip i(i=0, 1, . . . , m−1) into n blocks numbered from i×n to (i+1)×n−1, the block i×n+j(0, 1, . . . ,n−2) comprising pixels from column j×k h to column (j+1)×k h −1 of this strip, and the block n−1 comprising pixels from column (n−1)×k h to column N−1, wherein n is a minimum integer greater than or equal to N/k h ; if n=N/k h , the strip n−1 comprising zero column of pixels; and

embedding an equal amount of the original watermark data in each of the obtained m×n blocks.

4. The method of claim 1 , wherein each frame of the multimedia video data is uniformly divided into L blocks numbered from 0 to L−1, and the embedding the original watermark further comprises:

dividing a frame sequence into groups, each group comprising P×Q frames, which sequentially are frame 0 to frame P×Q−1 of the group;

selecting a frame q×P(q=0, . . . ,Q−1) of each group as the embedded frame;

selecting a block q+r×Q(r=0, . . . ,R−1,and q+r×Q≦L) of the embedded frame q×P(q=0, . . . ,Q−1) as the embedded block, wherein R is a maximum integer less than or equal to L/Q ; and

embedding an equal amount of the original watermark data in all the embedded blocks of the group.

5. A method for measuring multimedia video communication quality, comprising:

uniformly dividing the multimedia video data frames into blocks of equal size;

embedding an equal amount of the original watermark data in a part of the blocks or all of the blocks at a transmitting side;

transmitting the multimedia video data to a receiving side;

extracting a recovered watermark from the received multimedia video data at the receiving side;

calculating a distortion degree of the recovered watermark relative to the original watermark; and

determining a bit number of the original watermark data embedded in a part of the blocks or all of the blocks according to the size of the data block,

wherein embedding 1-bit data of the original watermark in the multimedia video data block comprises:

calculating an average value μ of the multimedia video data block according to pixels;

modifying a value of each pixel in the multimedia video data block according to b′=b+c , wherein b′ is a modified value of a pixel, b is a value of the pixel before modification, and c is a modification amount,

wherein the modification amount is calculated according to the following formula:

when the original watermark data bit is 1,

c

=

{

-

A

/

2

-

γ

(

0

γ

<

A

/

2

)

3

A

/

2

-

γ

(

A

/

2

γ

<

3

A

/

2

)

3

A

/

2

-

γ

(

3

A

/

2

γ

<

2

A

)

when the original watermark data bit is 0,

c

=

{

A

/

2

-

γ

(

0

γ

<

A

/

2

)

A

/

2

-

γ

(

A

/

2

γ

<

3

A

/

2

)

5

A

/

2

-

γ

(

3

A

/

2

γ

<

2

A

)

,

 and

wherein γ is a remainder of μ being divided by 2A , A represents an embedding strength and is equal to 2×Q P −1, and Q P represents a quantization factor for the multimedia video communication compression coding.

6. A method for measuring multimedia video communication quality, comprising:

uniformly dividing the multimedia video data frames into blocks of equal size;

embedding an equal amount of the original watermark data in a part of the blocks or all of the blocks at a transmitting side;

transmitting the multimedia video data to a receiving side;

extracting a recovered watermark from the received multimedia video data at the receiving side; and

calculating a distortion degree of the recovered watermark relative to the original watermark; and

determining a bit number of the original watermark data embedded in a part of the blocks or all of the blocks according to the size of the data block,

wherein extracting a data bit of the recovered watermark from the received multimedia video data block comprises:

calculating an average value μ′ of the received multimedia video data block according to pixels; and

calculating extracted data w′ of the recovered watermark according to the following formula:

w

=

{

0

(

0

γ

<

A

)

1

(

A

γ

<

2

A

)

,

 and

wherein γ′ is a remainder of μ′ being divided by 2A , A represents an embedding strength and is equal to 2×Q P− 1, and Q P represents a quantization factor for the multimedia video communication compression coding.

7. The method of claim 1 , further comprising: calculating a Peak Signal-to-Noise Ratio using a Pixel Recovery Rate of the recovered watermark relative to the original watermark to measure objective quality of the multimedia video communication.

8. The method of claim 7 , wherein the calculating a Peak Signal-to-Noise Ratio using a Pixel Recovery Rate of the recovered watermark relative to the original watermark to measure objected quality of the multimedia video communication comprises: fitting to obtain an estimated value of the Peak Signal-to-Noise Ratio using a linear function of the Pixel Recovery Rate of the recovered watermark relative to the original watermark based on statistic data of a multimedia video communication experiment and according to a Mean Square Error criterion to measure the objective quality of the multimedia video communication.

9. The method of claim 1 , wherein calculating the distortion degree of the recovered watermark relative to the original watermark measures the objective quality of the multimedia video communication.

10. The method of claim 9 , wherein the calculating the distortion degree of the recovered watermark relative to the original watermark comprises: calculating the distortion degree of the recovered watermark relative to the original watermark using the Pixel Recovery Rate of the recovered watermark relative to the original watermark.

11. The method of claim 1 , further comprising: on extracting the recovered watermark, post-processing the received multimedia video data to eliminate effect of the watermark embedment, wherein the post-processing comprises one of the following: smoothing filtering, median filtering, neural network filtering, mathematical morphology filtering and filtering based on fuzzy mathematics methods.

12. The method of claim 1 , further comprising: determining the original watermark, relevant parameters and a step for embedding the original watermark and extracting the recovered watermark through a communication negotiation between the transmitting side and the receiving side.

13. The method of claim 1 , further comprising: determining the original watermark, the relevant parameters and the strategy for embedding the original watermark and extracting the recovered watermark at the transmitting side, and informing the receiving side before communication.

14. The method of claim 2 , wherein for a color image, the original watermark is embedded in a luminance component of the original multimedia data, and wherein for a multi-channel image, the original watermark is embedded in one or more channels of the original multi-channel image data.

15. The method of claim 1 , wherein the original watermark is a bi-level image.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
SECURITY INTEREST Recorded Jun 29, 2018
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC
Reel/Frame 046486/0433 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2016
From: HUAWEI TECHNOLOGIES CO., LTD.
To: RPX CORPORATION
Reel/Frame 040124/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2007
From: YANG, FUZHENG; LUO, ZHONG; WAN, SHUAI; CHANG, YILIN
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 019512/0268 →
Priority Claims (1)
CN 2005 1 0035566 · Jun 25, 2005 · national
Continuity (1)
Related Publication 20080273861A1 · Nov 6, 2008