IP Library › Granted Patent US 8,654,845
Granted Patent B2
US 8,654,845 · App. 13/608,064 · Granted Feb 18, 2014

Method and device for video predictive encoding

Inventors: Pin Tao (Shenzhen, CN); Wenting Wu (Shenzhen, CN); Mou Xiao (Shenzhen, CN); Jiangtao Wen (Shenzhen, CN); Chenchen Gu (Shenzhen, CN); Jing Lv (Shenzhen, CN); Fuzhong Sheng (Shenzhen, CN)
Assignees: Tencent Technology (Shenzhen) Company Limited; Tsinghua University
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,654,845
App. No.
13/608,064
Granted
Feb 18, 2014
Kind
B2
Abstract

The invention provides a method and device for video predictive encoding.

Claims (105)

1. A method for video predictive encoding, comprising:

extracting a pixel block from current frame, dividing the pixel block into a principal set of pixels and a complementary set of pixels;

encoding the principal set of pixels, outputting code stream of the principal set of pixels, obtaining a reconstruction value of the principal set of pixels;

interpolating to reconstructed pixel values, which comprise the reconstruction value of the principal set of pixels, take a result as predictive value of the complementary set of pixels, executing an intra-frame predictive encoding for the complementary set of pixels, outputting code stream of the complementary set of pixels, obtaining a reconstruction value of the complementary set of pixels; and

combining the reconstruction value of the principal set of pixels and the reconstruction value of the complementary set of pixels, and obtaining a reconstruction value of the pixel block;

wherein encoding the principal set of pixels comprises:

determining type of current frame, when current frame is an I frame, employing an H.264 or an Advanced Video Coding (AVC) direction prediction algorithm to encode the principal set of pixels, when current frame is a P frame or B frame, employing the H.264 or AVC direction prediction algorithm, or employing an inter-frame motion search algorithm to encode the principal set of pixels.

2. The method according to claim 1 , wherein the reconstructed pixel values are the reconstruction value of the principal set of pixels.

3. The method according to claim 1 , wherein the reconstructed pixel values comprise the reconstruction value of the principal set of pixels, and reconstruction value of other pixel block except for the pixel block.

4. The method according to claim 1 , wherein interpolating to the reconstructed pixel values, which comprise the reconstruction value of the principal set of pixels, take the result as the predictive value of the complementary set of pixels, and executing the intra-frame predictive encoding for the complementary set of pixels comprise:

categorizing each pixel in the complementary set of pixels, according to location of the each pixel in the complementary set of pixels, putting pixels with adjacent information of same familiar degree into one category;

for the complementary set of pixels in each category, respectively interpolating to all the reconstructed pixel values, which comprise the reconstruction value of the principal set of pixels, the reconstruction value of the reconstructed complementary set of pixels and reconstructed pixel value of other pixel block, obtaining the predictive value, and executing the intra-frame predictive encoding of hierarchical structure.

5. The method according to claim 4 , wherein interpolating to all the reconstructed pixel values, which comprise the reconstruction value of the principal set of pixels, the reconstruction value of the reconstructed complementary set of pixels and the reconstructed pixel value of other pixel block, obtaining the predictive value, and executing the intra-frame predictive encoding of hierarchical structure comprise:

utilizing a 6 tap filter of the H.264 or AVC to interpolate to all the reconstructed pixel values, taking the result as the predictive value of the complementary set of pixels in each category.

6. The method according to claim 5 , wherein the principal set of pixels is an even Macro Block (MB), the complementary set of pixels is an odd MB, for any pixel X of the odd MB, predictive value XPrediction is:

X Prediction =round(( A reconstruction −5 B reconstruction +20 C reconstruction +20 D reconstruction −5 E reconstruction +F reconstruction )/32);

wherein the round is a function, which indicates to round towards nearest integer;

the C reconstruction is a reconstruction value of a reconstructed pixel C nearest to left of the pixel X;

the B reconstruction is a reconstruction value of a reconstructed pixel B next-nearest to the left of the pixel X;

the A reconstruction is a reconstruction value of a reconstructed pixel A third-nearest to the left of the pixel X;

the D reconstruction is a reconstruction value of a reconstructed pixel D nearest to right of the pixel X;

the E reconstruction is a reconstruction value of a reconstructed pixel E next-nearest to the right of the pixel X; and

the F reconstruction is a reconstruction value of a reconstructed pixel F third-nearest to the right of the pixel X.

7. The method according to claim 1 , wherein extracting the pixel block from current frame, dividing the pixel block into the principal set of pixels and the complementary set of pixels comprise:

dividing the pixel block into the principal set of pixels and the complementary set of pixels, according to the sampling mode of every other row and every other column;

wherein width and height of the principal set of pixels are respectively m, n, m and n comply with the following formula,

m

=

⌊

M

-

c

T

c

⌋

+

1

,

n

=

⌊

N

-

r

T

r

⌋

+

1

;

function └ ┘ indicates to round towards minus infinity;

M and N are respectively width and height of the pixel block;

T c is a column sampling period, T r is a row sampling period, T r is a non-zero integer, T r ≦N; T c is a non-zero integer, T c ≦M, T r ·T c ≠1;

r is a row number indicating first line of the principal set of pixels in the pixel block, r=1, . . . , T r ; c is a column number indicating first column of the principal set of pixels in the pixel block, c=1, . . . , T c .

8. The method according to claim 1 , wherein the pixel block is a luminance block or a chrominance block.

9. The method according to claim 1 , wherein dividing the pixel block into the principal set of pixels and the complementary set of pixels comprises:

dividing the pixel block into the principal set of pixels and the complementary set of pixels, according to a sampling mode of every other row and every other column, a board sampling mode, or a class board sampling mode.

10. A device for video predictive encoding, wherein the device comprises a pixel dividing unit, a unit for encoding a principal set of pixels, a unit for encoding a complementary set of pixels, and a unit for combining reconstruction value of pixel block;

the pixel dividing unit is to extract a pixel block from current frame, divide the pixel block into a principal set of pixels and a complementary set of pixels;

the unit for encoding a principal set of pixels is to encode the principal set of pixels, output code stream of the principal set of pixels, and obtain a reconstruction value of the principal set of pixels;

the unit for encoding a complementary set of pixels is to interpolate to reconstructed pixel values, which comprise the reconstruction value of the principal set of pixels, take a result as predictive value of the complementary set of pixels, execute an intra-frame predictive encoding for the complementary set of pixels, output code stream of the complementary set of pixels, and obtain a reconstruction value of the complementary set of pixels; and

the unit for combining reconstruction value of pixel block is to, combine the reconstruction value of the principal set of pixels and the reconstruction value of the complementary set of pixels, and obtain a reconstruction value of the pixel block;

wherein the unit for encoding a principal set of pixels is to determine type of current frame, when current frame is an I frame, employ an H.264 or an Advanced Video Coding (AVC) direction prediction algorithm to encode; when current frame is a P frame or B frame, employ the H.264 or AVC direction prediction algorithm or an inter-frame motion search algorithm to encode.

11. The device according to claim 10 , wherein the unit for encoding a complementary set of pixels is to categorize each pixel in the complementary set of pixels, according to location of the each pixel in the complementary set of pixels, put pixels with adjacent information of same familiar degree into one category, for the complementary set of pixels in each category, interpolate to all the reconstructed pixel values, which comprise the reconstruction value of the principal set of pixels, reconstruction value of the reconstructed complementary set of pixels, and reconstructed pixel value of other pixel block, obtain a predictive value, and execute an intra-frame predictive encoding of hierarchical structure.

12. The device according to claim 10 , wherein the unit for encoding a complementary set of pixels comprises a 6 tap filter of the H.264 or AVC, which is to interpolate to all the reconstructed pixel values and take the result as predictive value of the complementary set of pixel in each category.

13. The device according to claim 12 , wherein the principal set of pixels is an even Macro Block (MB), the complementary set of pixels is an odd MB;

for any pixel X of the odd MB, predictive value X Prediction is:

X Prediction =round(( A reconstruction −5 B reconstruction +20 C reconstruction +20 D reconstruction −5 E reconstruction +F reconstruction )/32);

the round is a function, which indicates to round towards nearest integer;

the C reconstruction is a reconstruction value of a reconstructed pixel C nearest to left of the pixel X;

the B reconstruction is a reconstruction value of a reconstructed pixel B next-nearest to the left of the pixel X;

the A reconstruction is a reconstruction value of a reconstructed pixel A third-nearest to the left of the pixel X;

the D reconstruction is a reconstruction value of a reconstructed pixel D nearest to right of the pixel X;

the E reconstruction is a reconstruction value of a reconstructed pixel E next-nearest to the right of the pixel X; and

the F reconstruction is a reconstruction value of a reconstructed pixel F third-nearest to the right of the pixel X.

14. The device according to claim 10 , wherein the pixel dividing unit is to divide the pixel block into the principal set of pixels and the complementary set of pixel, according to a sampling mode of every other row and every other column, width and height of the principal set of pixels are respectively m and n, m and n comply with the following formula,

m

=

⌊

M

-

c

T

c

⌋

+

1

,

n

=

⌊

N

-

r

T

r

⌋

+

1

;

function └ ┘ indicates to round towards minus infinity;

M and N are respectively width and height of the pixel block;

T c is a column sampling period, T r is a row sampling period, T r is a non-zero integer, T r ≦N; T c is a non-zero integer, T c ≦M, T r ·T c ≠1;

r is a row number indicating first line of the principal set of pixels in the pixel block, r=1, . . . , T r ; c is a column number indicating first column of the principal set of pixels in the pixel block, c=1, . . . , T c .

15. The device according to claim 10 , wherein the pixel dividing unit is to divide the pixel block into the principal set of pixels and the complementary set of pixels, according to a sampling mode of every other row and every other column or a board sampling mode.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2012
From: TAO, PIN; WU, WENTING; XIAO, MOU; WEN, JIANGTAO; GU, CHENCHEN; LV, JING; SHENG, FUZHONG
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED; TSINGHUA UNIVERSITY
Reel/Frame 028925/0740 →
Priority Claims (1)
CN 2010 1 0123950 · Mar 12, 2010 · national
Continuity (2)
Continuation PCTCN2011071611 · Mar 8, 2011
Related Publication 20130051468A1 · Feb 28, 2013