IP Library Granted Patent US 8,139,651
Granted Patent B2
US 8,139,651 · App. 12/788,210 · Granted Mar 20, 2012

Video deblocking filter

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,139,651
App. No.
12/788,210
Granted
Mar 20, 2012
Kind
B2
Abstract

Deblocking filters are disclosed, where the nature of the filter is determined based upon the level of detail of a reconstructed video frame in the region in which the block boundary is located. One embodiment of the method of the invention includes identifying a boundary between two blocks of the reconstructed video frame, determining the level of detail of the reconstructed video frame in a region in which the block boundary is located, wherein the region includes pixels from multiple rows and multiple columns of the reconstructed video frame and includes at least one pixel that is not immediately adjacent the block boundary and selecting a filter to apply to predetermined pixels on either side of the block boundary based upon the determined level of detail.

Claims (223)

1. A method of deblocking a reconstructed video frame, comprising:

identifying a boundary between two blocks of the reconstructed video frame;

determining the level of detail of the reconstructed video frame across a region in which the block boundary is located, wherein the region includes pixels from multiple rows and multiple columns of the reconstructed video frame that encompass pixels immediately adjacent to at least two sides of the block boundary and includes at least one pixel that is not immediately adjacent to the block boundary;

selecting a filter to apply to predetermined pixels on either side of the block boundary based upon the determined level of detail.

2. The method of claim 1 , wherein the determination of the level of detail of the reconstructed video frame in a region in which the block boundary is located further comprises taking the sum of the absolute difference of at least some of the pixels within a set of pixels surrounding the block boundary.

3. The method of claim 2 , wherein:

the block boundary is a horizontal block boundary;

the set of pixels is a block of pixels that is divided by the horizontal block boundary;

the sum of the absolute difference is taken for each vertically adjacent pair of pixels in each column of the block of pixels, except the pair of pixels that are separated by the block boundary.

4. The method of claim 2 , wherein the set of pixels is an 8×8 block that is evenly divided by the horizontal block boundary.

5. The method of claim 4 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

+

1

,

j

-

v

i

,

j

,

where i=1 to 7 and i≠4, j=1 to 8:

where:

v i,j is the chrominance of a pixel in row i and column j of the 8×8 block of pixels.

6. The method of claim 4 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

+

1

,

j

-

v

i

,

j

,

where

i=1 to 7 and i≠4, j=1 to 8:

where:

v i,j is the luminance of a pixel in row i and column j of the 8×8 block of pixels.

7. The method of claim 3 , wherein the set of pixels is a 4×8 block that is evenly divided by the horizontal block boundary.

8. The method of claim 7 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

+

1

,

j

-

v

i

,

j

,

where

i=1 to 7 and i≠4, j=1 to 4:

where:

v i,j is the chrominance of a pixel in row i and column j of the 4×8 block of pixels.

9. The method of claim 7 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

+

1

,

j

-

v

i

,

j

,

where i=1 to 7 and i=4, j=1 to 4:

where:

v i,j is the luminance of a pixel in row i and column j of the 4×8 block of pixels.

10. The method of claim 2 , wherein:

the block boundary is a vertical block boundary;

the set of pixels is a block of pixels that is divided by the vertical block boundary;

the sum of the absolute difference is taken for each adjacent pair of pixels in each row of the block of pixels, except the pair of pixels that are separated by the block boundary.

11. The method of claim 10 , wherein the set of pixels is an 8×8 block that is evenly divided by the vertical block boundary.

12. The method of claim 11 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

,

j

+

1

-

v

i

,

j

,

where

i=1 to 8, j=1 to 7 and j≠4:

where:

v i,j is the chrominance of a pixel in row i and column j of the 8×8 block of pixels.

13. The method of claim 11 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

,

j

+

1

-

v

i

,

j

,

where i=1 to 8, j=1 to 7 and j≠4:

where:

v i,j is the luminance of a pixel in row i and column j of the 8×8 block of pixels.

14. The method of claim 10 , wherein the set of pixels is an 8×4 block that is evenly divided by the vertical block boundary.

15. The method of claim 14 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

,

j

+

1

-

v

i

,

j

,

where i=1 to 4, j=1 to 7 and j≠4:

where:

v i,j is the chrominance of a pixel in row i and column j of the 8×4 block of pixels.

16. The method of claim 14 , wherein the determination of the level of detail involves calculating the following sum:

i

j

v

i

,

j

+

1

-

v

i

,

j

,

where i=1 to 4, j=1 to 7 and j≠4:

where:

v i,j is the luminance of a pixel in row i and column j of the 8×4 block of pixels.

17. The method of claim 1 , wherein selecting a filter to apply to predetermined pixels on either side of the block boundary based upon the determination of the level of detail comprises comparing the determined level of detail to a threshold.

18. The method of claim 17 , wherein the threshold varies depending upon the quantizer used in the encoding of the blocks at the block boundary.

19. The method of claim 17 , wherein selecting a filter to apply to predetermined pixels on either side of the block boundary based upon the determination of the level of detail further comprises:

when the level of detail exceeds the threshold, selecting a filter to apply to predetermined pixels;

wherein selection of a filter comprises determining the detail of the image in the region of the pixels being filtered.

20. The method of claim 19 , wherein:

the block boundary is a horizontal block boundary; and

determining the detail of the image in the region of the pixels being filtered comprises calculating the following expression with respect to a column of pixels divided by the horizontal block boundary:

(|v −2 -v −1 |*3+|v −1 -v 1 |*2+|v 1 -v 2 |*3)//8

where:

v i is the chrominance of the pixel i pixels from the horizontal block boundary.

Assignments (8)
CHANGE OF PRINCIPAL PLACE OF BUSINESS Recorded Feb 28, 2019
From: DIVX, LLC
To: DIVX, LLC
Reel/Frame 050096/0715 →
CHANGE OF NAME Recorded Mar 5, 2018
From: DIVX CF HOLDINGS LLC
To: DIVX, LLC
Reel/Frame 045498/0560 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2018
From: SONIC IP, INC.; DIVX, LLC
To: DIVX CF HOLDINGS LLC
Reel/Frame 045310/0020 →
PATENT RELEASE Recorded Jul 22, 2014
From: JPMORGAN CHASE BANK N.A., AS COLLATERAL AGENT
To: ALL MEDIA GUIDE, LLC; DIVX, LLC; SONIC SOLUTIONS LLC
Reel/Frame 033378/0685 →
RELEASE OF SECURITY INTEREST Recorded Apr 9, 2014
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: DIVX, LLC
Reel/Frame 032645/0559 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2013
From: DIVX, LLC
To: SONIC IP, INC.
Reel/Frame 031713/0032 →
MERGER Recorded Feb 13, 2012
From: DIVX, INC.
To: DIVX, LLC
Reel/Frame 027693/0864 →
SECURITY AGREEMENT Recorded Mar 25, 2011
From: ALL MEDIA GUIDE, LLC; DIVX, LLC; SONIC SOLUTIONS LLC
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 026026/0111 →