IP Library › Granted Patent US 11,949,859
Granted Patent B2
US 11,949,859 · App. 17/686,817 · Granted Apr 2, 2024

Reusing adaptive loop filter (ALF) sub-picture boundary processing for raster-scan slice boundaries

Inventors: Nan Hu (San Diego, CA); Vadim Seregin (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/117H04N19/136H04N19/174H04N19/176H04N19/182H04N19/46H04N19/86H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,949,859
App. No.
17/686,817
Granted
Apr 2, 2024
Kind
B2
Abstract

Systems, methods, and media are provided for loop filtering across raster scan slices. One example includes obtaining the video data comprising one or more pictures and a first block of a picture having a pixel subject to filtering. A second block is determined to be located in the first slice in a particular relation to the second block. A third block that includes pixels for filtering the pixel is determined to be in a second slice at a diagonal corner of the first block, with filtering across slice boundaries disabled. First one or more pixels of the second block are identified as available for performing loop filtering of the pixel and second one or more pixels of the third block identified as unavailable for performing the loop filtering of the pixel of the first block. The first one or more pixels and the second one or more pixels are padded.

Claims (64)

1. A method of processing video data, the method comprising:

obtaining the video data comprising one or more pictures;

obtaining a first block of a picture from the one or more pictures, the first block being located in a first slice of the picture;

determining that a second block is located at a top-left corner of the first block in a second slice of the picture, the second block including one or more pixels for use in performing loop filtering of a pixel of the first block;

determining that loop filtering across slice boundaries is disabled;

determining, based on the second block being located in the second slice and the loop filtering across slice boundaries being disabled, that the one or more pixels of the second block are unavailable for performing the loop filtering of the pixel of the first block; and

based on the one or more pixels of the second block being unavailable for performing the loop filtering of the pixel of the first block, using pixels of a third block of the first slice to replace the one or more pixels of the second block for performing the loop filtering of the pixel of the first block based on a converted slice boundary generated at a left border of the first block using a function modifying a variable associated with a left vertical boundary position.

2. The method of claim 1 , wherein the third block neighbors a top horizontal boundary of the first block.

3. The method of claim 1 , wherein the loop filtering for the first block is performed using an adaptive loop filter (ALF).

4. The method of claim 1 , wherein the pixels of the first block are positioned symmetrically about the one or more pixels.

5. The method of claim 1 , wherein the first slice is a raster scan slice.

6. The method of claim 1 , wherein the first block comprises a first coding tree unit (CTU).

7. The method of claim 1 , wherein the first slice and the second slice are obtained from raster scan partitioning of the picture.

8. The method of claim 1 , further comprising:

generating an encoded video bitstream comprising the one or more pictures.

9. The method of claim 8 , wherein the encoded video bitstream is generated based on the video data and a result of applying at least one filter to the first block.

10. The method of claim 8 , further comprising:

sending the encoded video bitstream to a decoding device, the encoded video bitstream being sent with signaling information, the signaling information comprising at least a clip flag and an adaptive loop filter flag.

11. The method of claim 8 , further comprising:

storing the encoded video bitstream.

12. The method of claim 1 , further comprising:

obtaining an encoded video bitstream comprising the one or more pictures;

identifying signaling information associated with the encoded video bitstream, the signaling information comprising at least an adaptive loop filter flag and an indication that the loop filtering across slice boundaries is disabled; and

decoding the first block of the picture from the encoded video bitstream.

13. The method of claim 12 , wherein decoding the first block of the picture from the encoded video bitstream comprises reconstructing the first block of the picture to generate a reconstructed first block, and further comprising applying at least one filter to the reconstructed first block.

14. The method of claim 1 , wherein padding the one or more pixels includes duplicating the pixels of the third block of the first slice to replace the one or more pixels with padded pixels.

15. An apparatus for processing video data, comprising:

at least one memory; and

at least one processor coupled to the at least one memory, the at least one processor being configured to:

obtain the video data comprising one or more pictures;

obtain a first block of a picture from the one or more pictures, the first block being located in a first slice of the picture;

determine that a second block is located at a top-left corner of the first block in a second slice of the picture, the second block including one or more pixels for use in performing loop filtering of a pixel of the first block;

determine that loop filtering across slice boundaries is disabled;

determine, based on the second block being located in the second slice and the loop filtering across slice boundaries being disabled, that the one or more pixels of the second block are unavailable for performing the loop filtering of the pixel of the first block; and

based on the one or more pixels of the second block being unavailable for performing the loop filtering of the pixel of the first block, use pixels of a third block of the first slice to replace the one or more pixels of the second block for performing the loop filtering of the pixel of the first block based on a converted slice boundary generated at a left border of the first block using a function modifying a variable associated with a left vertical boundary position.

16. The apparatus of claim 15 , wherein the third block neighbors a top horizontal boundary of the first block.

17. The apparatus of claim 15 , wherein the at least one processor is configured to perform the loop filtering for the first block using an adaptive loop filter (ALF).

18. The apparatus of claim 15 , wherein the pixels of the first block are positioned symmetrically about the one or more pixels.

19. The apparatus of claim 15 , wherein the first slice is a raster scan slice.

20. The apparatus of claim 15 , wherein the first block comprises a first coding tree unit (CTU).

21. The apparatus of claim 15 , wherein the first slice and the second slice are obtained from raster scan partitioning of the picture.

22. The apparatus of claim 15 , wherein the at least one processor is configured to:

generate an encoded video bitstream comprising the one or more pictures.

23. The apparatus of claim 22 , wherein the at least one processor is configured to generate the encoded video bitstream based on the video data and a result of applying at least one filter to the first block.

24. The apparatus of claim 22 , wherein the at least one processor is configured to:

send the encoded video bitstream to a decoding device with signaling information, the signaling information comprising at least a clip flag and an adaptive loop filter flag.

25. The apparatus of claim 22 , wherein the at least one processor is configured to:

output the encoded video bitstream for storage in the at least one memory.

26. The apparatus of claim 15 , wherein the at least one processor is configured to:

obtain an encoded video bitstream comprising the one or more pictures;

identify signaling information associated with the encoded video bitstream, the signaling information comprising at least an adaptive loop filter flag and an indication that the loop filtering across slice boundaries is disabled; and

decode the first block of the picture from the encoded video bitstream.

27. The apparatus of claim 26 , wherein:

to decode the first block of the picture from the encoded video bitstream, the at least one processor is configured to reconstruct the first block of the picture to generate a reconstructed first block; and

the at least one processor is configured to apply at least one filter to the reconstructed first block.

28. The apparatus of claim 15 , wherein, to pad the one or more pixels, the at least one processor is configured to duplicate the pixels of the third block of the first slice to replace the one or more pixels with padded pixels.

29. A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:

obtain video data comprising one or more pictures;

obtain a first block of a picture from the one or more pictures, the first block being located in a first slice of the picture;

determine that a second block is located at a top-left corner of the first block in a second slice of the picture, the second block including one or more pixels for use in performing loop filtering of a pixel of the first block;

determine that loop filtering across slice boundaries is disabled;

determine, based on the second block being located in the second slice and the loop filtering across slice boundaries being disabled, that the one or more pixels of the second block are unavailable for performing the loop filtering of the pixel of the first block; and

based on the one or more pixels of the second block being unavailable for performing the loop filtering of the pixel of the first block, use pixels of a third block of the first slice to replace the one or more pixels of the second block for performing the loop filtering of the pixel of the first block based on a converted slice boundary generated at a left border of the first block using a function modifying a variable associated with a left vertical boundary position.

30. The non-transitory computer-readable medium of claim 29 , wherein the third block neighbors a top horizontal boundary of the first block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2024
From: HU, NAN; SEREGIN, VADIM; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 066756/0924 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2022
From: HU, NAN; SEREGIN, VADIM; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 060041/0096 →
Continuity (4)
Continuation 17006087 · Aug 28, 2020
Provisional Application 62907552 · Sep 27, 2019
Provisional Application 62896501 · Sep 5, 2019
Related Publication 20220279177A1 · Sep 1, 2022