IP Library Granted Patent US 11,432,015
Granted Patent B2
US 11,432,015 · App. 16/921,106 · Granted Aug 30, 2022

Adaptive loop filtering across raster-scan slices

Inventors: Nan Hu (San Diego, CA); Vadim Seregin (San Diego, CA); Adarsh Krishnan Ramasubramonian (Irvine, CA); Muhammed Zeyd Coban (Carlsbad, CA); Marta Karczewicz (San Diego, CA)
Assignee: Qualcomm Incorporated
H04N19/80H04N19/119H04N19/172H04N19/174H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,432,015
App. No.
16/921,106
Granted
Aug 30, 2022
Kind
B2
Abstract

Systems, methods, and media are provided for loop filtering across raster scan slices. One example includes obtaining data comprising one or more pictures, including obtaining a first block located in a first slice of one of the pictures. The example then includes determining a second block is located in a second slice of the picture, the second block including one or more pixels for use in performing loop filtering of a pixel of the first block, and determining that loop filtering across slice boundaries is disabled. Based on this disabling, the example determines that the one or more pixels of the second block are unavailable for performing loop filtering of the pixel of the first block, and duplicates at least one pixel of the first block or at least one pixel of an additional block of the first slice for performing loop filtering of the pixel of the first block.

Claims (68)

1. A method of processing video data, the method comprising:

obtaining video data comprising one or more pictures;

obtaining a first block of a picture from the one or more pictures, the first block being located in a first slice of the picture, wherein the first slice is a raster scan slice;

determining one or more pixels of a second block are located in a second slice of the picture, the one or more pixels for use in performing loop filtering of a pixel of the first block, wherein the second block is located diagonally adjacent to a bottom-right corner of the first block;

determining loop filtering across slice boundaries is disabled;

determining, based on the one or more pixels of the second block being located in the second slice and the loop filtering across slice boundaries being disabled, that the one or more pixels of the second block are unavailable for use in performing loop filtering of the pixel of the first block; and

duplicating, for each pixel of the one or more pixels of the second block determined to be unavailable for use in performing loop filtering of the pixel of the first block, a respective pixel of a left-neighboring block closest to the second block for use in performing loop filtering of the pixel of the first block, the left-neighboring block being located in the first slice.

2. The method of claim 1 , wherein loop filtering for the first block is performed using an adaptive loop filter (ALF).

3. The method of claim 1 , further comprising:

duplicating, for one or more pixels of an additional block determined to be unavailable for performing loop filtering of an additional pixel of the first block, one or more pixels of a top-neighboring block closest to the additional block, the top-neighboring block being located in the first slice.

4. The method of claim 1 , further comprising:

duplicating, for one or more pixels of an additional block determined to be unavailable for performing loop filtering of an additional pixel of the first block, one or more pixels of the left-neighboring block and one or more pixels of a top-neighboring block closest to the additional block, the top-neighboring block being located in the first slice.

5. The method of claim 1 , wherein the first block comprises a first coding tree unit (CTU) and the second block comprises a second CTU.

6. The method of claim 1 , wherein the first slice and the second slice are obtained from raster scan partitioning of the picture.

7. The method of claim 1 , further comprising:

generating an encoded video bitstream comprising the one or more pictures.

8. The method of claim 7 , wherein the encoded video bitstream is generated based on the video data and a result of applying at least one filter to the first block.

9. The method of claim 7 , further comprising:

sending the encoded video bitstream to a decoding device, the encoded video bitstream being sent with signaling information, the signaling information comprising at least a clip flag and an adaptive loop filter flag.

10. The method of claim 7 , further comprising:

storing the encoded video bitstream.

11. The method of claim 1 , further comprising:

obtaining an encoded video bitstream comprising the one or more pictures;

identifying signaling information associated with the encoded video bitstream, the signaling information comprising at least an adaptive loop filter flag and an indication that the loop filtering across slice boundaries is disabled; and

decoding the first block of the picture from the encoded video bitstream.

12. The method of claim 11 , wherein decoding the first block of the picture from the encoded video bitstream comprises reconstructing the first block of the picture, and further comprising applying at least one filter to the reconstructed first block.

13. An apparatus comprising:

memory; and

one or more processors coupled to the memory, the one or more processors being configured to:

obtain video data comprising one or more pictures;

obtain a first block of a picture from the one or more pictures, the first block being located in a first slice of the picture, wherein the first slice is a raster scan slice;

determine one or more pixels of a second block are located in a second slice of the picture, the second block including one or more pixels for use in performing loop filtering of a pixel of the first block, wherein the second block is located diagonally adjacent to a bottom-right corner of the first block;

determine loop filtering across slice boundaries is disabled;

determine, based on the one or more pixels of the second block being located in the second slice and the loop filtering across slice boundaries being disabled, that the one or more pixels of the second block are unavailable for use in performing loop filtering of the pixel of the first block; and

duplicate, for each pixel of the one or more pixels of the second block determined to be unavailable for use in performing loop filtering of the pixel of the first block, a respective pixel of a left-neighboring block closest to the second block for use in performing loop filtering of the pixel of the first block, the left-neighboring block being located in the first slice.

14. The apparatus of claim 13 , wherein the one or more processors are configured to:

perform loop filtering for the first block using an adaptive loop filter (ALF).

15. The apparatus of claim 13 , wherein the one or more processors are configured to:

duplicate, for one or more pixels of an additional block determined to be unavailable for performing loop filtering of an additional pixel of the first block, one or more pixels of a top-neighboring block closest to the additional block, the top-neighboring block being located in the first slice.

16. The apparatus of claim 13 , wherein the one or more processors are configured to:

duplicate, for one or more pixels of an additional block determined to be unavailable for performing loop filtering of an additional pixel of the first block, one or more pixels of the left-neighboring block and one or more pixels of a top-neighboring block closest to the additional block, the top-neighboring block being located in the first slice.

17. The apparatus of claim 13 , wherein the first block comprises a first coding tree unit (CTU) and the second block comprises a second CTU.

18. The apparatus of claim 13 , wherein the first slice and the second slice are obtained from raster scan partitioning of the picture.

19. The apparatus of claim 13 , wherein the one or more processors are configured to:

generate an encoded video bitstream comprising the one or more pictures.

20. The apparatus of claim 19 , wherein the encoded video bitstream is generated based on the video data and a result of applying at least one filter to the first block.

21. The apparatus of claim 19 , wherein the one or more processors are configured to:

store the encoded video bitstream.

22. The apparatus of claim 19 , wherein the apparatus is a mobile computing device.

23. A non-transitory computer-readable storage medium comprising instructions stored thereon which, when executed by one or more processors, cause the one or more processors to:

obtain video data comprising one or more pictures;

obtain a first block of a picture from the one or more pictures, the first block being located in a first slice of the picture, wherein the first slice is a raster scan slice;

determine one or more pixels of a second block are located in a second slice of the picture, the second block including one or more pixels for use in performing loop filtering of a pixel of the first block, wherein the second block is located diagonally adjacent to a bottom-right corner of the first block;

determine loop filtering across slice boundaries is disabled;

determine, based on the one or more pixels of the second block being located in the second slice and the loop filtering across slice boundaries being disabled, that the one or more pixels of the second block are unavailable for use in performing loop filtering of the pixel of the first block; and

duplicate, for each pixel of the one or more pixels of the second block determined to be unavailable for use in performing loop filtering of the pixel of the first block, a respective pixel of a left-neighboring block closest to the second block for use in performing loop filtering of the pixel of the first block, the left-neighboring block being located in the first slice.

24. The non-transitory computer-readable storage medium of claim 23 , further comprising instructions which, when executed by the one or more processors, cause the one or more processors to:

duplicate, for one or more pixels of an additional block determined to be unavailable for performing loop filtering of an additional pixel of the first block, one or more pixels of a top-neighboring block closest to the additional block, the top-neighboring block being located in the first slice.

25. The non-transitory computer-readable storage medium of claim 23 , further comprising instructions which, when executed by the one or more processors, cause the one or more processors to:

duplicate, for one or more pixels of an additional block determined to be unavailable for performing loop filtering of an additional pixel of the first block, one or more pixels of the left-neighboring block and one or more pixels of a top-neighboring block closest to the additional block, the top-neighboring block being located in the first slice.

26. The non-transitory computer-readable storage medium of claim 23 , wherein the first block comprises a first coding tree unit (CTU) and the second block comprises a second CTU.

27. The non-transitory computer-readable storage medium of claim 23 , wherein the first slice and the second slice are obtained from raster scan partitioning of the picture.

28. The non-transitory computer-readable storage medium of claim 23 , further comprising instructions which, when executed by the one or more processors, cause the one or more processors to:

generate an encoded video bitstream comprising the one or more pictures.

29. The non-transitory computer-readable storage medium of claim 23 , further comprising instructions which, when executed by the one or more processors, cause the one or more processors to:

obtain an encoded video bitstream comprising the one or more pictures;

identify signaling information associated with the encoded video bitstream, the signaling information comprising at least an adaptive loop filter flag and an indication that the loop filtering across slice boundaries is disabled; and

decode the first block of the picture from the encoded video bitstream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2021
From: HU, NAN; SEREGIN, VADIM; RAMASUBRAMONIAN, ADARSH KRISHNAN; COBAN, MUHAMMED ZEYD; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 055018/0235 →
Continuity (2)
Provisional Application 62873174 · Jul 11, 2019
Related Publication 20210014537A1 · Jan 14, 2021