IP Library › Granted Patent US 11,805,241
Granted Patent B2
US 11,805,241 · App. 17/035,061 · Granted Oct 31, 2023

Concept for enhancing parallel coding capabilities

Inventors: Valeri George (Berlin, DE); Tobias Hinz (Berlin, DE); Jackie Ma (Berlin, DE); Jens Brandenburg (Berlin, DE); Christian Lehmann (Berlin, DE); Adam Wieckowski (Berlin, DE); Heiko Schwarz (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE); Thomas Schierl (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
H04N19/105H04N19/117H04N19/159H04N19/176H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,805,241
App. No.
17/035,061
Granted
Oct 31, 2023
Kind
B2
Abstract

Concepts are described which enable improved suitability of a respective codec for parallel processing at encoder and/or decoder.

Claims (80)

1. An apparatus comprising:

a processor; and

a memory storing instructions that, when executed, cause the processor to:

decode coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures; and

decode, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block by:

deriving a quantization parameter predictor from a quantization parameter of one or more blocks at one or more block positions having a predetermined relative locational relationship to the predetermined block if the block positions having the predetermined relative locational relationship to the predetermined block are inside a predetermined region of the current picture in which the predetermined block is located; and

if one or more of the block positions having the predetermined relative locational relationship to the predetermined block are outside the predetermined region:

substituting, for the quantization parameter of a block at a block position outside a predetermined region of the current picture in which the predetermined block is located, a major quantization parameter signaled in the data stream for the predetermined region; or

substitutionally using, as the quantization parameter predictor, a major quantization parameter signaled in the data stream for the predetermined region.

2. The apparatus of claim 1 , wherein

block-based decoding of the pictures of the video from the coding data is performed using an in-loop or post filter, and the instructions further cause the processor to:

set a filter parametrization setting of the in-loop or post filter for a current picture dependent on the quantization parameter associated with the blocks of the current picture.

3. The apparatus of claim 1 , wherein

block-based decoding of the current picture is performed using wave front parallel processing in stripes that partition the current picture and cross the current picture in a mutually parallel manner.

4. The apparatus of claim 1 , wherein the apparatus is configured to support an alternative mode for decoding the quantization parameter and the instructions further cause the processor to derive from a signal in the data stream whether the alternative mode is used or not.

5. An apparatus comprising:

a processor; and

a memory storing instructions that, when executed, cause the processor to:

decode coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures;

decode, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block; and

derive a quantization parameter predictor from the quantization parameter of a left neighboring block, a top neighboring block and a top left neighboring block on the basis of a difference of the sum of the quantization parameter of the left and top neighboring block subtracted by the quantization parameter of the top left neighboring block and clipping the difference to not exceed a quantization parameter range spanned by the quantization parameter of the left neighboring block and the top neighboring block.

6. The apparatus of claim 5 , wherein block-based decoding of the pictures of the video from the coding data is performed using an in-loop or post filter, and the instructions further cause the processor to:

set a filter parametrization setting of the in-loop or post filter for a current picture dependent on the quantization parameter associated with the blocks of the current picture.

7. The apparatus of claim 5 , wherein block-based decoding of the current picture is performed using wave front parallel processing in stripes that partition the current picture and cross the current picture in a mutually parallel manner.

8. The apparatus of claim 5 , wherein the apparatus is configured to support an alternative mode for decoding the quantization parameter and the instructions further cause the processor to derive from a signal in the data stream whether the alternative mode is used or not.

9. An apparatus comprising:

a processor; and

a memory storing instructions that, when executed, cause the processor to:

decode coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures; and

decode, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block by:

deriving a quantization parameter predictor from a quantization parameter of a left neighboring block and a top neighboring block if the left neighboring block and the top neighboring block reside inside a predetermined region of the current picture in which the predetermined block is located;

if the left neighboring block and the top neighboring block reside outside a predetermined region of the current picture in which the predetermined block is located, substitutionally using, as the quantization parameter predictor, a major quantization parameter signaled in the data stream for the predetermined region; and

if a first block selected from the group consisting of the left neighboring block and the top neighboring block resides outside the predetermined region and a second block selected from the group consisting of the left neighboring block and the top neighboring block resides inside the predetermined region, using as the quantization parameter predictor the quantization parameter of the second block.

10. The apparatus of claim 9 , wherein block-based decoding of the pictures of the video from the coding data is performed using an in-loop or post filter, and the instructions further cause the processor to:

set a filter parametrization setting of the in-loop or post filter for a current picture dependent on the quantization parameter associated with the blocks of the current picture.

11. The apparatus of claim 9 , wherein block-based decoding of the current picture is performed using wave front parallel processing in stripes that partition the current picture and cross the current picture in a mutually parallel manner.

12. The apparatus of claim 9 , wherein the apparatus is configured to support an alternative mode for decoding the quantization parameter and the instructions further cause the processor to derive from a signal in the data stream whether the alternative mode is used or not.

13. A video decoding method, comprising:

decoding coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures; and

decoding, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block by:

deriving a quantization parameter predictor from a quantization parameter of one or more blocks at one or more block positions having a predetermined relative locational relationship to the predetermined block if the block positions having the predetermined relative locational relationship to the predetermined block are inside a predetermined region of the current picture in which the predetermined block is located; and

if one or more of the block positions having the predetermined relative locational relationship to the predetermined block are outside the predetermined region:

substituting, for the quantization parameter of a block at a block position outside a predetermined region of the current picture in which the predetermined block is located, a major quantization parameter signaled in the data stream for the predetermined region; or

substitutionally using, as the quantization parameter predictor, a major quantization parameter signaled in the data stream for the predetermined region.

14. The method of claim 13 , wherein the block-based decoding of the pictures of the video from the coding data is performed using an in-loop or post filter, the method further comprising:

set a filter parametrization setting of the in-loop or post filter for a current picture dependent on the quantization parameter associated with the blocks of the current picture.

15. The method of claim 13 , wherein block-based decoding of the current picture is performed using wave front parallel processing in stripes that partition the current picture and cross the current picture in a mutually parallel manner.

16. A video decoding method, comprising:

decoding coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures;

decoding, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block; and

deriving a quantization parameter predictor from the quantization parameter of a left neighboring block, a top neighboring block and a top left neighboring block on the basis of a difference of the sum of the quantization parameter of the left and top neighboring block subtracted by the quantization parameter of the top left neighboring block and clipping the difference to not exceed a quantization parameter range spanned by the quantization parameter of the left neighboring block and the top neighboring block.

17. The method of claim 16 , wherein block-based decoding of the pictures of the video from the coding data is performed using an in-loop or post filter, the method further comprising:

set a filter parametrization setting of the in-loop or post filter for a current picture dependent on the quantization parameter associated with the blocks of the current picture.

18. The method of claim 16 , wherein block-based decoding of the current picture is performed using wave front parallel processing in stripes that partition the current picture and cross the current picture in a mutually parallel manner.

19. A video decoding method, comprising:

decoding coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures; and

decoding, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block by:

deriving a quantization parameter predictor from a quantization parameter of a left neighboring block and a top neighboring block if the left neighboring block and the top neighboring block reside inside a predetermined region of the current picture in which the predetermined block is located;

if the left neighboring block and the top neighboring block reside outside a predetermined region of the current picture in which the predetermined block is located, substitutionally using, as the quantization parameter predictor, a major quantization parameter signaled in the data stream for the predetermined region; and

if a first block selected from the group consisting of the left neighboring block and the top neighboring block resides outside the predetermined region and a second block selected from the group consisting of the left neighboring block and the top neighboring block resides inside the predetermined region, using as the quantization parameter predictor the quantization parameter of the second block.

20. The method of claim 19 , wherein block-based decoding of the pictures of the video from the coding data is performed using an in-loop or post filter, the method further comprising:

set a filter parametrization setting of the in-loop or post filter for a current picture dependent on the quantization parameter associated with the blocks of the current picture.

21. The method of claim 19 , wherein block-based decoding of the current picture is performed using wave front parallel processing in stripes that partition the current picture and cross the current picture in a mutually parallel manner.

22. A non-transitory processor-readable medium storing a program, which when executed by a computer causes the computer to execute an image processing method, the method comprising:

decoding coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures; and

decoding, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block by:

deriving a quantization parameter predictor from a quantization parameter of one or more blocks at one or more block positions having a predetermined relative locational relationship to the predetermined block if the block positions having the predetermined relative locational relationship to the predetermined block are inside a predetermined region of the current picture in which the predetermined block is located; and

if one or more of the block positions having the predetermined relative locational relationship to the predetermined block are outside the predetermined region:

substituting, for the quantization parameter of a block at a block position outside a predetermined region of the current picture in which the predetermined block is located, a major quantization parameter signaled in the data stream for the predetermined region; or

substitutionally using, as the quantization parameter predictor, a major quantization parameter signaled in the data stream for the predetermined region.

23. A non-transitory processor-readable medium storing a program, which when executed by a computer causes the computer to execute an image processing method, the method comprising:

decoding coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures;

decoding, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block; and

deriving a quantization parameter predictor from the quantization parameter of a left neighboring block, a top neighboring block and a top left neighboring block on the basis of a difference of the sum of the quantization parameter of the left and top neighboring block subtracted by the quantization parameter of the top left neighboring block and clipping the difference to not exceed a quantization parameter range spanned by the quantization parameter of the left neighboring block and the top neighboring block.

24. A non-transitory processor-readable medium storing a program, which when executed by a computer causes the computer to execute an image processing method, the method comprising:

decoding coding data from the data stream, the coding data including pictures of a video encoded into the data stream by block-based encoding and quantization information associating a quantization parameter with each of a plurality of blocks of the pictures; and

decoding, for a predetermined block of the current picture, the quantization parameter associated with the predetermined block from the data stream using spatial prediction and in a manner independent from quantization parameters of blocks outside a spatial neighborhood that includes neighbor blocks of the picture immediately adjacent to the predetermined block by:

deriving a quantization parameter predictor from a quantization parameter of a left neighboring block and a top neighboring block if the left neighboring block and the top neighboring block reside inside a predetermined region of the current picture in which the predetermined block is located;

if the left neighboring block and the top neighboring block reside outside a predetermined region of the current picture in which the predetermined block is located, substitutionally using, as the quantization parameter predictor, a major quantization parameter signaled in the data stream for the predetermined region; and

if a first block selected from the group consisting of the left neighboring block and the top neighboring block resides outside the predetermined region and a second block selected from the group consisting of the left neighboring block and the top neighboring block resides inside the predetermined region, using as the quantization parameter predictor the quantization parameter of the second block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2020
From: GEORGE, VALERI; HINZ, TOBIAS; MA, JACKIE; BRANDENBURG, JENS; LEHMANN, CHRISTIAN; WIECKOWSKI, ADAM; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS; SCHIERL, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 054517/0010 →
Priority Claims (1)
EP 18165206 · Mar 29, 2018 · regional
Continuity (2)
Continuation PCTEP2019057900 · Mar 28, 2019
Related Publication 20210014480A1 · Jan 14, 2021