Granted Patent B2

US 12,278,960 · App. 18/531,092 · Granted Apr 15, 2025

Inventors: Santiago De Luxán Hernández (Berlin, DE); Philipp Merkle (Berlin, DE); Heiko Schwarz (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)

Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

H04N19/119H04N19/105H04N19/132H04N19/159H04N19/176H04N19/46H04N19/70

Abstract

Claims (143)

1. A method for decoding of a picture from a data stream, the method comprising:

decoding a split mode flag for a block of the picture from the data stream, wherein the block is a leaf block subdivided from a tree-root block using recursive multi-tree subdivision;

determining an intra-coding mode of the block;

in response to a determination that the split mode flag indicates a first split mode:

determining a number of partitions into which the block is partitioned, wherein a width of the partitions, measured along a partition dimension, is determined out of at least two different width settings using implicit signaling, and

sequentially reconstructing each partition of the block according to a partition order based on the intra-coding mode of the block; and

in response to a determination that the split mode flag indicates a second split mode, reconstructing the block using spatial intra prediction based on the intra-coding mode,

wherein using the spatial intra prediction for reconstructing the block, comprises:

further subdividing the block into leaf blocks of an hierarchical multi-tree subdivision of the block along horizontal and vertical subdivision leaf block borders, and

sequentially reconstructing the leaf blocks of the block according to a leaf block order which sequentially traverses the leaf blocks of the block.

2. The method of claim 1 , wherein, sequentially reconstructing each partition of the block according to the partition order when the split mode flag indicates the first split mode, comprises:

for a current partition and before proceeding with a subsequent partition:

deriving a predictor for the current partition using the intra-coding mode of the block, based on one or more already reconstructed samples neighboring the current partition; and

combining the predictor and a prediction residual of the current partition signaled in the data stream.

3. The method of claim 2 , further comprising:

decoding the prediction residual from the data stream in transform domain; and

re-transforming the prediction residual into spatial domain for combining with the predictor.

4. The method of claim 2 , further comprising:

decoding the prediction residual from the data stream in transform domain using a transform per partition,

wherein the transform is selected based on at least one of an intra prediction mode, a dedicated syntax element or a size of the partition.

5. The method of claim 1 , further comprising:

determining the width of the partitions based on the intra-coding mode.

6. The method of claim 1 , further comprising:

identifying an index represented in the data stream associated with the block, the index indicating the at least two different width settings; and

determining the width of the partitions based on the index.

7. The method of claim 1 , further comprising:

decoding a partition dimension flag for the block from the data stream, and

determining that the partition dimension is horizontal or vertical based on the partition dimension flag.

8. The method of claim 7 , further comprising:

decoding the partition dimension flag using context-dependent entropy decoding using a context, wherein the context is based on the intra-coding mode.

9. The method of claim 8 , wherein:

the context is a first context, when the intra-coding mode is a non-angular mode,

the context is a second context, when the intra-coding mode is a horizontal mode, or

the context is a third context, when the intra-coding mode is a vertical mode.

10. The method of claim 1 , further comprising:

setting the partition order depending on the intra-coding mode.

11. An apparatus for decoding of a picture from a data stream, wherein the apparatus comprises:

a processor configured to:

decode a split mode flag for a block of the picture from the data stream, wherein the block is a leaf block subdivided from a tree-root block using recursive multi-tree subdivision;

determine an intra-coding mode of the block;

in response to a determination that the split mode flag indicates a first split mode:

determine a number of partitions into which the block is partitioned, wherein a width of the partitions, measured along a partition dimension, is determined out of at least two different width settings using implicit signaling, and

sequentially reconstruct each partition of the block according to a partition order based on the intra-coding mode of the block; and

in response to a determination that the split mode flag indicates a second split mode, reconstruct the block using spatial intra prediction based on the intra-coding mode,

wherein to use the spatial intra prediction to reconstruct the block, the processor is further configured to:

further subdivide the block into leaf blocks of an hierarchical multi-tree subdivision of the block along horizontal and vertical subdivision leaf block borders, and

sequentially reconstruct the leaf blocks of the block according to a leaf block order which sequentially traverses the leaf blocks of the block.

12. The apparatus of claim 11 , wherein to sequentially reconstruct each partition of the block according to the partition order when the split mode flag indicates the first split mode, the processor is further configured to:

for a current partition and before proceeding with a subsequent partition:

derive a predictor for the current partition using the intra-coding mode of the block, based on one or more already reconstructed samples neighboring the current partition; and

combine the predictor and a prediction residual of the current partition signaled in the data stream.

13. The apparatus of claim 12 , wherein the processor is further configured to:

decode the prediction residual from the data stream in transform domain; and

re-transform the prediction residual into spatial domain for combining with the predictor.

14. The apparatus of claim 12 , wherein the processor is further configured to:

decode the prediction residual from the data stream in transform domain using a transform per partition,

wherein the transform is selected based on at least one of an intra prediction mode, a dedicated syntax element or a size of the partition.

15. The apparatus of claim 11 , wherein the processor is further configured to:

determine the width of the partitions based on the intra-coding mode.

16. The apparatus of claim 11 , wherein the processor is further configured to:

identify an index represented in the data stream associated with the block, the index indicating the at least two different width settings; and

determine the width of the partitions based on the index.

17. The apparatus of claim 11 , wherein the processor is further configured to:

decode a partition dimension flag for the block from the data stream, and

determine that the partition dimension is horizontal or vertical based on the partition dimension flag.

18. The apparatus of claim 17 , wherein the processor is further configured to:

decode the partition dimension flag using context-dependent entropy decoding using a context, wherein the context is based on the intra-coding mode.

19. The apparatus of claim 18 , wherein:

the context is a first context, when the intra-coding mode is a non-angular mode,

the context is a second context, when the intra-coding mode is a horizontal mode, or

the context is a third context, when the intra-coding mode is a vertical mode.

20. The apparatus of claim 11 , wherein the processor is further configured to:

set the partition order depending on the intra-coding mode.

21. A non-transitory computer-readable medium storing instructions that, when executed by a processor of an electronic device, cause the processor to:

decode a split mode flag for a block of a picture from a data stream, wherein the block is a leaf block subdivided from a tree-root block using recursive multi-tree subdivision;

determine an intra-coding mode of the block;

in response to a determination that the split mode flag indicates a first split mode:

determine a number of partitions into which the block is partitioned, wherein a width of the partitions, measured along a partition dimension, is determined out of at least two different width settings using implicit signaling, and

sequentially reconstruct each partition of the block according to a partition order based on the intra-coding mode of the block; and

in response to a determination that the split mode flag indicates a second split mode, reconstruct the block using spatial intra prediction based on the intra-coding mode,

wherein the instructions that when executed cause the processor to use the spatial intra prediction to reconstruct the block, comprise instructions that when executed cause the processor to:

further subdivide the block into leaf blocks of an hierarchical multi-tree subdivision of the block along horizontal and vertical subdivision leaf block borders, and

sequentially reconstruct the leaf blocks of the block according to a leaf block order which sequentially traverses the leaf blocks of the block.

22. The non-transitory computer-readable medium of claim 21 , wherein the instructions that when executed cause the processor to sequentially reconstruct each partition of the block according to the partition order when the split mode flag indicates the first split mode, comprise instructions that when executed cause the processor to:

for a current partition and before proceeding with a subsequent partition:

derive a predictor for the current partition using the intra-coding mode of the block, based on one or more already reconstructed samples neighboring the current partition; and

combine the predictor and a prediction residual of the current partition signaled in the data stream.

23. The non-transitory computer-readable medium of claim 22 , further containing instructions that when executed cause the processor to:

decode the prediction residual from the data stream in transform domain; and

re-transform the prediction residual into spatial domain for combining with the predictor.

24. The non-transitory computer-readable medium of claim 22 , further containing instructions that when executed cause the processor to:

decode the prediction residual from the data stream in transform domain using a transform per partition,

wherein the transform is selected based on at least one of an intra prediction mode, a dedicated syntax element or a size of the partition.

25. The non-transitory computer-readable medium of claim 21 , further containing instructions that when executed cause the processor to:

determine the width of the partitions based on the intra-coding mode.

26. The non-transitory computer-readable medium of claim 21 , further containing instructions that when executed cause the processor to:

identify an index represented in the data stream associated with the block, the index indicating the at least two different width settings; and

determine the width of the partitions based on the index.

27. The non-transitory computer-readable medium of claim 21 , further containing instructions that when executed cause the processor to:

decode a partition dimension flag for the block from the data stream, and

determine that the partition dimension is horizontal or vertical based on the partition dimension flag.

28. The non-transitory computer-readable medium of claim 27 , further containing instructions that when executed cause the processor to:

decode the partition dimension flag using context-dependent entropy decoding using a context, wherein the context is based on the intra-coding mode.

29. The non-transitory computer-readable medium of claim 28 , wherein:

the context is a first context, when the intra-coding mode is a non-angular mode,

the context is a second context, when the intra-coding mode is a horizontal mode, or

the context is a third context, when the intra-coding mode is a vertical mode.

30. The non-transitory computer-readable medium of claim 21 , further containing instructions that when executed cause the processor to:

set the partition order depending on the intra-coding mode.

31. A method for encoding of a picture into a data stream, the method comprising:

encoding a split mode flag for a block of the picture into the data stream, wherein the block is a leaf block subdivided from a tree-root block using recursive multi-tree subdivisioning;

determining an intra-coding mode of the block;

in response to determining that the split mode flag indicates a first split mode:

determining a number of partitions into which the block is to be partitioned,

partitioning the block of the picture into the number of partitions, wherein a width of the partitions, measured along a partition dimension, is determined out of at least two different width settings using implicit signaling, and

sequentially processing each partition of the block according to a partition order based on the intra-coding mode; and

in response to determining that the split mode flag indicates a second split mode, processing the block using spatial intra prediction based on the intra-coding mode,

wherein use the spatial intra prediction to process the block, comprises:

further subdividing the block into leaf blocks of an hierarchical multi-tree subdivision of the block along horizontal and vertical subdivision leaf block borders, and

sequentially processing the leaf blocks of the block according to a leaf block order which sequentially traverses the leaf blocks.

32. An apparatus for encoding of a picture into a data stream, wherein the apparatus comprises:

a processor configured to:

encode a split mode flag for a block of the picture into the data stream, wherein the block is a leaf block subdivided from a tree-root block using recursive multi-tree subdivisioning;

determine an intra-coding mode of the block;

in response to a determination that the split mode flag indicates a first split mode:

determine a number of partitions into which the block is to be partitioned,

partition the block of the picture into the number of partitions, wherein a width of the partitions, measured along a partition dimension, is determined out of at least two different width settings using implicit signaling, and

sequentially process each partition of the block according to a partition order based on the intra-coding mode; and

in response to a determination that the split mode flag indicates a second split mode, process the block using spatial intra prediction based on the intra-coding mode,

wherein to use the spatial intra prediction to process the block, the processor is further configured to:

further subdivide the block into leaf blocks of an hierarchical multi-tree subdivision of the block along horizontal and vertical subdivision leaf block borders, and

sequentially process the leaf blocks of the block according to a leaf block order which sequentially traverses the leaf blocks.

33. A non-transitory computer-readable medium storing instructions that, when executed by a processor of an electronic device, cause the processor to:

encode a split mode flag for a block of a picture into a data stream, wherein the block is a leaf block subdivided from a tree-root block using recursive multi-tree subdivisioning;

determine an intra-coding mode of the block;

in response to a determination that the split mode flag indicates a first split mode:

determine a number of partitions into which the block is to be partitioned,

partition the block of the picture into the number of partitions, wherein a width of the partitions, measured along a partition dimension, is determined out of at least two different width settings using implicit signaling, and

sequentially process each partition of the block according to a partition order based on the intra-coding mode; and

in response to a determination that the split mode flag indicates a second split mode, process the block using spatial intra prediction based on the intra-coding mode,

wherein the instructions that when executed cause the processor to use the spatial intra prediction to process the block, comprise instructions that when executed cause the processor to:

further subdivide the block into leaf blocks of an hierarchical multi-tree subdivision of the block along horizontal and vertical subdivision leaf block borders, and

sequentially process the leaf blocks of the block according to a leaf block order which sequentially traverses the leaf blocks.

Assignments (1)

Priority Claims (2)

Continuity (4)

References Cited (27)