Granted Patent B2

US 12,284,368 · App. 18/333,152 · Granted Apr 22, 2025

Inventors: Philipp Merkle (Berlin, DE); Christian Bartnik (Berlin, DE); Haricharan Lakshman (Berlin, DE); Detlev Marpe (Berlin, DE); Karsten Mueller (Berlin, DE); Thomas Wiegand (Berlin, DE); Gerhard Tech (Berlin, DE)

Assignee: Dolby Video Compression, LLC

H04N19/176H04N19/105H04N19/119H04N19/126H04N19/157H04N19/196H04N19/46H04N19/593H04N19/597H04N19/61H04N19/70H04N19/82H04N19/96H04N19/14

Abstract

Claims (52)

1. A decoder for reconstructing a sample array of a video from a data stream, the decoder configured to:

obtain a set of wedgelet patterns to decode a block of the sample array of the video, wherein each wedgelet pattern of the set represents division of the block into two wedgelet portions separated by a line represented by the respective wedgelet pattern, and wherein to generate the set, a processor is configured to:

determine whether a first wedgelet pattern is identical or inverse identical to a second wedgelet pattern already in the set, and

responsive to a determination that the first wedgelet pattern is not identical or inverse identical to the second wedgelet pattern, insert the first wedgelet pattern in the set;

extract, from the data stream, an index value specifying one of the set of wedgelet patterns;

obtain, based on the index value, a specified wedgelet pattern from the set of wedgelet patterns to divide the block into: a first portion and a second portion;

obtain a first predicted value for the first portion or a second predicted value for the second portion;

refine the first predicted value for the first portion or the second predicted value for the second portion; and

decode the block based on the first portion and the second portion yielded by the line corresponding to the specified wedgelet pattern in accordance with the refined first predicted value or the refined second predicted value.

2. The decoder of claim 1 , wherein the line corresponding to the wedgelet pattern is defined by start and end positions that lie on a boundary of the block.

3. The decoder of claim 1 , the decoder is configured to decode the block based on the first and second portions yielded by the line corresponding to the specified wedgelet pattern based on an intra coding mode.

4. The decoder of claim 1 , wherein the decoder is configured to determine a plurality of sets of wedgelet patterns, wherein each set of the plurality of sets corresponds to one of a plurality of sizes of blocks of the sample array of the video.

5. The decoder of claim 1 , wherein each wedgelet pattern of the set is a two-dimensional array including binary-valued elements.

6. The decoder of claim 1 , wherein the index value is represented in a fixed number of bits in the data stream, and the decoder is configured to decode the index value based on fixed-length coding.

7. The decoder of claim 1 , wherein the decoder is configured to:

extract, from the data stream, a mode syntax element; and

decode the mode syntax element to determine whether the block is to be decoded according to a wedgelet mode using the set of wedgelet patterns or according to a contour mode in which the block is partitioned into two contour regions of arbitrary shapes.

8. The decoder of claim 2 , wherein:

the specified wedgelet pattern is an array having elements all with a first binary value,

the decoder is configured to update first elements of the array from the first binary value to a second binary value, and

the first elements form a line joining the start and end positions of the specified wedgelet pattern.

9. The decoder of claim 2 , wherein each wedgelet pattern of the set is associated with a resolution of the start and end positions of the corresponding wedgelet pattern, wherein the resolution is based on a size of the block.

10. The decoder of claim 1 , wherein the decoder is configured to, in decoding the block, predict the block by assigning a first constant partition value to samples of the sample array positioned within the first portion and a second constant partition value to samples of the sample array positioned within the second portion.

11. The decoder of claim 10 , wherein the sample array is a depth map, and the decoder is configured to use a reference quantization step size in order to reconstruct a texture sample array from the data stream, with which the depth map is associated.

12. An encoder for encoding a sample array of a video into a data stream, the encoder configured to:

generate a set of wedgelet patterns to encode a block of the sample array of the video, wherein each wedgelet pattern of the set represents division of the block into two wedgelet portions separated by a line corresponding to the wedgelet pattern, and to generate the set, the encoder is configured to:

determine whether a first wedgelet pattern is identical or inverse identical to a second wedgelet pattern already in the set, and

responsive to a determination that the first wedgelet pattern is not identical or inverse identical to the second wedgelet pattern, insert the first wedgelet pattern in the set;

select, for the block of the sample array of the video, a wedgelet pattern from the set of wedgelet patterns to divide the block into: a first portion and a second portion;

obtain a first predicted value for the first portion or a second predicted value for the second portion;

determine a refinement value associated with the first portion or the second portion, wherein the refinement value is applied to refine the first predicted value for the first portion or the second predicted value for the second portion;

insert, into the data stream, the refinement value and an index value identifying the selected wedgelet pattern in the set of wedgelet patterns; and

encode the block based on the first portion and the second portion yielded by the line corresponding to the selected wedgelet pattern.

13. The encoder of claim 12 , wherein the line corresponding to the wedgelet pattern is defined by start and end positions that lie on a boundary of the block.

14. The encoder of claim 12 , the encoder is configured to encode the block based on the first and second portions yielded by the line corresponding to the selected wedgelet pattern based on an intra coding mode.

15. The encoder of claim 12 , wherein the encoder is configured to determine a plurality of sets of wedgelet patterns, wherein each set of the plurality of sets corresponds to one of a plurality of sizes of blocks of the sample array of the video.

16. The encoder of claim 12 , wherein the index value is represented in a fixed number of bits in the data stream, and the encoder is configured to encode the index value based on fixed-length coding.

17. The encoder of claim 12 , wherein the encoder is configured to insert, into the data stream, a mode syntax element indicating whether the block is encoded according to a wedgelet mode using the set of wedgelet patterns or according to a contour mode in which the block is partitioned into two contour regions of arbitrary shapes.

18. The encoder of claim 13 , wherein:

the selected wedgelet pattern is an array having elements all with a first binary value,

the encoder is configured to update first elements of the array from the first binary value to a second binary value, and

the first elements form a line joining the start and end positions of the selected wedgelet pattern.

19. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising (a) an index value identifying a selected wedgelet pattern in a set of wedgelet patterns generated for a block of a sample array of the video and (b) a refinement value associated with a first portion or a second portion of the block, wherein the block is encoded into the data stream based on a plurality of operations comprising:

generating the set of wedgelet patterns to encode the block of the sample array of the video, wherein each wedgelet pattern of the set represents division of the block into portions separated by a line corresponding to the wedgelet pattern, the generating including:

determining whether a first wedgelet pattern is identical or inverse identical to a second wedgelet pattern already in the set, and

responsive to a determination that the first wedgelet pattern is not identical or inverse identical to the second wedgelet pattern, inserting the first wedgelet pattern in the set;

selecting, for the block of the sample array of the video, a wedgelet pattern from the set of wedgelet patterns to divide the block into: the first portion and the second portion;

obtaining a first predicted value for the first portion or a second predicted value for the second portion;

determining the refinement value associated with the first portion or the second portion, wherein the refinement value is applied to refine the first predicted value for the first portion or the second predicted value for the second portion;

inserting, into the data stream, the refinement value and the index value identifying the selected wedgelet pattern in the set of wedgelet patterns; and

encoding the block based on the first portion and the second portion yielded by the line corresponding to the selected wedgelet pattern.

Assignments (2)

Continuity (9)

References Cited (206)