Effective wedgelet partition coding using spatial prediction
In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.
1. A decoder for reconstructing a sample array from a data stream, the decoder configured to:
predict a first block of the sample array using intra-prediction by copying reconstructed values of samples of the sample array, neighboring the first block, along an intra-prediction direction into the first block;
derive a position of a wedgelet separation line within a second block of the sample array neighboring the first block based on an extension direction of the wedgelet separation line within the second block, wherein the extension direction is based on the intra-prediction direction used to predict the first block, and the wedgelet separation line divides the second block into first and second wedgelet partitions; and
decode the second block based on a first value related to samples within the first wedgelet partition and a second value related to samples within the second wedgelet partition.
2. The decoder according to claim 1 , wherein the decoder is configured to, in deriving the position of the wedgelet separation line within the second block, place a starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the second block along a portion of a circumference of the second block.
3. The decoder according to claim 1 , wherein the decoder is configured to:
retrieve a coding option identifier from the data stream,
if the coding option identifier comprises a predetermined value, check as to whether any of a set of candidate blocks neighboring the second block comprises a wedgelet separation line continuing into the second block, and
if so, derive a position of a wedgelet separation line within the second block of the sample array depending on the wedgelet separation line of the respective block such that the wedgelet separation line at the derived position within the second block forms an extension of the wedgelet separation line of the neighboring block into the second block, and
if not, perform the derivation of the position of the wedgelet separation line and the prediction of the second block.
4. The decoder according to claim 1 , wherein the decoder is configured to, in decoding the second block,
predict the second block by assigning a first constant partition value to samples of the sample array positioned within the first wedgelet partition and a second constant partition value to samples of the sample array positioned within the second wedgelet partition, the assignment depending on information from the data stream.
5. The decoder according to claim 4 , wherein the decoder is configured to refine the prediction of the second block by applying a first refinement value within the refinement information onto a mean value of values of neighboring samples associated with the first partition, and/or applying a second refinement value within the refinement information onto a mean value of values of neighboring samples associated with the second partition.
6. The decoder according to claim 4 , wherein the decoder is configured to, in applying the first and/or second refinement value, linearly combine the first and/or second refinement value with the mean value of values of the neighboring samples associated with the first partition, and/or the mean value of values of the neighboring samples associated with the second partition, respectively.
7. The decoder according to claim 5 , wherein the sample array is a depth map, and the decoder is configured to scale the first and/or second refinement value using a quantization step size depending on a reference quantization step size at which a predetermined spatially sampled component associated with the sample array is transmitted, and use the reference quantization step size in order to reconstruct a texture sample array from the data stream, with which the depth map is associated.
8. The decoder according to claim 1 , wherein the sample array is a depth map associated with a picture, wherein the decoder is configured to:
retrieve a coding option identifier from the data stream,
if the coding option identifier comprises a first predetermined value, perform the derivation of the position of the wedgelet separation line and the prediction of the second block, and
if the coding option identifier comprises a second predetermined value,
segment a reference block of the picture, co-located to the second block, by thresholding the picture within the reference block to acquire a bi-segmentation of the reference block into first and second partitions,
spatially transfer the bi-segmentation of the reference block of the picture onto the second block of the depth map so as to acquire first and second partitions of the second block, and
predict the second block by assigning a first constant partition value to samples of the depth map positioned within the first partition of the second block and a second constant partition value to samples of the depth map positioned within the second partition of the second block, the assignment depending on the data stream.
9. The decoder according to claim 1 , wherein the decoder is configured to use the second block as a reference in a prediction loop of the decoder.
10. An encoder for encoding a sample array into a data stream configured to:
predict a first block of the sample array using intra-prediction by copying values of already encoded samples of the sample array, neighboring the first block, along an intra-prediction direction into the first block;
derive a position of a wedgelet separation line within a second block of the sample array neighboring the first block based on an extension direction of the wedgelet separation line within the second block, wherein the extension direction is based on the intra-prediction direction used to predict the first block, and the wedgelet separation line divides the second block into first and second wedgelet partitions; and
encode the second block based on a first value related to samples within the first wedgelet partition and a second value related to samples within the second wedgelet partition.
11. The encoder according to claim 10 , wherein the decoder is configured to, in deriving the position of the wedgelet separation line within the second block, place a starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the second block along a portion of a circumference of the second block.
12. The encoder according to claim 10 , wherein the decoder is configured to encode a coding option identifier into the data stream, wherein a predetermined value of the coding option identifier indicates whether any of a set of candidate blocks neighboring the second block comprises a wedgelet separation line that continuing into the second block.
13. The encoder according to claim 10 , wherein the encoder is configured to, in encoding the second block,
predict the second block by assigning a first constant partition value to samples of the sample array positioned within the first wedgelet partition and a second constant partition value to samples of the sample array positioned within the second wedgelet partition.
14. The encoder according to claim 13 , wherein the encoder is configured to:
refine the prediction of the second block by applying a first refinement value within the refinement information onto a mean value of values of neighboring samples associated with the first partition, and/or applying a second refinement value within the refinement information onto a mean value of values of neighboring samples associated with the second partition; and
encode the first and second refinement values into the data stream.
15. The encoder according to claim 13 , wherein the encoder is configured to, in applying the first and/or second refinement value, linearly combine the first and/or second refinement value with the mean value of values of the neighboring samples associated with the first partition, and/or the mean value of values of the neighboring samples associated with the second partition, respectively.
16. The encoder according to claim 14 , wherein the sample array is a depth map, and the encoder is configured to scale the first and/or second refinement value using a quantization step size depending on a reference quantization step size at which a predetermined spatially sampled component associated with the sample array is transmitted.
17. A non-transitory computer readable medium including a computer program comprising a program code for performing, when running on a computer, a method for reconstructing a sample array from a data stream, the method comprising:
predicting a first block of the sample array using intra-prediction by copying reconstructed values of samples of the sample array, neighboring the first block, along an intra-prediction direction into the first block;
deriving a position of a wedgelet separation line within a second block of the sample array neighboring the first block based on an extension direction of the wedgelet separation line within the second block, wherein the extension direction is based on the intra-prediction direction used to predict the first block, and the wedgelet separation line divides the second block into first and second wedgelet partitions; and
decoding the second block based on a first value related to samples within the first wedgelet partition and a second value related to samples within the second wedgelet partition.
18. The non-transitory computer readable medium according to claim 17 , wherein the method comprises, in deriving the position of the wedgelet separation line within the second block, placing a starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the second block along a portion of a circumference of the second block.
19. The non-transitory computer readable medium according to claim 17 , wherein the method comprises:
retrieving a coding option identifier from the data stream,
if the coding option identifier comprises a predetermined value, checking as to whether any of a set of candidate blocks neighboring the second block comprises a wedgelet separation line continuing into the second block, and
if so, deriving a position of a wedgelet separation line within the second block of the sample array depending on the wedgelet separation line of the respective block such that the wedgelet separation line at the derived position within the second block forms an extension of the wedgelet separation line of the neighboring block into the second block, and
if not, performing the derivation of the position of the wedgelet separation line and the prediction of the second block.
20. The non-transitory computer readable medium according to claim 17 , wherein the method comprises, in decoding the second block, predicting the second block by assigning a first constant partition value to samples of the sample array positioned within the first wedgelet partition and a second constant partition value to samples of the sample array positioned within the second wedgelet partition, the assignment depending on information from the data stream.