IP Library Granted Patent US 10,321,148
Granted Patent B2
US 10,321,148 · App. 15/657,813 · Granted Jun 11, 2019

Effective wedgelet partition coding using spatial prediction

Inventors: Philipp Merkle (Berlin, DE); Christian Bartnik (Berlin, DE); Haricharan Lakshman (Berlin, DE); Detlev Marpe (Berlin, DE); Karsten Mueller (Berlin, DE); Thomas Wiegand (Berlin, DE); Gerhard Tech (Berlin, DE)
Assignee: GE VIDEO COMPRESSION, LLC
H04N19/51H04N19/105H04N19/119H04N19/157H04N19/176H04N19/196H04N19/46H04N19/52H04N19/593H04N19/597H04N19/70H04N19/82H04N19/96H04N19/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,321,148
App. No.
15/657,813
Granted
Jun 11, 2019
Kind
B2
Abstract

In accordance with a first aspect, the intra prediction direction of a neighboring, intra-predicted block is used in order to predict the extension direction of the wedgelet separation line of a current block, thereby reducing the side information rate necessitated in order to convey the partitioning information. In accordance with a second aspect, the idea is that previously reconstructed samples, i.e. reconstructed values of blocks preceding the current block in accordance with the coding/decoding order allow for at least a prediction of a correct placement of a starting point of the wedgelet separation line, namely by placing the starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the current block along a circumference thereof. Both aspects may be used individually or in combination.

Claims (25)

1. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information indicating an intra-prediction direction related to intra prediction of a first block of a sample array, wherein the intra-prediction direction is used to decode a second block of the sample array using a plurality of operations including:

predicting the first block of the sample array using intra prediction by determining sample values of the first block based on reconstructed values of samples of the sample array, neighboring the first block, along the intra-prediction direction;

deriving a position of a wedgelet separation line within the second block neighboring the first block by setting an extension direction of the wedgelet separation line within the second block based on the intra-prediction direction used to predict the first block, the wedgelet separation line dividing the second block into first and second wedgelet portions; and

decoding the second block in units of the first and second wedgelet portions.

2. The computer-readable medium according to claim 1 , wherein the plurality of operations further comprise, in deriving the position of the wedgelet separation line within the second block of the sample array, placing a starting point of the wedgelet separation line at a position of a maximum change between consecutive ones of a sequence of reconstructed values of samples of a line of samples extending adjacent to the second block along a portion of a circumference of the second block.

3. The computer-readable medium according to claim 1 , wherein the plurality of operations further comprise:

retrieving a coding option identifier from the data stream,

if the coding option identifier comprises a predetermined value, checking as to whether any of a set of candidate blocks neighboring the second block comprises a wedgelet separation line continuing into the second block, and

if so, deriving a position of a wedgelet separation line within the second block of the sample array depending on the wedgelet separation line of the respective block such that the wedgelet separation line at the derived position within the second block forms an extension of the wedgelet separation line of the neighboring block into the second block, and

if not, performing the derivation of the position of the wedgelet separation line based on the intra-prediction direction.

4. The computer-readable medium according to claim 1 , wherein, in decoding the second block, the plurality of operations comprise:

predicting the second block by assigning a first constant partition value to samples of the sample array positioned within the first wedgelet portion and a second constant partition value to samples of the sample array positioned within the second wedgelet portion, the assignment depending on information extracted from the data stream.

5. The computer-readable medium according to claim 4 , the plurality of operations comprising:

refining the prediction of the second block by applying a first refinement value within the refinement information onto a mean value of values of neighboring samples associated with the first portion, and/or applying a second refinement value within the refinement information onto a mean value of values of neighboring samples associated with the second portion.

6. The computer-readable medium according to claim 4 , the plurality of operations comprising, in applying the first and/or second refinement value, linearly combining the first and/or second refinement value with the mean value of values of the neighboring samples associated with the first portion, and/or the mean value of values of the neighboring samples associated with the second portion, respectively.

7. The computer-readable medium according to claim 5 , wherein the sample array is a depth map, and the plurality of operations comprising scaling the first and/or second refinement value using a quantization step size depending on a reference quantization step size at which a predetermined spatially sampled component associated with the sample array is transmitted, and using the reference quantization step size in order to reconstruct a texture sample array from the data stream, the texture sample array associated with the depth map.

8. The computer-readable medium according to claim 1 , wherein the sample array is a depth map associated with a picture, wherein the plurality of operations comprising:

retrieving a coding option identifier from the data stream,

if the coding option identifier comprises a first predetermined value, performing the derivation of the position of the wedgelet separation line based on the intra-prediction direction, and

if the coding option identifier comprises a second predetermined value,

segmenting a reference block of the picture, co-located to the second block, by thresholding the picture within the reference block to acquire a bi-segmentation of the reference block into first and second portions,

spatially transferring the bi-segmentation of the reference block of the picture onto the second block of the depth map so as to acquire first and second portions of the second block, and

predicting the second block by assigning a first constant partition value to samples of the depth map positioned within the first portion of the second block and a second constant partition value to samples of the depth map positioned within the second portion of the second block, the assignment depending on the data stream.

9. The computer-readable medium according to claim 1 , further configured to use the second block as a reference in a prediction loop to encode or decode sample arrays.

Assignments (3)
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2017
From: MERKLE, PHILIPP; BARTNIK, CHRISTIAN; LAKSHMAN, HARICHARAN; MARPE, DETLEV; MUELLER, KARSTEN; WIEGAND, THOMAS; TECH, GERHARD
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 043080/0918 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2017
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 043081/0204 →
Continuity (4)
Continuation 14273600 · May 9, 2014
Continuation PCTEP2012072326 · Nov 9, 2012
Provisional Application 61558630 · Nov 11, 2011
Related Publication 20170332093A1 · Nov 16, 2017