IP Library Granted Patent US 10,362,317
Granted Patent B2
US 10,362,317 · App. 15/663,256 · Granted Jul 23, 2019

Adaptive partition coding

Inventors: Philipp Merkle (Berlin, DE); Christian Bartnik (Berlin, DE); Haricharan Lakshman (Berlin, DE); Detlev Marpe (Berlin, DE); Karsten Mueller (Berlin, DE); Thomas Wiegand (Berlin, DE); Gerhard Tech (Berlin, DE)
Assignee: GE VIDEO COMPRESSION, LLC
H04N19/176H04N19/103H04N19/105H04N19/119H04N19/157H04N19/196H04N19/23H04N19/44H04N19/46H04N19/593H04N19/597H04N19/70H04N19/82H04N19/96H04N19/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,362,317
App. No.
15/663,256
Granted
Jul 23, 2019
Kind
B2
Abstract

Although wedgelet-based partitioning seems to represent a better tradeoff between side information rate on the one hand and achievable variety in partitioning possibilities on the other hand, compared to contour partitioning, the ability to alleviate the constraints of the partitioning to the extent that the partitions have to be wedgelet partitions, enables applying relatively uncomplex statistical analysis onto overlaid spatially sampled texture information in order to derive a good predictor for the bi-segmentation in a depth/disparity map. Thus, in accordance with a first aspect it is exactly the increase of the freedom which alleviates the signaling overhead provided that co-located texture information in form of a picture is present. Another aspect pertains the possibility to save side information rate involved with signaling a respective coding mode supporting irregular partitioning.

Claims (37)

1. A decoder for reconstructing a block of a depth map associated with a texture picture from a data stream, configured to:

determine a texture threshold based on a mean of sample values of a reference block of the texture picture, wherein the reference block is co-located to the predetermined block;

segment the reference block of the texture picture into two portions by comparing each sample of the reference block with the texture threshold;

determine each of first and second portions of the block of the depth map based one of the two portions of the reference block; and

decode the first and second portions to reconstruct the block of the depth map.

2. The decoder according to claim 1 , configured to, in segmenting the reference block, individually check values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of the first and second partitions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

3. The decoder according to claim 2 , configured to, in segmenting the reference block, individually check values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

4. The decoder according to claim 1 , configured to, in segmenting the reference block, apply morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire the two portions of the reference block.

5. The decoder according to claim 1 , configured to, in determining the texture threshold, determine a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

6. The decoder according to claim 1 , configured such that the segmentation, determination and decoding form a first set of coding options, wherein the decoder is further configured to

determine a dispersion of value of samples within the reference block of the texture picture;

receive a coding option identifier from the data stream; and

use the coding option identifier as an index to perform the operations forming the first set of coding options in case of the dispersion exceeding a predetermined threshold.

7. An encoder for encoding a block of a depth map associated with a texture picture into a data stream, configured to:

determine a texture threshold based on a mean of sample values of a reference block of the texture picture, wherein the reference block is co-located to the predetermined block;

segment the reference block of the texture picture into two portions by comparing each sample of the reference block with the texture threshold;

determine each of first and second portions of the block of the depth map based one of the two portions of the reference block; and

encode information related to the first and second portions of the block of the depth map into the data stream.

8. The encoder according to claim 7 , configured to, in segmenting the reference block, individually check values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of the first and second partitions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

9. The encoder according to claim 8 , configured to, in segmenting the reference block, individually check values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

10. The encoder according to claim 7 , configured to, in segmenting the reference block, apply morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire the two portions of the reference block.

11. The encoder according to claim 7 , configured to, in determining the texture threshold, determine a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

12. The encoder according to claim 7 , configured such that the segmentation, determination and encoding form a first set of coding options, wherein the encoder is further configured to

determine a dispersion of value of samples within the reference block of the texture picture; and

encode a coding option identifier into the data stream, wherein the coding option identifier is used as an index to perform the operations forming the first set of coding options in case of the dispersion exceeding a predetermined threshold.

13. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information of a reference block of a texture picture of the video and encoded information of a block of a depth map, which corresponds to the texture picture, of the video, wherein the reference block is co-located to the block of the depth map, wherein the block of the depth map is decoded using a plurality of operations including:

determining a texture threshold based on a mean of sample values of a reference block of the texture picture, wherein the reference block is co-located to the predetermined block;

segmenting the reference block of the texture picture into two portions by comparing each sample of the reference block with the texture threshold;

determining each of first and second portions of the block of the depth map based one of the two portions of the reference block; and

decoding the first and second portions to reconstruct the block of the depth map.

14. The computer-readable medium according to claim 13 , wherein segmenting the reference block includes individually checking values of the texture picture within the reference block at tiles of a two-dimensional subdivision of the reference block, as to whether the respective value is greater than or lower than a respective predetermined value, so that each of the first and second portions of the reference block of the texture picture is a set of the tiles which together completely cover the reference block of the texture picture and are complementary to each other.

15. The computer-readable medium according to claim 14 , wherein segmenting the reference block includes individually checking values of the texture picture within the reference block at sample resolution so that each tile corresponds to a sample position of the reference block.

16. The computer-readable medium according to claim 13 , wherein segmenting the reference block includes applying morphological hole filling and/or low-pass filtering onto a result of the comparing in order to acquire the two portions of the reference block.

17. The computer-readable medium according to claim 13 , wherein determining the texture threshold includes determining a measure for a central tendency of reconstructed sample values of the reference block of the texture picture, wherein the measure represents the texture threshold.

18. The computer-readable medium according to claim 13 , wherein decoding the first and second portion comprises predicting the block of the depth map by assigning a first constant partition value to samples of the sample array positioned within the first portion and a second constant partition value to samples of the sample array positioned within the second portion.

19. The decoder according to claim 1 , further configured to, in decoding the first and second portion, predict the block of the depth map by assigning a first constant partition value to samples of the sample array positioned within the first portion and a second constant partition value to samples of the sample array positioned within the second portion.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0703 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2017
From: MERKLE, PHILIPP; BARTNIK, CHRISTIAN; LAKSHMAN, HARICHARAN; MARPE, DETLEV; MUELLER, KARSTEN; WIEGAND, THOMAS; TECH, GERHARD
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 043133/0709 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2017
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 043133/0848 →
Continuity (4)
Continuation 14273601 · May 9, 2014
Continuation PCTEP2012072328 · Nov 9, 2012
Provisional Application 61558631 · Nov 11, 2011
Related Publication 20170332088A1 · Nov 16, 2017