IP Library Granted Patent US 11,910,029
Granted Patent B2
US 11,910,029 · App. 18/359,798 · Granted Feb 20, 2024

Coding of a spatial sampling of a two-dimensional information signal using sub-division preliminary class

Inventors: Heiner Kirchhoffer (Berlin, DE); Martin Winken (Berlin, DE); Philipp Helle (Berlin, DE); Detlev Marpe (Berlin, DE); Heiko Schwarz (Panketal, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE Video Compression, LLC
H04N19/96H04N19/17H04N19/176H04N19/1883H04N19/46H04N19/52H04N19/53H04N19/59H04N19/593H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,910,029
App. No.
18/359,798
Granted
Feb 20, 2024
Kind
B2
Abstract

Coding schemes for coding a spatially sampled information signal using sub-division and coding schemes for coding a sub-division or a multitree structure are described, wherein representative embodiments relate to picture and/or video coding applications.

Claims (69)

1. A decoder comprising:

a sub-divider configured to spatially sub-divide an array of information samples, representing a spatially sampled information signal, into blocks of different sizes by:

dividing the array of information samples into a regular arrangement of tree root blocks of zero-order hierarchy level size, and

sub-dividing, by recursive quadtree partitioning, the tree root blocks by

checking, for each tree root block, quadtree-partitioning information contained in a data stream into which the array of information samples is coded,

as to whether the respective tree root block is to be partitioned, and

if the respective tree root block is to be partitioned, partitioning the respective tree root block into four blocks of a first hierarchy level, and

recursively repeating the checking and partitioning for the blocks of the first hierarchy level in order to obtain blocks of higher-order hierarchy levels, with stopping the recursive repetition when no partitioning is to be performed according to the quadtree-partitioning information, or a maximum hierarchy level is reached;

a reconstructor configured to reconstruct the array of information samples from the data stream using the blocks of different sizes into which the array of information samples is spatially subdivided, by traversing the blocks of different sizes in a scan order according to which the tree root blocks are scanned in a zigzag scan order with, for each tree root block being partitioned, treating the blocks of different sizes therein in depth-first traversal order before stepping further to a next tree root block in the zigzag scan order; and

an extractor configured to extract syntax elements associated with the blocks of different sizes, in the scan order from the data stream,

wherein the quadtree-partitioning information is formed by a sequence of flags associated with nodes of the recursive quadtree partitioning in the depth-first traversal order, and the extractor is configured to extract the sequence of flags of the quadtree-partitioning information from the data stream using the depth-first traversal order and to choose a context to decode a respective flag of the sequence of flags using flags:

preceding the respective flag in accordance with the depth-first traversal order and

being associated with areas lying on top and/or left of an area to which the respective flag belongs.

2. The decoder according to claim 1 , wherein the extractor is configured to use, for a currently extracted syntax element, the syntax elements associated with the blocks of different sizes having a predetermined relative locational relationship to the block with which the currently extracted syntax element is associated, to set a probability estimation context and use the set probability estimation context in entropy decoding the currently extracted syntax element, or to perform a prediction for a coding parameter of the block with which the currently extracted syntax element is associated and combine the prediction with the currently extracted syntax element as residual to obtain the coding parameter of the block with which the currently extracted syntax element is associated.

3. The decoder according to claim 1 , wherein in accordance with the depth-first traversal order, blocks of the same hierarchy level are also scanned in a zigzag scan order.

4. The decoder according to claim 1 , wherein the reconstructor is configured to perform one or more of the following steps at a granularity which depends on the recursive quadtree partitioning:

decision which prediction mode among, at least, an intra and inter prediction mode to use;

transformation from spectra to spatial domain;

performing and/or setting parameters for an inter prediction; and

performing and/or setting parameters for an intra prediction.

5. The decoder according to claim 1 , wherein the reconstructor comprises an extractor for extracting syntax elements associated with the blocks of different sizes from the data stream in dependence on contexts of syntax elements of neighboring blocks among the blocks of different sizes which have been extracted from the data stream.

6. A method for decoding comprising:

spatially sub-dividing an array of information samples, representing a spatially sampled information signal, into blocks of different sizes by:

dividing the array of information samples into a regular arrangement of tree root blocks of zero-order hierarchy level size, and

sub-dividing, by recursive quadtree partitioning, the tree root blocks by:

checking, for each tree root block, quadtree-partitioning information contained in the data stream into which the array of information samples is coded, as to whether the respective tree root block is to be partitioned, and

if the respective tree root block is to be partitioned, partitioning the respective tree root block into four blocks of a first hierarchy level, and

recursively repeating the checking and partitioning for the blocks of the first hierarchy level in order to obtain blocks of higher-order hierarchy levels, with stopping the recursive repetition when no partitioning is to be performed according to the quadtree-partitioning information, or a maximum hierarchy level is reached;

reconstructing the array of information samples from the data stream using the blocks of different sizes into which the array of information samples is spatially subdivided, by traversing the blocks of different sizes in a scan order according to which the tree root blocks are scanned in a zigzag scan order with, for each tree root block being partitioned, treating the blocks of different sizes therein in depth-first traversal order before stepping further to a next tree root block in the zigzag scan order; and

extracting syntax elements associated with the blocks of different sizes, in the scan order from the data stream,

wherein the quadtree-partitioning information is formed by a sequence of flags associated with nodes of the recursive quadtree partitioning in the depth-first traversal order, and the sequence of flags of the quadtree-partitioning information are extracted from the data stream using the depth-first traversal order and a context to decode a respective flag of the sequence of flags is chosen using flags:

preceding the respective flag in accordance with the depth-first traversal order and

being associated with areas lying on top and/or left of an area to which the respective flag belongs.

7. An encoder comprising:

a sub-divider configured to spatially sub-divide an array of information samples, representing a spatially sampled information signal, into blocks of different sizes by:

dividing the array of information samples into a regular arrangement of tree root blocks of zero-order hierarchy level size, and

sub-dividing, by recursive quadtree partitioning, the tree root blocks according to quadtree-partitioning information contained in the data stream into which the array of information samples is coded, and indicating, for each tree root block, as to:

whether the respective tree root block is to be partitioned, wherein if the respective tree root block is indicated to be partitioned, the respective tree root block is partitioned into four blocks of a first hierarchy level, and

whether the partitioning is recursively repeated for the blocks of the first hierarchy level in order to obtain blocks of higher-order hierarchy levels, with the recursive repetition being stopped when no partitioning is to be performed according to the quadtree-partitioning information, or a maximum hierarchy level is reached; and

a data stream generator configured to encode the array of information samples into the data stream using the blocks of different sizes into which the array of information samples is spatially subdivided, by traversing the blocks of different sizes in a scan order according to which the tree root blocks are scanned in a zigzag scan order with, for each tree root block being partitioned, treating the blocks of different sizes therein in depth-first traversal order before stepping further to a next tree root block in the zigzag scan order,

wherein the data stream generator is configured to insert syntax elements associated with the blocks of different sizes, in the scan order into the data stream,

wherein the quadtree-partitioning information is formed by a sequence of flags associated with nodes of the recursive quadtree partitioning in the depth-first traversal order, and the data stream generator is configured to insert the sequence of flags of the quadtree-partitioning information into the data stream using the depth-first traversal order and to choose a context to encode a respective flag of the sequence of flags using flags:

preceding the respective flag in accordance with the depth-first traversal order and

being associated with areas lying on top and/or left of an area to which the respective flag belongs.

8. A method for encoding comprising:

spatially sub-dividing an array of information samples, representing a spatially sampled information signal, into blocks of different sizes by:

dividing the array of information samples into a regular arrangement of tree root blocks of zero-order hierarchy level size, and

sub-dividing, by recursive quadtree partitioning, the tree root blocks according to quadtree-partitioning information contained in the data stream into which the array of information samples is coded, and indicating, for each tree root block, as to:

whether the respective tree root block is to be partitioned, wherein if the respective tree root block is indicated to be partitioned, the respective tree root block is partitioned into four blocks of a first hierarchy level, and

whether the partitioning is recursively repeated for the blocks of the first hierarchy level in order to obtain blocks of higher-order hierarchy levels, with the recursive repetition being stopped when no partitioning is to be performed according to the quadtree-partitioning information, or a maximum hierarchy level is reached; and

encoding the array of information samples into the data stream using the blocks of different sizes into which the array of information samples is spatially subdivided, by traversing the blocks of different sizes in a scan order according to which the tree root block are scanned in a zigzag scan order with, for each tree root block being partitioned, treating the blocks of different sizes therein in depth-first traversal order before stepping further to a next tree root block in the zigzag scan order,

wherein the encoding the array of information samples of the data stream further comprises:

inserting syntax elements associated with the blocks of different sizes, in the scan order into the data stream,

wherein the quadtree-subdivision information is formed by a sequence of flags associated with nodes of the recursive quadtree partitioning in the depth-first traversal order, and the sequence of flags of the quadtree-partitioning information are inserted into the data stream using the depth-first traversal order and a context for encoding a respective flag of the sequence of flags is chosen using flags:

preceding the respective flag in accordance with the depth-first traversal order and

being associated with areas lying on top and/or left of an area to which the respective flag belongs.

9. A non-transitory computer-readable medium for storing data associated with a video, comprising:

a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information associated with an array of information samples representing a spatially sampled information signal, wherein the array of information samples is encoded into the data stream using blocks of different sizes into which the array of information samples is spatially subdivided, by operations including:

spatially sub-dividing the array of information samples into the blocks of different sizes by:

dividing the array of information samples into a regular arrangement of tree root blocks of zero-order hierarchy level size, and

sub-dividing, by recursive quadtree partitioning, the tree root blocks according to quadtree-partitioning information contained in the data stream into which the array of information samples is coded, and indicating, for each tree root block, as to:

whether the respective tree root block is to be partitioned, wherein if the respective tree root block is indicated to be partitioned, the respective tree root block is partitioned into four blocks of a first hierarchy level, and

whether the partitioning is recursively repeated for the blocks of the first hierarchy level in order to obtain blocks of higher-order hierarchy levels, with the recursive repetition being stopped when no partitioning is to be performed according to the quadtree-partitioning information, or a maximum hierarchy level is reached; and

encoding the array of information samples into the data stream using the blocks of different sizes into which the array of information samples is spatially subdivided, by traversing the blocks of different sizes in a scan order according to which the tree root block are scanned in a zigzag scan order with, for each tree root block being partitioned, treating the blocks of different sizes therein in depth-first traversal order before stepping further to a next tree root block in the zigzag scan order,

wherein the encoding the array of information samples of the data stream further comprises:

inserting syntax elements associated with the blocks of different sizes, in the scan order into the data stream,

wherein the quadtree-subdivision information is formed by a sequence of flags associated with nodes of the recursive quadtree partitioning in the depth-first traversal order, and the sequence of flags of the quadtree-partitioning information are inserted into the data stream using the depth-first traversal order and a context for encoding a respective flag of the sequence of flags is chosen using flags:

preceding the respective flag in accordance with the depth-first traversal order and

being associated with areas lying on top and/or left of an area to which the respective flag belongs.

Assignments (2)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0781 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0772 →
Priority Claims (2)
EP 10159819 · Apr 13, 2010 · regional
WO PCT/EP2010/054843 · Apr 13, 2010 · international
Continuity (10)
Continuation 18052718 · Nov 4, 2022
Continuation 17211013 · Mar 24, 2021
Continuation 16855266 · Apr 22, 2020
Continuation 16561427 · Sep 5, 2019
Continuation 16155281 · Oct 9, 2018
Continuation 15413852 · Jan 24, 2017
Continuation 15195407 · Jun 28, 2016
Continuation 13649251 · Oct 11, 2012
Continuation PCTEP2011055534 · Apr 8, 2011
Related Publication 20240022768A1 · Jan 18, 2024