IP Library Granted Patent US 11,694,224
Granted Patent B2
US 11,694,224 · App. 17/346,904 · Granted Jul 4, 2023

Region merging and coding parameter reuse via merging

Inventors: Philipp Helle (Berlin, DE); Simon Oudin (Berlin, DE); Martin Winken (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: GE Video Compression, LLC
G06Q30/0251G06F16/00G06Q30/02G06Q30/0601H04N19/105H04N19/119H04N19/139H04N19/14H04N19/147H04N19/176H04N19/186H04N19/196H04N19/197H04N19/46H04N19/463H04N19/52H04N19/61H04N19/96G06Q10/00G06Q30/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,694,224
App. No.
17/346,904
Granted
Jul 4, 2023
Kind
B2
Abstract

A favorable merging or grouping of simply connected regions into which the array of information samples is sub-divided, is coded with a reduced amount of data. To this end, a predetermined relative locational relationship is defined enabling an identifying, for a predetermined simply connected region, of simply connected regions within the plurality of simply connected regions which have the predetermined relative locational relationship to the predetermined simply connected region. Namely, if the number is zero, a merge indicator for the predetermined simply connected region may be absent within the data stream. In other embodiments, spatial sub-division is performed depending on a first subset of syntax elements, followed by combining spatially neighboring simply connected regions depending on a second subset of syntax elements, to obtain an intermediate sub-division.

Claims (37)

1. A decoder for decoding a data stream comprising an array of information samples, the decoder comprising:

an extractor configured for:

for a current region of a plurality of regions, which are obtained by dividing an array of information samples:

extracting, from the data stream, a merge indicator,

determining a plurality of candidate regions for the current region, wherein at least one of the plurality of candidate regions has a spatial relationship with the current region within the array of information samples,

based on a determination that a number of regions in the plurality of candidate regions is greater than one and coding parameters associated with the plurality of candidate regions are not identical to each other, extracting a candidate identifier from the data stream, and

identifying a candidate region from the plurality of candidate regions for the current region based on the candidate identifier; and

a reconstructor configured for:

processing the merge indicator to determine copying or computing a first coding parameter associated with the current region based on a second coding parameter associated with the candidate region,

copying or computing the first coding parameter based on the second coding parameter,

and

reconstructing the current region based on the first coding parameter.

2. The decoder of claim 1 , further comprising a subdivider configured for:

partitioning the array of information samples into a first set of regions in accordance with a maximum region size extracted from the data stream; and

sub-partitioning at least a subset of the first set of regions into a set of sub-regions based on multi-tree subdivision information associated therewith.

3. The decoder of claim 1 , wherein the array of information samples includes depth information.

4. The decoder of claim 1 , wherein the array of information samples is one of samples arrays related to different color components which form color planes of a picture.

5. The decoder of claim 1 , wherein the first and second coding parameters are motion parameters.

6. The decoder of claim 5 , wherein computing the first coding parameter is further based on a motion parameter difference value related to the first coding parameter.

7. An encoder for encoding an array of information samples into a data stream, the encoder comprising:

a subdivider configured for dividing the array of information samples into a plurality of regions; and

a data stream generator configured for:

encoding, into the data stream for a current region of the plurality of regions, a merge indicator,

determining a plurality of candidate regions for the current region, wherein at least one of the plurality of candidate regions has a spatial relationship with the current region within the array of information samples,

based on a determination that a number of regions in the plurality of candidate regions is greater than one and coding parameters associated with the plurality of candidate regions are not identical to each other, encoding into the data stream a candidate identifier, which identifies a candidate region from the plurality of candidate regions for the current region,

processing the merge indicator to determine copying or computing a first coding parameter associated with the current region based on a second coding parameter associated with the candidate region, and

encoding, into the data stream, the second coding parameter.

8. The encoder of claim 7 , wherein the array of information samples includes depth information.

9. The encoder of claim 7 , wherein the first and second coding parameters are motion parameters.

10. The encoder of claim 7 , wherein the data stream generator configured for determining a prediction residual of the first coding parameter based on the first coding parameter and the prediction of the first coding parameter, and encoding, into the data stream, the prediction residual.

11. A non-transitory computer readable medium configured to store a data stream, the data stream comprising encoded information including an array of information samples which is divided into a plurality of regions, the data stream comprising:

a merge indicator related to a current region of a plurality of regions, which are obtained by dividing the array of information samples;

a candidate identifier, which identifies a candidate region from a plurality of candidate regions, wherein the candidate region is to be used in reconstructing the current region, at least one of the plurality of candidate regions has a spatial relationship with the current region within the array of information samples, the current region has a first coding parameter associated therewith, wherein the candidate identifier is encoded based on a determination that a number of regions in the plurality of candidate regions is greater than one and coding parameters associated with the plurality of candidate regions are not identical to each other; and

a second coding parameter associated with the candidate region, wherein the first coding parameter is copied or computed from the second coding parameter based on the merge indicator and is used to reconstruct the current region.

12. The non-transitory computer readable medium of claim 11 , wherein the first and second coding parameters are motion parameters.

13. The non-transitory computer readable medium of claim 11 , wherein the array of information samples includes depth information.

14. The non-transitory computer readable medium of claim 11 , wherein the array of information samples is one of samples arrays related to different color components which form color planes of a picture.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0748 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0615 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: HELLE, PHILIPP; OUDIN, SIMON; WINKEN, MARTIN; MARPE, DETLEV; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 057146/0313 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 057210/0285 →
Priority Claims (2)
EP 10159799 · Apr 13, 2010 · regional
WO PCT/EP2010/054833 · Apr 13, 2010 · international
Continuity (6)
Continuation 16907861 · Jun 22, 2020
Continuation 16578542 · Sep 23, 2019
Continuation 16261823 · Jan 30, 2019
Continuation 13650635 · Oct 12, 2012
Continuation PCTEP2011055795 · Apr 13, 2011
Related Publication 20210304248A1 · Sep 30, 2021