IP Library › Granted Patent US 11,641,473
Granted Patent B2
US 11,641,473 · App. 17/145,050 · Granted May 2, 2023

Multi-hypothesis prediction

Inventors: Martin Winken (Berlin, DE); Christian Bartnik (Berlin, DE); Philipp Helle (Berlin, DE); Mischa Siekmann (Belin, DE); Jonathan Pfaff (Berlin, DE); Detlev Marpe (Berlin, DE); Heiko Schwarz (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
H04N19/139H04N19/109H04N19/117H04N19/137H04N19/176H04N19/57H04N19/577
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,641,473
App. No.
17/145,050
Filed
Jan 8, 2021
Granted
May 2, 2023
Kind
B2
Examiner
SUN, YULIN
Art Unit
2485
USPC
375/240.02
Abstract

A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.

Claims (26)

1. Video decoder for decoding a video from a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to:

control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion,

read from the data stream information on the number of prediction hypotheses for a currently processed inter predicted block dependent on a number of prediction hypotheses of previously processed inter predicted blocks within the predetermined portion and the predetermined criterion, and

based on the number of prediction hypotheses of the previously processed inter predicted blocks within the predetermined portion and the predetermined criterion, determine an allowed number interval, and, using a binarization of the allowed number interval, code the information into the data stream,

wherein the predetermined criterion indicates a target mean number of prediction hypotheses per inter predicted block or a maximum number of the hypotheses for the inter predicted blocks within the predetermined portion.

2. Video decoder according to claim 1 , wherein the hypothesis number control is configured to continuously update a mean number of prediction hypotheses per inter predicted block processed within the predetermined portion of the video and/or an accumulated number of prediction hypotheses of the inter predicted blocks within the predetermined portion, and determine the number of hypotheses for a current processed inter predicted block dependent on the predetermined criterion and the mean number and/or the accumulated number.

3. Video decoder according to claim 1 , configured so that the number of prediction hypotheses per inter predicted block is limited to an upper limit.

4. Video decoder according to claim 1 , wherein the predetermined portion is a collocated tile within a sequence of pictures, a slice, a picture, a group of pictures, a whole video sequence.

5. Video decoder according to claim 1 , configured to read from the data stream information on the number of prediction hypotheses for each inter predicted block.

6. Video decoder according to claim 1 , configured so that a maximum of the allowed number interval is the lower, the larger the number of prediction hypotheses of the previously processed inter predicted blocks within the predetermined portion is, and the binarization of the allowed number interval comprises a mean codeword length which is the lower, the lower the maximum of the allowed number interval is.

7. Method for decoding a video from a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, the method comprising:

controlling a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion,

reading from the data stream information on the number of prediction hypotheses for a currently processed inter predicted block dependent on a number of prediction hypotheses of previously processed inter predicted blocks within the predetermined portion and the predetermined criterion, and

based on the number of prediction hypotheses of the previously processed inter predicted blocks within the predetermined portion and the predetermined criterion, determining an allowed number interval, and, using a binarization of the allowed number interval, code the information into the data stream,

wherein the predetermined criterion indicates a target mean number of prediction hypotheses per inter predicted block or a maximum number of the hypotheses for the inter predicted blocks within the predetermined portion.

8. A non-transitory digital storage medium having a computer program stored thereon to perform a method for decoding a video from a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, the method comprising:

controlling a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion,

reading from the data stream information on the number of prediction hypotheses for a currently processed inter predicted block dependent on a number of prediction hypotheses of previously processed inter predicted blocks within the predetermined portion and the predetermined criterion, and

based on the number of prediction hypotheses of the previously processed inter predicted blocks within the predetermined portion and the predetermined criterion, determining an allowed number interval, and, using a binarization of the allowed number interval, code the information into the data stream,

wherein the predetermined criterion indicates a target mean number of prediction hypotheses per inter predicted block or a maximum number of the hypotheses for the inter predicted blocks within the predetermined portion,

when said computer program is run by a computer.

9. Video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to:

control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion,

insert into the data stream information on the number of prediction hypotheses for each inter predicted block, and

insert into the data stream information on the number of prediction hypotheses for a currently processed inter predicted block dependent on a number of prediction hypotheses of previously processed inter predicted blocks within the predetermined portion and the predetermined criterion,

wherein the predetermined criterion indicates a target mean number of prediction hypotheses per inter predicted block or a maximum number of the hypotheses for the inter predicted blocks within the predetermined portion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2021
From: WINKEN, MARTIN; BARTNIK, CHRISTIAN; HELLE, PHILIPP; SIEKMANN, MISCHA; PFAFF, JONATHAN; MARPE, DETLEV; SCHWARZ, HEIKO; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 055706/0623 →
Priority Claims (1)
EP 18182720 · Jul 10, 2018 · regional
Continuity (2)
Continuation PCTEP2019068384 · Jul 9, 2019
Related Publication 20210136386A1 · May 6, 2021