IP Library Granted Patent US 12,335,511
Granted Patent B2
US 12,335,511 · App. 18/640,755 · Granted Jun 17, 2025

System and method of motion information storage for video coding and signaling

Inventors: Yue Yu (San Diego, CA); Limin Wang (San Diego, CA)
Assignee: ARRIS Enterprises LLC
H04N19/513H04N19/105H04N19/107H04N19/172H04N19/176H04N19/70H04N19/96H04N19/517
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,511
App. No.
18/640,755
Filed
Apr 19, 2024
Granted
Jun 17, 2025
Kind
B2
Art Unit
2482
USPC
375/240.16
Abstract

A system and method are provided for inter-ceding video in which encoder and decoder memory requirements associated with storage of motion information related to collocated coding units is reduced. In some embodiments motion information related to only a single collocated coding unit may be stored at the encoder and decoder. In operation, if the encoder determines that motion information for a current coding unit should replace the currently stored motion information for the currently stored motion information for the collocated coding unit, then the encoder can replace the motion information at the encoder and transmit an indicator with the current coding unit to signal to the decoder that the motion information currently stored should be updated or replaced with the motion information associated with the current coding unit.

Claims (35)

1. A method decoding a video with a decoder that includes a processor comprising:

(a) receiving a bitstream having a plurality of pictures, each of the plurality of pictures indicating how a plurality of coding tree units for a respective single picture was partitioned into a plurality of coding units of the respective single picture that includes a partitioning structure that indicates a first node that is partitioned with a first binary partitioning defining a pair of first child nodes one of which is partitioned with a second binary partitioning, and that includes said partitioning structure that indicates a second node that is partitioned with a first ternary partitioning defining a triplet of second child nodes one of which is partitioned with a second ternary partitioning, where said pair of first child nodes of said first binary partitioning the other of which is partitioned with a ternary partitioning defining a triplet of child nodes, where said triplet of second child nodes of said first ternary partitioning another of which is partitioned with a binary partitioning defining a pair of child nodes, and that includes said partitioning structure that indicates a third node that is partitioned with a second ternary partitioning defining a triplet of third child nodes, where at least one of said coding units is rectangular;

(b) receiving a plurality of collocated coding units for the respective single picture;

(c) receiving motion information associated each of said plurality of collocated coding units for the respective single picture;

(d) receiving a current coding unit;

(e) receiving motion information associated with said current coding unit;

decoding said current coding unit;

(g) receiving a plurality of indicators one of which identifying whether said motion information associated with one of the plurality of said collocated coding units of the respective single picture is to be modified by said motion information associated with said current coding unit, where each of said plurality of said indicators being a single bit is included in a respective NAL unit header which is a part of a respective NAL unit of a respective one of said plurality of collocated coding units, where none of said plurality of indicators are included in a sequence parameter set.

2. The method of claim 1 wherein said indicator indicates that said motion information associated with said one of said collocated coding units is not to be modified by said motion information associated with said current coding unit.

3. The method of claim 1 wherein said indicator indicates whether said motion information associated with said one of said collocated coding units is not to be used for a future coding unit.

4. The method of claim 1 where said current coding unit is encoded according to VVC.

5. A method decoding a video with a decoder that includes a processor comprising:

(a) receiving a bitstream having a plurality of pictures, each of the plurality of pictures indicating how a plurality of coding tree units for a respective single picture was partitioned into a plurality of coding units of the respective single picture that includes a partitioning structure that indicates a first node that is partitioned with a first binary partitioning defining a pair of first child nodes one of which is partitioned with a second binary partitioning, and that includes said partitioning structure that indicates a second node that is partitioned with a first ternary partitioning defining a triplet of second child nodes one of which is partitioned with a second ternary partitioning, where said pair of first child nodes of said first binary partitioning the other of which is partitioned with a ternary partitioning defining a triplet of child nodes, where said triplet of second child nodes of said first ternary partitioning another of which is partitioned with a binary partitioning defining a pair of child nodes, and that includes said partitioning structure that indicates a third node that is partitioned with a second ternary partitioning defining a triplet of third child nodes, where at least one of said coding units is rectangular;

(b) receiving a plurality of rectangular collocated coding units for the respective single picture;

(c) receiving motion information associated with each of said plurality of rectangular collocated coding units for the respective single picture;

(d) receiving a rectangular current coding unit;

(e) determining motion information associated with said current coding unit based upon previously received motion information for a previously received coding unit other than said rectangular current coding unit;

(f) decoding said current coding based upon said previously received motion information maintained in said decoder prior to receiving said rectangular current coding unit;

(g) removing from said decoder said previously received motion information.

6. A method for storing bitstream of encoded video data for decoding by a decoder, with storing the encoded video data by a computer-readable storage medium, wherein:

(a) said bitstream containing data indicating a plurality of pictures, each of the plurality of pictures indicating how a plurality of coding tree units for a respective single picture was partitioned into a plurality of coding units of the respective single picture that includes a partitioning structure that indicates a first node that is partitioned with a first binary partitioning defining a pair of first child nodes one of which is partitioned with a second binary partitioning, and that includes said partitioning structure that indicates a second node that is partitioned with a first ternary partitioning defining a triplet of second child nodes one of which is partitioned with a second ternary partitioning, where said pair of first child nodes of said first binary partitioning the other of which is partitioned with a ternary partitioning defining a triplet of child nodes, where said triplet of second child nodes of said first ternary partitioning another of which is partitioned with a binary partitioning defining a pair of child nodes, and that includes said partitioning structure that indicates a third node that is partitioned with a second ternary partitioning defining a triplet of third child nodes, where at least one of said coding units is rectangular;

(b) said bitstream containing data indicating a plurality of rectangular collocated coding units for the respective single picture;

(c) said bitstream containing data indicating motion information associated with each of said plurality of rectangular collocated coding units for the respective single picture;

(d) said bitstream containing data indicating a rectangular current coding unit;

(e) said bitstream containing data indicating motion information associated with said current coding unit based upon previously received motion information for a previously received coding unit other than said rectangular current coding unit;

(f) said bitstream containing data indicating how decoding said current coding based upon said previously received motion information maintained in said decoder prior to receiving said rectangular current coding unit;

(g) wherein said bitstream is configured such that upon decoding said encoded video within said bitstream a decoder removes from said decoder said previously received motion information.

7. A method encoding a video with an encoder that includes a processor comprising:

(a) wherein said encoding is based upon a bitstream having a plurality of pictures, each of the plurality of pictures indicating how a plurality of coding tree units for a respective single picture was partitioned into a plurality of coding units of the respective single picture that includes a partitioning structure that indicates a first node that is partitioned with a first binary partitioning defining a pair of first child nodes one of which is partitioned with a second binary partitioning, and that includes said partitioning structure that indicates a second node that is partitioned with a first ternary partitioning defining a triplet of second child nodes one of which is partitioned with a second ternary partitioning, where said pair of first child nodes of said first binary partitioning the other of which is partitioned with a ternary partitioning defining a triplet of child nodes, where said triplet of second child nodes of said first ternary partitioning another of which is partitioned with a binary partitioning defining a pair of child nodes, and that includes said partitioning structure that indicates a third node that is partitioned with a second ternary partitioning defining a triplet of third child nodes, where at least one of said coding units is rectangular;

(b) wherein said encoding is based upon a plurality of rectangular collocated coding units for the respective single picture;

(c) wherein said encoding is based upon motion information associated with each of said plurality of rectangular collocated coding units for the respective single picture;

(d) wherein said encoding is based upon a rectangular current coding unit;

(e) wherein said encoding is based upon motion information associated with said current coding unit based upon previously received motion information for a previously received coding unit other than said rectangular current coding unit;

(f) wherein said encoding is based upon decoding said current coding based upon said previously received motion information maintained in said decoder prior to receiving said rectangular current coding unit;

(g) wherein said encoding is based upon removing from said decoder said previously received motion information.