IP Library › Granted Patent US 11,595,673
Granted Patent B2
US 11,595,673 · App. 17/004,782 · Granted Feb 28, 2023

Low complexity affine merge mode for versatile video coding

Inventor: Minhua Zhou (San Diego, CA)
Assignee: Avago Technologies International Sales Pte. Limited
H04N19/426H04N19/105H04N19/139H04N19/176H04N19/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,595,673
App. No.
17/004,782
Granted
Feb 28, 2023
Kind
B2
Abstract

In some aspects, the disclosure is directed to methods and systems for reducing memory utilization and increasing efficiency during affine merge mode for versatile video coding by utilizing motion vectors stored in a motion data line buffer for a prediction unit of a second coding tree unit neighboring a first coding tree unit to derive control point motion vectors for the first coding tree unit.

Claims (33)

1. A method for reduced memory utilization for motion data derivation in encoded video, comprising:

determining, by a video decoder of a device from an input video bitstream, one or more control point motion vectors of a first prediction unit of a first coding tree unit, based on a plurality of motion vectors of one or more second prediction units neighboring the first prediction unit stored in a motion data line buffer of the device, the one or more second prediction units from a second coding tree unit neighboring the first coding tree unit; and

decoding, by the video decoder, one or more sub-blocks of the first prediction unit based on the determined one or more control point motion vectors.

2. The method of claim 1 , wherein the one or more second prediction units are located at a top boundary of the first coding tree unit.

3. The method of claim 2 , wherein the plurality of motion vectors of the one or more second prediction units are stored in the motion data line buffer of the device during decoding of the first coding tree unit.

4. The method of claim 3 , further comprising deriving the one or more control point motion vectors of the first prediction unit proportional to an offset between a sample position of the first prediction unit and a sample position of the one or more second prediction units.

5. The method of claim 3 , further comprising:

determining, by the video decoder, one or more second control point motion vectors of another prediction unit of the first coding tree unit based on the one or more control point motion vectors, responsive to one or more third prediction units neighboring the another prediction unit not being located at the top boundary of the first coding tree unit; and

decoding, by the video decoder, one or more sub-blocks of the another prediction unit based on the determined one or more second control point motion vectors.

6. The method of claim 1 , wherein determining the one or more control point motion vectors further comprises calculating an offset from motion data of the one or more second prediction units neighboring the first prediction unit based on a height or width of the one or more second prediction units.

7. The method of claim 6 , wherein an identification of the height or width of the one or more second prediction units is stored in an affine motion data line buffer.

8. The method of claim 1 , wherein decoding the one or more sub-blocks of the first prediction unit based on the determined one or more control point motion vectors further comprises deriving sub-block motion data of the one or more sub-blocks based on the determined one or more control point motion vectors.

9. The method of claim 1 , further comprising providing, by the video decoder to a display device, the decoded one or more sub-blocks of the first prediction unit.

10. A system for reduced memory utilization for motion data derivation in encoded video, comprising:

a motion data line buffer; and

a video decoder, configured to:

determine, from an input video bitstream, one or more control point motion vectors of a first prediction unit of a first coding tree unit, based on a plurality of motion vectors of one or more second prediction units neighboring the first prediction unit stored in the motion data line buffer, the one or more second prediction units from a second coding tree unit neighboring the first coding tree unit, and

decode one or more sub-blocks of the first prediction unit based on the determined one or more control point motion vectors.

11. The system of claim 10 , wherein the one or more second prediction units are located at a top boundary of the first coding tree unit.

12. The system of claim 11 , wherein the plurality of motion vectors of the one or more second prediction units are stored in the motion data line buffer during decoding of the first coding tree unit.

13. The system of claim 12 , wherein the video decoder is further configured to derive the one or more control point motion vectors of the first prediction unit proportional to an offset between a sample position of the first prediction unit and a sample position of the one or more second prediction units.

14. The system of claim 12 , wherein the video decoder is further configured to:

determine one or more second control point motion vectors of another prediction unit of the first coding tree unit based on the one or more control point motion vectors, responsive to one or more third prediction units neighboring the another prediction unit not being located at the top boundary of the first coding tree unit, and

decode one or more sub-blocks of the another prediction unit based on the determined one or more second control point motion vectors.

15. The system of claim 10 , wherein the video decoder is further configured to calculate an offset from motion data of the one or more second prediction units neighboring the first prediction unit based on a height or width of the one or more second prediction units.

16. The system of claim 15 , further comprising an affine motion data line buffer configured to store an identification of the height or width of the one or more second prediction units.

17. The system of claim 10 , wherein the video decoder is further configured to derive sub-block motion data of the one or more sub-blocks based on the determined one or more control point motion vectors.

18. A method for reduced memory utilization for motion data derivation in encoded video, comprising:

for a first prediction unit of a first coding tree unit of an input video bitstream, determining, by a video decoder of a device, whether one or more second prediction units neighboring the first prediction unit are located at a top boundary of the first coding tree unit, the one or more second prediction units stored in a motion data line buffer of the device;

either:

(i) responsive to the one or more second prediction units being located at the top boundary of the first coding tree unit, deriving motion vectors for the first prediction unit from motion vectors of the one or more second prediction units, or

(ii) responsive to the one or more second prediction units not being located at the top boundary of the first coding tree unit, deriving motion vectors for the first prediction unit from one or more control point motion vectors of the one or more second prediction units; and

decoding, by the video decoder, one or more sub-blocks of the first prediction unit based on the derived motion vectors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2020
From: ZHOU, MINHUA
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 053618/0452 →
Continuity (5)
Continuation 16453672 · Jun 26, 2019
Provisional Application 62724464 · Aug 29, 2018
Provisional Application 62694643 · Jul 6, 2018
Provisional Application 62690583 · Jun 27, 2018
Related Publication 20200396468A1 · Dec 17, 2020