IP Library Granted Patent US 12,363,338
Granted Patent B2
US 12,363,338 · App. 17/352,127 · Granted Jul 15, 2025

Methods and apparatus of video coding for deriving affine motion vectors for chroma components

Inventors: Yi-Wen Chen (San Diego, CA); Xianglin Wang (San Diego, CA)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/521H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,363,338
App. No.
17/352,127
Granted
Jul 15, 2025
Kind
B2
Abstract

A method for video coding is provided. The method may include: arranging video data in a plurality of luma subblocks and a plurality of chroma subblocks, where each chroma subblock corresponds to one or more luma subblocks; and deriving an affine motion vector for a chroma subblock out of the chroma subblocks using motion vectors of the corresponding luma subblocks. The video data has a color sub-sampling format, and the corresponding luma subblocks are derived according to the color sub-sampling format.

Claims (29)

1. A method for video decoding, comprising:

arranging video data in a plurality of luma subblocks and a plurality of chroma subblocks, wherein each chroma subblock corresponds to one or more luma subblocks, wherein the video data has a color sampling format, and the plurality of luma subblocks are derived according to the color sampling format;

determining the color sampling format of the video data;

deriving an affine motion vector in an affine Motion Vector Field (MVF) for a chroma subblock out of the plurality of chroma subblocks using an average luma motion vector derived from motion vectors of the corresponding luma subblocks, wherein the motion vectors from different corresponding luma subblocks are used for deriving the average luma motion vector according to different variables corresponding to different color sampling formats, wherein the motion vectors of the corresponding luma subblocks are derived by deriving affine motion vectors for the corresponding luma subblocks based on a control point based affine motion model and invoking a rounding process with the affine motion vectors of the corresponding luma subblocks, rightShift set equal to 7, and leftShift set equal to 0 as inputs, and

wherein the variables comprise a first variable and a second variable according to the color sampling formats, the first variable is SubWidthC indicating width of chroma subblocks and the second variable is SubHeightC indicating height of chroma subblocks,

in response to determining that both of the first variable and the second variable are equal to 1, the average luma motion vector is the motion vector of one corresponding luma subblock without the averaging process, wherein the one corresponding luma subblock is determined as a luma subblock of which the position is the same as that of the chroma subblock, and

in response to determining that the first variable is equal to 2 and the second variable is equal to 1, the average luma motion vector is derived by taking an average of the motion vectors of two corresponding luma subblocks, wherein the two corresponding luma subblocks are luma subblocks of which the horizontal positions are different from that of the chroma subblock and the vertical positions are the same as that of the chroma subblock.

2. The method of claim 1 , further comprising:

left shifting the motion vectors of control points of the corresponding luma subblocks; and

deriving the motion vectors of the corresponding luma subblocks by the left shifted motion vectors.

3. An apparatus for video decoding, comprising:

a processor; and

a memory configured to store instructions executable by the processor;

wherein the processor, upon execution of the instructions, is configured to:

arrange video data in a plurality of luma subblocks and a plurality of chroma subblocks, wherein each chroma subblock corresponds to one or more luma subblocks, wherein the video data has a color sampling format, and the plurality of luma subblocks are derived according to the color sampling format;

determine the color sampling format of the video data;

derive an affine motion vector in an affine Motion Vector Field (MVF) for a chroma subblock out of the plurality of chroma subblocks using an average luma motion vector derived from motion vectors of the corresponding luma subblocks, wherein the motion vectors from different corresponding luma subblocks are used for deriving the average luma motion vector according to different variables corresponding to different color sampling formats, wherein the motion vectors of the corresponding luma subblocks are derived by deriving affine motion vectors for the corresponding luma subblocks based on a control point based affine motion model and invoking a rounding process with the affine motion vectors of the corresponding luma subblocks, rightShift set equal to 7, and leftShift set equal to 0 as inputs, and

wherein the variables comprise a first variable and a second variable according to the color sampling formats, the first variable is SubWidthC indicating width of chroma subblocks and the second variable is SubHeightC indicating height of chroma subblocks,

in response to determining that both of the first variable and the second variable are equal to 1, the average luma motion vector is the motion vector of one corresponding luma subblock without the averaging process, wherein the one corresponding luma subblock is determined as a luma subblock of which the position is the same as that of the chroma subblock, and

in response to determining that the first variable is equal to 2 and the second variable is equal to 1, the average luma motion vector is derived by taking an average of the motion vectors of two corresponding luma subblocks, wherein the two corresponding luma subblocks are luma subblocks of which the horizontal positions are different from that of the chroma subblock and the vertical positions are the same as that of the chroma subblock.

4. The apparatus of claim 3 , wherein the processor is further configured to: left shift the motion vectors of control points of the corresponding luma subblocks and derive the motion vectors of the corresponding luma subblocks by the left shifted motion vectors.

5. A non-transitory computer readable storage medium, comprising instructions stored therein, wherein, when the instructions are executed by a processor, the instructions cause the processor to perform a method for video decoding and to store the decoded bitstream in the non-transitory computer-readable storage medium, the method for video decoding comprises:

arranging video data in a plurality of luma subblocks and a plurality of chroma subblocks, wherein each chroma subblock corresponds to one or more luma subblocks, wherein the video data has a color sampling format, and the plurality of luma subblocks are derived according to the color sampling format;

determining the color sampling format of the video data;

deriving an affine motion vector in an affine Motion Vector Field (MVF) for a chroma subblock out of the plurality of chroma subblocks using an average luma motion vector derived from motion vectors of the corresponding luma subblocks, wherein the motion vectors from different corresponding luma subblocks are used for deriving the average luma motion vector according to different variables corresponding to different color sampling formats, wherein the motion vectors of the corresponding luma subblocks are derived by deriving affine motion vectors for the corresponding luma subblocks based on a control point based affine motion model and invoking a rounding process with the affine motion vectors of the corresponding luma subblocks, rightShift set equal to 7, and leftShift set equal to 0 as inputs, and

wherein the variables comprise a first variable and a second variable according to the color sampling formats, the first variable is SubWidthC indicating width of chroma subblocks and the second variable is SubHeightC indicating height of chroma subblocks,

in response to determining that both of the first variable and the second variable are equal to 1, the average luma motion vector is the motion vector of one corresponding luma subblock without the averaging process, wherein the one corresponding luma subblock is determined as a luma subblock of which the position is the same as that of the chroma subblock, and

in response to determining that the first variable is equal to 2 and the second variable is equal to 1, the average luma motion vector is derived by taking an average of the motion vectors of two corresponding luma subblocks, wherein the two corresponding luma subblocks are luma subblocks of which the horizontal positions are different from that of the chroma subblock and the vertical positions are the same as that of the chroma subblock.

6. The non-transitory computer readable storage medium of claim 5 , wherein the method for video decoding further comprises: left shifting the motion vectors of control points of the corresponding luma subblocks and deriving the motion vectors of the corresponding luma subblocks by the left shifted motion vectors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2021
From: CHEN, YI-WEN; WANG, XIANGLIN
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 056589/0953 →
Continuity (3)
Continuation PCTUS2019066098 · Dec 21, 2019
Provisional Application 62784369 · Dec 21, 2018
Related Publication 20210314601A1 · Oct 7, 2021
References Cited (45)
US 20120288006A1 · Sato · 2012 [cited by applicant]
US 20130022120A1 · Gupte et al. · 2013 [cited by applicant]
US 20130051469A1 · Park et al. · 2013 [cited by applicant]
US 20150124865A1 · Kim et al. · 2015 [cited by applicant]
US 20160227245A1 · Liu · 2016 [cited by examiner]
US 20160337661A1 · Pang et al. · 2016 [cited by applicant]
US 20170105014A1 · Lee et al. · 2017 [cited by applicant]
US 20170272748A1 · Seregin et al. · 2017 [cited by applicant]
US 20170332095A1 · Zou et al. · 2017 [cited by applicant]
US 20180205946A1 · Zhang et al. · 2018 [cited by applicant]
US 20200099945A1 · Pham Van · 2020 [cited by examiner]
US 20200120353A1 · Xu · 2020 [cited by examiner]
US 20200260108A1 · Chen · 2020 [cited by examiner]
CN 1347620A · 2002 [cited by applicant]
CN 101005620A · 2007 [cited by applicant]
CN 102714735A · 2012 [cited by applicant]
CN 104247425A · 2014 [cited by applicant]
CN 105723707A · 2016 [cited by applicant]
CN 107211147A · 2017 [cited by applicant]
CN 108353184A · 2018 [cited by applicant]
CN 108432250A · 2018 [cited by applicant]
CN 108781282A · 2018 [cited by applicant]
EP 2230849A1 · 2010 [cited by applicant]
KR 1020150070848A · 2015 [cited by applicant]
WO 2016160608A1 · 2016 [cited by applicant]
WO 2017086748A1 · 2017 [cited by applicant]
WO 2017171107A1 · 2017 [cited by applicant]
WO 2017204532A1 · 2017 [cited by applicant]
WO 2018062921A1 · 2018 [cited by applicant]
WO 2018070152A1 · 2018 [cited by applicant]
WO 2018110180A1 · 2018 [cited by applicant]
WO 2018221631A1 · 2018 [cited by applicant]
WO 2020072788A1 · 2020 [cited by applicant]
Bross, Benjamin, et al., “Versatile Video Coding (Draft 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-K1001-v7, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, (p. … [cited by examiner]
Bross et al. (“Versatile Video Coding (Draft 3)”, JVET-L1001-v7, Oct. 3-12, 2018). (Year: 2018). [cited by examiner]
International Search Report of PCT Application No. PCT/US2019/066098 dated Apr. 13, 2020, (3p). [cited by applicant]
Bross, Benjamin, et al., “Versatile Video Coding (Draft 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-K1001-v7, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, (141… [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 3)”-2, JVET-L1001-v7, 12 Meeting, Macao, China, Oct. 3-12, 2018 (first cited in the Office Action of the counterpart Japanese Application No. 2021-535786 from JPO on… [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 3)” JVET-L1001-v7, 12 Meeting, Macao, China, Oct. 3-12, 2018, (first cited in the European search report of the counterpart European Application No. 19899829.6 from … [cited by applicant]
Filippov (Huawei) et al., “Support of 4:4:4 and 4:″2:2 chroma formats in VVC” JVET-N0671-v3, 14th Meeting, Geneva, CH, Mar. 19-27, 2019 (first cited in the European search report of the counterpart European Application … [cited by applicant]
Zhang (Bytedance) K et al: “CE4: Affine Prediction with 4x4 Sub-blocks for Chroma Components (Test 4.1.16)”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IECJTCI/SC29/WG1… [cited by applicant]
Zhang (Bytedance) K et al: “CE4: Affine Prediction with 4x4 Sub-blocks for Chroma Components (Test 4.1.16)”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IECJTCI/SC29/WG1… [cited by applicant]
Summons to attend oral proceedings for European patent application 19899829.6 from the European Patent Office dated Jan. 4, 2023, (11p). [cited by applicant]
First CNOA issued on Application No. 2023109883860 dated Feb. 8, 2024 with English translation, (10p). [cited by applicant]
Notice of Hearing of Indian application No. 202117027332 dated on Jan. 10, 2024 with English translation, (3p). [cited by applicant]