IP Library › Granted Patent US 12,309,419
Granted Patent B2
US 12,309,419 · App. 18/325,588 · Granted May 20, 2025

Method and apparatus of motion vector constraint for video coding

Inventors: Tzu-Der Chuang (Hsinchu, TW); Ching-Yeh Chen (Hsinchu, TW); Yu-Wen Huang (Hsinchu, TW); Chih-Wei Hsu (Hsinchu, TW)
Assignee: HFI INNOVATION INC.
H04N19/52H04N19/159H04N19/176H04N19/189
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,309,419
App. No.
18/325,588
Granted
May 20, 2025
Kind
B2
Abstract

Method and apparatus of Inter prediction for video coding are disclosed. When a sub-block motion compensation coding tool is selected for the current block, the method generates sub-block MVs (motion vectors) associated with multiple sub-blocks, which are included or contained in the current block, according to the sub-block motion compensation coding tool, constrains the sub-block MVs within a range to form constrained sub-block MVs, and applies motion compensation to the current block using the constrained sub-block MVs or applies motion compensation to the current block using one sub-block MV within the range around the primary MV in a second list if a corresponding sub-block MV in a first list is outside the range. In another method, motion compensation is applied to the current block only using reference pixels of reference sub-blocks within a primary reference block.

Claims (19)

1. A method of video coding using an inter-prediction mode in a video coding system, the method comprising:

receiving input data associated with a current block in a current picture;

when a sub-block motion compensation coding tool is selected for the current block:

deriving a primary reference block;

generating sub-block MVs (motion vectors) associated with multiple sub-blocks according to the sub-block motion compensation coding tool, wherein the current block comprises the multiple sub-blocks; and

applying motion compensation to the current block using one or more reference pixels of reference sub-blocks within the primary reference block and excluding any reference pixel of reference sub-blocks outside the primary reference block, wherein the reference sub-blocks are pointed by the sub-block MVs.

2. The method of claim 1 , wherein the primary reference block covers a reference block pointed by a primary MV.

3. The method of claim 1 , wherein any reference pixel of reference sub-blocks outside the primary reference block is replaced by a pseudo reference pixel.

4. The method of claim 3 , wherein the pseudo reference pixel corresponds to a predefined pixel value or a padding pixel of the primary reference block.

5. The method of claim 1 , wherein interpolation filter coefficients are modified to exclude any reference pixel of reference sub-blocks outside the primary reference block.

6. The method of claim 1 , wherein size and shape of the primary reference block is determined according to size and shape of the current block or current sub-block, the primary MV, inter prediction direction of the current or the current sub-block, or the combination of the above.

7. The method of claim 1 , wherein the sub-block motion compensation coding tool is selected from a group comprising ATMVP (Advanced Temporal Motion Vector Prediction), STMVP (Spatial-Temporal Motion Vector Prediction), affine prediction, and sub-block refined PMVD (Pattern-based Motion Vector Derivation) mode.

8. The method of claim 1 , further comprising deriving a primary motion vector associated with the primary reference block.

9. An apparatus of video coding using an inter-prediction mode in a video coding system, the apparatus comprising one or more electronic devices or processors configured to:

receive input data associated with a current block in a current picture;

when a sub-block motion compensation coding tool is selected for the current block:

derive a primary reference block;

generate sub-block MVs (motion vectors) associated with multiple sub-blocks according to the sub-block motion compensation coding tool, wherein the current block comprises the multiple sub-blocks; and

apply motion compensation to the current block using one or more reference pixels of reference sub-blocks within the primary reference block and exclude any reference pixel of reference sub-blocks outside the primary reference block, wherein the reference sub-blocks are pointed by the sub-block MVs.

Continuity (4)
Continuation 16613674
Provisional Application 62519214 · Jun 14, 2017
Provisional Application 62507838 · May 18, 2017
Related Publication 20230300370A1 · Sep 21, 2023
References Cited (28)
US 9094682B2 · Sugio et al. · 2015 [cited by applicant]
US 9762904B2 · Chen et al. · 2017 [cited by applicant]
US 10021414B2 · Seregin et al. · 2018 [cited by applicant]
US 10645411B2 · Lim et al. · 2020 [cited by applicant]
US 20100098169A1 · Budagavi · 2010 [cited by applicant]
US 20130163668A1 · Chen · 2013 [cited by applicant]
US 20150326875A1 · Chen · 2015 [cited by examiner]
US 20180098063A1 · Chen · 2018 [cited by examiner]
US 20180124411A1 · Nakagami · 2018 [cited by examiner]
US 20180332093A1 · Makower · 2018 [cited by examiner]
US 20190149837A1 · Lim et al. · 2019 [cited by applicant]
US 20200045336A1 · Xiu · 2020 [cited by applicant]
US 20210127133A1 · Chen · 2021 [cited by examiner]
CN 103583044A · 2014 [cited by applicant]
CN 103650507A · 2014 [cited by applicant]
CN 104012096A · 2014 [cited by applicant]
CN 104885458A · 2015 [cited by applicant]
CN 105393539A · 2016 [cited by applicant]
KR 1020120088488A · 2012 [cited by applicant]
WO 2013139250A1 · 2013 [cited by applicant]
WO 2017036414A1 · 2017 [cited by applicant]
European Search Report dated Oct. 13, 2020, issued in application No. EP 18801342.9. [cited by applicant]
Hsu, C.W., et al.; “Description of SOR video coding technology proposal by MediaTek;” Apr. 2018; pp. 1-88. [cited by applicant]
Chen, J., et al.; “Algorithm Description of Joint Exploration Test Model 6 (JEM6);” Joint Video Exploration Team JVET) of ITU-T SG 16 WP 3 and ISO/IE JTC 1/SC 29/WG 11; Mar.-Apr. 2017; pp. 1-49. [cited by applicant]
Suzuki, Y.; “Simplification of JVT-0110 {Block-size Adaptive MC for Complexity Reduction);” Joint Video Team (JVT) of 1S0/IEC MPEG & ITU-T VCEG (1SO/IED JTC1/SC29N/WG11 and ITU-T SG 16 Q.6); Dec. 2002; pp. 1-12. [cited by applicant]
Chinese language office action Mar. 31, 2021, issued in application No. CN 201880032510.3. [cited by applicant]
International Search Report dated Aug. 13, 2018, issued in application No. PCT/CN2018/087351. [cited by applicant]
Chen,J., etal.;“AlgorithmDescriptionofJointExploration TestModel3;” JointVideoExplorationTeam(JVET)of ITU-T SG 16 WP 3 and 1SO/IEC JTC 1/SC 29/WG 11; May-Jun. 2016; pp. 1-37. [cited by applicant]