IP Library Granted Patent US 12,556,737
Granted Patent B2
US 12,556,737 · App. 18/538,846 · Granted Feb 17, 2026

Motion compensation for video encoding and decoding

Inventors: Ya Chen (Rennes, FR); Franck Galpin (Thorigne-Fouillard, FR); Tangi Poirier (Thorigné-fouillard, FR)
Assignee: InterDigital VC Holdings, Inc.
H04N19/513H04N19/132H04N19/149H04N19/176H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,556,737
App. No.
18/538,846
Granted
Feb 17, 2026
Kind
B2
Abstract

A video codec can involve processing video information based on a motion model involving a coding unit including a plurality of sub-blocks, such as an affine motion model, to produce motion compensation information, obtaining a local illumination compensation model, and encoding or decoding the video information based on the motion compensation information and the local illumination compensation model.

Claims (82)

1 . A video decoding device comprising:

a processor configured to:

obtain an affine motion model associated with a block, the affine motion model comprising a plurality of control point motion vectors;

obtain local illumination compensation information associated with the block based on the plurality of control point motion vectors of the affine motion model associated with the block; and

decode the block based on the affine motion model and the local illumination compensation information.

2 . The video decoding device of claim 1 , wherein the processor is further configured to:

obtain a prediction of the block based on the affine motion model; and

adjust the prediction of the block based on the local illumination compensation information wherein the block is decoded based on the adjusted prediction of the block.

3 . The video decoding device of claim 1 ,

wherein the block comprises a plurality of sub-blocks, and

wherein the processor is further configured to:

obtain a plurality of prediction sub-blocks based on the affine motion model; and

adjust the plurality of prediction sub-blocks based on the local illumination compensation information, wherein the block is decoded based on the adjusted plurality of prediction sub-blocks.

4 . The video decoding device of claim 1 ,

wherein the block comprises a plurality of sub-blocks, and

wherein the processor is further configured to:

determine, based on the plurality of control point motion vectors, a first motion vector associated with a first sub-block of the plurality of sub-blocks;

derive a set of local illumination compensation parameters based on the first motion vector and a template of the block;

obtain a plurality of prediction sub-blocks based on the affine motion model; and

apply the set of local illumination compensation parameters to the plurality of prediction sub-blocks.

5 . The video decoding device of claim 4 ,

wherein the processor configured to derive the set of local illumination compensation parameters based on the first motion vector and the template of the block is further configured to:

determine, based on the first motion vector, at least one sample associated with a reference block; and

compare the at least one sample associated with the reference block to the template of the block.

6 . The video decoding device of claim 5 ,

wherein the processor configured to compare the at least one sample associated with the reference block to the template of the block is further configured to compare the at least one sample associated with the reference block to one or more samples comprised in the template.

7 . The video decoding device of claim 1 ,

wherein the block comprises a plurality of sub-blocks, and

wherein the processor is further configured to:

determine, based on the plurality of control point motion vectors, a plurality of motion vectors associated with respective sub-blocks in the plurality of sub-blocks;

obtain a plurality of template samples based on the plurality of motion vectors associated with respective sub-blocks;

derive a set of local illumination compensation parameters based on the plurality of template samples and a template of the block;

obtain a plurality of prediction sub-blocks based on the affine motion model; and

apply the set of local illumination compensation parameters to the plurality of prediction sub-blocks.

8 . The video decoding device of claim 7 ,

wherein the processor configured to obtain the plurality of template samples based on the plurality of motion vectors associated with the respective sub-blocks is further configured to:

determine, based on the plurality of motion vectors, at least one of the plurality of template samples for each of a corresponding one of the respective sub-blocks.

9 . The video decoding device of claim 8 , wherein the plurality of template samples form a quasi-L shape.

10 . The video decoding device of claim 8 ,

wherein the processor configured to derive the set of local illumination compensation parameters based on the plurality of template samples and the template of the block is further configured to:

compare each of the plurality of template samples to a corresponding sample comprised in the template and associated with a respective sub-block.

11 . A method of video decoding, comprising:

obtaining an affine motion model associated with a block, the affine motion model comprising a plurality of control point motion vectors;

obtaining local illumination compensation information associated with the block based on the plurality of control point motion vectors of the affine motion model associated with the block; and

decoding the block based on the affine motion model and the local illumination compensation information.

12 . The method of claim 11 , further comprising:

obtaining a prediction of the block based on the affine motion model; and

adjusting the prediction of the block based on the local illumination compensation information wherein the block is decoded based on the adjusted prediction of the block.

13 . The method of claim 11 ,

wherein the block comprises a plurality of sub-blocks, and

wherein the method further comprises:

obtaining a plurality of prediction sub-blocks based on the affine motion model; and

adjusting the plurality of prediction sub-blocks based on the local illumination compensation information, wherein the block is decoded based on the adjusted plurality of adjusted prediction sub-blocks.

14 . The method of claim 11 ,

wherein the block comprises a plurality of sub-blocks, and

wherein the method further comprises:

determining, based on the plurality of control point motion vectors, a first motion vector associated with a first sub-block of the plurality of sub-blocks;

deriving a set of local illumination compensation parameters based on the first motion vector and a template of the block;

obtaining a plurality of prediction sub-blocks based on the affine motion model; and

applying the set of local illumination compensation parameters to the plurality of prediction sub-blocks.

15 . The method of claim 14 ,

wherein deriving the set of local illumination compensation parameters based on the first motion vector and the template of the block comprises:

determining, based on the first motion vector, at least one sample associated with a reference block; and

comparing the at least one sample associated with the reference block to the template of the block.

16 . The method of claim 15 ,

wherein comparing the at least one sample associated with the reference block to the template of the block comprises comparing the at least one sample associated with the reference block to one or more samples comprised in the template.

17 . The method of claim 11 ,

wherein the block comprises a plurality of sub-blocks, and

wherein the method further comprises:

determining, based on the plurality of control point motion vectors, a plurality of motion vectors associated with respective sub-blocks in the plurality of sub-blocks;

obtaining a plurality of template samples based on the plurality of motion vectors associated with respective sub-blocks;

deriving a set of local illumination compensation parameters based on the plurality of template samples and a template of the block;

obtaining a plurality of prediction sub-blocks based on the affine motion model; and

applying the set of local illumination compensation parameters to the plurality of prediction sub-blocks.

18 . The method of claim 17 ,

wherein obtaining the plurality of template samples based on the plurality of motion vectors associated with the respective sub-blocks comprises:

determining, based on the plurality of motion vectors, at least one of the plurality of template samples for each of a corresponding one of the respective sub-blocks.

19 . The method of claim 18 , wherein the plurality of template samples form a quasi-L shape.

20 . A non-transitory computer readable medium having stored thereon executable program instructions that cause a computer executing the executable program instructions to perform a method comprising:

obtaining an affine motion model associated with a block, the affine motion model comprising a plurality of control point motion vectors;

obtaining local illumination compensation information associated with the block based on the plurality of control point motion vectors of the affine motion model associated with the block; and

decoding the block based on the affine motion model and the local illumination compensation information.

Priority Claims (1)
EP 18305568 · May 9, 2018 · regional
Continuity (2)
Continuation 17051825
Related Publication 20240121423A1 · Apr 11, 2024
References Cited (24)
US 20160295240A1 · Kim et al. · 2016 [cited by applicant]
US 20170150183A1 · Zhang et al. · 2017 [cited by applicant]
US 20180098086A1 · Chuang · 2018 [cited by examiner]
US 20180098087A1 · Li et al. · 2018 [cited by applicant]
US 20180270500A1 · Li · 2018 [cited by examiner]
US 20190058896A1 · Huang et al. · 2019 [cited by applicant]
US 20200288139A1 · Lee · 2020 [cited by examiner]
US 20210076029A1 · Han · 2021 [cited by examiner]
CN 105659604A · 2016 [cited by applicant]
CN 107147911A · 2017 [cited by applicant]
CN 108293112A · 2018 [cited by applicant]
EP 3316580A2 · 2018 [cited by applicant]
TW 201803351A · 2018 [cited by applicant]
WO 2016200777A1 · 2016 [cited by applicant]
WO 2018070152A1 · 2018 [cited by applicant]
Chen, et al., “Algorithm Description of Joint Exploration Test Model”, Qualcomm Incorporated, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3, and ISO/IEC JTC 1/SC 29/WG 11, 2nd Meeting: San Diego, USA, Feb. 20-… [cited by applicant]
Chen, et al., “Algorithm Description of Joint Exploration Test Model 2”, JVET-B1001_V3, Editors, Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 2nd Meeting, San Diego, California, USA,… [cited by applicant]
Chen, et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)”, JVET-G1001-V1, Editors, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Ju… [cited by applicant]
Chen, et al., “CE1-Related: Combination of LIC and Affine”, JVET-N0171-v1, Huawei Technologies Co., Ltd, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC I/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. … [cited by applicant]
ITU-T, “High Efficiency Video Coding”, H.265, Telecommunications Standardization Sector of ITU, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Oct. 2014, 540… [cited by applicant]
ITU-T, “High Efficiency Video Coding”, H.265, Telecommunications Standardization Sector of ITU, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Apr. 2015, 634… [cited by applicant]
Liu, et al., “Local Illumination Compensation”, VCEG-AZ06, Qualcomm Incorporated, ITU—Telecommunications Standardization Sector, Study Group 16 Question 6, Video Coding Experts Group (VCEG), 52nd Meeting, Warsaw, Poland… [cited by applicant]
Marzuki, et al., “Overview of Potential Technologies for Future Video Coding Standard (FVC) in JEM Software: Status and Review”, IEIE Transactions on Smart Processing and Computing, vol. 7, No. 1, Feb. 28, 2018, pp. 22-… [cited by applicant]
Toma, et al., “Description of SDR Video Coding Technology Proposal by Panasonic”, JVET-J0020-v1, Panasonic, Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, Calif… [cited by applicant]