IP Library Granted Patent US 11,902,560
Granted Patent B2
US 11,902,560 · App. 17/051,825 · Granted Feb 13, 2024

Motion compensation for video encoding and decoding

Inventors: Ya Chen (Rennes, FR); Franck Galpin (Thorigné-Fouillard, FR); Tangi Poirier (Thorigné-Fouillard, FR)
Assignee: InterDigital VC Holdings, Inc.
H04N19/513H04N19/132H04N19/149H04N19/176H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,902,560
App. No.
17/051,825
Granted
Feb 13, 2024
Kind
B2
Abstract

A video codec can involve processing video information based on a motion model involving a coding unit including a plurality of sub-blocks, such as an affine motion model, to produce motion compensation information, obtaining a local illumination compensation model, and encoding or decoding the video information based on the motion compensation information and the local illumination compensation model.

Claims (51)

1. A method of encoding comprising:

obtaining local illumination compensation information associated with video information based on illumination changes in the video information and based on a plurality of motion vectors included in motion compensation information associated with the video information, the motion compensation information obtained based on an affine motion model; and

encoding the video information based on the local illumination compensation information and the motion compensation information;

wherein the video information comprises a first block including a first row of sub-blocks and a first column of sub-blocks, and the plurality of motion vectors comprises a group of motion vectors associated with a first subset of sub-blocks included in the first row of sub-blocks and a second subset of sub-blocks included in the first column of sub-blocks; and

wherein obtaining the local illumination compensation information is based on a set of reconstructed samples obtained based on the group of motion vectors; and

wherein the affine motion model comprises determining a local illumination compensation flag based on at least one affine control point associated with a second block neighboring the first block.

2. The method of claim 1 , wherein obtaining the local illumination compensation information comprises determining at least one model parameter of a linear model of illumination changes in the video information based on the group of motion vectors.

3. The method of claim 2 ,

wherein sub-blocks of the first block of video information are partitioned into a plurality of groups of sub-blocks;

wherein the at least one model parameter is determined for each of the plurality of groups of sub-blocks; and

wherein encoding or decoding based on the local illumination compensation information comprises processing video information associated with each group of sub-blocks using a respective at least one model parameter determined for each group of sub-blocks.

4. A method of decoding comprising:

obtaining local illumination compensation information associated with video information based on illumination changes in the video information and based on a plurality of motion vectors included in motion compensation information associated with the video information, the motion compensation information obtained based on an affine motion model; and

decoding the video information based on the local illumination compensation information and the motion compensation information;

wherein the video information comprises a first block including a first row of sub-blocks and a first column of sub-blocks, and the plurality of motion vectors comprises a group of motion vectors associated with a first subset of sub-blocks included in the first row of sub-blocks and a second subset of sub-blocks included in the first column of sub-blocks; and

wherein obtaining the local illumination compensation information is based on a set of reconstructed samples obtained based on the group of motion vectors; and

wherein the affine motion model comprises determining a local illumination compensation flag based on at least one affine control point associated with a second block neighboring the first block.

5. The method of claim 4 , wherein obtaining the local illumination compensation information comprises determining at least one model parameter of a linear model of illumination changes in the video information based on the group of motion vectors.

6. The method of claim 5 ,

wherein sub-blocks of the first block of video information are partitioned into a plurality of groups of sub-blocks;

wherein the at least one model parameter is determined for each of the plurality of groups of sub-blocks; and

wherein encoding or decoding based on the local illumination compensation information comprises processing video information associated with each group of sub-blocks using a respective at least one model parameter determined for each group of sub-blocks.

7. A non-transitory computer readable medium storing executable program instructions to cause a computer executing the program instructions to perform a method according to claim 4 .

8. An apparatus comprising:

one or more processors configured to:

obtain local illumination compensation information associated with video information based on illumination changes in the video information and based on a plurality of motion vectors included in motion compensation information associated with the video information, the motion compensation information obtained based on an affine motion model; and

encode the video information based on the local illumination compensation information and the motion compensation information;

wherein the video information comprises a first block including a first row of sub-blocks and a first column of sub-blocks, and the plurality of motion vectors comprises a group of motion vectors associated with a first subset of sub-blocks included in the first row of sub-blocks and a second subset of sub-blocks included in the first column of sub-blocks; and

wherein the local illumination compensation information is obtained based on a set of reconstructed samples obtained based on the group of motion vectors; and

wherein the affine motion model comprises a local illumination compensation flag determined based on at least one affine control point associated with a second block neighboring the first block.

9. The apparatus of claim 8 , wherein obtaining the local illumination compensation information comprises determining at least one model parameter of a linear model of illumination changes in the video information based on the group of motion vectors.

10. The apparatus of claim 9 ,

wherein sub-blocks of the first block of video information are partitioned into a plurality of groups of sub-blocks;

wherein the at least one model parameter is determined for each of the plurality of groups of sub-blocks; and

wherein encoding or decoding based on the local illumination compensation information comprises processing video information associated with each group of sub-blocks using a respective at least one model parameter determined for each group of sub-blocks.

11. A non-transitory computer readable medium storing executable program instructions to cause a computer executing the program instructions to perform a method according to claim 8 .

12. An apparatus comprising:

one or more processors configured to:

obtain local illumination compensation information associated with video information based on illumination changes in the video information and based on a plurality of motion vectors included in motion compensation information associated with the video information, the motion compensation information obtained based on an affine motion model; and

decode the video information based on the local illumination compensation information and the motion compensation information;

wherein the video information comprises a first block including a first row of sub-blocks and a first column of sub-blocks, and the plurality of motion vectors comprises a group of motion vectors associated with a first subset of sub-blocks included in the first row of sub-blocks and a second subset of sub-blocks included in the first column of sub-blocks; and

wherein the local illumination compensation information is obtained based on a set of reconstructed samples obtained based on the group of motion vectors; and

wherein the affine motion model comprises a local illumination compensation flag determined based on at least one affine control point associated with a second block neighboring the first block.

13. The apparatus of claim 12 , wherein obtaining the local illumination compensation information comprises determining at least one model parameter of a linear model of illumination changes in the video information based on the group of motion vectors.

14. The apparatus of claim 13 ,

wherein sub-blocks of the first block of video information are partitioned into a plurality of groups of sub-blocks;

wherein the at least one model parameter is determined for each of the plurality of groups of sub-blocks; and

wherein encoding or decoding based on the local illumination compensation information comprises processing video information associated with each group of sub-blocks using a respective at least one model parameter determined for each group of sub-blocks.

15. The apparatus of claim 12 , further comprising:

at least one of (i) an antenna configured to receive a signal, the signal including data representative of the video information, (ii) a band limiter configured to limit the signal to a band of frequencies that includes the data representative of the video information, or (iii) a display configured to display an image from the video information.

16. The apparatus of claim 12 , wherein the apparatus comprises one of a television, a television signal receiver, a set-top box, a gateway device, a mobile device, a cell phone, a tablet, a computer such as a laptop computer or a desktop computer, a server, or other electronic device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2020
From: CHEN, YA; GALPIN, FRANCK; POIRIER, TANGI
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 054241/0098 →
Priority Claims (1)
EP 18305568.0 · May 9, 2018 · regional
Continuity (1)
Related Publication 20210243465A1 · Aug 5, 2021
Cited By (1)
US 12,707,074