IP Library Granted Patent US 11,778,218
Granted Patent B2
US 11,778,218 · App. 17/748,839 · Granted Oct 3, 2023

Method and apparatus for cross-component filtering

Inventors: Yixin Du (Los Altos, CA); Xin Zhao (Santa Clara, CA); Liang Zhao (Sunnyvale, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/44H04N19/117H04N19/132H04N19/137H04N19/159H04N19/176H04N19/186H04N19/513H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,778,218
App. No.
17/748,839
Granted
Oct 3, 2023
Kind
B2
Abstract

Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus includes processing circuitry. For example, the processing circuitry obtains reconstructed samples in a temporal source frame that is different from a current frame, and determines filter coefficients of a filter for a current block in the current frame based on at least the reconstructed samples in the temporal source frame. The processing circuitry generates prediction information of the current block based on the determined filter coefficients. The temporal source frame is an inter coded frame that satisfies at least one of a quantization parameter (QP) requirement, a temporal distance requirement, and a reference picture requirement.

Claims (65)

1. A method for video encoding, comprising:

obtaining reconstructed samples in a temporal source frame that is different from a current frame;

determining filter coefficients of a filter for a current block in the current frame based on at least the reconstructed samples in the temporal source frame; and

generating prediction information of the current block based on the determined filter coefficients,

wherein the temporal source frame is an inter coded frame that satisfies at least one of:

a quantization parameter (QP) requirement that requires the inter coded frame to have a lower QP value than the current frame;

a temporal distance requirement that requires a temporal distance between the inter coded frame and the current frame is less than a threshold; and

a reference picture requirement that requires the inter coded frame to be a reference picture that is used in motion compensation during a reconstruction of the current frame.

2. The method of claim 1 , further comprising at least one of:

applying the filter to a luma component of the temporal source frame to generate offsets for reconstructed samples of the current block;

applying the filter to a chroma component of the temporal source frame to generate the offsets for the reconstructed samples of the current block; and

applying the filter to a weighted sum of the luma component and the chroma component of the temporal source frame to generate the offsets for the reconstructed samples of the current block.

3. The method of claim 1 , further comprising:

applying the filter to a first color component of the temporal source frame to generate offsets for reconstructed samples of the current block; and

combining a second color component of the reconstructed samples of the current block with the generated offsets for the reconstructed samples of the current block.

4. The method of claim 1 , wherein the temporal source frame is the inter coded frame that satisfies the QP requirement.

5. The method of claim 1 , wherein the temporal source frame is the inter coded frame that satisfies the temporal distance requirement.

6. The method of claim 1 , wherein the temporal source frame is the inter coded frame that satisfies the reference picture requirement.

7. The method of claim 1 , further comprising:

identifying motion information of the current block;

determining, in the temporal source frame, a corresponding block to the current block based on the identified motion information; and

applying the filter to at least reconstructed samples of the determined corresponding block to generate offsets for reconstructed samples of the current block.

8. The method of claim 7 , further comprising at least one of:

deriving the motion information as a motion vector used for motion compensation of the current block;

performing a motion estimation process to identify the motion information; and

performing the motion estimation process with the motion vector used for motion compensation of the current block as a starting point to identify the motion information.

9. The method of claim 7 , further comprising at least one of:

performing a motion estimation process using a luma component of the current block and a luma component of the temporal source frame to identify the motion information;

performing the motion estimation process using a current color component of the current block and a current color component of the temporal source frame to identify the motion information; and

performing the motion estimation process using two or more color components of the current block and the two or more color components of the temporal source frame to identify the motion information.

10. The method of claim 7 , further comprising:

applying the filter to a weighed sum of the reconstructed samples of the corresponding block and the reconstructed samples of the current block to generate the offsets.

11. The method of claim 1 , wherein the filter includes at least one of a cross component filter (CCF), an adaptive loop filter (ALF), a loop restoration filter, and an in loop constrained directional enhanced filter (CDEF).

12. An apparatus, comprising:

processing circuitry configured to:

obtain reconstructed samples in a temporal source frame that is different from a current frame;

determine filter coefficients of a filter for a current block in the current frame based on at least the reconstructed samples in the temporal source frame; and

generate prediction information of the current block based on the determined filter coefficients,

wherein the temporal source frame is an inter coded frame that satisfies at least one of:

a quantization parameter (QP) requirement that requires the inter coded frame to have a lower QP value than the current frame;

a temporal distance requirement that requires a temporal distance between the inter coded frame and the current frame is less than a threshold; and

a reference picture requirement that requires the inter coded frame to be a reference picture that is used in motion compensation during a reconstruction of the current frame.

13. The apparatus of claim 12 , wherein the processing circuitry is further configured to:

apply the filter to at least one of:

a luma component of an intra coded frame having a lower quantization parameter value than the current frame;

a chroma component of the intra coded frame having a lower quantization parameter value than the current frame; and

a weighted sum of the luma component and the chroma component of the intra coded frame having a lower quantization parameter value than the current frame.

14. The apparatus of claim 12 , wherein the processing circuitry is further configured to:

apply the filter to a first color component of the temporal source frame to generate offsets for reconstructed samples of the current block; and

combine a second color component of the reconstructed samples of the current block with the generated offsets for the reconstructed samples of the current block.

15. The apparatus according to claim 12 , wherein the temporal source frame is the inter coded frame that satisfies the QP requirement.

16. The apparatus according to claim 12 , wherein the temporal source frame is the inter coded frame that satisfies the temporal distance requirement.

17. The apparatus according to claim 12 , wherein the temporal source frame is the inter coded frame that satisfies the reference picture requirement.

18. The apparatus of claim 12 , wherein the processing circuitry is further configured to:

identify motion information of the current block;

determine, in the temporal source frame, a corresponding block to the current block based on the identified motion information; and

apply the filter to at least reconstructed samples of the determined corresponding block to generate offsets for reconstructed samples of the current block.

19. The apparatus of claim 18 , wherein the processing circuitry is further configured to perform at least one of:

deriving the motion information as a motion vector used for motion compensation of the current block;

a motion estimation process to identify the motion information; and

the motion estimation process with the motion vector used for motion compensation of the current block as a starting point to identify the motion information.

20. The apparatus of claim 18 , wherein the processing circuitry is further configured to perform at least one of:

a motion estimation process using a luma component of the current block and a luma component of the temporal source frame to identify the motion information;

the motion estimation process using a current color component of the current block and a current color component of the temporal source frame to identify the motion information; and

the motion estimation process using two or more color components of the current block and two or more color components of the temporal source frame to identify the motion information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2022
From: DU, YIXIN; ZHAO, XIN; ZHAO, LIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 059963/0083 →
Continuity (3)
Continuation 17091605 · Nov 6, 2020
Provisional Application 62975516 · Feb 12, 2020
Related Publication 20220279198A1 · Sep 1, 2022