IP Library › Granted Patent US 11,683,530
Granted Patent B2
US 11,683,530 · App. 17/568,565 · Granted Jun 20, 2023

Adaptive non-linear mapping for sample offset

Inventors: Yixin Du (Los Altos, CA); Xin Zhao (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/82H04N19/105H04N19/107H04N19/117H04N19/132H04N19/14H04N19/159H04N19/176H04N19/186H04N19/503H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,683,530
App. No.
17/568,565
Granted
Jun 20, 2023
Kind
B2
Abstract

A method for in-loop sample offset filtering in a video decoder is disclosed. The method includes obtaining at least one statistical property associated with reconstructed samples of at least a first color component in a current reconstructed data block of a video stream, selecting a target sample offset filter among a plurality of sample offset filters based on the at least one statistical property, the target sample offset filter comprising a nonlinear mapping between sample delta measures and sample offset values, and filtering a current sample in a second color component of the current reconstructed data block using the target sample offset filter and reference samples in a third color component of the current reconstructed data block to generate a filtered reconstructed sample of the current sample.

Claims (50)

1. A method for in-loop filtering of a video stream, comprising:

obtaining at least one statistical property associated with reconstructed samples of at least a first color component in a current reconstructed data block of the video stream;

selecting a target sample offset filter among a plurality of sample offset filters based on the at least one statistical property, each of the plurality of sample offset filters comprising a plurality of offset values nonlinearly mapped to a plurality of possible combinations of available sample delta measures of a plurality of reference tap positions relative to a filter tap position, the available sample delta measures comprising quantifications of available sample differences between the plurality of reference tap positions and the filter tap position; and

filtering a current reconstructed sample in a second color component of the current reconstructed data block by:

selecting a current sample offset from the plurality of offset values of the target sample offset filter based on a calculated combination of sample delta measures of a filter sample and corresponding reference samples at the plurality of reference tap positions of the filter sample in a third color component of the current reconstructed data block; and

applying the selected current sample offset to the current reconstructed sample to generate a filtered reconstructed sample of the current reconstructed sample in the second color component.

2. The method of claim 1 , wherein the first color component is a same color component as the third color component.

3. The method of claim 1 , wherein first color component is a same color component as the second color component.

4. The method of claim 1 , wherein the second color component is a different color component as the third color component.

5. The method of claim 1 , wherein the second color component is a same color component as the third color component.

6. The method of claim 1 , wherein the at least the first color component comprises one, two, or three color components.

7. The method of claim 1 , wherein the at least one statistical property comprises edge information of the current reconstructed data block.

8. The method of claim 7 , wherein:

the edge information of the current reconstructed data block comprises an edge direction derived in a Constrained Directional Enhanced Filtering (CDEF) process; and

the plurality of sample offset filters comprise N sample offset filters corresponding to N CDEF edge directions, N being an integer between 1 and 8 inclusive.

9. The method of claim 8 , wherein the plurality of sample offset filters are signaled at a frame level in high level syntax (HLS).

10. The method of claim 1 , wherein the at least one statistical property comprises a smoothness measure of the current reconstructed data block.

11. The method of claim 10 , wherein:

the smoothness measure of the current reconstructed data block is mapped to one of M predefined smoothness levels characterized by M−1 smoothness level thresholds;

the plurality of sample offset filters comprises M sample offset filters corresponding to the M predefined smoothness levels; and

the target sample offset filter is selected from the M sample offset filters according the one of the M predefined smoothness levels mapped to the smoothness measure.

12. The method of claim 1 , wherein the at least one statistical property comprises a coding information of the current reconstructed data block.

13. The method of claim 12 , wherein

coding information comprises a current prediction mode of the current reconstructed data block;

the plurality of sample offset filters correspond to different prediction modes; and

the target sample offset filter is selected from the plurality of sample offset filters according to the current prediction mode of the current reconstructed data block.

14. The method of claim 13 , wherein the different prediction modes comprise at least one of intra DC mode, intra Planar mode, intra PAETH mode, intra SMOOTH mode, intra recursive filtering mode, and inter SKIP mode.

15. The method of claim 1 , wherein each of the plurality of sample offset filters is associated with a set of filter coefficients, a number of the plurality of reference tap positions, and the plurality of reference tap positions.

16. The method of claim 1 , wherein filtering the current reconstructed sample in the second color component of the current reconstructed data block comprises:

determining a first location of the current reconstructed sample of the second color component;

identifying the filter sample of the third color component at the first location and the reference samples at the plurality of reference tap positions relative to the first location in the third color component;

determining the calculated combination of sample delta measures between the reference samples and the filter sample of the third color component of the current reconstructed data block;

extracting the current sample offset from the plurality of offset values of the target sample offset filter based on the calculated combination of sample delta measures; and

applying the current sample offset to the current reconstructed sample to generate the filtered reconstructed sample of the current reconstructed sample in the second color component.

17. The method of claim 1 , wherein:

the plurality of sample offset filters are predetermined;

the plurality of sample offset filters and an index of the selected target sample offset filter among the plurality of sample offset filters are signaled at a sequence level, a picture level, or coding tree unit level.

18. A device for in-loop filtering of a video stream, comprising a processing circuitry configured to:

obtain at least one statistical property associated with reconstructed samples of at least a first color component in a current reconstructed data block of the video stream;

select a target sample offset filter among a plurality of sample offset filters based on the at least one statistical property, each of the plurality of sample offset filters comprising a plurality of offset values nonlinearly mapped to a plurality of possible combinations of available sample delta measures of a plurality of reference tap positions relative to a filter tap position, the available sample delta measures comprising quantifications of available sample differences between the plurality of reference tap positions and the filter tap position; and

filter a current reconstructed sample in a second color component of the current reconstructed data block by:

selecting a current sample offset from the plurality of offset values of the target sample offset filter based on a calculated combination of sample delta measures of a filter sample and corresponding reference samples at the plurality of reference tap positions of the filter sample in a third color component of the current reconstructed data block; and

applying the selected current sample offset to the current reconstructed sample to generate a filtered reconstructed sample of the current reconstructed sample in the second color component.

19. The device of claim 18 , wherein the at least one statistical property comprises at least one of edge information, smoothness measure, and coding information of the current reconstructed data block.

20. A non-transitory computer readable medium for storing computer instructions, the computer instructions, when executed by a processor, causes the processor to:

obtain at least one statistical property associated with reconstructed samples of at least a first color component in a current reconstructed data block of a video stream;

select a target sample offset filter among a plurality of sample offset filters based on the at least one statistical property, each of the plurality of sample offset filters comprising a plurality of offset values nonlinearly mapped to a plurality of possible combinations of available sample delta measures of a plurality of reference tap positions relative to a filter tap position, the available sample delta measures comprising quantifications of available sample differences between the plurality of reference tap positions and the filter tap position; and

filter a current reconstructed sample in a second color component of the current reconstructed data block by:

selecting a current sample offset from the plurality of offset values of the target sample offset filter based on a calculated combination of sample delta measures of a filter sample and corresponding reference samples at the plurality of reference tap positions of the filter sample in a third color component of the current reconstructed data block; and

applying the selected current sample offset to the current reconstructed sample to generate a filtered reconstructed sample of the current reconstructed sample in the second color component.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2022
From: DU, YIXIN; ZHAO, XIN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 058550/0815 →
Continuity (2)
Provisional Application 63163707 · Mar 19, 2021
Related Publication 20220303586A1 · Sep 22, 2022
Cited By (4)
US 12,262,019 US 12,388,991 US 12,425,598 US 12,627,796