IP Library › Granted Patent US 11,172,216
Granted Patent B1
US 11,172,216 · App. 17/357,311 · Granted Nov 9, 2021

Signaling of filtering information in video processing

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/46H04N19/176H04N19/186H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,172,216
App. No.
17/357,311
Granted
Nov 9, 2021
Kind
B1
Abstract

A video processing method is provided to include performing a conversion between a coded representation of a video comprising one or more video regions and the video, wherein the coded representation includes side information applicable for in-loop reshaping (ILR) of some of the one or more video regions, wherein the side information provides parameters for a reconstruction of a video unit of a video region based on a representation of the video unit in a first domain and a second domain and/or scaling chroma residue of a chroma video unit, and wherein the side information for a current video region is determined according to a rule that disallows inheritance or prediction of the side information based on a temporal layer index of the current video region.

Claims (48)

1. A method of processing video data, comprising:

performing a conversion between a bitstream of a video comprising one or more video regions and the video,

wherein the bitstream includes side information applicable for a coding tool of some of the one or more video regions,

wherein the side information provides parameters for a construction of a video unit of a current video region based on at least one of:

1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component are converted from an original domain to a reshaped domain,

2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component in the reshaped domain to the original domain, or

3) a scaling process, in which residual samples of a chroma component of the video unit are scaled before being used to reconstruct the chroma component, and

wherein the side information for the current video region is based on a first video region having smaller or equal a temporal layer index of the current video region.

2. The method of claim 1 , wherein the side information for the current video region is copied from the first video region.

3. The method of claim 1 , wherein a level of the first video region is higher than a level of the current video region.

4. The method of claim 1 , wherein inheritance or the prediction is disabled in a case that a second video region is associated with a temporal layer index greater than the temporal layer index of the current video region.

5. The method of claim 1 , wherein parameters of the first video region are copied to the parameters in the side information of the current video region.

6. The method of claim 1 , wherein the parameters in the side information include at least one of: i) at least one first parameter indicating a minimum bin index used in the forward mapping process or the inverse mapping process, ii) at least one second parameter indicating a maximum bin index used in the forward mapping process or the inverse mapping process, iii) at least one third parameter indicating a delta codeword value for the forward mapping process or the inverse mapping process, iv) at least one fourth parameter related to at least one chroma residue scaling factor for the scaling process.

7. The method of claim 1 , a piecewise linear model is used in the forward mapping process to map the prediction samples of the luma component into particular values.

8. The method of claim 1 , wherein scale coefficients of the piecewise linear model are determined based on first variables which are determined base on the parameters in the side information and a second variable which are determined base on a bit depth.

9. The method of claim 1 , wherein the current video region is a current picture, slice, tile group, or other video data units.

10. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.

11. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.

12. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a bitstream of a video comprising one or more video regions and the video,

wherein the bitstream includes side information applicable for a coding tool of some of the one or more video regions,

wherein the side information provides parameters for a construction of a video unit of a current video region based on at least one of:

1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component are converted from an original domain to a reshaped domain,

2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component in the reshaped domain to the original domain, or

3) a scaling process, in which residual samples of a chroma component of the video unit are scaled before being used to reconstruct the chroma component, and

wherein the side information for the current video region is based on a first video region having smaller or equal a temporal layer index of the current video region.

13. The apparatus of claim 12 , wherein the side information for the current video region is copied from the first video region.

14. The apparatus of claim 12 , wherein a level of the first video region is higher than a level of the current video region.

15. The apparatus of claim 12 , wherein the parameters in the side information include at least one of: i) at least one first parameter indicating a minimum bin index used in the forward mapping process or the inverse mapping process, ii) at least one second parameter indicating a maximum bin index used in the forward mapping process or the inverse mapping process, iii) at least one third parameter indicating a delta codeword value for the forward mapping process or the inverse mapping process, iv) at least one fourth parameter related to at least one chroma residue scaling factor for the scaling process.

16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a bitstream of a video comprising one or more video regions and the video,

wherein the bitstream includes side information applicable for a coding tool of some of the one or more video regions,

wherein the side information provides parameters for a construction of a video unit of a current video region based on at least one of:

1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component are converted from an original domain to a reshaped domain,

2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component in the reshaped domain to the original domain, or

3) a scaling process, in which residual samples of a chroma component of the video unit are scaled before being used to reconstruct the chroma component, and

wherein the side information for the current video region is based on a first video region having smaller or equal a temporal layer index of the current video region.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the side information for the current video region is copied from the first video region.

18. The non-transitory computer-readable storage medium of claim 16 , wherein a level of the first video region is higher than a level of the current video region.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the parameters in the side information include at least one of: i) at least one first parameter indicating a minimum bin index used in the forward mapping process or the inverse mapping process, ii) at least one second parameter indicating a maximum bin index used in the forward mapping process or the inverse mapping process, iii) at least one third parameter indicating a delta codeword value for the forward mapping process or the inverse mapping process, iv) at least one fourth parameter related to at least one chroma residue scaling factor for the scaling process.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream of the video comprising one or more video regions,

wherein the bitstream includes side information applicable for a coding tool of some of the one or more video regions,

wherein the side information provides parameters for a construction of a video unit of a current video region based on at least one of:

1) a forward mapping process for a luma component of the video unit, in which prediction samples of the luma component are converted from an original domain to a reshaped domain,

2) an inverse mapping process, which is an inverse operation of the forward mapping process, that convert reconstructed samples of the luma component in the reshaped domain to the original domain, or

3) a scaling process, in which residual samples of a chroma component of the video unit are scaled before being used to reconstruct the chroma component, and

wherein the side information for the current video region is based on a first video region having smaller or equal a temporal layer index of the current video region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2021
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 056659/0344 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 056659/0395 →
Priority Claims (3)
WO PCT/CN2019/076852 · Mar 4, 2019 · international
WO PCT/CN2019/077643 · Mar 11, 2019 · international
WO PCT/CN2019/078410 · Mar 17, 2019 · international
Continuity (1)
Continuation PCTCN2020077724 · Mar 4, 2020
Cited By (11)
US 12,219,136 US 12,309,363 US 12,368,841 US 12,432,372 US 12,445,653 US 12,531,994 US 12,634,443 US 12,684,120 US 12,732,640 US 12,744,890 US 12,744,891