Granted Patent B2

US 12,445,653 · App. 18/313,144 · Granted Oct 14, 2025

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.

H04N19/70H04N19/105H04N19/117H04N19/132H04N19/172H04N19/176H04N19/186H04N19/30H04N19/50H04N19/80

Abstract

Claims (101)

1. A method of processing video data, comprising:

determining, during a conversion between a current chroma video block of a current video unit of a video region of a video and a bitstream of the video, that a scaling process is applied on chroma residual samples of the current chroma video block; and

performing the conversion by applying the scaling process on the chroma residual samples based on at least one scaling factor,

wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and

wherein the at least one scaling factor is derived based on a variable which is derived using specific luma samples by an offset-based average operation, and the variable is calculated depending on a color format of the video;

wherein, for a luma video block of the current video unit of the video region, at least one of the following is performed:

1) a forward mapping process for the luma video block, in which prediction samples of the luma video block are converted from an original domain to a reshaped domain; or

2) an inverse mapping process, which is an inverse operation of the forward mapping process, in which reconstructed samples of the luma video block in the reshaped domain are converted to the original domain;

wherein a second piecewise linear model is used to map the prediction samples of the luma video block into particular values during the forward mapping process;

wherein model information of a coding tool for the current video unit is included in the bitstream, wherein the coding tool includes at least one of the scaling process, forward, mapping process, or inverse mapping process,

wherein in response to the video region comprising one or more video units including the current video unit, each of the one or more video units share the same model information of the coding tool for the current video unit,

wherein the one or more video units correspond to one or more slices, one or more tile groups, one or more coding tree units, or one or more coding units, and

wherein the video region is a picture.

2. The method of claim 1 , wherein the scaling process is based on a first piecewise linear model, and wherein an index identifying a piece to which the variable belongs, and the at least one scaling factor is derived based on the index.

3. The method of claim 1 , wherein a filtering process is applied on converted reconstructed samples of the luma video block in the original domain generated in the inverse mapping process.

4. The method of claim 1 , wherein a first syntax element and a second syntax element for the second piecewise linear model are included in the bitstream, the first syntax element plus 1 specifying a number of bits used for representation of the second syntax elements, and the second syntax element specifying an absolute delta code word value for an i-th bin, which is associated the particular values,

wherein a value of the first syntax element is smaller than a threshold, and

wherein the threshold depends on a bit depth.

5. The method of claim 2 , wherein the first piecewise linear model is used for an inverse mapping process, which is an inverse operation of a forward mapping process, in which reconstructed samples of a luma video block of the video region in a reshaped domain are converted to an original domain, wherein in the forward mapping process for the luma video block, prediction samples of the luma video block are converted from the original domain to the reshaped domain.

6. The method of claim 1 , wherein a third syntax element and a fourth syntax element are included in the bitstream, the third syntax element specifying a difference between a maximum allowed bin index and a maximum bin index to be used in the forward mapping process, and the fourth syntax element specifying a minimum bin index to be used in the forward mapping process.

7. The method of claim 6 , wherein a value of the third syntax element is in a range from 0 to the maximum allowed bin index,

wherein a value of the fourth syntax element is smaller than or equal to the maximum bin index to be used in the forward mapping process,

wherein a value of the fourth syntax element is in a range from 0 to the maximum bin index to be used in the forward mapping process, or

wherein the maximum allowed bin index is equal to 15.

8. The method of claim 1 , wherein a usage flag of the coding tool is included in a sequence parameter set.

9. The method of claim 1 , wherein a model of the coding tool includes the second piecewise linear model, and a value of at least one variable of the second piecewise linear model is dependent on a bit depth of the video, or

wherein a range of a value of a code word for an i-th piecewise of the second piecewise linear model is dependent on a bit depth of the video, and the code word for the i-th piecewise is associated with the particular values, and the value of the code word for the i-th piecewise is determined based on the model information of the coding tool for the current video unit.

10. The method of claim 1 , wherein the conversion includes encoding the current video unit into the bitstream.

11. The method of claim 1 , wherein the conversion includes decoding the current video unit from the bitstream.

12. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, during a conversion between a current chroma video block of a video region of a video and a bitstream of the video, that a scaling process is applied on chroma residual samples of the current chroma video block; and

perform the conversion by applying the scaling process on the chroma residual samples based on at least one scaling factor,

wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and

wherein the at least one scaling factor is derived based on a variable which is derived using specific luma samples by an offset-based average operation, and the variable is calculated depending on a color format of the video;

wherein, for a luma video block of the current video unit of the video region, at least one of the following is performed:

1) a forward mapping process for the luma video block, in which prediction samples of the luma video block are converted from an original domain to a reshaped domain; or

2) an inverse mapping process, which is an inverse operation of the forward mapping process, in which reconstructed samples of the luma video block in the reshaped domain are converted to the original domain;

wherein a second piecewise linear model is used to map the prediction samples of the luma video block into particular values during the forward mapping process;

wherein model information of a coding tool for the current video unit is included in the bitstream, wherein the coding tool includes at least one of the scaling process, forward, mapping process, or inverse mapping process,

wherein in response to the video region comprising one or more video units including the current video unit, each of the one or more video units share the same model information of the coding tool for the current video unit,

wherein the one or more video units correspond to one or more slices, one or more tile groups, one or more coding tree units, or one or more coding units, and

wherein the video region is a picture.

13. The apparatus of claim 12 , wherein the scaling process is based on a first piecewise linear model, and wherein an index identifying a piece to which the variable belongs, and the at least one scaling factor is derived based on the index,

wherein a filtering process is applied on converted reconstructed samples of the luma video block in the original domain generated in the inverse mapping process,

wherein a first syntax element and a second syntax element for the second piecewise linear model are included in the bitstream, the first syntax element plus 1 specifying a number of bits used for representation of the second syntax elements, and the second syntax element specifying an absolute delta code word value for an i-th bin, which is associated the particular values,

wherein a value of the first syntax element is smaller than a threshold, and

wherein the threshold depends on a bit depth,

wherein the first piecewise linear model is used for an inverse mapping process, which is an inverse operation of a forward mapping process, in which reconstructed samples of a luma video block of the video region in a reshaped domain are converted to an original domain, wherein in the forward mapping process for the luma video block, prediction samples of the luma video block are converted from the original domain to the reshaped domain,

wherein a third syntax element and a fourth syntax element are included in the bitstream, the third syntax element specifying a difference between a maximum allowed bin index and a maximum bin index to be used in the forward mapping process, and the fourth syntax element specifying a minimum bin index to be used in the forward mapping process,

wherein a value of the third syntax element is in a range from 0 to the maximum allowed bin index, wherein a value of the fourth syntax element is smaller than or equal to the maximum bin index to be used in the forward mapping process, wherein a value of the fourth syntax element is in a range from 0 to the maximum bin index to be used in the forward mapping process, or wherein the maximum allowed bin index is equal to 15,

wherein a usage flag of the coding tool is included in a sequence parameter set,

wherein a model of the coding tool includes the second piecewise linear model, and a value of at least one variable of the second piecewise linear model is dependent on a bit depth of the video, or

wherein a range of a value of a code word for an i-th piecewise of the second piecewise linear model is dependent on a bit depth of the video, and the code word for the i-th piecewise is associated with the particular values, and the value of the code word for the i-th piecewise is determined based on the model information of the coding tool for the current video unit.

14. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, during a conversion between a current chroma video block of a video region of a video and a bitstream of the video, that a scaling process is applied on chroma residual samples of the current chroma video block; and

perform the conversion by applying the scaling process on the chroma residual samples based on at least one scaling factor,

wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and

wherein the at least one scaling factor is derived based on a variable which is derived using specific luma samples by an offset-based average operation, and the variable is calculated depending on a color format of the video;

wherein, for a luma video block of the current video unit of the video region, at least one of the following is performed:

1) a forward mapping process for the luma video block, in which prediction samples of the luma video block are converted from an original domain to a reshaped domain; or

2) an inverse mapping process, which is an inverse operation of the forward mapping process, in which reconstructed samples of the luma video block in the reshaped domain are converted to the original domain;

wherein a second piecewise linear model is used to map the prediction samples of the luma video block into particular values during the forward mapping process;

wherein model information of a coding tool for the current video unit is included in the bitstream, wherein the coding tool includes at least one of the scaling process, forward, mapping process, or inverse mapping process, and

wherein in response to the video region comprising one or more video units including the current video unit, each of the one or more video units share the same model information of the coding tool for the current video unit,

wherein the one or more video units correspond to one or more slices, one or more tile groups, one or more coding tree units, or one or more coding units, and

wherein the video region is a picture.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the scaling process is based on a first piecewise linear model, and wherein an index identifying a piece to which the variable belongs, and the at least one scaling factor is derived based on the index,

wherein a filtering process is applied on converted reconstructed samples of the luma video block in the original domain generated in the inverse mapping process,

wherein a first syntax element and a second syntax element for the second piecewise linear model are included in the bitstream, the first syntax element plus 1 specifying a number of bits used for representation of the second syntax elements, and the second syntax element specifying an absolute delta code word value for an i-th bin, which is associated the particular values,

wherein a value of the first syntax element is smaller than a threshold, and

wherein the threshold depends on a bit depth,

wherein the first piecewise linear model is used for an inverse mapping process, which is an inverse operation of a forward mapping process, in which reconstructed samples of a luma video block of the video region in a reshaped domain are converted to an original domain, wherein in the forward mapping process for the luma video block, prediction samples of the luma video block are converted from the original domain to the reshaped domain,

wherein a third syntax element and a fourth syntax element are included in the bitstream, the third syntax element specifying a difference between a maximum allowed bin index and a maximum bin index to be used in the forward mapping process, and the fourth syntax element specifying a minimum bin index to be used in the forward mapping process,

wherein a value of the third syntax element is in a range from 0 to the maximum allowed bin index, wherein a value of the fourth syntax element is smaller than or equal to the maximum bin index to be used in the forward mapping process, wherein a value of the fourth syntax element is in a range from 0 to the maximum bin index to be used in the forward mapping process, or wherein the maximum allowed bin index is equal to 15,

wherein a usage flag of the coding tool is included in a sequence parameter set,

wherein a model of the coding tool includes the second piecewise linear model, and a value of at least one variable of the second piecewise linear model is dependent on a bit depth of the video, or

wherein a range of a value of a code word for an i-th piecewise of the second piecewise linear model is dependent on a bit depth of the video, and the code word for the i-th piecewise is associated with the particular values, and the value of the code word for the i-th piecewise is determined based on the model information of the coding tool for the current video unit.

16. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining that a scaling process is applied on chroma residual samples of a current chroma video block of a video region of a video; and

generating the bitstream by applying the scaling process on the chroma residual samples based on at least one scaling factor,

wherein in the scaling process, the chroma residual samples are scaled before being used to reconstruct the current chroma video block, and

wherein the at least one scaling factor is derived based on a variable which is derived using specific luma samples by an offset-based average operation, and the variable is calculated depending on a color format of the video;

wherein, for a luma video block of the current video unit of the video region, at least one of the following is performed:

1) a forward mapping process for the luma video block, in which prediction samples of the luma video block are converted from an original domain to a reshaped domain; or

2) an inverse mapping process, which is an inverse operation of the forward mapping process, in which reconstructed samples of the luma video block in the reshaped domain are converted to the original domain;

wherein a second piecewise linear model is used to map the prediction samples of the luma video block into particular values during the forward mapping process;

wherein model information of a coding tool for the current video unit is included in the bitstream, wherein the coding tool includes at least one of the scaling process, forward, mapping process, or inverse mapping process, and

wherein in response to the video region comprising one or more video units including the current video unit, each of the one or more video units share the same model information of the coding tool for the current video unit,

wherein the one or more video units correspond to one or more slices, one or more tile groups, one or more coding tree units, or one or more coding units, and

wherein the video region is a picture.

17. The non-transitory computer-readable recording medium of claim 16 , wherein the scaling process is based on a first piecewise linear model, and wherein an index identifying a piece to which the variable belongs, and the at least one scaling factor is derived based on the index,

wherein a filtering process is applied on converted reconstructed samples of the luma video block in the original domain generated in the inverse mapping process,

wherein a first syntax element and a second syntax element for the second piecewise linear model are included in the bitstream, the first syntax element plus 1 specifying a number of bits used for representation of the second syntax elements, and the second syntax element specifying an absolute delta code word value for an i-th bin, which is associated the particular values,

wherein a value of the first syntax element is smaller than a threshold, and

wherein the threshold depends on a bit depth,

wherein the first piecewise linear model is used for an inverse mapping process, which is an inverse operation of a forward mapping process, in which reconstructed samples of a luma video block of the video region in a reshaped domain are converted to an original domain, wherein in the forward mapping process for the luma video block, prediction samples of the luma video block are converted from the original domain to the reshaped domain,

wherein a third syntax element and a fourth syntax element are included in the bitstream, the third syntax element specifying a difference between a maximum allowed bin index and a maximum bin index to be used in the forward mapping process, and the fourth syntax element specifying a minimum bin index to be used in the forward mapping process,

wherein a value of the third syntax element is in a range from 0 to the maximum allowed bin index, wherein a value of the fourth syntax element is smaller than or equal to the maximum bin index to be used in the forward mapping process, wherein a value of the fourth syntax element is in a range from 0 to the maximum bin index to be used in the forward mapping process, or wherein the maximum allowed bin index is equal to 15,

wherein a usage flag of the coding tool is included in a sequence parameter set,

wherein a model of the coding tool includes the second piecewise linear model, and a value of at least one variable of the second piecewise linear model is dependent on a bit depth of the video, or

wherein a range of a value of a code word for an i-th piecewise of the second piecewise linear model is dependent on a bit depth of the video, and the code word for the i-th piecewise is associated with the particular values, and the value of the code word for the i-th piecewise is determined based on the model information of the coding tool for the current video unit.

Assignments (2)

Priority Claims (1)

Continuity (3)

References Cited (400)