Granted Patent B2

US 12,262,017 · App. 17/826,302 · Granted Mar 25, 2025

Inventors: Je Won Kang (Seoul, KR); Seung Wook Park (Yongin-si, KR); Wha Pyeong Lim (Hwaseong-si, KR)

Assignees: HYUNDAI MOTOR COMPANY; KIA CORPORATION; EWHA UNIVERSITY—INDUSTRY COLLABORATION FOUNDATION

H04N19/132H04N19/105H04N19/159H04N19/176H04N19/186H04N19/46H04N19/70

Abstract

Claims (79)

1. A method for decoding a bitstream encoded from a video sequence comprising a plurality of pictures, the method comprising:

decoding, from a sequence parameter set of the bitstream, information on a chroma sampling format and high level syntax elements related to differential modulation for residual signals,

wherein the information on the chroma sampling format indicates one of a plurality of chroma sampling formats including 4:4:4, 4:2:2, or 4:2:0, and

wherein the high level syntax elements comprise a single common control flag indicating whether the differential modulation is permitted for the residual signals of each of luma and chroma components of the video sequence and information on a maximum block size for which the differential modulation is permitted;

decoding a first chroma syntax element indicating whether the differential modulation has been applied to a chroma block corresponding to a first block to be currently decoded, when the first block satisfies conditions defined by the information on the chroma sampling format and the high level syntax elements;

decoding a second chroma syntax element indicating a differential modulation direction applied to the chroma block in response to the first chroma syntax element indicating that the differential modulation has been applied to the chroma block;

determining a differential-modulated residual block for the chroma block from the bitstream;

determining quantized residual values by differential-demodulating the differential- modulated residual block in the differential modulation direction indicated by the second chroma syntax element;

inversely quantizing the quantized residual values for the chroma block;

generating predicted values for the chroma block; and

reconstructing the chroma block corresponding to the first block based on the inversely quantized residual values and the predicted values,

wherein the conditions defined by the information on the chroma sampling format and the high level syntax elements are satisfied when:

(1) the single common control flag indicates that the differential modulation is permitted for the video sequence,

(2) a value obtained by dividing a width of the first block by a horizontal scaling factor determined by the chroma sampling format that the information on the chroma sampling format indicates among the plurality of chroma sampling formats is smaller than or equal to the maximum block size, and

(3) a value obtained by dividing a height of the first block by a vertical scaling factor determined by the chroma sampling format indicated by the information on the chroma sampling format is smaller than or equal to the maximum block size.

2. The method of claim 1 , wherein generating the predicted values for the chroma block comprises:

setting, as an intra prediction mode for the chroma block, a prediction mode having a direction identical with the differential modulation direction indicated by the second chroma syntax element among a vertical prediction mode and a horizontal prediction mode; and

generating the predicted values for the chroma block based on the intra prediction mode for the chroma block.

3. The method of claim 1 , wherein generating the prediction values for the chroma block comprises:

generating the prediction values for the chroma block by performing intra prediction on the chroma block by using samples not filtered from edge samples of a top or left block of the chroma block.

4. The method of claim 1 , wherein determining the quantized residual values comprises:

determining, as in an equation below, the quantized residual values when the second chroma syntax element indicates that the differential modulation direction is horizontal

Q ( r i,j )=Σ k=0 j {tilde over (r)} i,k , 0 ≤i ≤( M −1), 0 ≤j ≤( N− 1),

wherein, Q(r i,j ) is a quantized residual value at a position [i, j] within the chroma block, {tilde over (r)} i,k is a sample value at a position [i, k] within the differential-modulated residual block, M is the number of rows of the chroma block, and N is the number of columns of the chroma block.

5. The method of claim 1 , wherein determining the quantized residual values comprises, determining, as in an equation below, the quantized residual values when the second chroma syntax element indicates that the differential modulation direction is vertical

Q ( r i,j )=Σ k=0 j {tilde over (r)} i,k , 0 ≤i ≤( M −1), 0 ≤j ≤( N− 1),

wherein, Q(r i,j ) is a quantized residual value at a position [i, j] within the chroma block, {tilde over (r)} i,k is a sample value at a position [k, j] within the differential-modulated residual block, M is the number of rows of the chroma block, and N is the number of columns of the chroma block.

6. The method of claim 1 , wherein the information on the maximum block size for which the differential modulation is permitted is information on a maximum transform size for which a transform skip is permitted.

7. The method of claim 1 , further comprising:

decoding a first luma syntax element indicating whether the differential modulation has been applied to a luma block corresponding to the first block, when the first block satisfies the condition defined by the high level syntax elements;

decoding a second luma syntax element indicating a differential modulation direction applied to the luma block, in response to the first luma syntax element indicating that the differential modulation has been applied to the luma block;

determining a differential-modulated residual block for the luma block from the bitstream;

determining quantized residual values by differential-demodulating the differential- modulated residual block for the luma block in a differential modulation direction indicated by the second luma syntax element;

inversely quantizing the quantized residual values for the luma block;

generating predicted values for the luma block; and

reconstructing the luma block corresponding to the first block based on the inversely quantized residual values and the predicted values.

8. The method of claim 7 , wherein the condition defined by the high level syntax elements is satisfied when

the single common control flag indicates that the differential modulation is permitted for the video sequence,

a width of the first block is smaller than or equal to the maximum block size, and

a height of the first block is smaller than or equal to the maximum block size.

9. The method of claim 7 , wherein in determining an MPM list for a luma block corresponding to a second block neighboring the luma block corresponding to the first block, an intra prediction mode of the luma block corresponding to the first block is set as a prediction mode having a direction identical with the differential modulation direction indicated by the second luma syntax element among a vertical prediction mode and a horizontal prediction mode.

10. A method for encoding a video sequence comprising a plurality of pictures, the method comprising:

encoding, in a sequence parameter set of a bitstream, information on a chroma sampling format and high level syntax elements related to differential modulation for residual signals,

wherein the information on the chroma sampling format indicates one of a plurality of chroma sampling formats including 4:4:4, 4:2:2, or 4:2:0, and

wherein the high level syntax elements comprise a single common control flag indicating whether the differential modulation is permitted for the residual signals of each of luma and chroma components of the video sequence and information on a maximum block size for which the differential modulation is permitted;

encoding a first chroma syntax element indicating whether the differential modulation has been applied to a chroma block corresponding to a first block, when the first block to be currently decoded satisfies conditions defined by the information on the chroma sampling format and the high level syntax elements;

encoding a second chroma syntax element indicating a differential modulation direction applied to the chroma block in response to the first chroma syntax element indicating that the differential modulation has been applied to the chroma block;

generating predicted values for the chroma block;

determining a residual block for the chroma block based on original sample values and the predicted values of the chroma block;

generating quantized residual values by quantizing the residual block for the chroma block;

determining differential-modulated residual values by differential-modulating the quantized residual values in the differential modulation direction indicated by the second chroma syntax element; and

encoding the differential-modulated residual values in the bitstream, wherein the conditions defined by the information on the chroma sampling format and the high level syntax elements are satisfied when:

(1) the single common control flag indicates that the differential modulation is permitted for the video sequence,

(2) a value obtained by dividing a width of the first block by a horizontal scaling factor determined by the chroma sampling format that the information on the chroma sampling format indicates among the plurality of chroma sampling formats is smaller than or equal to the maximum block size, and

(3) a value obtained by dividing a height of the first block by a vertical scaling factor determined by the chroma sampling format indicated by the information on the chroma sampling format is smaller than or equal to the maximum block size.

11. The method of claim 10 , wherein generating the predicted values for the chroma block comprises:

setting, as an intra prediction mode for the chroma block, a prediction mode having a direction identical with the differential modulation direction indicated by the second chroma syntax element among a vertical prediction mode and a horizontal prediction mode; and

generating the predicted values for the chroma block based on the intra prediction mode for the chroma block.

12. The method of claim 10 , wherein generating the predicted values for the chroma block comprises:

generating the predicted values for the chroma block by performing intra prediction on the chroma block by using samples not filtered from edge samples of a top or left block of the chroma block.

13. The method of claim 10 , wherein the information on the maximum block size for which the differential modulation is permitted is information on a maximum transform size for which a transform skip is permitted.

14. A method for providing a video decoding apparatus with a video data, the method comprising:

encoding a video data into a bitstream; and

transmitting the bitstream to the video decoding apparatus,

wherein the encoding of the video data includes:

encoding, in a sequence parameter set of the bitstream, information on a chroma sampling format and high level syntax elements related to differential modulation for residual signals,

wherein the information on the chroma sampling format indicates one of a plurality of chroma sampling formats including 4:4:4, 4:2:2, or 4:2:0, and

wherein the high level syntax elements comprise a single common control flag indicating whether the differential modulation is permitted for the residual signals of each of luma and chroma components of the video sequence and information on a maximum block size for which the differential modulation is permitted;

encoding a first chroma syntax element indicating whether the differential modulation has been applied to a chroma block corresponding to a first block, when the first block to be currently decoded satisfies conditions defined by the information on the chroma sampling format and the high level syntax elements;

encoding a second chroma syntax element indicating a differential modulation direction applied to the chroma block in response to the first chroma syntax element indicating that the differential modulation has been applied to the chroma block;

generating predicted values for the chroma block;

determining a residual block for the chroma block based on original sample values and the predicted values of the chroma block;

generating quantized residual values by quantizing the residual block for the chroma block;

determining differential-modulated residual values by differential-modulating the quantized residual values in the differential modulation direction indicated by the second chroma syntax element; and

encoding the differential-modulated residual values in the bitstream,

wherein the conditions defined by the information on the chroma sampling format and the high level syntax elements are satisfied when:

(1) the single common control flag indicates that the differential modulation is permitted for the video sequence,

(2) a value obtained by dividing a width of the first block by a horizontal scaling factor determined by the chroma sampling format that the information on the chroma sampling format indicates among the plurality of chroma sampling formats is smaller than or equal to the maximum block size, and

(3) a value obtained by dividing a height of the first block by a vertical scaling factor determined by the chroma sampling format indicated by the information on the chroma sampling format is smaller than or equal to the maximum block size.

Assignments (1)

Priority Claims (2)

Continuity (2)

References Cited (20)