IP Library › Granted Patent US 11,431,966
Granted Patent B2
US 11,431,966 · App. 17/502,233 · Granted Aug 30, 2022

Intra coded video using quantized residual differential pulse code modulation coding

Inventors: Weijia Zhu (San Diego, CA); Li Zhang (San Diego, CA); Jizheng Xu (San Diego, CA); Hsiao Chiang Chuang (San Diego, CA)
Assignee: BYTEDANCE INC.
H04N19/105H04N19/159H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,431,966
App. No.
17/502,233
Granted
Aug 30, 2022
Kind
B2
Abstract

Video coding and decoding methods are described. In example method includes performing a conversion between a current video block of a video and a bitstream representation of the current video block by determining a first intra coding mode to be stored which is associated with the current video block using a differential coding mode, where the first intra coding mode associated with the current video block is determined according to a second prediction mode used by the differential coding mode, and where, in the differential coding mode, a difference between a quantized residual of an intra prediction of the current video block and a prediction of the quantized residual is represented in the bitstream representation for the current video block using a differential pulse coding modulation (DPCM) representation.

Claims (51)

1. A method of processing video data, comprising:

determining that a differential coding mode is applied to a first video block of a video, and in the differential coding mode, a difference between a quantized residual derived with a first intra prediction mode of the first video block and a prediction of the quantized residual is included in a bitstream of the video;

storing, aligned with a prediction direction used in the differential coding mode for the first video block, the first intra prediction mode of the first video block;

constructing, based on the stored first intra prediction mode of the first video block, a mode candidate list for a second video block of the video, wherein the first video block is a spatial neighboring block of the second video block and the second video block is an intra block;

determining, based on the mode candidate list, a second intra prediction mode for the second video block; and

performing, based on the second intra prediction mode, a conversion between the second video block and the bitstream of the video,

wherein, when the first video block is not available, a candidate in the mode candidate list corresponding to the first video block is set to a planar intra prediction mode,

wherein a cross-component linear model coding mode is not applied to the first video block in response to the differential coding mode being applied to the first video block; and

wherein the first video block is a luma block, and a third syntax element is further used to indicate whether the differential coding mode is applied to a chroma components or not.

2. The method of claim 1 , wherein the first intra prediction mode is inferred to a vertical intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being vertical direction.

3. The method of claim 1 , wherein the first intra prediction mode is inferred to a horizontal intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being horizontal direction.

4. The method of claim 1 , wherein the prediction direction of the differential coding mode for the first video block is determined based on a first syntax element included in the bitstream indicating whether the prediction direction is horizontal or vertical direction.

5. The method of claim 1 , wherein the first video block is a left or above neighboring block of the second video block.

6. The method of claim 1 , wherein the second intra prediction mode is determined based on a second syntax element in the bitstream, wherein the second syntax element indicates an index of a candidate in the mode candidate list which is used for an intra prediction of the second video block.

7. The method of claim 1 , wherein the difference is represented using a differential pulse coding modulation representation.

8. The method of claim 1 , wherein the conversion includes encoding the second video block into the bitstream.

9. The method of claim 1 , wherein the conversion includes decoding the second video block from the bitstream.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine that a differential coding mode is applied to a first video block of a video, and in the differential coding mode, a difference between a quantized residual derived with a first intra prediction mode of the first video block and a prediction of the quantized residual is included in a bitstream of the video;

store, aligned with a prediction direction used in the differential coding mode for the first video block, the first intra prediction mode of the first video block;

construct, based on the stored first intra prediction mode of the first video block, a mode candidate list for a second video block of the video, wherein the first video block is a spatial neighboring block of the second video block and the second video block is an intra block;

determine, based on the mode candidate list, a second intra prediction mode for the second video block; and

perform, based on the second intra prediction mode, a conversion between the second video block and the bitstream of the video,

wherein, when the first video block is not available, a candidate in the mode candidate list corresponding to the first video block is set to a planar intra prediction mode,

wherein a cross-component linear model coding mode is not applied to the first video block in response to the differential coding mode being applied to the first video block; and

wherein the first video block is a luma block, and a third syntax element is further used to indicate whether the differential coding mode is applied to a chroma components or not.

11. The apparatus of claim 10 , wherein the first intra prediction mode is inferred to a vertical intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being vertical direction, or the first intra prediction mode is inferred to a horizontal intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being horizontal direction, and wherein the prediction direction of the differential coding mode for the first video block is determined based on a first syntax element included in the bitstream indicating whether the prediction direction is horizontal or vertical direction.

12. The apparatus of claim 10 , wherein the first video block is a left or above neighboring block of the second video block.

13. The apparatus of claim 10 , wherein the second intra prediction mode is determined based on a second syntax element in the bitstream, wherein the second syntax element indicates an index of a candidate in the mode candidate list which is used for an intra prediction of the second video block.

14. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine that a differential coding mode is applied to a first video block of a video, and in the differential coding mode, a difference between a quantized residual derived with a first intra prediction mode of the first video block and a prediction of the quantized residual is included in a bitstream of the video;

store, aligned with a prediction direction used in the differential coding mode for the first video block, the first intra prediction mode of the first video block;

construct, based on the stored first intra prediction mode of the first video block, a mode candidate list for a second video block of the video, wherein the first video block is a spatial neighboring block of the second video block and the second video block is an intra block;

determine, based on the mode candidate list, a second intra prediction mode for the second video block; and

perform, based on the second intra prediction mode, a conversion between the second video block and the bitstream of the video,

wherein, when the first video block is not available, a candidate in the mode candidate list corresponding to the first video block is set to a planar intra prediction mode,

wherein a cross-component linear model coding mode is not applied to the first video block in response to the differential coding mode being applied to the first video block; and

wherein the first video block is a luma block, and a third syntax element is further used to indicate whether the differential coding mode is applied to a chroma components or not.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the first intra prediction mode is inferred to a vertical intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being vertical direction, or the first intra prediction mode is inferred to a horizontal intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being horizontal direction, and

wherein the prediction direction of the differential coding mode for the first video block is determined based on a first syntax element included in the bitstream indicating whether the prediction direction is horizontal or vertical direction.

16. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining that a differential coding mode is applied to a first video block of a video, and in the differential coding mode, a difference between a quantized residual derived with a first intra prediction mode of the first video block and a prediction of the quantized residual is included in a bitstream of the video;

storing, aligned with a prediction direction used in the differential coding mode for the first video block, the first intra prediction mode of the first video block;

constructing, based on the stored first intra prediction mode of the first video block, a mode candidate list for a second video block of the video, wherein the first video block is a spatial neighboring block of the second video block and the second video block is an intra block;

determining, based on the mode candidate list, a second intra prediction mode for the second video block; and

generating the bitstream based on the second intra prediction mode,

wherein, when the first video block is not available, a candidate in the mode candidate list corresponding to the first video block is set to a planar intra prediction mode,

wherein a cross-component linear model coding mode is not applied to the first video block in response to the differential coding mode being applied to the first video block; and

wherein the first video block is a luma block, and a third syntax element is further used to indicate whether the differential coding mode is applied to a chroma components or not.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the first intra prediction mode is inferred to a vertical intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being vertical direction, or the first intra prediction mode is inferred to a horizontal intra prediction mode in response to the prediction direction used in the differential coding mode for the first video block being horizontal direction, and

wherein the prediction direction of the differential coding mode for the first video block is determined based on a first syntax element included in the bitstream indicating whether the prediction direction is horizontal or vertical direction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2021
From: ZHU, WEIJIA; ZHANG, LI; XU, JIZHENG; CHUANG, HSIAO CHIANG
To: BYTEDANCE INC.
Reel/Frame 057808/0135 →
Priority Claims (1)
WO PCT/CN2019/085398 · May 1, 2019 · international
Continuity (2)
Continuation PCTUS2020030684 · Apr 30, 2020
Related Publication 20220038687A1 · Feb 3, 2022
Cited By (4)
US 12,368,844 US 12,395,623 US 12,432,385 US 12,634,431