IP Library › Granted Patent US 11,743,509
Granted Patent B2
US 11,743,509 · App. 17/650,935 · Granted Aug 29, 2023

Intra video coding using a decoupled tree structure

Inventors: Li Zhang (San Diego, CA); Wei-Jung Chien (San Diego, CA); Jianle Chen (San Diego, CA); Xin Zhao (Santa Clara, CA); Marta Karczewicz (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N19/96H04N19/11H04N19/186H04N19/46H04N19/463H04N19/593H04N19/70H04N19/124H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,743,509
App. No.
17/650,935
Granted
Aug 29, 2023
Kind
B2
Abstract

An example device includes a memory and processing circuitry in communication with the memory. The processing circuitry of a device is configured to form a most probable mode (MPM) candidate list for a chroma block of the video data stored to the memory, such that the MPM candidate list includes one or more derived modes (DMs) associated with a luma block of the video data associated with the chroma block, and a plurality of luma prediction modes that can be used for coding luminance components of the video data. The processing circuitry is further configured to select a mode from the MPM candidate list, and to code the chroma block according to the mode selected from the MPM candidate list.

Claims (63)

1. A method of decoding video data, the method comprising:

determining an intra prediction mode for a chroma prediction unit of a chroma block of video data according to an intra prediction mode of a luma prediction unit in a corresponding luma block, the chroma block having a width and a height and the chroma block further having a position defined based on a horizontal offset and a vertical offset relative to a slice of the video data, the slice comprising one of a frame or a portion of a frame,

wherein partitioning of the corresponding luma block into a plurality of luma prediction units is determined using a first tree structure that is separate from a second tree structure that determines the partitioning of the chroma block into chroma predictions units, the first and second tree structures being quad-tree-binary-tree structures, wherein determining the intra prediction mode for the chroma prediction unit of the chroma block according to the intra prediction mode of the luma prediction unit in the corresponding luma block comprises:

determining one of the plurality of luma prediction units of the corresponding luma block that is located at a position corresponding to a center position of the luma block corresponding to the chroma block, wherein the center position is defined according to a coordinate tuple including an x coordinate defined using twice the horizontal offset of the chroma block and a y coordinate defined using twice the vertical offset of the chroma block, wherein the coordinate tuple is based on the width and the height of the chroma block; and

deriving a derived mode (DM) for the chroma mode from a luma mode associated with the luma prediction unit located at the center position of the corresponding luma block partition, and

decoding the chroma prediction unit according to the determined intra prediction mode.

2. The method of claim 1 , further comprising calculating the center position of the corresponding luma block, comprising:

determining a position (x, y) of an upper-left coefficient of the chroma block;

determining the video data has 4:2:0 format; and

calculating the center position according to the formula (2x+W−1, 2y+H−1), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

3. The method of claim 1 , further comprising calculating the center position of the corresponding luma block, comprising:

determining a position (x, y) of an upper-left coefficient of the chroma block;

determining the video data has 4:2:0 format; and

calculating the center position according to the formula (2x+(2*W/4/2−1)*4, 2y+(2*H/4/2−1)*4), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

4. The method of claim 1 , further comprising encoding the chroma prediction unit prior to decoding the chroma prediction unit.

5. A device for decoding video data, the device comprising:

a memory configured to store video data; and

one or more processors implemented in circuitry and configured to:

determine an intra prediction mode for a chroma prediction unit of a chroma block of video data according to an intra prediction mode of a luma prediction unit in a corresponding luma block, the chroma block having a width and a height and the chroma block further having a position defined based on a horizontal offset and a vertical offset relative to a slice of the video data, the slice comprising one of a frame or a portion of a frame,

wherein partitioning of the corresponding luma block into a plurality of luma prediction units is determined using a first tree structure that is separate from a second tree structure that determines the partitioning of the chroma block into chroma predictions units, the first and second tree structures being quad-tree-binary-tree structures, wherein to determine the intra prediction mode for the chroma prediction unit of the chroma block according to the intra prediction mode of the luma prediction unit in the corresponding luma block, the one or more processors are configured to:

determine one of the plurality of luma prediction units of the corresponding luma block that is located at a position corresponding to a center position of the luma block corresponding to the chroma block, wherein the center position is defined according to a coordinate tuple including an x coordinate defined using twice the horizontal offset of the chroma block and a y coordinate defined using twice the vertical offset of the chroma block, wherein the coordinate tuple is based on the width and the height of the chroma block; and

derive a derived mode (DM) for the chroma mode from a luma mode associated with the luma prediction unit located at the center position of the corresponding luma block partition, and

decode the chroma prediction unit according to the determined intra prediction mode.

6. The device of claim 5 , wherein the one or more processors are further configured to calculate the center position of the corresponding luma block, and wherein to calculate the center position of the corresponding luma block, the one or more processors are configured to:

determine a position (x, y) of an upper-left coefficient of the chroma block;

determine the video data has 4:2:0 format; and

calculate the center position according to the formula (2x+W−1, 2y+H−1), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

7. The device of claim 5 , wherein the one or more processors are further configured to calculate the center position of the corresponding luma block, and wherein to calculate the center position of the corresponding luma block, the one or more processors are configured to:

determine a position (x, y) of an upper-left coefficient of the chroma block;

determine the video data has 4:2:0 format; and

calculate the center position according to the formula (2x+(2*W/4/2−1)*4, 2y+(2*H/4/2−1)*4), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

8. The device of claim 5 , further comprising a display configured to display the decoded video data.

9. The device of claim 5 , wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box.

10. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor to:

determine an intra prediction mode for a chroma prediction unit of a chroma block of video data according to an intra prediction mode of a luma prediction unit in a corresponding luma block, the chroma block having a width and a height and the chroma block further having a position defined based on a horizontal offset and a vertical offset relative to a slice of the video data, the slice comprising one of a frame or a portion of a frame,

wherein partitioning of the corresponding luma block into a plurality of luma prediction units is determined using a first tree structure that is separate from a second tree structure that determines the partitioning of the chroma block into chroma predictions units, the first and second tree structures being quad-tree-binary-tree structures, wherein the instructions that cause the processor to determine the intra prediction mode for the chroma prediction unit of the chroma block according to the intra prediction mode of the luma prediction unit in the corresponding luma block comprise instructions that cause the processor to:

determine one of the plurality of luma prediction units of the corresponding luma block that is located at a position corresponding to a center position of the luma block corresponding to the chroma block, wherein the center position is defined according to a coordinate tuple including an x coordinate defined using twice the horizontal offset of the chroma block and a y coordinate defined using twice the vertical offset of the chroma block, wherein the coordinate tuple is based on the width and the height of the chroma block; and

derive a derived mode (DM) for the chroma mode from a luma mode associated with the luma prediction unit located at the center position of the corresponding luma block partition, and

decode the chroma prediction unit according to the determined intra prediction mode.

11. The non-transitory computer-readable storage medium of claim 10 , further comprising instructions that cause the processor to calculate the center position of the corresponding luma block, comprising instructions that cause the processor to:

determine a position (x, y) of an upper-left coefficient of the chroma block;

determine the video data has 4:2:0 format; and

calculate the center position according to the formula (2x+W−1, 2y+H−1), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

12. The non-transitory computer-readable storage medium of claim 10 , further comprising instructions that cause the processor to calculate the center position of the corresponding luma block, comprising instructions that cause the processor to:

determine a position (x, y) of an upper-left coefficient of the chroma block;

determine the video data has 4:2:0 format; and

calculate the center position according to the formula (2x+(2*W/4/2−1)*4, 2y+(2*H/4/2−1)*4), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

13. The non-transitory computer-readable storage medium of claim 10 , further comprising instructions that cause the processor to encode the chroma prediction unit prior to decoding the chroma prediction unit.

14. A device for decoding video data, the device comprising:

means for determining an intra prediction mode for a chroma prediction unit of a chroma block of video data according to an intra prediction mode of a luma prediction unit in a corresponding luma block, the chroma block having a width and a height and the chroma block further having a position defined based on a horizontal offset and a vertical offset relative to a slice of the video data, the slice comprising one of a frame or a portion of a frame,

wherein partitioning of the corresponding luma block into a plurality of luma prediction units is determined using a first tree structure that is separate from a second tree structure that determines the partitioning of the chroma block into chroma predictions units, the first and second tree structures being quad-tree-binary-tree structures, wherein the means for determining the intra prediction mode for the chroma prediction unit of the chroma block according to the intra prediction mode of the luma prediction unit in the corresponding luma block comprises:

means for determining one of the plurality of luma prediction units of the corresponding luma block that is located at a position corresponding to a center position of the luma block corresponding to the chroma block, wherein the center position is defined according to a coordinate tuple including an x coordinate defined using twice the horizontal offset of the chroma block and a y coordinate defined using twice the vertical offset of the chroma block, wherein the coordinate tuple is based on the width and the height of the chroma block; and

means for deriving a derived mode (DM) for the chroma mode from a luma mode associated with the luma prediction unit located at the center position of the corresponding luma block partition, and

means for decoding the chroma prediction unit according to the determined intra prediction mode.

15. The device of claim 14 , further comprising means for calculating the center position of the corresponding luma block, comprising:

means for determining a position (x, y) of an upper-left coefficient of the chroma block;

means for determining the video data has 4:2:0 format; and

means for calculating the center position according to the formula (2x+W−1, 2y+H−1), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

16. The device of claim 14 , further comprising means for calculating the center position of the corresponding luma block, comprising:

means for determining a position (x, y) of an upper-left coefficient of the chroma block;

means for determining the video data has 4:2:0 format; and

means for calculating the center position according to the formula (2x+(2*W/4/2−1)*4, 2y+(2*H/4/2−1)*4), wherein W has a value equal to the width of the chroma block and H has a value equal to the height of the chroma block.

17. The device of claim 14 , further comprising means for encoding the chroma prediction unit prior to decoding the chroma prediction unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2022
From: ZHANG, LI; CHIEN, WEI-JUNG; CHEN, JIANLE; ZHAO, XIN; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 059003/0132 →
Continuity (5)
Continuation 16452315 · Jun 25, 2019
Continuation 15676345 · Aug 14, 2017
Provisional Application 62404572 · Oct 5, 2016
Provisional Application 62375383 · Aug 15, 2016
Related Publication 20220256203A1 · Aug 11, 2022