IP Library Granted Patent US 11,616,965
Granted Patent B2
US 11,616,965 · App. 17/479,192 · Granted Mar 28, 2023

Restriction on applicability of cross component mode

Inventors: Zhipin Deng (Beijing, CN); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Kai Zhang (San Diego, CA); Jizheng Xu (San Diego, CA)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/30H04N19/105H04N19/132H04N19/146H04N19/176H04N19/186H04N19/196H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,616,965
App. No.
17/479,192
Granted
Mar 28, 2023
Kind
B2
Abstract

A method for visual media processing, including performing a conversion between a current chroma chroma block of visual media data and a bitstream representation of the current chroma chroma block, wherein, during the conversion, a chroma residual of the current chroma chroma block is scaled based on a scaling coefficient, wherein the scaling coefficient is derived at least based on luma samples located in predefined positions.

Claims (50)

1. A method of processing video data, comprising:

determining, for a conversion between a chroma block of a video and a bitstream of the video, whether to enable or disable a cross-component linear model intra prediction on the chroma block, based on whether one or more luma video units which cover at least one sample of a corresponding luma region of the chroma block are coded with a subblock-based prediction mode, wherein the chroma block is in a dual tree structure in which a luma component and at least one chroma component have separate partition tree structures;

in response to the cross-component linear model intra prediction enabled, determining parameters of the cross-component linear model at least based on neighboring chroma samples of the chroma block;

applying the cross-component linear model to derive prediction values of the chroma block based on the parameters; and

performing the conversion based on the prediction values, wherein the parameters of the cross-component linear model are derived by following:

checking an availability of one or more neighboring chroma blocks of the chroma block;

finding R chroma samples from neighboring chroma samples in the one or more neighboring chroma blocks to determine the parameters of the cross-component linear model, wherein R is an integer greater than 2 , and wherein at least one neighboring chroma sample does not belong to the R chroma samples based on a size of the chroma block.

2. The method of claim 1 , wherein the subblock-based prediction mode corresponds to an intra sub-partitions mode.

3. The method of claim 1 , wherein the cross-component linear model is disabled in response to the one or more luma video units being coded with the subblock- based prediction mode.

4. The method of claim 1 , wherein whether to enable or disable the cross-component linear model intra prediction on the chroma block is further based on partition information of the one or more luma video units.

5. The method of claim 4 , wherein the partition information includes a partition tree depth of the one or more luma video units.

6. The method of claim 5 , wherein the partition tree depth is a quadtree depth.

7. The method of claim 1 , wherein whether to enable or disable the cross-component linear model intra prediction on the chroma block is further based on a block dimension of one or more chroma video units which cover at least one sample of a corresponding chroma region of the chroma block.

8. The method of claim 1 , wherein whether to enable or disable the cross-component linear model intra prediction on the chroma block is further based on whether the one or more luma video units are split from multi-type partition tree operation different from a quadtree partition operation.

9. The method of claim 1 , wherein in response to the one or more neighboring chroma blocks being unavailable, the prediction values of the chroma block are set to 1<<(bitDepth−1), where bitDepth is a bit depth of the video.

10. The method of claim 1 , wherein the conversion includes encoding the chroma block into the bitstream.

11. The method of claim 1 , wherein the conversion includes decoding the chroma block from the bitstream.

12. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a chroma block of a video and a bitstream of the video, whether to enable or disable a cross-component linear model intra prediction on the chroma block, based on whether one or more luma video units which cover at least one sample of a corresponding luma region of the chroma block are coded with a subblock-based prediction mode, wherein the chroma block is in a dual tree structure in which a luma component and at least one chroma component have separate partition tree structures;

in response to the cross-component linear model intra prediction enabled, determine parameters of the cross-component linear model at least based on neighboring chroma samples of the chroma block;

apply the cross-component linear model to derive prediction values of the chroma block based on the parameters; and

perform the conversion based on the prediction values,

wherein the parameters of the cross-component linear model are derived by following:

checking an availability of one or more neighboring chroma blocks of the chroma block:

finding R chroma samples from neighboring chroma samples in the one or more neighboring chroma blocks to determine the parameters of the cross-component linear model, wherein R is an integer greater than 2, and

wherein at least one neighboring chroma sample does not belong to the R chroma samples based on a size of the chroma block.

13. The apparatus of claim 12 , wherein the subblock-based prediction mode corresponds to an intra sub-partitions mode.

14. The apparatus of claim 12 , wherein whether to enable or disable the cross-component linear model intra prediction on the chroma block is further based on partition information of the one or more luma video units, the partition information includes a partition tree depth of the one or more luma video units, and the partition tree depth is a quadtree depth.

15. The apparatus of claim 12 , wherein in response to the one or more neighboring chroma blocks being unavailable, the prediction values of the chroma block are set to 1<<(bitDepth−1), where bitDepth is a bit depth of the video.

16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a chroma block of a video and a bitstream of the video, whether to enable or disable a cross-component linear model intra prediction on the chroma block, based on whether one or more luma video units which cover at least one sample of a corresponding luma region of the chroma block are coded with a subblock-based prediction mode, wherein the chroma block is in a dual tree structure in which a luma component and at least one chroma component have separate partition tree structures;

in response to the cross-component linear model intra prediction enabled, determine parameters of the cross-component linear model at least based on neighboring chroma samples of the chroma block;

apply the cross-component linear model to derive prediction values of the chroma block based on the parameters; and

perform the conversion based on the prediction values,

wherein the parameters of the cross-component linear model are derived by following:

checking an availability of one or more neighboring chroma blocks of the chroma block:

finding R chroma samples from neighboring chroma samples in the one or more neighboring chroma blocks to determine the parameters of the cross-component linear model, wherein R is an integer greater than 2, and

wherein at least one neighboring chroma sample does not belong to the R chroma samples based on a size of the chroma block.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the subblock-based prediction mode corresponds to an intra sub-partitions mode.

18. The non-transitory computer-readable storage medium of claim 16 , wherein whether to enable or disable the cross-component linear model intra prediction on the chroma block is further based on partition information of the one or more luma video units, the partition information includes a partition tree depth of the one or more luma video units, and the partition tree depth is a quadtree depth.

19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, whether to enable or disable a cross-component linear model intra prediction on a chroma block of a video, based on whether one or more luma video units which cover at least one sample of a corresponding luma region of the chroma block are coded with a subblock-based prediction mode, wherein the chroma block is in a dual tree structure in which a luma component and at least one chroma component have separate partition tree structures;

in response to the cross-component linear model intra prediction enabled, determining parameters of the cross-component linear model at least based on neighboring chroma samples of the chroma block;

applying the cross-component linear model to derive prediction values of the chroma block based on the parameters; and

generating the bitstream of the video based on the determining,

wherein the parameters of the cross-component linear model are derived by following:

checking an availability of one or more neighboring chroma blocks of the chroma block;

finding R chroma samples from neighboring chroma samples in the one or more neighboring chroma blocks to determine the parameters of the cross-component linear model, wherein R is an integer greater than 2, and

wherein at least one neighboring chroma sample does not belong to the R chroma samples based on a size of the chroma block.

20. The non-transitory computer-readable recording medium of claim 19 , wherein the subblock-based prediction mode corresponds to an intra sub-partitions mode, and whether to enable or disable the cross-component linear model intra prediction on the chroma block is further based on partition information of the one or more luma video units, the partition information includes a partition tree depth of the one or more luma video units, and the partition tree depth is a quadtree depth.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2021
From: ZHANG, LI; ZHANG, KAI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 057536/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2021
From: DENG, ZHIPIN; LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 057536/0808 →
Priority Claims (1)
WO PCT/CN2019/083320 · Apr 18, 2019 · international
Continuity (2)
Continuation PCTCN2020085654 · Apr 20, 2020
Related Publication 20220030220A1 · Jan 27, 2022
Cited By (4)
US 12,200,218 US 12,301,845 US 12,368,841 US 12,445,653