IP Library › Granted Patent US 12,355,982
Granted Patent B2
US 12,355,982 · App. 18/091,178 · Granted Jul 8, 2025

Decoder-side chroma intra prediction mode gradient-based derivation

Inventors: Xinwei Li (Beijing, CN); Ru-Ling Liao (Beijing, CN); Jie Chen (Beijing, CN); Yan Ye (San Diego, CA)
Assignee: Alibaba (China) Co., Ltd
H04N19/159H04N19/11H04N19/117H04N19/13H04N19/132H04N19/176H04N19/186H04N19/593H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,355,982
App. No.
18/091,178
Granted
Jul 8, 2025
Kind
B2
Abstract

A VVC-standard encoder and a VVC-standard decoder are provided, implementing a decoder-side chroma intra prediction mode gradient-based derivation method, which improves coding efficiency of chroma intra prediction, thereby saving on signaling cost. A VVC-standard decoder configures one or more processors of a computing system to derive one of multiple possible chroma intra prediction modes by computing gradients of adjacent luma samples and chroma samples of a current chroma block. With minimal increase in signaling cost, the VVC-standard coding and decoding processes are enhanced to base intra prediction modes for chroma blocks on collocated luma block-adjacent reconstructed luma samples adjacent reconstructed chroma samples, enabling prior computational work done on coding and decoding adjacent blocks to be referenced. In this fashion, coding gains can be achieved in matching texture characteristics of the current chroma block based on a texture gradient including adjacent blocks.

Claims (44)

1. A computing system, comprising:

one or more processors, and

a computer-readable storage medium communicatively coupled to the one or more processors, the computer-readable storage medium storing computer-readable instructions executable by the one or more processors that, when executed by the one or more processors, perform associated operations comprising:

signaling a first flag in a bitstream, the first flag indicating whether to apply, by one or more processors of a computing system configured by an entropy decoder, a gradient-based derived chroma intra prediction mode to a current chroma block;

signaling a second flag in the bitstream, the second flag indicating whether to apply, by the one or more processors configured by an entropy decoder, Direct Mode (“DM”) mode to the current chroma block;

wherein the first flag is after the second flag in the bitstream.

2. The computing system of claim 1 , wherein the second flag is set to a false value.

3. A computing system, comprising:

one or more processors, and

a computer-readable storage medium communicatively coupled to the one or more processors, the computer-readable storage medium storing computer-readable instructions executable by the one or more processors that, when executed by the one or more processors, perform associated operations comprising:

deriving a chroma intra prediction mode to be applied in reconstructing a current chroma block based on computing gradients of:

a plurality of collocated reconstructed luma samples;

a plurality of collocated luma block-adjacent reconstructed luma samples; and

a plurality of adjacent reconstructed chroma samples consisting of samples of a second nearest neighboring line adjacent to an upper edge of the current chroma block and adjacent to a left edge of the current chroma block.

4. The computing system of claim 3 , wherein computing gradients comprises multiplying samples of a filter window by at least a matrix other than a Sobel filter.

5. The computing system of claim 3 , wherein deriving a chroma intra prediction mode comprises selecting an intra prediction mode corresponding to a largest histogram amplitude value from an intra prediction mode histogram based on computed gradients.

6. The computing system of claim 5 , wherein deriving a chroma intra prediction mode further comprises:

determining that the intra prediction mode corresponding to a largest histogram amplitude value is Direct Mode (“DM”); and

selecting an intra prediction mode corresponding to a second largest histogram amplitude value from an intra prediction mode histogram based on computed gradients.

7. The computing system of claim 3 , wherein the chroma intra prediction mode is derived based on computing gradients of only the plurality of collocated reconstructed luma samples.

8. The computing system of claim 3 , wherein the chroma intra prediction mode is derived based on computing gradients of the plurality of collocated luma block-adjacent reconstructed luma samples and the plurality of adjacent reconstructed chroma samples;

wherein the plurality of adjacent reconstructed chroma samples comprises reconstructed Cb samples and reconstructed Cr samples.

9. The computing system of claim 8 , wherein the chroma intra prediction mode is derived based further on computing gradients of the plurality of collocated reconstructed luma samples.

10. The computing system of claim 3 , wherein the samples of the second nearest neighboring line comprise extended samples to an upper-right of the current chroma block and extended samples to a lower-left of the current chroma block.

11. The computing system of claim 3 , wherein the operations further comprise:

parsing a first flag signaled in a bitstream before deriving the chroma intra prediction mode;

wherein the first flag indicates either:

to apply a gradient-based derived chroma intra prediction mode to the current chroma block; or

to apply one among the gradient-based derived chroma intra prediction mode or Direct Mode (“DM”) mode to the current chroma block.

12. The computing system of claim 11 , wherein the operations further comprise parsing a second flag signaled in the bitstream before deriving the chroma intra prediction mode;

wherein the first flag indicates to apply a gradient-based derived chroma intra prediction mode to a current chroma block; and

wherein the second flag indicates not to apply DM mode to the current chroma block.

13. The computing system of claim 12 , wherein the first flag is after the second flag in the bitstream.

14. A method of storing a bitstream associated with a video sequence, the method comprising:

generating a bitstream comprising:

a first flag indicating whether to apply, by one or more processors of a computing system configured by an entropy decoder, a gradient-based derived chroma intra prediction mode to a current chroma block; and

a second flag indicating whether to apply, by the one or more processors, Direct Mode (“DM”) mode to the current chroma block;

wherein the first flag is after the second flag in the bitstream; and

storing the bitstream in a non-transitory computer-readable storage medium.

15. The method of claim 14 , wherein the first flag indicates whether to apply, by the one or more processors, a gradient-based derived chroma intra prediction mode to a current chroma block; and

wherein the first flag is signaled in the bitstream after a second flag, the second flag indicating whether to apply, by the one or more processors, DM mode to the current chroma block.

16. The method of claim 15 , wherein the second flag is set to a false value.

17. The method of claim 14 , wherein the first flag is signaled in the bitstream before a second flag, the second flag indicating whether to apply, by the one or more processors, DM mode to the current chroma block.

18. The method of claim 14 , wherein the first flag indicates which, between the gradient-based derived chroma intra prediction mode and DM mode, to the current chroma block; and wherein the first flag is signaled in the bitstream after a second flag, the second flag indicating whether to apply either or neither of the gradient-based derived chroma intra prediction mode and DM mode, by the one or more processors, to the current chroma block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2025
From: CHEN, JIE; YE, YAN; LIAO, RU-LING; LI, XINWEI
To: ALIBABA (CHINA) CO., LTD.
Reel/Frame 070002/0290 →
Continuity (3)
Provisional Application 63315957 · Mar 2, 2022
Provisional Application 63296482 · Jan 4, 2022
Related Publication 20230217030A1 · Jul 6, 2023
References Cited (10)
US 20150281687A1 · Yasugi et al. · 2015 [cited by applicant]
US 20200014920A1 · Zhao · 2020 [cited by examiner]
US 20200128272A1 · Jangwon et al. · 2020 [cited by applicant]
US 20210329259A1 · Huo et al. · 2021 [cited by applicant]
US 20220070451A1 · Abdoli · 2022 [cited by examiner]
US 20220150479A1 · Rosewarne · 2022 [cited by examiner]
EP 3654645A1 · 2020 [cited by applicant]
WO WO2021052494A1 · 2021 [cited by applicant]
International Search Report mailed Mar. 22, 2023, from PCT/CN2023/070246, 4 pages. [cited by applicant]
Written Opinion mailed Mar. 22, 2023, from PCT/CN2023/070246, 3 pages. [cited by applicant]