IP Library Granted Patent US 12,244,863
Granted Patent B2
US 12,244,863 · App. 18/400,981 · Granted Mar 4, 2025

Method and system for processing video content

Inventors: Yan Ye (San Mateo, CA); Jie Chen (San Mateo, CA); Ru-Ling Liao (San Mateo, CA)
Assignee: Alibaba Group Holding Limited
H04N19/61H04N19/124H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,244,863
App. No.
18/400,981
Granted
Mar 4, 2025
Kind
B2
Abstract

Embodiments of the present disclosure provides systems and methods for processing video content. The methods include: reconstructing a chroma block based on a plurality of luma samples associated with the chroma block, wherein reconstructing the chroma block includes: determining whether the chroma block has non-zero chroma residuals; and in response to a determination that the chroma block has no non-zero chroma residuals, bypassing a process of averaging the plurality of luma samples, wherein the process of averaging is used for reconstructing the chroma block.

Claims (56)

1. A computer-implemented video processing method, comprising:

reconstructing a chroma block based on a plurality of luma samples associated with the chroma block,

wherein reconstructing the chroma block comprises:

determining whether the chroma block has non-zero chroma residuals; and

in response to a determination that the chroma block has no non-zero chroma residuals, bypassing a process of averaging the plurality of luma samples, wherein the process of averaging is used for reconstructing the chroma block.

2. The method according to claim 1 , wherein reconstructing the chroma block further comprises:

in response to a determination that the chroma block has one or more non-zero chroma residuals, performing the process of averaging to determine an averaged value of the plurality of luma samples, scaling the one or more non-zero chroma residuals based on the averaged value, and reconstructing the chroma block based on the scaled one or more non-zero chroma residuals.

3. The method according to claim 2 , where scaling the one or more non-zero chroma residuals based on the averaged value of the plurality of luma samples comprises:

determining a chroma scaling factor based on the averaged value; and

applying the chroma scaling factor to the one or more non-zero chroma residuals.

4. The method according to claim 1 , wherein whether the chroma block has no non-zero chroma residuals is determined based on a value of a coded block flag associated with the chroma block.

5. The method according to claim 4 , further comprising:

in response to the value of the coded block flag being equal to 1, determining that the chroma block has one or more non-zero chroma residuals.

6. The method according to claim 4 , further comprising:

in response to the value of the coded block flag being equal to 0, determining that the chroma block has no non-zero chroma residuals.

7. The method according to claim 1 , wherein whether the chroma block has no non-zero chroma residuals is determined based on:

a value of a first coded block flag associated with a first chroma component of the chroma block, and

a value of a second coded block flag associated with a second chroma component of the chroma block.

8. The method according to claim 7 , further comprising:

in response to at least one of the value of the first coded block flag or the value of the second coded block flag being equal to 1, determining that the chroma block has one or more non-zero chroma residuals.

9. The method according to claim 7 , further comprising:

in response to both the value of the first coded block flag and the value of the second coded block flag being equal to 0, determining that the chroma block has no non-zero chroma residuals.

10. An apparatus, comprising:

one or more memories storing a set of instructions; and

one or more processors configured to execute the set of instructions to cause the apparatus to perform:

reconstructing a chroma block based on a plurality of luma samples associated with the chroma block,

wherein in reconstructing the chroma block, the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform:

determining whether the chroma block has non-zero chroma residuals; and

in response to a determination that the chroma block has no non-zero chroma residuals, bypassing a process of averaging the plurality of luma samples, wherein the process of averaging is used for reconstructing the chroma block.

11. The apparatus according to claim 10 , wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform:

in response to a determination that the chroma block has one or more non-zero chroma residuals, performing the process of averaging to determine an averaged value of the plurality of luma samples, scaling the one or more non-zero chroma residuals based on the averaged value, and reconstructing the chroma block based on the scaled one or more non-zero chroma residuals.

12. The apparatus according to claim 11 , wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform:

determining a chroma scaling factor based on the averaged value of the plurality of luma samples; and

applying the chroma scaling factor to the one or more non-zero chroma residuals.

13. The apparatus according to claim 10 , wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform:

determining whether the chroma block has no non-zero chroma residuals, based on a value of a coded block flag associated with the chroma block.

14. The apparatus according to claim 13 , wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform:

in response to the value of the coded block flag being equal to 1, determining that the chroma block has one or more non-zero chroma residuals.

15. The apparatus according to claim 13 , wherein the one or more processors are configured to execute the set of instructions to cause the apparatus to further perform:

in response to the value of the coded block flag being equal to 0, determining that the chroma block has no non-zero chroma residuals.

16. A non-transitory computer readable storage medium storing a bitstream of a video for processing according to a method comprising:

reconstructing a chroma block based on a plurality of luma samples associated with the chroma block,

wherein reconstructing the chroma block comprises:

determining whether the chroma block has non-zero chroma residuals; and

in response to a determination that the chroma block has no non-zero chroma residuals, bypassing a process of averaging the plurality of luma samples, wherein the process of averaging is used for reconstructing the chroma block.

17. The non-transitory computer-readable storage medium according to claim 16 , wherein the method further comprises:

in response to a determination that the chroma block has one or more non-zero chroma residuals, performing the process of averaging to determine an averaged value of the plurality of luma samples, scaling the one or more non-zero chroma residuals based on the averaged value, and reconstructing the chroma block based on the scaled one or more non-zero chroma residuals.

18. The non-transitory computer-readable storage medium according to claim 17 , where scaling the one or more non-zero chroma residuals based on the averaged value comprises:

determining a chroma scaling factor based on the averaged value; and

applying the chroma scaling factor to the one or more non-zero chroma residuals.

19. The non-transitory computer-readable storage medium of claim 16 , wherein the bitstream comprises a coded block flag indicating whether the chroma block has no non-zero chroma residuals.

20. The non-transitory computer-readable storage medium of claim 16 , wherein the bitstream comprises:

a first coded block flag associated with a first chroma component of the chroma block, and

a second coded block flag associated with a second chroma component of the chroma block, wherein:

when at least one of a value of the first coded block flag or a value of the second coded block flag is equal to 1, it is indicated that the chroma block has one or more non-zero chroma residuals; and

when both the value of the first coded block flag and the value of the second coded block flag are equal to 0, it is indicated that the chroma block has no non-zero chroma residuals.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2024
From: YE, YAN; CHEN, JIE; LIAO, RU-LING
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 069620/0543 →
Continuity (5)
Continuation 18059105 · Nov 28, 2022
Continuation 16805611 · Feb 28, 2020
Provisional Application 62817546 · Mar 12, 2019
Provisional Application 62813728 · Mar 4, 2019
Related Publication 20240155158A1 · May 9, 2024
References Cited (51)
US 20090245387A1 · Hvidsten · 2009 [cited by examiner]
US 20130010196A1 · Payson et al. · 2013 [cited by applicant]
US 20140133551A1 · Alshina et al. · 2014 [cited by applicant]
US 20150015783A1 · Bernard et al. · 2015 [cited by applicant]
US 20150016512A1 · Pu · 2015 [cited by examiner]
US 20150117519A1 · Kim · 2015 [cited by examiner]
US 20150124865A1 · Kim · 2015 [cited by examiner]
US 20170085917A1 · Hannuksela · 2017 [cited by applicant]
US 20170105014A1 · Lee · 2017 [cited by examiner]
US 20170244975A1 · Huang et al. · 2017 [cited by applicant]
US 20180176594A1 · Zhang · 2018 [cited by examiner]
US 20190068969A1 · Rusanovskyy · 2019 [cited by examiner]
US 20190191172A1 · Rusanovskyy · 2019 [cited by examiner]
US 20190289306A1 · Zhao · 2019 [cited by examiner]
US 20190327477A1 · Ramasubramonian · 2019 [cited by examiner]
US 20200154115A1 · Ramasubramonian · 2020 [cited by examiner]
US 20200366910A1 · Zhang · 2020 [cited by examiner]
US 20210092413A1 · Tsukuba · 2021 [cited by examiner]
CN 101188776A · 2008 [cited by applicant]
CN 103444177A · 2013 [cited by applicant]
CN 104471940A · 2015 [cited by applicant]
CN 105165010A · 2015 [cited by applicant]
CN 107079157A · 2017 [cited by applicant]
JP 2016541164A · 2016 [cited by applicant]
JP 2022517683A · 2022 [cited by applicant]
WO 2014007520A1 · 2014 [cited by applicant]
WO WO2018016381A1 · 2018 [cited by applicant]
WO 2019040502A1 · 2019 [cited by applicant]
WO WO2020069667A1 · 2020 [cited by applicant]
WO WO2020176459A1 · 2020 [cited by examiner]
“Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding”—Kai Zhang, Jianle Chen, Li Zhang, Xiang Li, Marta Karczewicz; IEEE Transactions on Image Processing, vol. 27, No. 8, Aug. 2018 3983 (Ye… [cited by examiner]
G.J. Sullivan, J.R. Ohm, W.J. Han, T. Wiegand, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Trans. Circuits and Systems for Video Technology, vol. 22, No. 12, pp. 1649-1668, Dec. 2012. [cited by applicant]
J. Chen, E. Alshina, G. J. Sullivan, J.-R. Ohm, J. Boyce, “Algorithm description of Joint Exploration Test Model 7 (JEM7)”, JVET-G1001, Jul. 2017. [cited by applicant]
A. Segall, V. Baroncini, J. Boyce, J. Chen, and T. Suzuki, “Joint Call for Proposals on Video Compression with Capability beyond HEVC,” JVET-H1002, Oct. 2017. [cited by applicant]
B. Bross, J. Chen, S. Liu, “Versatile Video Coding (draft 4)”, JVET-M1001, Jan. 2019. [cited by applicant]
J. Chen, Y. Ye, S. Kim, “Algorithm description for Versatile Video Coding and Test Model 4 (VTM 4),” JVET-M1002, Jan. 2019. [cited by applicant]
T. Lu, F. Pu, P. Yin, W. Husak, S. McCarthy, T. Chen, “CE12: Mapping functions (test CE12-1 and CE12-2),” JVET-M0427, Jan. 2019. [cited by applicant]
“Extended Cross-Component Prediction in HEVC”—Tung Nguyen, Ali Khairat, Detlev Marpe, Mischa Siekmann, and Thomas Wiegand; 978-1-4799-7783-3/15/$31.00 © 2015 IEEE. (Year: 2015). [cited by applicant]
“Adaptive Cross-Component Prediction For 4:4:4 High Efficiency Video Coding”—Ali Khairat, Tung Nguyen, Mischa Siekmann, Detlev Marpe, and Thomas Wiegand; 978-1-4799-575 1-4/14/$31.00 © 2014 IEEE. (Year: 2014). [cited by applicant]
PCT International Search Report and Written Opinion mailed May 26, 2020, issued in corresponding International Application No. PCT/US2020/020513 (11 pgs.). [cited by applicant]
European Patent Office Communication issued for Application No. 20765801.4 the Supplementary European Search Report (Art. 153(7) EPC) and the European search opinion dated Jul. 11, 2022, 9 pages. [cited by applicant]
Rusanovkskyy et al. “Additional Information on HOR video coding technology proposal by Qualcomm and Technicolor,” JVET-J0067, 10 [cited by applicant]
Chinese Search Report issued in corresponding Chinese Application No. 202080018751.X (3 pages), Aug. 19, 2023. [cited by applicant]
Francois et al., “Suggested luma mapping with chroma scaling modifications in N0220/N0389/N0477,” JVET-N0806, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 4 pages. [cited by applicant]
Japanese Office Action issued in corresponding Japanese Application No. 2021-547465 on Feb. 27, 2024 (17 pages). [cited by applicant]
Japanese Search Report issued in corresponding Japanese Application No. 2021-547465 on Feb. 29, 2024 (38 pages). [cited by applicant]
Lu et al., “CE12-2: HDR In-Loop Reshaping,” JVET-L0245-v2, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 20 pages. [cited by applicant]
Gao et al., “Video Denoising Alglorithm via Multi-scale Joint Luma Chroma Bilateral Filter,” Beijing Key Laboratory of Digital Media, School of Computer Science and Engineering, 2015, 5 pages. [cited by applicant]
Yonghong, Qin, “HEVC decoder design based on TMS320DM642,” Masters Thesis, Southwest Jiaotong University, 2009, 81 pages. (translation of abstract only). [cited by applicant]
European Patent Office Communication pursuant to Article 94(3) EPC issued for Application No. 20765801.4 dated Oct. 8, 2024, 7 pages. [cited by applicant]
Francois et al., “Chroma residual scaling with separate luma/chroma tree,” JVET-N0389-r1, 14 [cited by applicant]