IP Library › Granted Patent US 12,262,019
Granted Patent B2
US 12,262,019 · App. 18/367,976 · Granted Mar 25, 2025

Adaptive bands for filter offset selection in cross-component sample offset

Inventors: Samruddhi Yashwant Kahu (Laguna Hills, CA); Xin Zhao (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/132H04N19/117H04N19/172H04N19/176H04N19/186H04N19/1887H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,262,019
App. No.
18/367,976
Granted
Mar 25, 2025
Kind
B2
Abstract

Processing circuitry receives coded information indicative of applying cross-component sample offset (CCSO) with adaptive bands. The processing circuitry determines at least a first band width for a first band and a second band width for a second band. The processing circuitry determines at least a first offset associated with the first band and a second offset associated with the second band, and categorizes reconstructed samples of a first color component into at least the first band and the second band. The first band includes first reconstructed samples and the second band includes second reconstructed samples. The processing circuitry applies the first offset to first reconstructed samples of a second color component that are collocated with the first reconstructed samples of the first color component, and the second offset to second reconstructed samples of the second color component that are collocated with the second reconstructed samples of the first color component.

Claims (59)

1. A method of video processing in a decoder, comprising:

receiving coded information from a coded video bitstream, the coded information being indicative of applying cross-component sample offset (CCSO) with adaptive bands;

determining at least a first band width for a first band and a second band width for a second band, the first band width being different from the second band width;

determining, for a current block in a current picture, at least a first offset associated with the first band and a second offset associated with the second band;

categorizing reconstructed samples of a first color component in the current block into at least the first band and the second band based on the first band width of the first band and the second band width of the second band, the first band comprising first reconstructed samples of the first color component and the second band comprising second reconstructed samples of the first color component, the first reconstructed samples of the first color component collocating with first reconstructed samples of a second color component in the current block, the second reconstructed samples of the first color component collocating with second reconstructed samples of the second color component in the current block; and

applying at least the first offset to the first reconstructed samples of the second color component and the second offset to the second reconstructed samples of the second color component to generate CCSO compensated samples of the second color component.

2. The method of claim 1 , wherein the determining at least the first band width for the first band and the second band width for the second band further comprises:

decoding at least the first band width from the coded information.

3. The method of claim 2 , wherein the coded information comprises each of at least the first band width and the second band width that are coded by a fixed length code word.

4. The method of claim 2 , further comprising:

decoding at least a first difference value and a second difference value from the coded information;

determining the second band width by combining the first band width and the first difference value; and

determining a third band width for a third band by combining the first band width and the second difference value.

5. The method of claim 2 , further comprising:

decoding at least a first difference value and a second difference value from the coded information;

determining the second band width by combining the first band width and the first difference value; and

determining a third band width for a third band by combining the second band width and the second difference value.

6. The method of claim 2 , further comprising:

decoding, from at least one of a sequence parameter set, a picture header, and a slice header, a syntax element with a value that indicates a number of bits for coding at least the first band width.

7. The method of claim 1 , wherein the determining at least the first band width for the first band and the second band width for the second band further comprises:

decoding difference values respectively associated with at least the first band and the second band from the coded video bitstream; and

combining the difference values with corresponding band widths of a previous picture to determine at least the first band width for the first band and the second band width for the second band.

8. The method of claim 1 , wherein the current picture is at least one of:

a first frame in a video sequence that is coded in the coded video bitstream;

a key frame in the video sequence; and

a frame with a temporary layer satisfying a requirement.

9. The method of claim 1 , further comprising:

decoding, from at least one of a sequence parameter set, a picture header, and a slice header, a syntax element with a value that indicates whether the adaptive bands being applied with the CCSO.

10. The method of claim 1 , wherein the coded information indicates to apply the CCSO with the adaptive bands for all frames in a video sequence.

11. The method of claim 1 , wherein a first set of band widths associated with the current picture comprises the first band width for the first band and the second band width for the second band, and the method further comprises:

determining the first set of band widths associated with the current picture based on a second set of band widths associated with another frame.

12. An apparatus for video decoding, comprising processing circuitry configured to:

receive coded information from a coded video bitstream, the coded information being indicative of applying cross-component sample offset (CCSO) with adaptive bands;

determine at least a first band width for a first band and a second band width for a second band, the first band width being different from the second band width;

determine, for a current block in a current picture, at least a first offset associated with the first band and a second offset associated with the second band;

categorize reconstructed samples of a first color component in the current block into at least the first band and the second band based on the first band width of the first band and the second band width of the second band, the first band comprising first reconstructed samples of the first color component and the second band comprising second reconstructed samples of the first color component, the first reconstructed samples of the first color component collocating with first reconstructed samples of a second color component in the current block, the second reconstructed samples of the first color component collocating with second reconstructed samples of the second color component in the current block; and

apply at least the first offset to the first reconstructed samples of the second color component and the second offset to the second reconstructed samples of the second color component to generate CCSO compensated samples of the second color component.

13. The apparatus of claim 12 , wherein the processing circuitry is configured to:

decode at least the first band width from the coded information.

14. The apparatus of claim 13 , wherein the coded information comprises each of at least the first band width and the second band width that are coded by a fixed length code word.

15. The apparatus of claim 13 , wherein the processing circuitry is configured to:

decode at least a first difference value and a second difference value from the coded information;

determine the second band width by combining the first band width and the first difference value; and

determine a third band width for a third band by combining the first band width and the second difference value.

16. The apparatus of claim 13 , wherein the processing circuitry is configured to:

decode at least a first difference value and a second difference value from the coded information;

determine the second band width by combining the first band width and the first difference value; and

determine a third band width for a third band by combining the second band width and the second difference value.

17. The apparatus of claim 13 , wherein the processing circuitry is configured to:

decode, from at least one of a sequence parameter set, a picture header, and a slice header, a syntax element with a value that indicates a number of bits for coding at least the first band width.

18. The apparatus of claim 12 , wherein the processing circuitry is configured to:

decode difference values respectively associated with at least the first band and the second band from the coded video bitstream; and

combine the difference values with corresponding band widths of a previous picture to determine at least the first band width for the first band and the second band width for the second band.

19. The apparatus of claim 12 , wherein the current picture is at least one of:

a first frame in a video sequence that is coded in the coded video bitstream;

a key frame in the video sequence; and

a frame with a temporary layer satisfying a requirement.

20. The apparatus of claim 12 , wherein the processing circuitry is configured to:

decode, from at least one of a sequence parameter set, a picture header, and a slice header, a syntax element with a value that indicates whether the adaptive bands being applied with the CCSO.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2023
From: KAHU, SAMRUDDHI YASHWANT; ZHAO, XIN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 064895/0785 →
Continuity (2)
Provisional Application 63439044 · Jan 13, 2023
Related Publication 20240244212A1 · Jul 18, 2024
References Cited (48)
US 11595644B2 · Du et al. · 2023 [cited by applicant]
US 11683530B2 · Du et al. · 2023 [cited by applicant]
US 20130336383A1 · Xu et al. · 2013 [cited by applicant]
US 20170034511A1 · Yamazaki · 2017 [cited by examiner]
US 20170127078A1 · Kobayashi · 2017 [cited by applicant]
US 20190045186A1 · Zhang et al. · 2019 [cited by applicant]
US 20190052877A1 · Zhang et al. · 2019 [cited by applicant]
US 20190182482A1 · Vanam et al. · 2019 [cited by applicant]
US 20200029080A1 · Kim · 2020 [cited by examiner]
US 20210051320A1 · Tourapis et al. · 2021 [cited by applicant]
US 20220101095A1 · Li et al. · 2022 [cited by applicant]
US 20220109848A1 · Wang · 2022 [cited by applicant]
US 20220248007A1 · Misra et al. · 2022 [cited by applicant]
US 20220272335A1 · Liu et al. · 2022 [cited by applicant]
US 20220272347A1 · Zhu et al. · 2022 [cited by applicant]
US 20220272348A1 · Zhang et al. · 2022 [cited by applicant]
US 20220279176A1 · Sarwer et al. · 2022 [cited by applicant]
US 20220286674A1 · Wang et al. · 2022 [cited by applicant]
US 20220295054A1 · Zhao et al. · 2022 [cited by applicant]
US 20220303586A1 · Du et al. · 2022 [cited by applicant]
US 20220321919A1 · Deshpande · 2022 [cited by applicant]
US 20220337853A1 · Li et al. · 2022 [cited by applicant]
US 20230101318A1 · Kotra · 2023 [cited by examiner]
US 20230336734A1 · Kotra · 2023 [cited by examiner]
CN 104702963B · 2017 [cited by applicant]
WO 2015163046A1 · 2015 [cited by applicant]
WO 2020259538A1 · 2020 [cited by applicant]
WO 2022040428A1 · 2022 [cited by applicant]
Chen et al., An Overview of Core Coding Tools in the AV1 Video Codec, 2018 Picture Coding Symposium (PCS), San Francisco, CA, USA, 2018, pp. 41-45. [cited by applicant]
Rivaz et al., AV1 Bitstream & Decoding Process Specification The Alliance for Open Media 681, Jan. 8, 2019, pp. 1-681. [cited by applicant]
D. Mukherjee, S. Li, Y. Chen, A. Anis, S. Parker, and J. Bankoski. “A switchable loop-restoration with side-information framework for the emerging AV1 video codec.” In 2017 IEEE International Conference on Image Process… [cited by applicant]
S. Midtskogen, A. Fuldseth, G. Bj, and T. Davies. “Integrating Thor tools into the emerging AV1 codec.” In 2017 IEEE International Conference on Image Processing (ICIP), pp. 930-933. IEEE, 2017. [cited by applicant]
S. Midtskogen, and J.-M. Valin. “The AV1 constrained directional enhancement filter (CDEF).” In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1193-1197. IEEE, 2018. [cited by applicant]
Daede, Thomas J., Nathan E. Egge, Jean-Marc Valin, Guillaume Martres, and Timothy B. Terriberry. “Daala: A perceptually-driven next generation video codec.” arXiv preprint arXiv:1603.03129 (2016). [cited by applicant]
X. Zhao, Y. Du, Y. Zheng, et al., “Improved CCSO with luma extension and band feature.” CWG-B099, Jan. 2022, pp. 1-5. [cited by applicant]
Y. Du, X. Zhao and S. Liu, “Cross-component sample offset for image and video coding.” In 2021 IEEE International Conference on Visual Communication and Image Processing (VCIP), IEEE, 2021, pp. 1-5. [cited by applicant]
C. Tsai, C. Fu, C. Chen, Y. Huang, S. Lei, “TE10 Subtest2: Coding Unit Synchronous Picture Quadtree-based Adaptive Loop Filter”, ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JCTVC-C143, Oct. 2010, pp. 1-12. [cited by applicant]
J. Taquet, P. Onno, C. Gisquet, G. Laroche, “CE5: Results of tests CE5-3.1, CE5-3.2, CE5-3.3 and CE5-3.4 on Non-Linear Adaptive Loop Filter.”, ISO/IEC JTC1/SC29/WG11 JVET-N0242-v2, Mar. 2019, pp. 1-10. [cited by applicant]
K. Misra, F. Bossen, A. Segall, “Cross-Component Adaptive Loop Filter for chroma”, ISO/IEC JTC1/SC29/WG11 JVET O-0636-r1, Jul. 2019, pp. 1-9. [cited by applicant]
K. Misra, F. Bossen, A. Segall, ect, “CE5-related: On the design of CC-ALF”, ISO/IEC JTC1/SC29/WG11 JVET-P1008-v2, Oct. 2019, pp. 1-6. [cited by applicant]
B. Bross, J. Chen, S. Liu, Y. K. Wang, “Versatile Video Coding (Draft 8)”, ISO/IEC JTC1/SC29/WG11 JVET-Q2001, Jan. 2020, pp. 1-510. [cited by applicant]
International Search Report mailed May 3, 2022 for International Application No. PCT/US2022/014255. [cited by applicant]
Written Opinion mailed May 3, 2022 for International Application No. PCT/US2022/014255. [cited by applicant]
Bross, B. et al.; “Versatile Video Coding (Draft 6)”; Document: JVET-O2001-vE; Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019; 455 pages. [cited by applicant]
Bross, B. et al.; “Versatile Video Coding (Draft 7)”; Document: JVET-P2001-vE; Joint Video Experts Team (JVET) of ITU-T SH 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019; 485 pages. [cited by applicant]
Office Action issued on European Application 22760638.1 on Jun. 9, 2023, 16p. [cited by applicant]
Bross, Benjamin et al., “Working Draft 5 of Versatile Video Coding”, JVET, International Organization for Standardization, ISO/IEC JTC 1/SC29/WG11 N18370, Coding of Moving Pictures and Audio, Mar. 2019, 406p, CH. [cited by applicant]
Bhat, Madhukar et al., “AHG10: Adaptive Coding Sub-set for encoder optimization”, Input Document to JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Jul. 3-12, 2019, 7p, SE. [cited by applicant]