IP Library › Granted Patent US 12,413,735
Granted Patent B2
US 12,413,735 · App. 18/125,568 · Granted Sep 9, 2025

Chroma coding enhancement in cross-component sample adaptive offset with virtual boundary

Inventors: Che-Wei Kuo (Beijing, CN); Xiaoyu Xiu (Beijing, CN); Yi-Wen Chen (Beijing, CN); Wei Chen (Beijing, CN); Tsung-Chuan Ma (Beijing, CN); Hong-Jheng Jhu (Beijing, CN); Bing Yu (Beijing, CN); Xianglin Wang (Beijing, CN)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/132H04N19/105H04N19/176H04N19/1883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,413,735
App. No.
18/125,568
Granted
Sep 9, 2025
Kind
B2
Abstract

An electronic apparatus performs a method of decoding video data. The method includes: receiving, from the video signal, a picture frame that includes a first component and a second component; determining a classifier for the second component from a set of one or more samples of the first component associated with a respective sample of the second component; determining whether to modify a value of the respective sample of the second component of a current block of the picture frame within a virtual boundary according to the classifier; in response to the determination to modify the value of the respective sample of the second component of the current block according to the classifier, determining a sample offset for the respective sample of the second component according to the classifier; and modifying the value of the respective sample of the second component based on the determined sample offset.

Claims (45)

1. A method of decoding a video signal, comprising:

receiving, from the video signal, a picture frame that includes a first component and a second component;

in response to a current Coding Tree Unit (CTU) being not located within a bottom row of CTUs of a frame, slice, tile, subpicture or patch, determining a set of one or more samples of the first component according to a positional relationship between a respective sample of the second component and a virtual boundary;

determining a class index for the second component from the set of one or more samples of the first component associated with the respective sample of the second component;

selecting a sample offset from a plurality of sample offsets for the respective sample of the second component according to the class index; and

obtaining a cross-component offsetted sample value of the second component based on the selected sample offset.

2. The method of claim 1 , further comprising:

in response to the current CTU being located within the bottom row of CTUs of the frame, slice, tile, subpicture or patch, determining the set of one or more samples of the first component regardless of the virtual boundary, wherein the set of one or more samples comprises a collocated sample of the first component relative to the respective sample of the second component or a neighboring sample of the collocated sample of the first component relative to the respective sample of the second component.

3. The method of claim 1 , wherein determining the set of one or more samples of the first component according to the positional relationship between the respective sample of the second component and the virtual boundary comprises:

determining a first set of one or more samples of the first component as the set of one or more samples of the first component when the respective sample of the second component is above the virtual boundary; and

determining a second set of one or more samples of the first component as the set of one or more samples of the first component when the respective sample of the second component is on or below the virtual boundary, wherein the second set of one or more samples is different from the first set of one or more samples.

4. The method of claim 3 , wherein the first set of one or more samples comprises a collocated sample of the first component relative to the respective sample of the second component or a neighboring sample of the collocated sample of the first component relative to the respective sample of the second component.

5. The method of claim 3 , wherein the virtual boundary comprises a virtual boundary within a Coding Tree Block (CTB) of the second component.

6. The method of claim 3 , wherein the virtual boundary is parallel with a block boundary and separated from the block boundary by at least one row or column of samples.

7. An electronic apparatus comprising:

one or more processing units;

memory coupled to the one or more processing units; and

a plurality of programs stored in the memory that, when executed by the one or more processing units, cause the electronic apparatus to perform a method of decoding a video signal, the method comprises:

receiving, from the video signal, a picture frame that includes a first component and a second component;

in response to a current Coding Tree Unit (CTU) being not located within a bottom row of CTUs of a frame, slice, tile, subpicture or patch, determining a set of one or more samples of the first component according to a positional relationship between a respective sample of the second component and a virtual boundary;

determining a class index for the second component from the set of one or more samples of the first component associated with the respective sample of the second component;

selecting a sample offset from a plurality of sample offsets for the respective sample of the second component according to the class index; and

obtaining a cross-component offsetted sample value of the second component based on the selected sample offset.

8. The electronic apparatus of claim 7 , the method further comprising:

in response to the current CTU being located within the bottom row of CTUs of the frame, slice, tile, subpicture or patch, determining the set of one or more samples of the first component regardless of the virtual boundary, wherein the set of one or more samples comprises a collocated sample of the first component relative to the respective sample of the second component or a neighboring sample of the collocated sample of the first component relative to the respective sample of the second component.

9. The electronic apparatus of claim 7 , wherein determining the set of one or more samples of the first component according to the positional relationship between the respective sample of the second component and the virtual boundary comprises:

determining a first set of one or more samples of the first component as the set of one or more samples of the first component when the respective sample of the second component is above the virtual boundary; and

determining a second set of one or more samples of the first component as the set of one or more samples of the first component when the respective sample of the second component is on or below the virtual boundary, wherein the second set of one or more samples is different from the first set of one or more samples.

10. The electronic apparatus of claim 9 , wherein the first set of one or more samples comprises a collocated sample of the first component relative to the respective sample of the second component or a neighboring sample of the collocated sample of the first component relative to the respective sample of the second component.

11. The electronic apparatus of claim 9 , wherein the virtual boundary comprises a virtual boundary within a Coding Tree Block (CTB) of the second component.

12. The electronic apparatus of claim 9 , wherein the virtual boundary is parallel with a block boundary and separated from the block boundary by at least one row or column of samples.

13. A non-transitory computer readable storage medium storing a plurality of programs for execution by an electronic apparatus having one or more processing units, wherein the plurality of programs, when executed by the one or more processing units, cause the electronic apparatus to perform a method of decoding a video signal, the method comprising:

receiving, from the video signal, a picture frame that includes a first component and a second component;

in response to a current Coding Tree Unit (CTU) being not located within a bottom row of CTUs of a frame, slice, tile, subpicture or patch, determining a set of one or more samples of the first component according to a positional relationship between a respective sample of the second component and a virtual boundary;

determining a class index for the second component from the set of one or more samples of the first component associated with the respective sample of the second component;

selecting a sample offset from a plurality of sample offsets for the respective sample of the second component according to the class index; and

obtaining a cross-component offsetted sample value of the second component based on the selected sample offset.

14. The storage medium of claim 13 , the method further comprising:

in response to the current CTU being located within the bottom row of CTUs of the frame, slice, tile, subpicture or patch, determining the set of one or more samples of the first component regardless of the virtual boundary, wherein the set of one or more samples comprises a collocated sample of the first component relative to the respective sample of the second component or a neighboring sample of the collocated sample of the first component relative to the respective sample of the second component.

15. The storage medium of claim 13 , wherein determining the set of one or more samples of the first component according to the positional relationship between the respective sample of the second component and the virtual boundary comprises:

determining a first set of one or more samples of the first component as the set of one or more samples of the first component when the respective sample of the second component is above the virtual boundary; and

determining a second set of one or more samples of the first component as the set of one or more samples of the first component when the respective sample of the second component is on or below the virtual boundary, wherein the second set of one or more samples is different from the first set of one or more samples.

16. The storage medium of claim 15 , wherein the first set of one or more samples comprises a collocated sample of the first component relative to the respective sample of the second component or a neighboring sample of the collocated sample of the first component relative to the respective sample of the second component.

17. The storage medium of claim 15 , wherein the virtual boundary comprises a virtual boundary within a Coding Tree Block (CTB) of the second component.

18. The storage medium of claim 15 , wherein the virtual boundary is parallel with a block boundary and separated from the block boundary by at least one row or column of samples.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2023
From: KUO, CHE-WEI; XIU, XIAOYU; CHEN, YI-WEN; CHEN, WEI; MA, TSUNG-CHUAN; JHU, HONG-JHENG; YU, BING; WANG, XIANGLIN
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 065340/0189 →
Continuity (4)
Continuation PCTUS2021051573 · Sep 22, 2021
Provisional Application 63086504 · Oct 1, 2020
Provisional Application 63082356 · Sep 23, 2020
Related Publication 20230308652A1 · Sep 28, 2023
References Cited (18)
US 20040076237A1 · Kadono · 2004 [cited by examiner]
US 20160241880A1 · Chao et al. · 2016 [cited by applicant]
US 20190327494A1 · Dong et al. · 2019 [cited by applicant]
US 20200021822A1 · An et al. · 2020 [cited by applicant]
US 20200296425A1 · Seregin et al. · 2020 [cited by applicant]
US 20220272332A1 · Lai · 2022 [cited by examiner]
US 20240098259A1 · Misra · 2024 [cited by examiner]
WO 2020083108A1 · 2020 [cited by applicant]
WO 2020147782A1 · 2020 [cited by applicant]
Extended European Search Report issued in European Application No. 21873363.2, mailed on Mar. 4, 2024 (7 pages). [cited by applicant]
C-M Fu et al.; “CE8.c.2: Single-source SAO and ALF virtual boundary processing;” 7. JCT-VC Meeting; 98. MPEG Meeting; Nov. 21, 2011-Nov. 30, 2011; Geneva; (Joint Collaborative Team on Video Coding of ISO/IEC JTC1/SC29/W… [cited by applicant]
An (Hisilicon) J et al: “Unified Adaptive Loop Filter for Luma and Chroma”; 6. JVET Meeting; Mar. 31, 2017-Apr. 7, 2017; Hobart; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16); No. JVET-F00… [cited by applicant]
C-M Fu et al: “Sample Adaptive Offset with Zero Pixel Line Buffers for LCU-based Decoding;” 6. JCT-VC Meeting; Jul. 14, 2011-Jul. 22, 20112; Torino; (Joint Collaborative Team on Video Coding of ISO/IEC JTC1/SC29/WG11 an… [cited by applicant]
Chih-Ming Fu et al.; “Sample Adaptive Offset in the HEVC Standard;” IEEE Transactions on Circuits and Systems for Video Technology; vol. 22; Issue 12; Dec. 1, 2012; pp. 1755-1764 (10 pages). [cited by applicant]
C-W Kuo (Kwai) et al: “AHG12: Cross-component Sample Adaptive Offset;” 22. JVET Meeting; Apr. 20, 2021-Apr. 28, 2021; Teleconference; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16); No. JVE… [cited by applicant]
Office Action issued in European Application No. 21873363.2, mailed on Mar. 15, 2024 (7 Pages). [cited by applicant]
International Search Report issued in International Application No. PCT/US2021/051573 dated Jan. 11, 2022 (3 pages). [cited by applicant]
Written Opinion issued in International Application No. PCT/US2021/051573 dated Jan. 11, 2022 (5 pages). [cited by applicant]