IP Library › Granted Patent US 12,581,070
Granted Patent B2
US 12,581,070 · App. 17/930,331 · Granted Mar 17, 2026

Edge offset for cross component sample adaptive offset (CCSAO) filter

Inventors: Venkata Meher Satchit Anand Kotra (Munich, DE); Nan Hu (San Diego, CA); Vadim Seregin (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: QUALCOMM INCORPORATED
H04N19/117H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,581,070
App. No.
17/930,331
Granted
Mar 17, 2026
Kind
B2
Abstract

Systems and techniques are described for processing video data. For instance, a process can include obtaining video data. The process can further include determining a classification band for a first sample of the video data using at least chroma information from the first sample, collocated luma information and collocated chroma information. The process can also include filtering at least the first sample of the video data based on the classification band.

Claims (42)

1 . An apparatus for processing video data, the apparatus comprising:

at least one memory; and

at least one processor coupled to the at least one memory, the at least one processor being configured to:

obtain video data;

determine a classification band for a first sample of the video data using at least chroma information from the first sample, collocated luma information, and collocated chroma information, the collocated luma information including luma information of a second sample that is collocated with the first sample or luma information of one or more samples neighboring the second sample, and the collocated chroma information including chroma information of a third sample that is collocated with the first sample;

determine a classification for the first sample based on the classification band, a first variable indicative of whether there is an edge between the second sample and a first neighboring sample of the one or more samples neighboring the second sample, and a second variable indicative of whether there is an edge between the second sample and a second neighboring sample of the one or more samples neighboring the second sample, the first variable determined based on whether a difference between a value of the second sample and a value of the first neighboring sample is less than a predetermined value and whether the difference between the value of the second sample and the value of the first neighboring sample is greater than a threshold, and the second variable determined based on a difference between the value of the second sample and a value of the second neighboring sample is less than the predetermined value and whether the difference between the value of the second sample and the value of the second neighboring sample is greater than the threshold; and

filter at least the first sample of the video data based on the determined classification.

2 . The apparatus of claim 1 , wherein the at least one processor is further configured to use edge information to determine the classification band for the first sample of the video data, and wherein the edge information comprises information from a set of neighboring samples neighboring the first sample.

3 . The apparatus of claim 2 , wherein the edge information is based on at least one of the difference between the value of the second sample and the value of the first neighboring sample or the difference between the value of the second sample and the value of the second neighboring sample.

4 . The apparatus of claim 1 , wherein the chroma information comprises first chroma component information, and wherein the collocated chroma information comprises second chroma component information, the first chroma component information being different from the second chroma component information.

5 . The apparatus of claim 1 , wherein the at least one processor is further configured to determine the classification band from among a plurality of available classification bands.

6 . The apparatus of claim 5 , wherein the at least one processor is further configured to:

determine the classification band based on the collocated chroma information based on a number of available classification bands being greater than a threshold value.

7 . The apparatus of claim 6 , wherein the threshold value is a value of four.

8 . The apparatus of claim 1 , wherein the first sample is obtained from a position in a first picture of the video data, and wherein the collocated luma information and the collocated chroma information are obtained from a corresponding position of a second picture of the video data.

9 . The apparatus of claim 1 , wherein the predetermined value is a value of 0.

10 . A method for processing video data, the method comprising:

obtaining video data;

determining a classification band for a first sample of the video data using at least chroma information from the first sample, collocated luma information, and collocated chroma information, the collocated luma information including luma information of a second sample that is collocated with the first sample or luma information of one or more samples neighboring the second sample, and the collocated chroma information including chroma information of a third sample that is collocated with the first sample;

determining a classification for the first sample based on the classification band, a first variable indicative of whether there is an edge between the second sample and a first neighboring sample of the one or more samples neighboring the second sample, and a second variable indicative of whether there is an edge between the second sample and a second neighboring sample of the one or more samples neighboring the second sample, the first variable determined based on whether a difference between a value of the second sample and a value of the first neighboring sample is less than a predetermined value and whether the difference between the value of the second sample and the value of the first neighboring sample is greater than a threshold, and the second variable determined based on a difference between the value of the second sample and a value of the second neighboring sample is less than the predetermined value and whether the difference between the value of the second sample and the value of the second neighboring sample is greater than the threshold; and

filtering at least the first sample of the video data based on the determined classification.

11 . The method of claim 10 , further comprising using edge information to determine the classification band for the first sample of the video data, and wherein the edge information comprises information from a set of neighboring samples neighboring the first sample.

12 . The method of claim 11 , wherein the edge information is based on at least one of the difference between the value of the second sample and the value of the first neighboring sample or the difference between the value of the second sample and the value of the second neighboring sample.

13 . The method of claim 10 , wherein the chroma information comprises first chroma component information, and wherein the collocated chroma information comprises second chroma component information, the first chroma component information being different from the second chroma component information.

14 . The method of claim 10 , further comprising determining the classification band from among a plurality of available classification bands.

15 . The method of claim 14 , further comprising determining the classification band based on the collocated chroma information based on a number of available classification bands being greater than a threshold value.

16 . The method of claim 15 , wherein the threshold value is a value of four.

17 . The method of claim 10 , wherein the first sample is obtained from a position in a first picture of the video data, and wherein the collocated luma information and the collocated chroma information are obtained from a corresponding position of a second picture of the video data.

18 . The method of claim 10 , wherein the predetermined value is a value of 0.

19 . A non-transitory computer-readable medium having stored thereon instructions that, when executed by at least one processor, cause the at least one processor to:

obtain video data;

determine a classification band for a first sample of the video data using at least chroma information from the first sample, collocated luma information and collocated chroma information, the collocated luma information including luma information of a second sample that is collocated with the first sample or luma information of one or more samples neighboring the second sample, and the collocated chroma information including chroma information of a third sample that is collocated with the first sample;

determine a classification for the first sample based on the classification band, a first variable indicative of whether there is an edge between the second sample and a first neighboring sample of the one or more samples neighboring the second sample, and a second variable indicative of whether there is an edge between the second sample and a second neighboring sample of the one or more samples neighboring the second sample, the first variable determined based on whether a difference between a value of the second sample and a value of the first neighboring sample is less than a predetermined value and whether the difference between the value of the second sample and the value of the first neighboring sample is greater than a threshold, and the second variable determined based on a difference between the value of the second sample and a value of the second neighboring sample is less than the predetermined value and whether the difference between the value of the second sample and the value of the second neighboring sample is greater than the threshold; and

filter at least the first sample of the video data based on the determined classification.

20 . The non-transitory computer-readable medium of claim 19 , wherein the instructions further cause the at least one processor to use edge information to determine the classification band for the first sample of the video data, and wherein the edge information comprises information from a set of neighboring samples neighboring the first sample.

21 . The non-transitory computer-readable medium of claim 20 , wherein the edge information is based on at least one of the difference between the value of the second sample and the value of the first neighboring sample or the difference between the value of the second sample and the value of the second neighboring sample.

22 . The non-transitory computer-readable medium of claim 19 , wherein the chroma information comprises first chroma component information, and wherein the collocated chroma information comprises second chroma component information, the first chroma component information being different from the second chroma component information.

23 . The non-transitory computer-readable medium of claim 19 , wherein the instructions further cause the at least one processor to determine the classification band from among a plurality of available classification bands.

24 . The non-transitory computer-readable medium of claim 23 , wherein the instructions further cause the at least one processor to determine the classification band based on the collocated chroma information based on a number of available classification bands being greater than a threshold value.

25 . The non-transitory computer-readable medium of claim 24 , wherein the threshold value is a value of four.

26 . The non-transitory computer-readable medium of claim 19 , wherein the first sample is obtained from a position in a first picture of the video data, and wherein the collocated luma information and the collocated chroma information are obtained from a corresponding position of a second picture of the video data.

27 . The non-transitory computer-readable medium of claim 19 , wherein the predetermined value is a value of 0.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2022
From: KOTRA, VENKATA MEHER SATCHIT ANAND; HU, NAN; SEREGIN, VADIM; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 061260/0230 →
Continuity (3)
Provisional Application 63250141 · Sep 29, 2021
Provisional Application 63262272 · Oct 8, 2021
Related Publication 20230101318A1 · Mar 30, 2023
References Cited (15)
US 20150103930A1 · Jang · 2015 [cited by examiner]
US 20180352225A1 · Guo · 2018 [cited by examiner]
US 20220182635A1 · Li · 2022 [cited by examiner]
US 20220295069A1 · Li · 2022 [cited by examiner]
US 20230308652A1 · Kuo · 2023 [cited by examiner]
US 20230319315A1 · Kuo · 2023 [cited by examiner]
WO WO2013107314A1 · 2013 [cited by examiner]
WO 2022117010A1 · 2022 [cited by applicant]
WO 2022178424A1 · 2022 [cited by applicant]
WO WO2022164757A1 · 2022 [cited by examiner]
WO WO2022197794A1 · 2022 [cited by examiner]
WO WO2022221456A1 · 2022 [cited by examiner]
International Search Report and Written Opinion—PCT/US2022/076105—ISA/EPO—Dec. 5, 2022. [cited by applicant]
Kuo C-W (Kwai)., et al., “AHG12: Cross-Component Sample Adaptive Offset”, 22. JVET Meeting, Apr. 20, 2021-Apr. 28, 2021, Teleconference, (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16), No. … [cited by applicant]
Zhao X., et al., “Study on Coding Tools Beyond AV1”, 2021 IEEE International Conference on Multimedia and Expo (ICME), IEEE, Jul. 5, 2021, pp. 1-6, XP034125211, 6 Pages, section 3.4. [cited by applicant]