IP Library › Granted Patent US 12,200,206
Granted Patent B2
US 12,200,206 · App. 17/784,961 · Granted Jan 14, 2025

Low complexity image filter

Inventors: Jacob Ström (Stockholm, SE); Zhi Zhang (Solna, SE); Kenneth Andersson (Gävle, SE)
Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
H04N19/117H04N19/176H04N19/186H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,206
App. No.
17/784,961
Granted
Jan 14, 2025
Kind
B2
Abstract

There is provided a method for encoding or decoding an image. The method comprises obtaining a first luma sample value, L1, associated with the image. The method comprises obtaining a second luma sample value, L2, associated with the image. The method further comprises obtaining a first luma delta value, ΔL1, wherein ΔL1=L2−L1. The method comprises obtaining a first product, P1, using ΔL1 and a first coefficient value, C1, wherein P1=(C1)(ΔL1). The method comprises calculating a first residual correction value, ΔI1 using P1 and a set of other products. The method comprises filtering an unfiltered chroma value, R C , associated with the image using the first residual correction value, ΔI1, thereby producing a filtered chroma value R F C associated with the image.

Claims (86)

1. A method for encoding or decoding an image, the method comprising:

obtaining a first luma sample value, L1, associated with the image;

obtaining a second luma sample value, L2, associated with the image;

obtaining a first luma delta value, ΔL1, wherein ΔL1=L2−L1;

obtaining a first coefficient value, C1, from a set of predefined integers (Z sub ), wherein Z sub comprises:

a first subset of integers (Z two ), wherein each integer in Z two is a power of two or −1 times a power of two or zero; and

a second subset of integers (Z ext ) comprising a first integer that is equal to α2 n +β2 p , where α=±1, β=±1, n is an integer greater than or equal to 0, p is an integer greater than or equal to 0, and p≠n, and further wherein Z ext does not include any positive integer that is not equal to a sum of two different powers of two;

obtaining a first product, P1, using ΔL1 and C1, wherein P1=(C1)(ΔL1);

calculating a first residual correction value, ΔI1 using P1 and a set of other products; and

filtering an unfiltered chroma value, R C , associated with the image using the first residual correction value, ΔI1, thereby producing a filtered chroma value R C F associated with the image.

2. The method of claim 1 , wherein filtering the unfiltered chroma value to produce the filtered chroma value consists of calculating: R C F =ΔI1+R C .

3. The method of claim 1 , wherein

the set of other products comprises a second product, P2,

P 2=( C 2)(Δ L 2),

C2 is a second coefficient value,

ΔL2 is a second luma delta value that is equal to L3−L1, and

L3 is a third luma sample value associated with the image.

4. The method of claim 1 , wherein

L1 has a first position within a two-dimensional block of luma sample values associated with the image, wherein the coordinates of the first position are x1,y1,

L2 has a second position within the two-dimensional block of luma sample values, wherein the coordinates of the second position are x2,y2,

the absolute value of (x1-x2) is less than or equal to 4, and

the absolute value of (y1-y2) is less than or equal to 4.

5. The method of claim 4 , wherein

the absolute value of (x1-x2) is less than or equal to 1, and

the absolute value of (y1-y2) is less than or equal to 2.

6. The method of claim 1 , wherein

R C has a position within a two-dimensional block of chroma sample values associated with the image, where the coordinates of the position are xc,yc,

L1 has a first position within a two-dimensional block of luma sample values associated with the image, wherein the coordinates of the first position are x1,y1,

L2 has a second position within the two-dimensional block of luma sample values, wherein the coordinates of the second position are x2,y2, and

the second position is obtained from the position of R C within the two-dimensional block of chroma sample values.

7. The method of claim 6 , wherein

x 2=( Wc )( xc ),

y 2=( Hc )( yc ),

Wc is a first predetermined coefficient that is based on the format of the image, and

Hc is a second predetermined coefficient that is based on the format of the image.

8. The method of claim 7 , wherein

when the format of the image is 4:2:0, Wc=Hc=2;

when the format of the image is 4:2:2, Wc=2 and Hc=1; and

when the format of the image is 4:4:4, Wc=Hc=1.

9. A non-transitory computer readable medium storing a computer program comprising instructions which when executed by processing circuitry causes the processing circuitry to perform the method of claim 1 .

10. An apparatus, the apparatus comprising:

processing circuitry; and

a memory, said memory containing instructions executable by said processing circuitry, wherein said apparatus is operative to perform a method comprising:

obtaining a first luma sample value, L1, associated with the image;

obtaining a second luma sample value, L2, associated with the image;

obtaining a first luma delta value, ΔL1, wherein ΔL1=L2−L1;

obtaining a first coefficient value, C1, from a set of predefined integers (Z sub ), wherein Z sub comprises:

a first subset of integers (Z two ), wherein each integer in Z two is a power of two or −1 times a power of two or zero; and

a second subset of integers (Z ext ) comprising a first integer that is equal to α2 n +β2 p , where α=±1, β=±1, n is an integer greater than or equal to 0, p is an integer greater than or equal to 0, and p≠n, and further wherein Z ext does not include any positive integer that is not equal to a sum of two different powers of two;

obtaining a first product, P1, using ΔL1 and C1, wherein P1=(C1)(ΔL1);

calculating a first residual correction value, ΔI1, using P1 and a set of other products; and

filtering an unfiltered chroma value, R C , associated with the image using the first residual correction value, ΔI1 thereby producing a filtered chroma value R C F associated with the image.

11. The apparatus of claim 10 , wherein filtering the unfiltered chroma value to produce the filtered chroma value consists of calculating: R C F =ΔI1+R C .

12. The apparatus of claim 10 , wherein

the set of other products comprises a second product, P2,

P 2=( C 2)(Δ L 2),

C2 is a second coefficient value,

ΔL2 is a second luma delta value that is equal to L3−L1, and

L3 is a third luma sample value associated with the image.

13. The apparatus of claim 10 , wherein

L1 has a first position within a two-dimensional block of luma sample values associated with the image, wherein the coordinates of the first position are x1,y1,

L2 has a second position within the two-dimensional block of luma sample values, wherein the coordinates of the second position are x2,y2,

the absolute value of (x1-x2) is less than or equal to 4, and

the absolute value of (y1-y2) is less than or equal to 4.

14. The apparatus of claim 13 , wherein

the absolute value of (x1-x2) is less than or equal to 1, and

the absolute value of (y1-y2) is less than or equal to 2.

15. The apparatus of claim 10 , wherein

R C has a position within a two-dimensional block of chroma sample values associated with the image, where the coordinates of the position are xc,yc,

L1 has a first position within a two-dimensional block of luma sample values associated with the image, wherein the coordinates of the first position are x1,y1,

L2 has a second position within the two-dimensional block of luma sample values, wherein the coordinates of the second position are x2,y2, and

the second position is obtained from the position of R C within the two-dimensional block of chroma sample values.

16. The apparatus of claim 15 , wherein

x 2=( Wc )( xc ),

y 2=( Hc )( yc ),

Wc is a first predetermined coefficient that is based on the format of the image, and

Hc is a second predetermined coefficient that is based on the format of the image.

17. The apparatus of claim 15 , wherein

when the format of the image is 4:2:0, Wc=Hc=2;

when the format of the image is 4:2:2, Wc=2 and Hc=1; and

when the format of the image is 4:4:4, Wc=Hc=1.

18. The method of claim 1 , wherein

every positive integer within Z ext can be expressed in the form of either 3×2 m or 5×2 m , where m is an integer greater than or equal to 0, and

every negative integer within Z ext can be expressed in the form of either −3×2 m or −5×2 m .

19. The method of claim 1 , wherein every integer in Z sub is greater than −x and less than x.

20. The method of claim 19 , wherein x=129.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2022
From: STRÖM, JACOB; ZHANG, ZHI; ANDERSSON, KENNETH
To: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
Reel/Frame 060225/0015 →
Continuity (2)
Provisional Application 62949204 · Dec 17, 2019
Related Publication 20230023387A1 · Jan 26, 2023
References Cited (42)
US 20120183081A1 · Lui et al. · 2012 [cited by applicant]
US 20160173881A1 · Alshina et al. · 2016 [cited by applicant]
US 20170034525A1 · Sato · 2017 [cited by applicant]
US 20190116361A1 · Rusanovskyy et al. · 2019 [cited by applicant]
US 20190215517A1 · Ramasubramonian et al. · 2019 [cited by applicant]
US 20190373291A1 · Francois et al. · 2019 [cited by applicant]
US 20200413082A1 · Li et al. · 2020 [cited by applicant]
US 20210160513A1 · Hu · 2021 [cited by examiner]
US 20220312006A1 · Taquet et al. · 2022 [cited by applicant]
US 20230024020A1 · Ström et al. · 2023 [cited by applicant]
CN 109691102A · 2019 [cited by applicant]
EP 1626499A1 · 2006 [cited by applicant]
JP 2022554308A · 2022 [cited by applicant]
WO 2015191834A1 · 2015 [cited by applicant]
WO 2017093189A1 · 2017 [cited by applicant]
WO 2017143211A1 · 2017 [cited by applicant]
WO 2019026807A1 · 2019 [cited by applicant]
WO 2019170259A1 · 2019 [cited by applicant]
WO 2019189344A1 · 2019 [cited by applicant]
WO 2020126411A1 · 2020 [cited by applicant]
WO 2021083258A1 · 2021 [cited by applicant]
WO 2021101892A1 · 2021 [cited by applicant]
Misra, Kiran et al. “CE5-Related: Reducing multiplier count in CCALF”. JVET-P0468 [date of search: Sep. 27, 2023], Sep. 25, 2019, jvet-experts.org/doc_end_user/documents/16_Geneva/wg11/JVET-P0468-v1.zip, Joint Video Exp… [cited by applicant]
Yao, J. et al., “Non-CES: Non-Linear Cross Component Adaptive Loop Filter”, Document: JVET-Q0304-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-… [cited by applicant]
Bross, B. et al., “Versatile Video Coding (Draft 7)”, Document: JVET-P2001-vE, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019 (494 pages). [cited by applicant]
International Search Report and Written Opinion dated Feb. 12, 2021 in International Application No. PCT/SE2020/051221 (14 pages). [cited by applicant]
Misra, K. et al., “CE5-Related: Reducing multiplier count in CCALF”, Document: JVET-P0468-v3, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019 … [cited by applicant]
Zhang, Z. et al., “CE5-related: On the CC-ALF filtering process”, Document: JVET-Q0165-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020 (… [cited by applicant]
Misra, K., et al., “Cross-Component Adaptive Loop Filter for chroma,” Document: JVET-O0636_r1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, … [cited by applicant]
Chen, C., et al., “Description of Core Experiment 5 (CE5): Cross Component Adaptative Loop Filtering,” Document: JVET-P2025-v4, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Mee… [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 6)”, Document: JVET-O2001-vE, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (461 pages… [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 6)”, Document: JVET-O2001-vE, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019 (455 pages… [cited by applicant]
Misra, K., et al., “Cross-Component Adaptive Loop Filter for chroma,” Document: JVET-O0636_r1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, … [cited by applicant]
Misra, K., et al., “CE5-related: On the design of CC-ALF”, Document: JVET-P1008-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019 (6 pages). [cited by applicant]
Li, T. et al., “Crosscheck of JVET-P0561 (AHG16: Context restriction on CTU boundary for line buffer reduction)”, Document: JVET-P0636-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 1… [cited by applicant]
Response to Non-Final Office Action filed Jul. 22, 2024 in related U.S. Appl. No. 17/783,132 (8 pages). [cited by applicant]
Non-Final Office Action dated Apr. 23, 2024 in related U.S. Appl. No. 17/783,132 (16 pages). [cited by applicant]
Hu, N et al., “CE5-related: Multiplication removal for cross component adaptive loop filter”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0557, 16th Meeting: Geneva… [cited by applicant]
Taquet, J. et al., “Non-CE5: CC-ALF filtering simplification”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0330, 16th Meeting: Geneva, CH, Oct. 1-11, 2019 (8 pages). [cited by applicant]
Zhao, Y. et al., “CE5-related: Simplified CCALF with 6 filter coefficients”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-P0251-v4, 16th Meeting: Geneva, CH, Oct. 1-1… [cited by applicant]
Ström, J. et al., “Non-CE5: Multiplication simplification for ALF and CC-ALF”, Joint Video Experts Team (JVET) of ITU- T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-Q0167_v2, 17th Meeting: Brussels, BE, Jan… [cited by applicant]
Final Office Action dated Oct. 16, 2024 in related U.S. Appl. No. 17/783,132 (17 pages). [cited by applicant]