IP Library › Granted Patent US 12,301,886
Granted Patent B2
US 12,301,886 · App. 17/636,935 · Granted May 13, 2025

Method and apparatus for adaptive loop filtering at picture and sub-picture boundary in video coding

Inventors: Chen-Yen Lai (Hsinchu, TW); Ching-Yeh Chen (Hsinchu, TW); Tzu-Der Chuang (Hsinchu, TW); Lulin Chen (San Jose, CA)
Assignee: HFI INNOVATION INC.
H04N19/82H04N19/117H04N19/182H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,886
App. No.
17/636,935
Granted
May 13, 2025
Kind
B2
Abstract

Methods and apparatus for video coding using Adaptive Loop Filter (ALF) processing are disclosed. According to one method, the ALF virtual boundary processing is always applied to the bottom CTU row regardless whether the bottom CTU row is for a picture or a sub-picture. In another method, the ALF padding process is unified for different boundary types belonging to the target boundary belongs to a boundary-type group comprising two or more of slice boundary, tile boundary, VR360 face boundary, and sub-picture boundary. In yet another method, the ALF VB processing has a fixed priority for a corner region that both horizontal and vertical virtual boundaries can be applied.

Claims (11)

1. A method for video coding, the method comprising:

receiving reconstructed pixels in a current picture associated with a target sub-picture in a current picture, wherein the current picture is divided into one or more sub-pictures, wherein when one sample for an adaptive loop filter (ALF) filter position is at one side of a virtual boundary of a target coding tree unit (CTU) row, adaptive loop filter virtual boundary (ALF VB) processing is performed to make one corresponding sample at the other side of the virtual boundary for the ALF filter position be replaced with a padded sample;

when a current picture height is a multiple of CTU row height: applying ALF VB processing to the target CTU row in case that the target CTU row is a bottom CTU row of the target sub-picture; and

when a current picture height is a multiple of CTU row height: applying ALF VB processing to the target CTU row in case that the target CTU row is a bottom CTU row of the current picture.

2. The method for video coding according to claim 1 , wherein repetitive padding applied to horizontal boundaries is accorded a higher priority than repetitive padding applied to vertical boundaries, in situations where both can be applied.

3. The method of claim 1 , wherein at least one of said one sample for an ALF filter position is at one side of the virtual boundary and said one corresponding sample at the other side of the virtual boundary for the ALF filter position is unavailable when the ALF VB processing is performed.

4. An apparatus for video coding, the apparatus comprising one or more electronic circuits or processors arranged to:

receive reconstructed pixels in a current picture associated with a target sub-picture in a current picture, wherein the current picture is divided into one or more sub-pictures, wherein when one sample for an adaptive loop filter (ALF) filter position is at one side of a virtual boundary of a target coding tree unit (CTU) row, adaptive loop filter virtual boundary (ALF VB) processing is performed to make one corresponding sample at the other side of the virtual boundary for the ALF filter position be replaced with a padded sample;

when a current picture height is a multiple of CTU row height: apply ALF VB processing to the target CTU row in case that the target CTU row is a bottom CTU row of the target sub-picture; and

when a current picture height is a multiple of CTU row height: apply ALF VB processing to the target CTU row in case that the target CTU row is a bottom CTU row of the current picture.

5. The apparatus for video coding according to claim 4 , wherein repetitive padding applied to horizontal boundaries is accorded a higher priority than repetitive padding applied to vertical boundaries, in situations where both can be applied.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2022
From: MEDIATEK INC.
To: HFI INNOVATION INC.
Reel/Frame 060045/0050 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2022
From: LAI, CHEN-YEN; CHEN, CHING-YEH; CHUANG, TZU-DER; CHEN, LULIN
To: MEDIATEK INC.
Reel/Frame 059055/0964 →
Continuity (4)
Provisional Application 62903043 · Sep 20, 2019
Provisional Application 62896631 · Sep 6, 2019
Provisional Application 62896032 · Sep 5, 2019
Related Publication 20220303587A1 · Sep 22, 2022
References Cited (17)
US 20130114735A1 · Wang · 2013 [cited by applicant]
US 20130272624A1 · Budagavi · 2013 [cited by applicant]
US 20150103900A1 · Liu et al. · 2015 [cited by applicant]
US 20170195670A1 · Budagavi · 2017 [cited by examiner]
US 20220394248A1 · Deng · 2022 [cited by examiner]
US 20230231998A1 · Zhang · 2023 [cited by examiner]
CN 103503456A · 2014 [cited by applicant]
CN 104160702A · 2014 [cited by applicant]
WO 2018191224A1 · 2018 [cited by applicant]
International Search Report and Written Opinion dated Feb. 2, 2021, issued in application No. PCT/US2020/049015. [cited by applicant]
Chinese language Notice of Allowance dated Sep. 7, 2021, issued in application No. TW 109130197. [cited by applicant]
Extended European Search Report dated Aug. 4, 2023, issued in application No. EP 20861494.1. [cited by applicant]
Lai, C-Y., et al.; “CE5-related: Align ALF padding processes at picture and subpicture boundaries;” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; Oct. 2019; pp. 1-21. [cited by applicant]
Lai, C-Y., et al.; “CE5-related: Align ALF virtual boundary processes in the bottom CTU rows of one picture and one subpicture;” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; Oct. 20… [cited by applicant]
Hu, N., et al.; “AHG12/Non-CE5: Unification of boundary handling for adaptive loop filter;” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; Jun. 2019; pp. 1-13. [cited by applicant]
Liu, H., et al.; “Non-CE5: Unified padding method for samples at variant boundaries in ALF;” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; Jul. 2019; pp. 1-4. [cited by applicant]
Chinese language office action dated Nov. 30, 2024, issued in application No. CN 202080062450.7. [cited by applicant]