IP Library Granted Patent US 12,501,039
Granted Patent B2
US 12,501,039 · App. 18/243,256 · Granted Dec 16, 2025

Method and apparatus for video coding using de-blocking filtering based on segmentation information

Inventors: Han Sol Choi (Dongducheon-si, KR); Min Hun Lee (Uijeongbu-si, KR); Dong Gyu Sim (Seoul, KR); Seung Wook Park (Yongin-si, KR)
Assignees: HYUNDAI MOTOR COMPANY; KIA CORPORATION; KWANGWOON UNIVEERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
H04N19/117H04N19/119H04N19/176H04N19/46H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,501,039
App. No.
18/243,256
Granted
Dec 16, 2025
Kind
B2
Abstract

A video coding method and an apparatus using a deblocking filtering based on segmentation information are disclosed. The video coding method and the apparatus perform deblocking filtering using segmentation information of an image to avoid performing filtering at the boundary of an object within the image.

Claims (48)

1 . A method performed by a video encoding apparatus for applying deblocking filtering on a restored area of an image, the method comprising:

performing segmentation on the restored area to partition the restored area into separate objects and generating segmentation information for identifying the objects;

selecting within the restored area, a filtering boundary to which the deblocking filtering is applied;

in a P area and a Q area which form the filtering boundary, setting a P sub-area and a Q sub-area belonging to the same object using the segmentation information; and

performing the deblocking filtering for a sub-boundary between the P sub-area and the Q sub-area,

wherein the deblocking filtering is performed based on:

a length of the sub-boundary between the P sub-area and the Q sub-area, and

for each of the P sub-area and the Q sub-area, a number of samples on a line perpendicular to the sub-boundary.

2 . The method of claim 1 , wherein the segmentation information of the objects is a map in which each object is assigned a corresponding index per pixel basis.

3 . The method of claim 1 , further comprising:

obtaining the number of objects within the restored area from a high-level, wherein

generating the segmentation information partitions the restored area into as many sub-areas as the number of objects.

4 . The method of claim 1 , further comprising:

obtaining a flag indicating whether to perform the segmentation from a high-level,

wherein, when the flag is true, the segmentation is performed.

5 . The method of claim 4 , wherein, when the same segmentation method is performed respectively on the original area and the restored area, and a pixel difference as large as a predetermined threshold value occurs between the segmentation results from the original area and the restored area, the flag is set as false.

6 . The method of claim 1 , wherein the deblocking filtering is performed when the sub-boundary between the P sub-area and the Q sub-area is longer than or equal to a predetermined sample length, and when, for each of the P sub-area and the Q sub-area, a minimum value of the numbers of samples on respective lines perpendicular to the sub-boundary is larger than or equal to a predetermined threshold value.

7 . The method of claim 6 , wherein, when the sub-boundary is shorter than the predetermined sample length or when at least one of the minimum value for the P sub-area and the minimum value for the Q sub-area is smaller than the predetermined threshold value, the deblocking filtering is not performed.

8 . The method of claim 6 , wherein performing the deblocking filtering comprises:

setting a filter length of the P sub-area to one of predetermined values according to the minimum number.

9 . The method of claim 8 , wherein performing the deblocking filtering comprises:

setting a P filter length for the P sub-area to the minimum of the filter length of the P sub-area and an initialized P filter length.

10 . The method of claim 1 , wherein performing the deblocking filtering comprises:

calculating a boundary strength of the sub-boundary between the P sub-area and the Q sub-area,

wherein, when the boundary strength is larger than a predetermined threshold value, the deblocking filtering is performed on the P sub-area and the Q sub-area adjacent to the sub-boundary.

11 . The method of claim 6 , wherein performing the deblocking filtering comprises:

calculating a degree of spatial change by using samples of a first line and samples of a last line among the lines perpendicular to the sub-boundary in the P sub-area and Q sub-area; and

performing the deblocking filtering based on the degree of spatial change.

12 . The method of claim 1 , wherein the deblocking filer is one of a long filer, a short and strong filter, or a short and weak filter.

13 . A deblocking filtering method performed by a video decoding apparatus, the method comprising:

obtaining segmentation information for identifying separate objects on a restored area;

selecting, within the restored area, a filtering boundary to which deblocking filtering is applied;

in a P area and a Q area, which form the filtering boundary, setting a P sub-area and a Q sub-area belonging to the same object using the segmentation information; and

performing the deblocking filtering for a sub-boundary between the P sub-area and the Q sub-area,

wherein the deblocking filtering is performed based on:

a length of the sub-boundary between the P sub-area and the Q sub-area, and

for each of the P sub-area and the Q sub-area, a number of samples on a line perpendicular to the sub-boundary.

14 . A method for providing video data to a video decoding apparatus, the method comprising:

encoding the video data into a bitstream; and

transmitting the bitstream to the video decoding apparatus,

wherein encoding the video data comprises:

performing segmentation on the restored area to partition a restored area into separate objects and generating segmentation information for identifying the objects;

selecting, within the restored area, a filtering boundary to which deblocking filtering is applied;

in a P area and a Q area which form the filtering boundary, setting a P sub-area and a Q sub-area belonging to the same object using the segmentation information; and

performing the deblocking filtering for a sub-boundary between the P sub-area and the Q sub-area,

wherein the deblocking filtering is performed based on:

a length of the sub-boundary between the P sub-area and the Q sub-area, and

for each of the P sub-area and the Q sub-area, the number of samples on a line perpendicular to the sub-boundary.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2023
From: CHOI, HAN SOL; LEE, MIN HUN; SIM, DONG GYU; PARK, SEUNG WOOK
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION; KWANGWOON UNIVERSITY INDUSTRY-ACADEMIC COLLABORATION FOUNDATION
Reel/Frame 064833/0798 →
Priority Claims (2)
KR 10-2021-0030850 · Mar 9, 2021 · national
KR 10-2022-0027870 · Mar 4, 2022 · national
Continuity (2)
Continuation PCTKR2022003108 · Mar 4, 2022
Related Publication 20230421758A1 · Dec 28, 2023
References Cited (19)
US 8325796B2 · Wilkins et al. · 2012 [cited by applicant]
US 9924161B2 · Wilkins et al. · 2018 [cited by applicant]
US 10225549B1 · Wilkins et al. · 2019 [cited by applicant]
US 11122299B2 · Wang et al. · 2021 [cited by applicant]
US 11259019B2 · Zhu et al. · 2022 [cited by applicant]
US 20100061444A1 · Wilkins et al. · 2010 [cited by applicant]
US 20130101019A1 · Wilkins et al. · 2013 [cited by applicant]
US 20190058879A1 · Wilkins et al. · 2019 [cited by applicant]
US 20200404333A1 · Wang · 2020 [cited by examiner]
US 20200413055A1 · Kusakabe et al. · 2020 [cited by applicant]
US 20210120239A1 · Zhu · 2021 [cited by examiner]
US 20210377570A1 · Wang et al. · 2021 [cited by applicant]
US 20210409701A1 · Zhu et al. · 2021 [cited by applicant]
US 20230388646A1 · Kim · 2023 [cited by examiner]
KR 20110056388A · 2011 [cited by applicant]
KR 20140124040A · 2014 [cited by examiner]
KR 20200128588A · 2020 [cited by applicant]
KR 20210011458A · 2021 [cited by applicant]
International Search Report and Written Opinion cited in corresponding international app No. PCT/KR2022/003108; Jun. 14, 2022; 9pp. [cited by applicant]