IP Library Granted Patent US 12,418,682
Granted Patent B2
US 12,418,682 · App. 18/421,548 · Granted Sep 16, 2025

Method for padding processing with sub-region partitions in video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Stephan Wenger (Palo Alto, CA); Shan Liu (Palo Alto, CA)
Assignee: TENCENT AMERICA LLC
H04N19/70H04N19/105H04N19/132H04N19/172H04N19/186H04N19/46H04N19/513H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,418,682
App. No.
18/421,548
Granted
Sep 16, 2025
Kind
B2
Abstract

A method, computer program, and computer system is provided for video coding. The method may include decoding coded syntax elements corresponding to a wrap-around padding process based on shifting a reference block by a width value that is determined based on luma samples in the reference block; and reconstructing at least one coded current picture using the wrap-around padding process, wherein the wrap-around padding process is applied at boundaries of subpictures.

Claims (32)

1. A method of video decoding, executable by a processor, the method comprising:

decoding coded syntax elements corresponding to a wrap-around padding process comprising a first flag indicating that a sub-picture is treated as a picture in a decoding process;

decoding a second flag comprised in the coded syntax element, the second flag indicating whether or not the wrap-around padding process is applied; and

when the second flag indicates that the wrap-around padding process is to be applied reconstructing at least one coded current picture using the wrap-around padding process by applying the wrap-around padding process at a boundary of the sub-picture, the boundary of the sub-picture being a rectangular region divided from the at least one current picture, and the boundary of the sub-picture being different from a boundary of the current picture, wherein an offset value of the wrap-around process is obtained by subtracting a width of a left padding region in a luma sample and a width of a right padding region in the luma sample from a picture width in the luma sample.

2. The method of claim 1 , wherein a pixel position for a motion compensated prediction in a reference picture is determined by interpreting the syntax elements corresponding to the wrap-around padding process by a clipping process.

3. The method of claim 2 , wherein a fractional pixel is interpolated for the motion compensated prediction based on the determined pixel position.

4. The method of claim 1 , wherein the wrap-around padding process is applied at a boundary of the at least one picture.

5. The method of claim 1 , wherein the wrap-around padding process is applied at a horizontal, a vertical boundary, or at both the vertical and horizontal boundaries.

6. The method of claim 5 , wherein a flag in a high level syntax structure indicates whether the wrap-around padding process is applied at the horizontal, the vertical boundary or both the vertical and horizontal boundaries.

7. A computer system for video coding, the computer system comprising:

one or more computer-readable non-transitory storage media configured to store program code; and

one or more computer processors configured to access said program code and operate as instructed by said program code, said program code including:

first setting code configured to cause the one or more computer processors to set syntax element corresponding to a wrap-around padding process comprising a first flag indicating that a sub-picture is treated as a picture in a decoding process;

second code configured to cause the one or more computer processors to set a second flag comprised in the coded syntax element, the second flag indicating whether or not the wrap-around padding process is applied; and

signaling, code configured to cause the one or more computer processors to signal, when the second flag indicates that the wrap-around padding process is to be applied, that at least one picture is to be decoded using the wrap-around padding process by applying the wrap-around padding process at a boundary of the sub-picture, the boundary of the sub-picture being a rectangular region divided from the at least one current picture and the boundary of the sub-picture being different from a boundary of the current picture, wherein an offset value of the wrap-around process is obtained by subtracting a width of a left padding region in a luma sample and a width of a right padding region in the luma sample from a picture width in the luma sample.

8. The computer system of claim 7 , wherein a pixel position for a motion compensated prediction in a reference picture is determined by interpreting the syntax elements corresponding to the wrap-around padding process by a clipping process.

9. The computer system of claim 8 , wherein a fractional pixel is interpolated for the motion compensated prediction based on the determined pixel position.

10. The computer system of claim 7 , wherein the at least one picture is a reference for motion compensation.

11. A non-transitory computer readable medium having stored thereon a program for video processing, the program configured to cause one or more computer processors to:

perform a conversion between a visual media file and a bitstream of a visual media data according to a format rule,

wherein the bitstream comprises coded syntax elements corresponding to a wrap-around padding process comprising a first flag indicating that a sub-picture is treated as a picture in a decoding process, and

wherein the bitstream further comprises a second flag comprised in the coded syntax element, the second flag indicating whether or not the wrap-around padding process is applied; and

when the second flag indicates that the wrap-around padding process is to be applied, the bitstream further comprises an indication that a reconstruction of at least one picture is to be performed using the wrap-around padding process by applying the wrap-around padding process at a boundary of the sub-picture, the boundary of the sub-picture being a rectangular region divided from the at least one current picture, and the boundary of the sub-picture being different from a boundary of the current picture, wherein an offset value of the wrap-around process is obtained by subtracting a width of a left padding region in a luma sample and a width of a right padding region in the luma sample from a picture width in the luma sample.

12. The method of claim 1 , wherein the at least one reconstructed picture is stored for used as a reference picture for motion compensation.

13. The computer system of claim 7 , wherein the wrap-around padding process is to be applied at a boundary of the at least one picture.

14. The computer system of claim 7 , wherein the wrap-around padding process is to be applied at a horizontal, a vertical boundary, or at both the vertical and horizontal boundaries.

15. The computer system of claim 14 , wherein a flag in a high level syntax structure indicates whether the wrap-around padding process is applied at the horizontal, the vertical boundary or both the vertical and horizontal boundaries.

16. The non-transitory computer readable medium of claim 11 , wherein a pixel position for a motion compensated prediction in a reference picture is determined by interpreting the syntax elements corresponding to the wrap-around padding process by a clipping process.

17. The non-transitory computer readable medium of claim 16 , wherein a fractional pixel is interpolated for the motion compensated prediction based on the determined pixel position.

18. The non-transitory computer readable medium of claim 11 , wherein the wrap-around padding process is applied at a boundary of the at least one picture.

19. The non-transitory computer readable medium of claim 11 , wherein the wrap-around padding process is applied at a horizontal, a vertical boundary, or at both the vertical and horizontal boundaries.

20. The non-transitory computer readable medium of claim 19 , wherein a flag in a high level syntax structure indicates whether the wrap-around padding process is applied at the horizontal, the vertical boundary or both the vertical and horizontal boundaries.

Continuity (4)
Continuation 17828833 · May 31, 2022
Continuation 17019692 · Sep 14, 2020
Provisional Application 62903635 · Sep 20, 2019
Related Publication 20240244264A1 · Jul 18, 2024
References Cited (30)
US 20160241868A1 · Li et al. · 2016 [cited by applicant]
US 20170085917A1 · Hannuksela · 2017 [cited by applicant]
US 20180376126A1 · Hannuksela · 2018 [cited by applicant]
US 20190082184A1 · Hannuksela · 2019 [cited by applicant]
US 20190110076A1 · Lim et al. · 2019 [cited by applicant]
US 20190253622A1 · Van der Auwera et al. · 2019 [cited by applicant]
US 20200336762A1 · Lee et al. · 2020 [cited by applicant]
US 20210092447A1 · Choi · 2021 [cited by applicant]
JP 2016521070A · 2016 [cited by applicant]
JP 2022500914A · 2022 [cited by applicant]
KR 1020160034998A · 2016 [cited by applicant]
KR 1020190080805A · 2019 [cited by applicant]
WO 2015011339A1 · 2015 [cited by applicant]
WO 2020056247A1 · 2020 [cited by applicant]
WO 2020090841A1 · 2020 [cited by applicant]
WO 2020142360A1 · 2020 [cited by applicant]
WO 2020262286A1 · 2020 [cited by applicant]
Extended European Search Report issued Aug. 7, 2023 in European Application No. 20865222.2. [cited by applicant]
Jianle CHEN et al., “AHG12: Treating tile and tile group boundaries as picture boundaries”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-M0136-v1, Jan. 9-18, 2019, 13th Meeting… [cited by applicant]
Office Action issued Sep. 13, 2022 in Japanese Application No. 2021-549513. [cited by applicant]
Philippe Hanhart et al., “CE13 PERP with horizontal geometry padding of reference pictures (Test 3.3)”, Joint Video Experts Team (JVET) of Itu-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0231-r2, 12th Meeting, Mac… [cited by applicant]
Philippe Hanhart et al., “AHG8: Geometry padding for PERP”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J0044, 10th Meeting, San Diego, US, Apr. 10-20, 2018, pp. 1-5 (12 pages… [cited by applicant]
Written Opinion of the International Searching Authority dated Dec. 22, 2020 in Application No. PCT/US2020/051192. [cited by applicant]
International Search Report dated Dec. 22, 2020 in Application No. PCT/US2020/051192. [cited by applicant]
Korean Office Action dated May 16, 2023 in Korean Application No. 10-2021-7027148. [cited by applicant]
Philippe Hanhart et al., “CE13: PERP with horizontal geometry padding of reference pictures (Test 3.3)”Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11, JVET-L0231-r2, 12th Meeting, Mac… [cited by applicant]
Office Action issued Jun. 25, 2024 in Japanese Application No. 2021-549513. [cited by applicant]
Muhammed Coban, et al., “Support of independent sub-pictures”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-10356, Apr. 27-May 7, 2012, pp. 1-5. [cited by applicant]
Atsumichi Murakami, et al., “High Efficiency Video Coding Technology HEVC/H.265 and its Applications”, Ohmsha Co., Ltd., 1st edition, Feb. 25, 2013 (12 pages). [cited by applicant]
Communication issued Oct. 24, 2024 in Australian Application No. 2023255026. [cited by applicant]