IP Library Granted Patent US 11,252,434
Granted Patent B2
US 11,252,434 · App. 16/710,936 · Granted Feb 15, 2022

Method for wrap-around padding for omnidirectional media coding

Inventors: Byeongdoo Choi (Palo Alto, CA); Weiwei Feng (Mountain View, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/563H04N19/597H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,252,434
App. No.
16/710,936
Granted
Feb 15, 2022
Kind
B2
Abstract

Reconstructing a coded current picture for video decoding including decoding picture partitioning information corresponding to the current picture; determining whether padding is applied to sub-regions of the current picture using the picture partitioning information; based on determining that padding is not applied, decoding the sub-regions without padding the sub-regions; based on determining that padding is applied, determining whether the padding includes wrap-around padding using the picture partitioning information; based on determining that the padding does not include wrap-around padding, applying repetition padding to the sub-regions, and decoding the sub-regions using the repetition padding; based on determining that the padding includes wrap-around padding, applying the wrap-around padding to the sub-regions, and decoding the sub-regions using the wrap-around padding; and reconstructing the current picture based on the decoded sub-regions.

Claims (47)

1. A method of reconstructing a coded current picture for video decoding using at least one processor, the method comprising:

decoding picture partitioning information corresponding to the current picture;

determining whether padding is applied to a plurality of sub-regions of the current picture using the picture partitioning information;

based on determining that padding is not applied, decoding the plurality of sub-regions without padding the plurality of sub-regions;

based on determining that padding is applied, determining whether the padding comprises wrap-around padding using the picture partitioning information;

based on determining that the padding does not comprise wrap-around padding, applying repetition padding to the plurality of sub-regions, and decoding the plurality of sub-regions using the repetition padding;

based on determining that the padding comprises wrap-around padding, obtaining an offset value from the picture partitioning information, applying the wrap-around padding to the plurality of sub-regions based on the offset value, and decoding the plurality of sub-regions using the wrap-around padding; and

reconstructing the current picture based on the decoded plurality of sub-regions,

wherein the offset value specifies an offset in luma samples used to compute a wrap-around position used to select a reference block corresponding to a current block of the current picture.

2. The method of claim 1 , wherein the picture partitioning information is included in a picture parameter set corresponding to the current picture.

3. The method of claim 2 , wherein the picture partitioning information comprises at least one flag included in the picture parameter set.

4. The method of claim 1 , wherein the plurality of sub-regions comprises at least one from among a brick, tile, a slice, a tile group, a sub-picture, or a sub-layer.

5. The method of claim 1 , wherein the padding is applied to a boundary of a sub-region from among a plurality of sub-regions.

6. The method of claim 5 , wherein the boundary is a vertical boundary of the sub-region.

7. The method of claim 5 , wherein the boundary is a horizontal boundary of the sub-region.

8. The method of claim 1 , wherein the padding is applied to a vertical boundary of a sub-region from among a plurality of sub-regions and a horizontal boundary of the sub-region.

9. The method of claim 1 , wherein the picture partitioning information indicates left padding width information and right padding width information.

10. A device for reconstructing a coded current picture for video decoding, the device comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

first decoding code configured to cause the at least one processor to decode picture partitioning information corresponding to the current picture;

first determining code configured to cause the at least one processor to determine whether padding is applied to a plurality of sub-regions of the current picture using the picture partitioning information;

second decoding code configured to cause the at least one processor to, based on determining that padding is not applied, decode the plurality of sub-regions without padding the plurality of sub-regions;

second determining code configured to, based on determining that padding is applied, determine whether the padding comprises wrap-around padding using the picture partitioning information;

repetition padding code configured to cause the at least one processor to, based on determining that the padding does not comprise wrap-around padding, apply repetition padding to the plurality of sub-regions, and decode the plurality of sub-regions using the repetition padding;

wrap-around padding code configured to cause the at least one processor to, based on determining that the padding comprises wrap-around padding, obtain an offset value from the picture partitioning information, apply the wrap-around padding to the plurality of sub-regions based on the offset value, and decode the plurality of sub-regions using the wrap-around padding; and

reconstructing code configured to cause the at least one processor to reconstruct the current picture based on the decoded plurality of sub-regions,

wherein the offset value specifies an offset in luma samples used to compute a wrap-around position used to select a reference block corresponding to a current block of the current picture.

11. The device of claim 10 , wherein the picture partitioning information is included in a picture parameter set corresponding to the current picture.

12. The device of claim 10 , wherein the plurality of sub-regions comprises at least one from among a brick, tile, a slice, a tile group, a sub-picture, or a sub-layer.

13. The device of claim 10 , wherein the padding is applied to a boundary of a sub-region from among a plurality of sub-regions.

14. The device of claim 13 , wherein the boundary is a vertical boundary of the sub-region.

15. The device of claim 13 , wherein the boundary is a horizontal boundary of the sub-region.

16. The device of claim 10 , wherein the padding is applied to a vertical boundary of a sub-region from among a plurality of sub-regions and a horizontal boundary of the sub-region.

17. The device of claim 10 , wherein the picture partitioning information indicates left padding width information and right padding width information.

18. The method of claim 10 , wherein the left padding width information specifies a width of a left-side padding region,

wherein the right padding width information specifies a width of a right-side padding region, and

wherein the offset value is obtained by subtracting the width of the left-side padding region and the width of the right-side padding region from a width of the current picture.

19. A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for reconstructing a coded current picture for video decoding, cause the one or more processors to:

decode picture partitioning information corresponding to the current picture;

determine whether padding is applied to a plurality of sub-regions of the current picture using the picture partitioning information;

based on determining that padding is not applied, decode the plurality of sub-regions without padding the plurality of sub-regions;

based on determining that padding is applied, determine whether the padding comprises wrap-around padding using the picture partitioning information;

based on determining that the padding does not comprise wrap-around padding, apply repetition padding to the plurality of sub-regions, and decode the plurality of sub-regions using the repetition padding;

based on determining that the padding comprises wrap-around padding, obtain an offset value from the picture partitioning information, apply the wrap-around padding to the plurality of sub-regions based on the offset value, and decode the plurality of sub-regions using the wrap-around padding; and

reconstruct the current picture based on the decoded plurality of sub-regions,

wherein the offset value specifies an offset in luma samples used to compute a wrap-around position used to select a reference block corresponding to a current block of the current picture.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2020
From: FENG, WEIWEI
To: TENCENT AMERICA LLC
Reel/Frame 054196/0955 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2020
From: FENG, WEIWEI
To: TENCENT AMERICA LLC
Reel/Frame 054040/0941 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 053872/0749 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: CHOI, BYEONGDOO
To: TENCENT AMERICA LLC
Reel/Frame 053873/0081 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2019
From: CHOI, BYEONGDOO; FENG, WEIWEI; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 051260/0860 →
Continuity (2)
Provisional Application 62787063 · Dec 31, 2018
Related Publication 20200213617A1 · Jul 2, 2020