IP Library › Granted Patent US 11,765,398
Granted Patent B2
US 11,765,398 · App. 17/128,965 · Granted Sep 19, 2023

Border partition

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Hsiao Chiang Chuang (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/96H04N19/119H04N19/13H04N19/132H04N19/176H04N19/186H04N19/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,765,398
App. No.
17/128,965
Granted
Sep 19, 2023
Kind
B2
Abstract

Devices, systems and methods for picture border coding are described. In a representative aspect, a method for processing picture includes segmenting a picture into one or multiple picture segments, determining that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein a size of the first block is M×N pixels, selecting a second block of size K×L pixels, where (K≤M and L<N) or (K<M and L≤N), wherein the second block falls entirely within the picture segment and wherein the second block is used as a largest coding unit, a leaf coding block or a coding tree block; and processing, using a partition tree, the border of the picture segment, wherein the partition tree is based on the size of the second block.

Claims (43)

1. A method for coding video data, comprising:

determining, for a conversion between a picture of a video and a bitstream of the video, that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein the picture segment represents one of a plurality of segments into which the picture is segmented, wherein a size of the first block is M×N pixels;

selecting a second block of size K×L pixels, wherein (K≤M and L<N) or (K<M and L≤N), wherein the second block falls entirely within the picture segment and wherein the second block is used as a largest coding unit, a leaf coding block, or a coding tree block;

selecting a third block of size K′×L′ pixels by padding one or both dimensions of the second block, wherein K′ is set to 2 a , wherein 2 a ≥K and 2 a-1 <K and/or wherein L′ is set to 2 b , wherein 2 b >L and 2 b-1 <L, and the third block is another largest coding unit, another leaf coding block or another coding tree block; and

splitting, using a partition tree selected from a subset of partition trees applied to the first block, the third block, wherein the subset is determined based on a comparison between a ratio based on K′ and L′ and a threshold,

wherein the padding comprises a mirrored repetition or a motion-compensation based samples padding.

2. The method of claim 1 , wherein the conversion comprises encoding the picture into the bitstream.

3. The method of claim 1 , wherein the conversion comprises decoding the picture from the bitstream.

4. The method of claim 1 , wherein the size of the second block is backward compatible with a video coding standard.

5. The method of claim 4 , wherein parameters corresponding to the partition tree are communicated using signaling that is backward compatible with the video coding standard.

6. The method of claim 4 , wherein the video coding standard includes H.264/AVC (Advanced Video Coding) standard, H.265/HEVC (High Efficiency Video Coding) standard, or VVC (Versatile Video Coding) standard.

7. The method of claim 1 , wherein the padding the one or both dimensions comprises repeating outermost samples of the second block.

8. The method of claim 1 , further comprising:

determining that the size of the second block is not backward compatible with a video coding standard.

9. The method of claim 1 , further comprising entropy coding the partition tree using context-adaptive binary adaptive coding (CABAC).

10. The method of claim 1 , wherein the first block is a coding tree unit (CTU), a coding unit (CU), a prediction unit (PU), or a transform unit (TU).

11. The method of claim 1 , wherein a partition tree based on the size of the second block is different from the partition tree selected based on the size of the third block.

12. The method of claim 1 , wherein the picture segment is a slice or a tile.

13. The method of claim 1 , wherein the partition tree comprises subblocks, obtained by splitting the third block, being directly coded with no further splitting.

14. An apparatus for coding video data, the apparatus comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a picture of a video and a bitstream of the video, that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein the picture segment represents one of a plurality of segments into which the picture is segmented, wherein a size of the first block is M×N pixels;

select a second block of size K×L pixels, wherein (K≤M and L<N) or (K<M and L≤N), wherein the second block falls entirely within the picture segment and wherein the second block is used as a largest coding unit, a leaf coding block, or a coding tree block;

select a third block of size K′×L′ pixels by padding one or both dimensions of the second block, wherein K′ is set to 2 a , wherein 2 a ≤K and 2 a-1 <K and/or wherein L′ is set to 2 b , wherein 2 b ≥L and 2 b-1 <L, and the third block is another largest coding unit, another leaf coding block or another coding tree block; and

split, using a partition tree selected from a subset of partition trees applied to the first block, the third block, wherein the subset is determined based on a comparison between a ratio based on K′ and L′ and a threshold,

wherein the padding comprises a mirrored repetition or a motion-compensation based samples padding.

15. The apparatus of claim 14 , wherein the size of the second block is backward compatible with a video coding standard.

16. The apparatus of claim 14 , wherein a partition tree based on the size of the second block is different from the partition tree selected based on the size of the third block.

17. A non-transitory computer readable media storing instructions that cause a processor to:

determine, for a conversion between a picture of a video and a bitstream of the video, that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein the picture segment represents one of a plurality of segments into which the picture is segmented, wherein a size of the first block is M×N pixels;

select a second block of size K×L pixels, wherein (K≤M and L<N) or (K<M and L≤N), wherein the second block falls entirely within the picture segment and wherein the second block is used as a largest coding unit, a leaf coding block, or a coding tree block;

select a third block of size K′×L′ pixels by padding one or both dimensions of the second block, wherein K′ is set to 2 a , wherein 2 a K and 2 a-1 <K and/or wherein L′ is set to 2 b , wherein 2 b ≤L and 2 2-1 <L, and the third block is another largest coding unit, another leaf coding block or another coding tree block; and

split, using a partition tree selected from a subset of partition trees applied to the first block, the third block, wherein the subset is determined based on a comparison between a ratio based on K′ and L′ and a threshold,

wherein the padding comprises a mirrored repetition or a motion-compensation based samples padding.

18. The non-transitory computer readable media of claim 17 , wherein a partition tree based on the size of the second block is different from the partition tree selected based on the size of the third block.

19. A method for storing a bitstream of a video, comprises:

determining, for a picture of the video, that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein the picture segment represents one of a plurality of segments into which a picture is segmented, wherein a size of the first block is M×N pixels;

selecting a second block of size K×L pixels, wherein (K≤M and L<N) or (K<M and L≤N), wherein the second block falls entirely within the picture segment and wherein the second block is used as a largest coding unit, a leaf coding block, or a coding tree block;

selecting a third block of size K′×L′ pixels by padding one or both dimensions of the second block, wherein K′ is set to 2 a , wherein 2 a ≥K and 2 a-1 <K and/or wherein L′ is set to 2 b , wherein 2 b ≥L and 2 b-1 <L, and the third block is another largest coding unit, another leaf coding block or another coding tree block;

splitting, using a partition tree selected from a subset of partition trees applied to the first block, the third block, wherein the subset is determined based on a comparison between a ratio based on K′ and L′ and a threshold;

generating the bitstream from a current block based on the splitting, and

storing the bitstream in a non-transitory computer-readable recording medium;

wherein the padding comprises a mirrored repetition or a motion-compensation based samples padding.

20. The method of claim 19 , wherein a partition tree based on the size of the second block is different from the partition tree selected based on the size of the third block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2020
From: ZHANG, LI; ZHANG, KAI; CHUANG, HSIAO CHIANG
To: BYTEDANCE INC.
Reel/Frame 054716/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2020
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 054716/0424 →
Priority Claims (1)
WO PCT/CN2018/092125 · Jun 21, 2018 · international
Continuity (2)
Continuation PCTIB2019055243 · Jun 21, 2019
Related Publication 20210112284A1 · Apr 15, 2021