IP Library Granted Patent US 11,638,004
Granted Patent B2
US 11,638,004 · App. 17/702,318 · Granted Apr 25, 2023

Setting intra-block copy virtual buffer based on virtual pipeline data unit

Inventors: Jizheng Xu (San Diego, CA); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/139H04N19/176H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,638,004
App. No.
17/702,318
Granted
Apr 25, 2023
Kind
B2
Abstract

A method of video processing is described. The method includes determining, for a conversion between a current video block of a video picture of a video and a coded representation of the video, whether or how to reset reference sample values of a reference region of the video picture used for predicting the current video block according to a rule; and performing the conversion based on the determining.

Claims (56)

1. A method of processing video data, comprising:

determining, for a conversion between a current video block of a video picture of a video and a bitstream of the video, that a prediction mode is applied to derive prediction samples of the current video block;

maintaining, for the prediction mode, a virtual buffer comprising one or more reference samples derived from reconstructed blocks of the video picture; and

performing the conversion based on the determining,

wherein in the prediction mode, reference samples determined by a block vector in the virtual buffer are used for the derivation of the prediction samples,

wherein when the virtual buffer is a luma buffer, positions of unavailable reference samples in the virtual buffer are determined based on positions of the current video block,

wherein when the virtual buffer is a chroma buffer, positions of unavailable reference samples in the virtual buffer are independent of positions of the current video block, and

wherein the unavailable reference samples in the virtual buffer are not allowed for the derivation of the prediction samples.

2. The method of claim 1 , wherein when the virtual buffer is the chroma buffer, the reference samples in the virtual buffer are disallowed to be marked unavailable.

3. The method of claim 1 , wherein when the current video block is a first luma block in a virtual unit and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the virtual unit are marked unavailable.

4. The method of claim 1 , wherein when a size of a virtual unit is greater or equal to a width of the current video block and is greater or equal to a height of the current video block and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the virtual unit are marked unavailable, and

wherein the size of the virtual unit is equal to min(ctbSize, 64), where ctbSize denotes a width or a height of a coding tree block of the video picture.

5. The method of claim 1 , wherein when a size of a virtual unit is less than a width of the current video block and is less than a height of the current video block and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the current video block are marked unavailable, and

wherein the size of the virtual unit is equal to min(ctbSize, 64), where ctbSize denotes a width or a height of a coding tree block of the video picture.

6. The method of claim 1 , wherein when a variable is set to indicate resetting the virtual buffer and the virtual buffer is the luma buffer, the virtual buffer is reset, and

wherein when the virtual buffer is the chroma buffer, the virtual buffer is disallowed to be reset.

7. The method of claim 6 , wherein when the virtual buffer is reset, the reference samples in the virtual buffer are reset to be −1.

8. The method of claim 1 , wherein the unavailable reference samples have a value of −1.

9. The method of claim 1 , wherein the conversion comprises encoding the current video block into the bitstream.

10. The method of claim 1 , wherein the conversion comprises decoding the current video block from the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current video block of a video picture of a video and a bitstream of the video, that a prediction mode is applied to derive prediction samples of the current video block;

maintain, for the prediction mode, a virtual buffer comprising one or more reference samples derived from reconstructed blocks of the video picture; and

perform the conversion based on the determining,

wherein in the prediction mode, reference samples determined by a block vector in the virtual buffer are used for the derivation of the prediction samples,

wherein when the virtual buffer is a luma buffer, positions of unavailable reference samples in the virtual buffer are determined based on positions of the current video block,

wherein when the virtual buffer is a chroma buffer, positions of unavailable reference samples in the virtual buffer are independent of positions of the current video block, and

wherein the unavailable reference samples in the virtual buffer are not allowed for the derivation of the prediction samples.

12. The apparatus of claim 11 , wherein when the virtual buffer is the chroma buffer, the reference samples in the virtual buffer are disallowed to be marked unavailable.

13. The apparatus of claim 11 , wherein when the current video block is a first luma block in a virtual unit and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the virtual unit are marked unavailable.

14. The apparatus of claim 11 , wherein when a size of a virtual unit is greater or equal to a width of the current video block and is greater or equal to a height of the current video block and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the virtual unit are marked unavailable, and

wherein the size of the virtual unit is equal to min(ctbSize, 64), where ctbSize denotes a width or a height of a coding tree block of the video picture; or

wherein when a size of a virtual unit is less than a width of the current video block and is less than a height of the current video block and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the current video block are marked unavailable, and

wherein the size of the virtual unit is equal to min(ctbSize, 64), where ctbSize denotes a width or a height of a coding tree block of the video picture.

15. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current video block of a video picture of a video and a bitstream of the video, that a prediction mode is applied to derive prediction samples of the current video block;

maintain, for the prediction mode, a virtual buffer comprising one or more reference samples derived from reconstructed blocks of the video picture; and

perform the conversion based on the determining,

wherein in the prediction mode, reference samples determined by a block vector in the virtual buffer are used for the derivation of the prediction samples,

wherein when the virtual buffer is a luma buffer, positions of unavailable reference samples in the virtual buffer are determined based on positions of the current video block,

wherein when the virtual buffer is a chroma buffer, positions of unavailable reference samples in the virtual buffer are independent of positions of the current video block, and

wherein the unavailable reference samples in the virtual buffer are not allowed for the derivation of the prediction samples.

16. The non-transitory computer-readable storage medium of claim 15 , wherein when the virtual buffer is the chroma buffer, the reference samples in the virtual buffer are disallowed to be marked unavailable.

17. The non-transitory computer-readable storage medium of claim 15 , wherein when the current video block is a first luma block in a virtual unit and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the virtual unit are marked unavailable.

18. The non-transitory computer-readable storage medium of claim 15 , wherein when a size of a virtual unit is greater or equal to a width of the current video block and is greater or equal to a height of the current video block and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the virtual unit are marked unavailable, and

wherein the size of the virtual unit is equal to min(ctbSize, 64), where ctbSize denotes a width or a height of a coding tree block of the video picture.

19. The non-transitory computer-readable storage medium of claim 15 , wherein when a size of a virtual unit is less than a width of the current video block and is less than a height of the current video block and the virtual buffer is the luma buffer, reference samples in the virtual buffer corresponding to the current video block are marked unavailable, and

wherein the size of the virtual unit is equal to min(ctbSize, 64), where ctbSize denotes a width or a height of a coding tree block of the video picture.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current video block of a video picture of the video, that a prediction mode is applied to derive prediction samples of the current video block;

maintaining, for the prediction mode, a virtual buffer comprising one or more reference samples derived from reconstructed blocks of the video picture; and

generating the bitstream based on the determining,

wherein in the prediction mode, reference samples determined by a block vector in the virtual buffer are used for the derivation of the prediction samples,

wherein when the virtual buffer is a luma buffer, positions of unavailable reference samples in the virtual buffer are determined based on positions of the current video block,

wherein when the virtual buffer is a chroma buffer, positions of unavailable reference samples in the virtual buffer are independent of positions of the current video block, and

wherein the unavailable reference samples in the virtual buffer are not allowed for the derivation of the prediction samples.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2022
From: XU, JIZHENG; ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 059387/0461 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2022
From: LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059387/0503 →
Priority Claims (1)
WO PCT/CN2019/107380 · Sep 23, 2019 · international
Continuity (2)
Continuation PCTCN2020116959 · Sep 23, 2020
Related Publication 20220224887A1 · Jul 14, 2022
Cited By (4)
US 12,231,625 US 12,323,583 US 12,382,016 US 12,470,701