IP Library › Granted Patent US 12,069,282
Granted Patent B2
US 12,069,282 · App. 17/461,150 · Granted Aug 20, 2024

Order-based updating for intra block copy in video coding

Inventors: Jizheng Xu (San Diego, CA); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/423H04N19/137H04N19/152H04N19/159H04N19/176H04N19/186H04N19/593H04N19/70H04N19/96H04N19/132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,069,282
App. No.
17/461,150
Granted
Aug 20, 2024
Kind
B2
Abstract

A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.

Claims (35)

1. A method of processing visual data, comprising:

determining, for a conversion between a current video block and a bitstream of the current video block, a buffer that is used to store reconstructed samples for prediction in an intra block copy mode, wherein the conversion is performed in the intra block copy mode which is based on motion information related to a reconstructed block located in same video region with the current video block; and

updating the reconstructed samples stored in the buffer in accordance with an order,

wherein the reconstructed samples stored in the buffer are assigned priority values, and wherein the reconstructed samples stored in the buffer are replaced according to the priority values,

wherein a flag included in the bitstream indicates the priority values that satisfy one or more conditions, and wherein the one of more conditions relate to a percentage of the reconstructed samples coded using a palette mode and/or an intra block coding (IBC) mode and/or a transform-skip mode.

2. The method of claim 1 , wherein the buffer is updated in accordance with a sequential order.

3. The method of claim 1 , wherein the buffer is updated in accordance with an order of reconstructed blocks.

4. The method of claim 1 , further comprising:

upon determining that the buffer is full, replacing the reconstructed samples stored in the buffer with recently reconstructed samples.

5. The method of claim 4 , wherein determining that a number of available samples in the buffer is equal or larger than a threshold is indicative of the buffer being full, and wherein the threshold is 64×64×3 luma samples.

6. The method of claim 1 , wherein the reconstructed samples stored in the buffer are replaced in a first-in-first-out order.

7. The method of claim 1 , wherein an oldest set of the reconstructed samples stored in the buffer are replaced.

8. The method of claim 1 , wherein a subset of the reconstructed samples stored in the buffer are marked for replacement in future, and wherein samples not included in the subset are replaced initially.

9. The method of claim 1 , wherein the priority values are assigned based on a characteristic of the current video block.

10. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.

11. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.

12. The method of claim 1 , wherein, in response to determining that the percentage of the reconstructed samples coded using the palette mode and/or the intra block coding (IBC) mode and/or the transform-skip mode exceed a threshold, assigning all samples in the current video block as high priority.

13. The method of claim 12 , wherein the threshold is based on a size of the current video block and/or a color component of the current video block and/or a size of a coding tree unit (CTU) including the current video block.

14. The method of claim 13 , wherein the threshold is included as a field in the bitstream.

15. The method of claim 14 , wherein the field is included in a sequence parameter set (SPS), a picture parameter set (PPS), a sequence header, a slice header, a tile group, a tile level, or a video region.

16. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current video block and a bitstream of the current video block, a buffer that is used to store reconstructed samples for prediction in an intra block copy mode, wherein the conversion is performed in the intra block copy mode which is based on motion information related to a reconstructed block located in same video region with the current video block; and

update the reconstructed samples stored in the buffer in accordance with an order,

wherein the reconstructed samples stored in the buffer are assigned priority values, and

wherein the reconstructed samples stored in the buffer are replaced according to the priority values, wherein a flag included in the bitstream indicates the priority values that satisfy one or more conditions, and wherein the one of more conditions relate to a percentage of the reconstructed samples coded using a palette mode and/or an intra block coding (IBC) mode and/or a transform-skip mode.

17. The apparatus of claim 16 , wherein the buffer is updated in accordance with a sequential order or the buffer is updated in accordance with an order of reconstructed blocks.

18. The apparatus of claim 16 , wherein the instructions upon execution by the processor further cause the processor to:

upon determining that the buffer is full, replace the reconstructed samples stored in the buffer with recently reconstructed samples.

19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a generation of the bitstream from a current video block, a buffer that is used to store reconstructed samples for prediction in an intra block copy mode, wherein the generation is performed in the intra block copy mode which is based on motion information related to a reconstructed block located in same video region with the current video block;

updating the reconstructed samples stored in the buffer in accordance with an order; and

generating the bitstream based on the determining,

wherein the reconstructed samples stored in the buffer are assigned priority values, and wherein the reconstructed samples stored in the buffer are replaced according to the priority values,

wherein a flag included in the bitstream indicates the priority values that satisfy one or more conditions, and wherein the one of more conditions relate to a percentage of the reconstructed samples coded using a palette mode and/or an intra block coding (IBC) mode and/or a transform-skip mode.

20. The non-transitory computer-readable recording medium of claim 19 , wherein the buffer is updated in accordance with a sequential order or the buffer is updated in accordance with an order of reconstructed blocks.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2021
From: XU, JIZHENG; ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 057338/0537 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 057338/0646 →
Priority Claims (14)
WO PCT/CN2019/076695 · Mar 1, 2019 · international
WO PCT/CN2019/076848 · Mar 4, 2019 · international
WO PCT/CN2019/077725 · Mar 11, 2019 · international
WO PCT/CN2019/079151 · Mar 21, 2019 · international
WO PCT/CN2019/085862 · May 7, 2019 · international
WO PCT/CN2019/088129 · May 23, 2019 · international
WO PCT/CN2019/091691 · Jun 1, 2019 · international
WO PCT/CN2019/093552 · Jun 28, 2019 · international
WO PCT/CN2019/094957 · Jul 6, 2019 · international
WO PCT/CN2019/095297 · Jul 9, 2019 · international
WO PCT/CN2019/095504 · Jul 10, 2019 · international
WO PCT/CN2019/095656 · Jul 11, 2019 · international
WO PCT/CN2019/095913 · Jul 13, 2019 · international
WO PCT/CN2019/096048 · Jul 15, 2019 · international
Continuity (2)
Continuation PCTCN2020077417 · Mar 2, 2020
Related Publication 20230019459A1 · Jan 19, 2023
Cited By (4)
US 12,238,314 US 12,389,022 US 12,464,116 US 12,568,201