IP Library Granted Patent US 12,413,708
Granted Patent B2
US 12,413,708 · App. 18/622,821 · Granted Sep 9, 2025

Adaptive local reference range

Inventors: Xin Zhao (San Jose, CA); Xiaozhong Xu (State College, PA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/105H04N19/132H04N19/136H04N19/159H04N19/172H04N19/176H04N19/423H04N19/463H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,413,708
App. No.
18/622,821
Granted
Sep 9, 2025
Kind
B2
Abstract

Aspects of the disclosure provide a method, an apparatus, and non-transitory computer-readable storage medium for video decoding. The apparatus includes processing circuitry configured to reconstruct an area in a block in a current picture from a coded video bitstream. The block includes one or more coding blocks (CBs) in the current picture. After the reconstructing, the processing circuitry determines whether to update a previous local reference range for an intra block copy (IBC) mode based on a content of the reconstructed area and/or prediction information of the reconstructed area. In response to a determination not to update the previous local reference range for the IBC mode, the previous local reference range for the IBC mode is not updated. The processing circuitry decodes a coding block in the current picture using the IBC mode that is based on the previous local reference range, which does not include the reconstructed area.

Claims (62)

1. A method for video decoding, comprising:

reconstructing an area in a current picture from a coded video bitstream, the area including one or more coding blocks (CBs) in the current picture;

determining a content of the reconstructed area based on reconstructed samples in the reconstructed area, the content of the reconstructed area indicating a percentage of a predefined type of content in the reconstructed area;

determining whether to update a previous local reference search range for an intra block copy (IBC) mode based on the percentage of the predefined type of content in the reconstructed area; and

when the previous local reference search range for the IBC mode is determined not to be updated with the reconstructed samples in the reconstructed area,

decoding a coding block (CB) in the current picture using the IBC mode that is based on the previous local reference search range that does not include the reconstructed area.

2. The method of claim 1 , wherein

the content of the reconstructed area includes no screen content; and

the determining whether to update the previous local reference search range includes determining that the previous local reference search range for the IBC mode is not to be updated.

3. The method of claim 1 , wherein the determining whether to update the previous local reference search range further comprises:

decoding prediction information of the area, the prediction information indicating a prediction mode of the area; and

determining whether to update the previous local reference search range for the IBC mode based on the percentage of the predefined type of content in the reconstructed area and the prediction mode.

4. The method of claim 1 , wherein

the previous local reference search range for the IBC mode is determined to be updated;

the previous local reference search range includes multiple areas stored in a reference sample memory (RSM), the multiple areas including reference samples; and

the method further includes:

ranking the multiple areas based on contents of the multiple areas, each of the contents corresponding to a respective one of the multiple areas;

selecting an area in the multiple areas that is to be replaced by the reconstructed samples in the reconstructed area based on the ranking of the multiple areas; and

generating a current local reference search range by replacing the selected area in the previous local reference search range with the reconstructed samples in the reconstructed area.

5. The method of claim 4 , wherein

each of the contents corresponding to the respective one of the multiple areas is indicated by a percentage of a predefined type of content in the corresponding area; and

the ranking the multiple areas includes ranking the multiple areas based on the respective percentages of the type of content of the multiple areas.

6. The method of claim 1 , wherein

the previous local reference search range for the IBC mode is determined to be updated;

the previous local reference search range includes multiple areas stored in a reference sample memory (RSM);

each area of the multiple areas includes a number of reference samples in the respective area that are coded with one or more prediction modes in a set of pre-defined prediction modes; and

the method further includes:

ranking the multiple areas based on the respective numbers of reference samples in the multiple areas;

selecting an area in the multiple areas that is to be replaced by the reconstructed samples in the reconstructed area based on the ranking of the multiple areas; and

generating a current local reference search range by replacing the selected area in the previous local reference search range with the reconstructed samples in the reconstructed area.

7. The method of claim 1 , wherein

the previous local reference search range for the IBC mode is determined to be updated;

the previous local reference search range includes multiple areas stored in a reference sample memory (RSM);

a reference frequency associated with each area of the multiple areas indicates a number of times that the respective area is referenced by block vectors used to predict CBs in the current picture; and

the method further includes:

ranking the multiple areas based on the respective reference frequencies of the multiple areas;

selecting an area in the multiple areas that is to be replaced by the reconstructed samples in the reconstructed area based on the ranking of the multiple areas; and

generating a current local reference search range by replacing the selected area in the previous local reference search range with the reconstructed samples in the reconstructed area.

8. The method of claim 1 , wherein

the previous local reference search range includes multiple areas;

reconstructed samples of the multiple areas except reconstructed samples of a sub-area in one of the multiple areas are stored in a reference sample memory (RSM); and

the reconstructed samples of the sub-area in the one of the multiple areas are replaced by a padding process that stores padded samples corresponding to the sub-area in the one of the multiple areas in the RSM.

9. The method of claim 1 , wherein

the reconstructed area is a reconstructed coding block, or

a size of the reconstructed area is a size of a memory update area unit.

10. A method for video encoding, comprising:

determining a content of a reconstructed area based on reconstructed samples in the reconstructed area, the content of the reconstructed area indicating a percentage of a predefined type of content in the reconstructed area, the reconstructed area including one or more coding blocks (CBs) in a current picture;

determining whether to update a previous local reference search range for an intra block copy (IBC) mode based on the percentage of the predefined type of content in the reconstructed area; and

when the previous local reference search range for the IBC mode is determined not to be updated with the reconstructed samples in the reconstructed area,

encoding a coding block (CB) in the current picture in a coded video bitstream using the IBC mode that is based on the previous local reference search range that does not include the reconstructed area.

11. The method of claim 10 , wherein

the content of the reconstructed area includes no screen content; and

the determining whether to update the previous local reference search range includes determining that the previous local reference search range for the IBC mode is not to be updated.

12. The method of claim 10 , wherein the determining whether to update the previous local reference search range further comprises:

decoding prediction information of the reconstructed area, the prediction information indicating a prediction mode of the reconstructed area; and

determining whether to update the previous local reference search range for the IBC mode based on the percentage of the predefined type of content in the reconstructed area and the prediction mode.

13. A method of processing video data, the method comprising:

processing a coded video bitstream of the video data, wherein the coded video bitstream causes a decoder to:

reconstruct an area in a current picture from the coded video bitstream, the area including one or more coding blocks (CBs) in the current picture;

determine a content of the reconstructed area based on reconstructed samples in the reconstructed area, the content of the reconstructed area indicating a percentage of a predefined type of content in the reconstructed area;

determine whether to update a previous local reference search range for an intra block copy (IBC) mode based on the percentage of the predefined type of content in the reconstructed area; and

when the previous local reference search range for the IBC mode is determined not to be updated with the reconstructed samples in the reconstructed area, decode a coding block (CB) in the current picture using the IBC mode that is based on the previous local reference search range that does not include the reconstructed area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: ZHAO, XIN; XU, XIAOZHONG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 067150/0530 →
Continuity (3)
Continuation 17893877 · Aug 23, 2022
Provisional Application 63237098 · Aug 25, 2021
Related Publication 20240244188A1 · Jul 18, 2024
References Cited (26)
US 11140400B2 · Nakagami · 2021 [cited by applicant]
US 20160241875A1 · Wu · 2016 [cited by examiner]
US 20160360210A1 · Xiu et al. · 2016 [cited by applicant]
US 20170302958A1 · Li et al. · 2017 [cited by applicant]
US 20200236384A1 · Xu et al. · 2020 [cited by applicant]
US 20200252621A1 · Xu · 2020 [cited by examiner]
US 20210321092A1 · Zhang · 2021 [cited by examiner]
US 20210321093A1 · Sundaram · 2021 [cited by examiner]
US 20210368164A1 · Xu · 2021 [cited by examiner]
US 20220078433A1 · Yoo · 2022 [cited by examiner]
US 20220159295A1 · Xiu et al. · 2022 [cited by applicant]
US 20220312003A1 · Lee et al. · 2022 [cited by applicant]
US 20220353498A1 · Sundaram · 2022 [cited by examiner]
WO 2020185964A1 · 2020 [cited by applicant]
WO WO2021004348A1 · 2021 [cited by examiner]
Xu et al.,; “Intra block copy in Versatile Video Coding with Reference Sample Memory Reuse”, 2019 Picture coding symposium (PCS), IEEE, XP033688140, Nov. 12, 2019, 5 pages (Year: 2019). [cited by examiner]
Chen, et al., “An Overview of Core Coding Tools in the AV1 Video Codec”, 2018 Picture Coding Symposium (PCS), Sep. 6, 2018, pp. 41-45. [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/075402, mailed on Nov. 23, 2022, 8 pages. [cited by applicant]
Jiahao Li, et al., Intra Block Copy for Screen Content in the Emerging AV1 Video Codec, 2018 Data Compression Conference, Jul. 23, 2018, pp. 355-364. [cited by applicant]
Nguyen, et al., “Overview of the Screen Content Support in VVC: Applications, Coding Tools, and Performance”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, No. 10, Apr. 21, 2021, pp. 3801-3817. [cited by applicant]
Office Action received for Japanese Patent Application No. 2023-5321507, mailed on Mar. 6, 2024, 12 pages (7 pages of English Translation and 5 pages of Original Document). [cited by applicant]
Rivaz et al., “AV1 Bitstream & Decoding Process Specification”, The Alliance for Open Media 681, Jan. 8, 2019, pp. 1-681. [cited by applicant]
Wang, et al., “IntraBC with Local Reference Ranges, Alliance for Open Media Codec Working Group”, Document: CWG-B071[i]_v1, Aug. 18, 2021, pp. 1-6. [cited by applicant]
Extended European Search Report and Search Opinion received for European Application No. 22859542.7, mailed on Nov. 13, 2024, 11 pages. [cited by applicant]
Tsang et al., “Hash Based Fast Local Search for Intra Block Copy (IntraBC) Mode in HEVC Screen Content Coding”, Proceedings of APSIPA Annual Summit and Conference 2015, XP032870573, Dec. 16-19, 2015, pp. 396-400. [cited by applicant]
Xu et al., “Intra block copy in Versatile Video Coding with Reference Sample Memory Reuse”, 2019 Picture coding symposium (PCS), IEEE, XP033688140, Nov. 12, 2019, 5 pages. [cited by applicant]