IP Library Granted Patent US 12,284,375
Granted Patent B2
US 12,284,375 · App. 18/241,755 · Granted Apr 22, 2025

Implicit masked blending mode improvement with high level syntax

Inventors: Han Gao (Palo Alto, CA); Xin Zhao (Palo Alto, CA); Liang Zhao (Palo Alto, CA); Jing Ye (Palo Alto, CA); Shan Liu (Palo Alto, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04N19/105H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,284,375
App. No.
18/241,755
Granted
Apr 22, 2025
Kind
B2
Abstract

A computing system receives a video bitstream comprising a current picture that includes a first block. The system determines that the first block is encoded using a first reference block and a second reference block. The system identifies a high-level syntax (HLS) flag in the video bitstream that indicates a weighting scheme for using the first and second reference blocks. The system reconstructs the first block using a first set of weighting factors for reference values from the first reference and second reference blocks when the HLS flag has a first value. The system reconstructs the first block using a second set of weighting factors for the reference values from the first and second reference blocks when (i) the HLS flag has a second value and (ii) at least one of the first and second reference blocks is at least partially outside of a corresponding reference boundary.

Claims (44)

1. A method of video decoding performed at a computing system having memory and one or more processors, the method comprising:

receiving a video bitstream comprising a current picture that includes a first block;

determining that the first block is encoded using a first reference block and a second reference block;

identifying a high-level syntax (HLS) flag in the video bitstream that indicates whether an implicit masked blending mode is enabled for the first block, wherein the implicit masked blending mode is associated with a weighting scheme for using the first reference block and the second reference block;

in accordance with the HLS flag having a first value, reconstructing the first block using a first set of weighting factors for reference values from the first reference block and the second reference block; and

in accordance with (i) the HLS flag having a second value and (ii) a determination that at least one of the first reference block and the second reference block is at least partially outside of a corresponding reference boundary, reconstructing the first block using a second set of weighting factors for the reference values from the first reference block and the second reference block.

2. The method of claim 1 , wherein the second set of weighting factors correspond to a non-averaged weighting.

3. The method of claim 1 , wherein the second set of weighting factors correspond to a masked blending.

4. The method of claim 1 , wherein the HLS flag is signaled at a sequence level.

5. The method of claim 1 , wherein the HLS flag is signaled at a frame level.

6. The method of claim 1 , wherein the HLS flag is signaled in at a tile or subpicture level.

7. The method of claim 1 , further comprising:

identifying a second HLS flag in the video bitstream that indicates a granularity of position checks for generating a boundary-dependent mask;

in accordance with the second HLS flag having a first corresponding value, performing a respective position check at each of a set of sample locations; and

in accordance with the second HLS flag having a second corresponding value, forgoing performing the respective position check at a subset of the sample locations.

8. The method of claim 7 , wherein the second HLS flag is signaled at a frame, sequence, tile, or subpicture level.

9. The method of claim 1 , further comprising:

identifying a third HLS flag in the video bitstream that indicates a weighting factor to be used for out-of-boundary positions;

in accordance with the third HLS flag having a first corresponding value, applying a first set of weighting factors for out-of-boundary positions; and

in accordance with the third HLS flag having a second corresponding value, applying a second set of weighting factors for out-of-boundary positions.

10. The method of claim 9 , wherein the third HLS flag is signaled at a frame, sequence, tile, or subpicture level.

11. The method of claim 1 , wherein a default value for the HLS flag is 1.

12. The method of claim 1 , wherein the corresponding reference boundary is a picture boundary, a slice boundary, a subpicture boundary, or a tile boundary.

13. A computing system, comprising:

control circuitry;

memory; and

one or more sets of instructions stored in the memory and configured for execution by the control circuitry, the one or more sets of instructions comprising instructions for:

receiving a video bitstream comprising a current picture that includes a first block;

determining that the first block is encoded using a first reference block and a second reference block;

identifying a high-level syntax (HLS) flag in the video bitstream that indicates whether an implicit masked blending mode is enabled for the first block, wherein the implicit masked blending mode is associated with a weighting scheme for using the first reference block and the second reference block;

in accordance with the HLS flag having a first value, reconstructing the first block using a first set of weighting factors for reference values from the first reference block and the second reference block; and

in accordance with (i) the HLS flag having a second value and (ii) a determination that at least one of the first reference block and the second reference block is at least partially outside of a corresponding reference boundary, reconstructing the first block using a second set of weighting factors for the reference values from the first reference block and the second reference block.

14. The computing system of claim 13 , wherein the second set of weighting factors correspond to a non-averaged weighting.

15. The computing system of claim 13 , wherein the second set of weighting factors correspond to a masked blending.

16. The computing system of claim 13 , wherein the HLS flag is signaled at a sequence level.

17. A non-transitory computer-readable storage medium storing one or more sets of instructions configured for execution by a computing device having control circuitry and memory, the one or more sets of instructions comprising instructions for:

receiving a video bitstream comprising a current picture that includes a first block;

determining that the first block is encoded using a first reference block and a second reference block;

identifying a high-level syntax (HLS) flag in the video bitstream that indicates whether an implicit masked blending mode is enabled for the first block, wherein the implicit masked blending mode is associated with a weighting scheme for using the first reference block and the second reference block;

in accordance with the HLS flag having a first value, reconstructing the first block using a first set of weighting factors for reference values from the first reference block and the second reference block; and

in accordance with (i) the HLS flag having a second value and (ii) a determination that at least one of the first reference block and the second reference block is at least partially outside of a corresponding reference boundary, reconstructing the first block using a second set of weighting factors for the reference values from the first reference block and the second reference block.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the second set of weighting factors correspond to a non-averaged weighting.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the second set of weighting factors correspond to a masked blending.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the HLS flag is signaled at a sequence level.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2023
From: GAO, HAN; ZHAO, XIN; ZHAO, LIANG; YE, JING; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 064851/0254 →
Continuity (2)
Provisional Application 63523566 · Jun 27, 2023
Related Publication 20250008137A1 · Jan 2, 2025
References Cited (56)
US 9398293B2 · Wang et al. · 2016 [cited by applicant]
US 11363265B2 · Ahn · 2022 [cited by applicant]
US 11570432B2 · Kanoh et al. · 2023 [cited by applicant]
US 11882282B2 · Lee · 2024 [cited by applicant]
US 11949894B2 · Xu et al. · 2024 [cited by applicant]
US 11973962B2 · Zhang et al. · 2024 [cited by applicant]
US 12047581B2 · Chen et al. · 2024 [cited by applicant]
US 12095984B2 · Li et al. · 2024 [cited by applicant]
US 12120346B2 · Zhao et al. · 2024 [cited by applicant]
US 12143595B2 · Otsuka · 2024 [cited by applicant]
US 12206861B2 · Li et al. · 2025 [cited by applicant]
US 20130266070A1 · Sato · 2013 [cited by applicant]
US 20170280090A1 · Raskin · 2017 [cited by applicant]
US 20180278950A1 · Chen et al. · 2018 [cited by applicant]
US 20200029087A1 · Lim et al. · 2020 [cited by applicant]
US 20200029090A1 · Alshin · 2020 [cited by examiner]
US 20210160527A1 · Chuang et al. · 2021 [cited by applicant]
US 20210266531A1 · Kang et al. · 2021 [cited by applicant]
US 20210281852A1 · Alshina · 2021 [cited by examiner]
US 20220109861A1 · Hannuksela et al. · 2022 [cited by applicant]
US 20220167003A1 · Li et al. · 2022 [cited by applicant]
US 20220239950A1 · Zhang et al. · 2022 [cited by applicant]
US 20220272373A1 · Moon et al. · 2022 [cited by applicant]
US 20220329797A1 · Liao et al. · 2022 [cited by applicant]
US 20220329852A1 · Sullivan et al. · 2022 [cited by applicant]
US 20230140041A1 · Gan · 2023 [cited by applicant]
US 20230224472A1 · Chen et al. · 2023 [cited by applicant]
US 20230247216A1 · Huang et al. · 2023 [cited by applicant]
US 20230336773A1 · Zhao et al. · 2023 [cited by applicant]
US 20230345023A1 · Chen · 2023 [cited by examiner]
US 20230388484A1 · Gao · 2023 [cited by examiner]
US 20230403392A1 · Wang · 2023 [cited by applicant]
US 20240137552A1 · Li et al. · 2024 [cited by applicant]
US 20240291982A1 · Wang · 2024 [cited by applicant]
US 20240364905A1 · Mao et al. · 2024 [cited by applicant]
US 20240430448A1 · Gao et al. · 2024 [cited by applicant]
US 20250008137A1 · Gao et al. · 2025 [cited by applicant]
US 20250024055A1 · Gao et al. · 2025 [cited by applicant]
US 20250024070A1 · Gao et al. · 2025 [cited by applicant]
US 20250039364A1 · Wang · 2025 [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding Editorial Refinements on Draft 10”, Document: JVET-T2001-v2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 20th Meeting, by teleconference, O… [cited by applicant]
Han Gao et al., “Implicit Masked Blending Mode”, Document: CWG-D057_v1, Alliance for Open Media Codec Working Group, Jun. 7, 2023, 3 pgs. [cited by applicant]
Han Gao et al., “Joint Proposal of CWG-D057 and CWG-CWG-D062”, Document: CWG-D071 v5, Alliance for Open Media Codec Working Group, Jun. 21, 2023, 4 pgs. [cited by applicant]
Han Gao et al., “Wedge Mode Extensions”, Document: CWG-C092_v1,Media Codec Working Group, Dec. 14, 2022, 4 pgs. [cited by applicant]
Leo Zhao et al., “Advanced Motion Vector Difference Coding”, Document: CWG-B092, Alliance for Open Media, Codec Working Group, Nov. 24, 2021, 7 pgs. [cited by applicant]
Leo Zhao et al., “Improved Adaptive MVD Resolution”, Document: CWG-C011, Alliance for Open Media, Codec Working Group, Feb. 9, 2022, 7 pgs. [cited by applicant]
Mohammed Golam Sarwer et al., “Sub-block Based MV Refinement”, Document: CWG-D031v6, Alliance for Open Media Codec Working Group, Apr. 10, 2023, 19 pgs. [cited by applicant]
Peter de Rivaz et al., “AV1 Bitstream & Decoding Process Specification”, The Alliance for Open Media, Jan. 8, 2019, 681 pgs. Retrieved from the Internet: https://aomediacodec.github.io/av1-spec/av1-spec.pdf. [cited by applicant]
Xin Zhao et al., “Tool Description for AV1 and Libaom”, Document: CWG-B078_v1, Alliance for Open Media Codec Working Group, Oct. 4, 2021, 41 pgs. [cited by applicant]
Yue Chen et al., “An Overview of Core Coding Tools in the AVI Video Codec”, 2018 IEEE Picture Coding Symposium, San Francisco, CA, USA, 5 pgs. [cited by applicant]
Elliott Karpilovsky et al., “Proposal: New Inter Modes for AV2”, Alliance for Open Media, Codec Working Group, Document: CWG-B018 v1, Feb. 24, 2021, 6 pgs. [cited by applicant]
Tencent Technology, ISRWO, PCT/CN2023/032331, Dec. 15, 2023, 16 pgs. [cited by applicant]
Tencent Technology, ISRWO, PCT/CN2023/032336, Dec. 18, 2023, 14 pgs. [cited by applicant]
Tencent Technology, ISRWO, PCT/CN2023/032338, Dec. 11, 2023, 5 pgs. [cited by applicant]
Tencent Technology, ISRWO, PCT/CN2023/032341, Dec. 12, 2023, 11 pgs. [cited by applicant]
Tencent Technology, ISRWO, PCT/CN2023/032344, Dec. 12, 2023, 14 pgs. [cited by applicant]