IP Library › Granted Patent US 12,445,639
Granted Patent B2
US 12,445,639 · App. 17/716,655 · Granted Oct 14, 2025

Method and apparatus for video coding

Inventors: Liang Zhao (Sunnyvale, CA); Xin Zhao (San Diego, CA); Xiang Li (Saratoga, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/51H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,445,639
App. No.
17/716,655
Granted
Oct 14, 2025
Kind
B2
Abstract

Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. For example, the processing circuitry decodes prediction information of a current block from a coded video bitstream. The prediction information indicates that a prediction of the current block is at least partially based on an inter prediction. Then, the processing circuitry reconstructs at least a sample of the current block as a combination of a result from the inter prediction and neighboring samples of the block that are selected based on a position of the sample.

Claims (48)

1. A method for video decoding in a decoder, comprising:

decoding prediction information of a current block from a coded video bitstream, the prediction information indicating that a prediction of the current block is at least partially based on an inter prediction;

receiving a first flag for an intra-inter prediction mode that uses a combination of an intra prediction and the inter prediction of the current block;

excluding a motion refinement based on a bi-directional optical flow (BDOF) mode from the inter prediction of the current block;

decoding, when the first flag indicates true for the intra-inter prediction mode, a second flag that is indicative of a usage of a position dependent prediction combination (PDPC) on the inter prediction; and

reconstructing a sample of the current block based on the PDPC on the inter prediction.

2. The method of claim 1 , wherein the method further comprises:

excluding the motion refinement in the decoder.

3. The method of claim 1 , further comprising:

decoding, based on a context model for an entropy coding, the second flag that is indicative of the usage of the PDPC.

4. The method of claim 1 , further comprising:

applying a filter on neighboring samples of the current block; and

reconstructing at least a sample of the current block as a combination of a result from the inter prediction and neighboring samples of the current block that are selected based on a position of the sample.

5. The method of claim 1 , wherein the reconstructing comprises:

reconstructing the sample of the current block using neighboring samples of the current block without an application of a filter on the neighboring samples of the current block.

6. The method of claim 1 , further comprising:

determining whether the current block meets a block size condition that limits an application of the PDPC in the reconstruction of the current block; and

excluding the application of the PDPC in the reconstruction of at least one sample of the current block when the block size condition is met.

7. The method of claim 6 , wherein the block size condition depends on a size of a virtual process data unit.

8. The method of claim 4 , further comprising

disregarding a particular neighboring sample in a calculation of the combination when a distance of the particular neighboring sample to the sample is larger than a threshold.

9. The method of claim 4 , further comprising:

combining the result from the inter prediction with the neighboring samples that are selected based on a position of the sample and reconstructed based on inter prediction.

10. The method of claim 1 , further comprising:

decoding the second flag that is indicative of the usage of the PDPC when the prediction information is indicative of a merge mode.

11. The method of claim 1 , further comprising:

decoding, when a flag is indicative of non-zero residue for the current block, the second flag that is indicative of the usage of the PDPC.

12. A method of video processing in an encoder, comprising:

determining a current block is to be predicted at least partially based on an inter prediction;

encoding, in a bitstream, a first flag for an intra-inter prediction mode that uses a combination of an intra prediction and the inter prediction of the current block;

excluding a motion refinement and a bi-directional optical flow (BDOF) mode from the inter prediction of the current block;

encoding, in the bitstream when the first flag indicates true for the intra-inter prediction mode, a second flag that is indicative of a usage of a position dependent prediction combination (PDPC) on the inter prediction; and

encoding a sample of the current block based on the PDPC on the inter prediction.

13. The method of claim 12 , wherein the method further comprises:

excluding the motion refinement when reconstructing the current block.

14. The method of claim 12 , wherein the method further comprises:

encoding, based on a context model for an entropy coding, the second flag that is indicative of the usage of the PDPC in the bitstream.

15. A method of processing visual media data, the method comprising:

processing a bitstream that includes the visual media data according to a format rule, wherein

the bitstream includes prediction information of a current block of a video, the prediction information indicating that a prediction of the current block is at least partially based on an inter prediction; and

the format rule specifies that:

a first flag is indicative of an intra-inter prediction mode that uses a combination of an intra prediction and the inter prediction of the current block, a motion refinement based on a bi-directional optical flow (BDOF) mode is excluded from the inter prediction of the current block;

a second flag that is indicative of a usage of a position dependent prediction combination (PDPC) on the inter prediction when the first flag indicates true for the intra-inter prediction mode; and

a sample of the current block is reconstructed based on the PDPC on the inter prediction.

16. The method of claim 15 , wherein the format rule further specifies that:

the motion refinement is excluded when reconstructing the current block.

17. The method of claim 15 , wherein the format rule further specifies:

the second flag that is indicative of the usage of the PDPC based on a context model for an entropy coding.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2022
From: ZHAO, LIANG; ZHAO, XIN; LI, XIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 059548/0493 →
Continuity (3)
Continuation 16777339 · Jan 30, 2020
Provisional Application 62800400 · Feb 1, 2019
Related Publication 20220239940A1 · Jul 28, 2022
References Cited (41)
US 11115676B2 · Zhang · 2021 [cited by examiner]
US 20110280304A1 · Jeon et al. · 2011 [cited by applicant]
US 20120287995A1 · Budagavi et al. · 2012 [cited by applicant]
US 20130034158A1 · Kirchhoffer et al. · 2013 [cited by applicant]
US 20130251036A1 · Lee et al. · 2013 [cited by applicant]
US 20150016512A1 · Pu et al. · 2015 [cited by applicant]
US 20160330481A1 · Zhang et al. · 2016 [cited by applicant]
US 20170272748A1 · Seregin et al. · 2017 [cited by applicant]
US 20170280162A1 · Zhao · 2017 [cited by examiner]
US 20200162728A1 · Van der Auwera · 2020 [cited by examiner]
US 20200204824A1 · Lai et al. · 2020 [cited by applicant]
US 20200221099A1 · Pham Van et al. · 2020 [cited by applicant]
US 20210144366A1 · Zhang et al. · 2021 [cited by applicant]
US 20210266530A1 · Liu · 2021 [cited by examiner]
US 20210266585A1 · Liu et al. · 2021 [cited by applicant]
US 20210409727A1 · Jang · 2021 [cited by examiner]
JP 2007074050A · 2007 [cited by applicant]
JP 2022512088A · 2022 [cited by applicant]
WO 2015059973A1 · 2015 [cited by applicant]
WO 2017030198A1 · 2017 [cited by applicant]
WO 2018174657A1 · 2018 [cited by applicant]
WO 2018219925A1 · 2018 [cited by applicant]
WO 2020146562A1 · 2020 [cited by applicant]
Japanese Office Action issued Jan. 16, 2023 in Application No. 2021-531589 with English Translation, pp. 1-32. [cited by applicant]
Japanese Office Action issued Jun. 27, 2022 in Application No. 2021-531589 with English Translation, pp. 1-15. [cited by applicant]
Jianle Chen, et al., “Algorithm description for Versatile Video Coding and Test Model 3 (VTM 3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L1002 (version2), Dec. 24, 2018, p… [cited by applicant]
Okubo, “3rd Edition of Impress Standard Textbook Series Revision H.264/AVC Textbook”, 1st Edition, Jan. 1, 2009, Impress Corporation R&D, ISBN: 978-4-8443-2664-9, pp. 110-116. [cited by applicant]
Martin Winken, et al., “CE10: Multi-hypothesis inter prediction (Test 10.1.2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 7, 2019, JVET-M0425 (version 2), pp. 1-13. [cited by applicant]
F. Galpin, et al., “CE-10 related: M0390-M0096 combination”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 13, 2019, JVET-M0838 (version 1), pp. 1-4. [cited by applicant]
Jianle Chen, et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Aug. 19, 2017, JVET-G1001 (version 1), pp. 1… [cited by applicant]
Hyeongmun Jang, et al., “EE1-Related: Harmonization UW Prediction method with improved PDPC”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 14, 2017, JVET-G0062 (version 3),… [cited by applicant]
Supplementary European Search Report issued Jun. 13, 2022 in Application No. 20749343.8, pp. 1-19. [cited by applicant]
Zhao L et al: “CE10-related: Simplification and Improvement of combined intra-inter prediction mode”, 126. MPEG Meeting; Mar. 25, 2019-Mar. 29, 2019; Geneva; (Motion Picture Expert Group or ISO/IEC JTC1 /SC29/WG11 ), No… [cited by applicant]
Sullivan G J et al: “Meeting Report of the 12th JVET Meeting (Macao, Oct. 3-12, 2018)”, 124. MPEG Meeting; Oct. 8, 2018-Oct. 12, 2018; Macao; (Motion Picture Expert Group or ISO/IEC JTC1 /SC29/WG11 ), No. m45224, Jan. 8… [cited by applicant]
Sarwer MG et al: “CE3-related: Boundary PDPC”, 12. JVET Meeting; Oct. 3, 2018-Oct. 12, 2018; Macao; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ), No. JVET-L0087, Oct. 4, 2018. [cited by applicant]
Supplementary European Search Report issued Mar. 16, 2022 in Application No. 20749343.8, pp. 1-19. [cited by applicant]
International Search Report and Written Opinion Issued in Application PCT/US2020/016144 on Apr. 30, 2020. [cited by applicant]
Sullivan et al., “Standardized extensions of high efficiency video coding (HEVC)”, IEEE Journal of selected topics in Signal Processing, Dec. 2013. [cited by applicant]
Korean Office Action issued Feb. 28, 2024 in Application No. 10-2021-7020075 with English Translation, pp. 1-13. [cited by applicant]
B. Bross, the et. al, “Versatile Video Coding (Draft 3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO / IEC JTC 1 / SC 29 / WG 11 12th Meeting: Macao, CN, Oct. 3-12, 2018, and the JVET-L1001, pp. 1-233. [cited by applicant]
Office Action received for Japanese Patent Application No. 2023-134843, mailed on Jun. 3, 2024, 10 pages (5 pages of English Translation and 5 pages of Original Document). [cited by applicant]
Cited By (1)
US 12,707,043