IP Library › Granted Patent US 12,231,628
Granted Patent B2
US 12,231,628 · App. 18/168,799 · Granted Feb 18, 2025

Picture prediction method and apparatus

Inventors: Weiwei Xu (Hangzhou, CN); Haitao Yang (Shenzhen, CN); Yin Zhao (Hangzhou, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/11H04N19/132H04N19/137H04N19/159H04N19/176H04N19/513H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,231,628
App. No.
18/168,799
Granted
Feb 18, 2025
Kind
B2
Abstract

A picture prediction method includes receiving a bitstream; parsing the bitstream to obtain a prediction mode of a current block; when the prediction mode of the current block is a combined intra and inter prediction mode, selecting an execution manner of a triangular prediction unit mode according to a preset policy; determining motion information of the current block according to the execution manner of the triangular prediction unit mode; performing a motion compensation process based on the motion information, to obtain an inter prediction sample; obtaining an intra prediction sample according to the prediction mode of the current block; and combining the inter prediction sample and the intra prediction sample to obtain a prediction picture of the current block.

Claims (45)

1. A method, comprising:

encoding an identifier into a bitstream, wherein the identifier indicates whether a combined intra and inter prediction mode is applied for a current block, wherein an intra prediction mode in the combined intra and inter prediction mode is a planar mode; and

determining, when the identifier indicates that the combined intra and inter prediction mode is applied for the current block, that a geometric partitioning based prediction mode is not used to obtain prediction samples of the current block, wherein the geometric partitioning based prediction mode comprises a triangular prediction unit mode.

2. The method of claim 1 , further comprising:

obtaining inter prediction samples of the current block according to an inter prediction mode;

obtaining intra prediction samples of the current block according to the intra prediction mode; and

combining the inter prediction samples and the intra prediction samples to obtain combined prediction samples of the current block.

3. The method of claim 1 , further comprising encoding a merge index into the bitstream, wherein the merge index is for determining motion information of the current block, and wherein the motion information is for obtaining inter prediction samples of the current block.

4. The method of claim 1 , further comprising determining, when a constraint condition is met, that the geometric partitioning based prediction mode is used to obtain the prediction samples of the current block, wherein the constraint condition comprises the identifier, and wherein the identifier indicates the combined intra and inter prediction mode is not applied for the current block.

5. The method of claim 4 , further comprising:

determining motion information of the current block according to the geometric partitioning based prediction mode; and

performing a motion compensation process based on the motion information to obtain the prediction samples of the current block.

6. The method of claim 4 , further comprising encoding a geometric partitioning index into the bitstream, wherein a splitting direction of the geometric partitioning based prediction mode is based on the geometric partitioning index.

7. An apparatus comprising:

a memory configured to store instructions; and

a processor coupled to the memory, wherein the instructions cause the processor to be configured to:

encode an identifier into a bitstream, wherein the identifier indicating whether a combined intra and inter prediction mode is applied for a current block, wherein an intra prediction mode in the combined intra and inter prediction mode is a planar mode; and

determine, when the identifier indicates that the combined intra and inter prediction mode is applied for the current block, that a geometric partitioning based motion compensation is not used to obtain prediction samples of the current block, wherein the geometric partitioning based prediction mode comprises a triangular prediction unit mode.

8. The apparatus of claim 7 , wherein the instructions further cause the processor to be configured to:

obtain inter prediction samples of the current block according to an inter prediction mode;

obtain intra prediction samples of the current block according to the intra prediction mode; and

combine the inter prediction samples and the intra prediction samples to obtain combined prediction samples of the current block.

9. The apparatus of claim 7 , wherein the instructions further cause the processor to be configured to encode a merge index into the bitstream, wherein the merge index is used to determine motion information of the current block, and wherein the motion information is used to obtain inter prediction samples of the current block.

10. The apparatus of claim 7 , wherein the instructions further cause the processor to be configured to determine, when a constraint condition is met, that the geometric partitioning based prediction mode is used to obtain the prediction samples of the current block, wherein the constraint condition comprises the identifier indicating that the combined intra and inter prediction mode is not applied for the current block.

11. The apparatus of claim 10 , wherein the instructions further cause the processor to be configured to:

determine motion information of the current block according to the geometric partitioning based prediction mode; and

perform a motion compensation process based on the motion information to obtain the prediction samples of the current block.

12. The apparatus of claim 10 , wherein the instructions further cause the processor to be configured to encode a geometric partitioning index into the bitstream, wherein a splitting direction of the geometric partitioning based prediction mode is based on the geometric partitioning index.

13. A non-transitory computer-readable storage medium storing program code comprising instructions, which when executed using a processor of an apparatus, cause the apparatus to:

encode an identifier into a bitstream, wherein the identifier indicating whether a combined intra and inter prediction mode is applied for a current block, wherein an intra prediction mode in the combined intra and inter prediction mode is a planar mode; and

determine, when the identifier indicates that the combined intra and inter prediction mode is applied for the current block, that a geometric partitioning based motion compensation is not used to obtain prediction samples of the current block, wherein the geometric partitioning based prediction mode comprises a triangular prediction unit mode.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the instructions, when executed using the processor, further cause the apparatus to:

obtain inter prediction samples of the current block according to an inter prediction mode;

obtain intra prediction samples of the current block according to the intra prediction mode; and

combine the inter prediction samples and the intra prediction samples to obtain combined prediction samples of the current block.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the instructions, when executed using the processor, further cause the apparatus to encode a merge index into the bitstream, wherein the merge index is used to determine motion information of the current block, and wherein the motion information is used to obtain inter prediction samples of the current block.

16. The non-transitory computer-readable storage medium of claim 13 ,

wherein the instructions, when executed using the processor, further cause the apparatus to determine, when a constraint condition is met, that the geometric partitioning based motion compensation is used to obtain the prediction samples of the current block, wherein the constraint condition comprises the identifier indicating that the combined intra and inter prediction mode is not applied for the current block.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions, when executed using the processor, further cause the apparatus to:

determine motion information of the current block according to the geometric partitioning based motion compensation; and

perform a motion compensation process based on the motion information to obtain the prediction samples of the current block.

18. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions, when executed using the processor, further cause the apparatus to encode a geometric partitioning index into the bitstream, and wherein a splitting direction of the geometric partitioning based prediction mode is based on the geometric partitioning index.

19. A non-transitory computer-readable medium storing a bitstream that is generated by an encoding method performed by a video encoding apparatus, wherein the bitstream comprises an identifier indicating whether a combined intra and inter prediction mode is applied for a current block, wherein an intra prediction mode in the combined intra and inter prediction mode is a planar mode, wherein when the identifier indicates that the combined intra and inter prediction mode is applied for the current block, a geometric partitioning based motion compensation is not used to obtain prediction samples of the current block, wherein the geometric partitioning based prediction mode comprises a triangular prediction unit mode, wherein when a constraint condition is met, the geometric partitioning based motion compensation is used to obtain the prediction samples of the current block, and wherein the constraint condition comprises the identifier indicating that the combined intra and inter prediction mode is not applied for the current block.

20. The non-transitory computer-readable medium of claim 19 , wherein a merge index is encoded into the bitstream, and wherein the merge index is for determining motion information of the current block.

21. The non-transitory computer-readable medium of claim 20 , wherein the motion information is for obtaining inter prediction samples of the current block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2023
From: XU, WEIWEI; YANG, HAITAO; ZHAO, YIN
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 062691/0849 →
Priority Claims (1)
CN 201811262934.7 · Oct 27, 2018 · national
Continuity (3)
Continuation 17240508 · Apr 26, 2021
Continuation PCTCN2019113541 · Oct 28, 2019
Related Publication 20230188711A1 · Jun 15, 2023
References Cited (67)
US 6577310B1 · Kim et al. · 2003 [cited by applicant]
US 9609343B1 · Chen · 2017 [cited by examiner]
US 10009622B1 · Mukherjee · 2018 [cited by examiner]
US 11711511B2 · Xu · 2023 [cited by examiner]
US 20090232217A1 · Lee et al. · 2009 [cited by applicant]
US 20100195715A1 · Liu et al. · 2010 [cited by applicant]
US 20110142132A1 · Tourapis et al. · 2011 [cited by applicant]
US 20140185664A1 · Van Der Auwera · 2014 [cited by examiner]
US 20140314147A1 · Rusanovskyy · 2014 [cited by examiner]
US 20150016501A1 · Guo · 2015 [cited by examiner]
US 20150030073A1 · Chen · 2015 [cited by examiner]
US 20150103921A1 · Hannuksela · 2015 [cited by examiner]
US 20150195573A1 · Aflaki Beni · 2015 [cited by examiner]
US 20150312580A1 · Hannuksela · 2015 [cited by examiner]
US 20150312588A1 · Yamamoto · 2015 [cited by examiner]
US 20160165263A1 · Zhang · 2016 [cited by examiner]
US 20160173873A1 · Oh et al. · 2016 [cited by applicant]
US 20160191931A1 · Hannuksela · 2016 [cited by examiner]
US 20160277761A1 · Li · 2016 [cited by examiner]
US 20170054976A1 · Li · 2017 [cited by examiner]
US 20170070748A1 · Li · 2017 [cited by examiner]
US 20170078703A1 · Ridge · 2017 [cited by examiner]
US 20170094288A1 · Hannuksela · 2017 [cited by examiner]
US 20180103268A1 · Huang · 2018 [cited by examiner]
US 20180139469A1 · Lainema · 2018 [cited by examiner]
US 20180176587A1 · Panusopone · 2018 [cited by examiner]
US 20180249156A1 · Heo et al. · 2018 [cited by applicant]
US 20180376126A1 · Hannuksela · 2018 [cited by examiner]
US 20190082184A1 · Hannuksela · 2019 [cited by examiner]
US 20190141334A1 · Lim et al. · 2019 [cited by applicant]
US 20190182504A1 · Lainema · 2019 [cited by examiner]
US 20190230350A1 · Chen · 2019 [cited by examiner]
US 20190268599A1 · Hannuksela · 2019 [cited by examiner]
US 20190297339A1 · Hannuksela · 2019 [cited by examiner]
US 20190364284A1 · Moon · 2019 [cited by examiner]
US 20200120334A1 · Xu et al. · 2020 [cited by applicant]
US 20200236356A1 · Bordes · 2020 [cited by examiner]
US 20200236390A1 · Galpin · 2020 [cited by examiner]
US 20200244966A1 · Yoo · 2020 [cited by examiner]
US 20200260063A1 · Hannuksela · 2020 [cited by examiner]
US 20200288171A1 · Hannuksela · 2020 [cited by examiner]
US 20200322610A1 · Leleannec · 2020 [cited by examiner]
US 20200374528A1 · Huang et al. · 2020 [cited by applicant]
US 20210120235A1 · Liao et al. · 2021 [cited by applicant]
US 20210227209A1 · Liu et al. · 2021 [cited by applicant]
US 20210250581A1 · Xu et al. · 2021 [cited by applicant]
CN 101415121A · 2009 [cited by applicant]
CN 102685474A · 2012 [cited by applicant]
CN 108282658A · 2018 [cited by applicant]
EP 3217663A1 · 2017 [cited by applicant]
JP H09261654A · 1997 [cited by applicant]
WO 2017043816A1 · 2017 [cited by applicant]
WO 2017204532A1 · 2017 [cited by applicant]
WO 2018128466A1 · 2018 [cited by applicant]
WO 2020009086A1 · 2020 [cited by applicant]
WO 2020242883A1 · 2020 [cited by applicant]
Man-Shu Chiang, et al., “CE10.1: Combined and multi-hypothesis prediction,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0257-v1, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018… [cited by applicant]
Ru-Ling Liao et al “CE10.3.1.b: Triangular prediction unit mode,” Joint Video Exploration Team (JVET) of ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0124-v2, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 9 pages. [cited by applicant]
Martin Winken, et al., CE10: Multi-Hypothesis Inter Prediction (Tests 1.2.a-1.2.c), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0148-v3, 12th Meeting: Macao, CN, Oct. 3-12, 2… [cited by applicant]
JVET-J1000, Gary Sullivan, et al, “Meeting Report of the 10th meeting of the Joint Video Experts Team (JVET), San Diego, US, Apr. 10-20, 2018,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/… [cited by applicant]
Joceli Mayer, et al, “Region Based Image Compression using Recursive Triangular Partitioning with a Blending Model,” 1998, IEEE, 5 pages. XP032136032. [cited by applicant]
JVET-M0883, Hongtao Wang, et al, “CE1O-related: Using regular merge index signaling for triangle mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 13th Meeting: Marrakech, MA, Jan. … [cited by applicant]
JVET-L0100-v3, Chiang, M., et al, “CE10.1.1: Multi-hypothesis prediction for improving AMVP mode, skip or merge mode, and intra mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 1… [cited by applicant]
JVET-K1001-v7, Bross, B., et al, “Versatile Video Coding (Draft 2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, 148 pages. [cited by applicant]
JVET-L0375-v1, Xu, W., et al, “CE10-related: inter prediction sample filtering,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 4 pages. [cited by applicant]
ITU-T H.265, “Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding,” Feb. 2018, 692 pages. [cited by applicant]
Document: JVET-K0248-v1, Yu-Chi Su et al, CE4.4.1: Generalized bi-prediction for inter coding, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, … [cited by applicant]