IP Library › Granted Patent US 12,531,975
Granted Patent B2
US 12,531,975 · App. 18/649,543 · Granted Jan 20, 2026

Picture prediction method and apparatus, and computer-readable storage medium

Inventors: Xu Chen (Shenzhen, CN); Huanbang Chen (Shenzhen, CN); Haitao Yang (Shenzhen, CN); Lian Zhang (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/105H04N19/159H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,531,975
App. No.
18/649,543
Granted
Jan 20, 2026
Kind
B2
Abstract

Embodiments of this application disclose a picture prediction method and apparatus. The picture prediction method includes: determining whether a merge mode is used for a current picture block; when the merge mode is used for the current picture block, determining whether a level-1 merge mode is available for the current picture block; when the level-1 merge mode is unavailable, and a high-layer syntax element corresponding to a first merge mode indicates that the first merge mode is forbidden to be used, determining a second merge mode as a target merge mode used for the current picture block, where the first merge mode and the second merge mode are included in a level-2 merge mode; and predicting the current picture block based on the target merge mode. In the embodiments of this application, redundancy generated in a merge mode determining process can be reduced as much as possible.

Claims (101)

1 . A method of decoding implemented by a decoder, comprising:

performing entropy decoding, inverse quantization process and inverse transform process on a received video bitstream, to obtain a residual block and syntax elements;

determining whether a merge mode is used for a current picture block;

determining that the current picture block meets at least one of the following:

a size of the current picture block meets a preset condition; or

a skip mode is not used to predict the current picture block;

when the merge mode is used for the current picture block, determining whether a regular merge mode is available;

when the regular merge mode is unavailable, and a syntax element sps_triangle_enabled_flag of the syntax elements corresponding to a triangle partition mode (TPM), indicates that the TPM is forbidden to be used, determining a combined intra and inter prediction (CIIP) mode as a target merge mode used for the current picture block, wherein the syntax element sps_triangle_enabled_flag corresponding to the TPM is at a sequence level;

when the regular merge mode is unavailable, and the syntax element sps_triangle_enabled_flag corresponding to the TPM indicates that the TPM is allowed to be used, determining the target merge mode based on at least one of the syntax element sps_triangle_enabled_flag corresponding to the CIIP mode or available status information of the CIIP mode, wherein the available status information of the CIIP mode is a value of a ciip_flag;

predicting the current picture block based on the target merge mode to obtain a prediction block of the current picture block; and

obtaining a reconstructed block of the current picture block based on the prediction block and the residual block.

2 . The method according to claim 1 , wherein the size of the current picture block meets the preset condition when the current picture block meets the following:

(cdWidth*cbHeight)≥64;

cbWidth<128; and

cbHeight<128;

wherein the cdWidth is a width of the current picture block, and the cbHeight is a height of the current picture block.

3 . The method according to claim 1 , wherein

before determining the target merge mode based on the syntax element sps_triangle_enabled_flag corresponding to the at least one of the CIIP mode or the available status information of the CIIP mode, the method further comprises:

determining whether a type of a slice or slice group in which the current picture block is located is bi-directional; and

determining whether a maximum quantity of candidate TPM modes supported by the slice or slice group in which the current picture block is located is greater than or equal to 2.

4 . The method according to claim 1 , further comprising:

determining the CIIP mode as the target merge mode, when the regular merge mode is unavailable, and the syntax element sps_triangle_enabled_flag corresponding to the TPM indicates that the TPM is allowed to be used, and any one of the following is not met:

a type of a slice in which the current picture block is located is bi-directional; and

a maximum quantity of candidate TPM modes supported by the slice or slice group in which the current picture block is located is greater than or equal to 2.

5 . The method according to claim 1 , further comprising:

determining the CIIP mode as the target merge mode, when the CIIP mode is allowed to be used, and when any one of the following is not met:

a TPM mode is allowed to be used;

a skip mode is not used to predict the current picture block;

(cbWidth*cbHeight)≥64;

cbWidth<128; and

cbHeight<128;

wherein the cbWidth is a width of the current picture block, and the cbHeight is a height of the current picture block.

6 . The method according to claim 1 , further comprising:

determining the CIIP mode as the target merge mode, when the CIIP mode is allowed to be used, and any one of the following is not met:

a TPM mode is allowed to be used;

a type of a slice or slice group in which the current picture block is located is bi-directional;

a maximum quantity of candidate TPM modes supported by the slice or the slice group in which the current picture block is located is determined to be greater than or equal to 2;

a size of the current picture block meets a preset condition; and

a skip mode is not used to predict the current picture block.

7 . The method according to claim 1 , wherein the syntax elements are the sequence level.

8 . The method according to claim 1 , wherein the method is performed by a decoder side, to decode the current picture block.

9 . A decoding apparatus, comprising:

one or more processors; and

a memory configured to store a program, which when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:

performing entropy decoding, inverse quantization process and inverse transform process on a received video bitstream, to obtain a residual block and syntax elements;

determining whether a merge mode is used for a current picture block;

determining that the current picture block meets at least one of the following:

a size of the current picture block meets a preset condition; or

a skip mode is not used to predict the current picture block;

when the merge mode is used for the current picture block, determining whether a regular merge mode is available;

when the regular merge mode is unavailable, and a syntax element sps_triangle_enabled_flag of the syntax elements corresponding to a triangle partition mode (TPM), indicates that the TPM is forbidden to be used, determining a combined intra and inter prediction (CIIP) mode as a target merge mode used for the current picture block, wherein the syntax element sps_triangle_enabled_flag corresponding to the TPM is at a sequence level;

when the regular merge mode is unavailable, and the syntax element sps_triangle_enabled_flag corresponding to the TPM indicates that the TPM is allowed to be used, determining the target merge mode based on at least one of the syntax element sps_triangle_enabled_flag corresponding to the CIIP mode or available status information of the CIIP mode, wherein the available status information of the CIIP mode is a value of a ciip_flag;

predicting the current picture block based on the target merge mode to obtain a prediction block of the current picture block; and

obtaining a reconstructed block of the current picture block based on the prediction block and the residual block.

10 . The apparatus according to claim 9 , wherein the size of the current picture block meets the preset condition when the current picture block meets the following:

(cdWidth*cbHeight)≥64;

cbWidth<128; and

cbHeight<128;

wherein the cdWidth is a width of the current picture block, and the cbHeight is a height of the current picture block.

11 . The apparatus according to claim 9 , wherein before determining the target merge mode based on the syntax element sps_triangle_enabled_flag corresponding to the at least one of the CIIP mode or the available status information of the CIIP mode,

the operations further comprise:

determining whether a type of a slice or slice group in which the current picture block is located is bi-directional; and

determining whether a maximum quantity of candidate TPM modes supported by the slice or slice group in which the current picture block is located is greater than or equal to 2.

12 . The apparatus according to claim 9 , wherein

the operations further comprise:

determining the CIIP mode as the target merge mode, when the regular merge mode is unavailable, and the syntax element sps_triangle_enabled_flag corresponding to the TPM indicates that the TPM is allowed to be used, and any one of the following is not met:

a type of a slice in which the current picture block is located is bi-directional; and

a maximum quantity of candidate TPM modes supported by the slice or slice group in which the current picture block is located is greater than or equal to 2.

13 . The apparatus according to claim 9 , wherein the operations further comprise:

determining the CIIP mode as the target merge mode, when the CIIP mode is allowed to be used, and when any one of the following is not met:

a TPM mode is allowed to be used;

a skip mode is not used to predict the current picture block;

(cbWidth*cbHeight)≥64;

cbWidth<128; and

cbHeight<128;

wherein the cbWidth is a width of the current picture block, and the cbHeight is a height of the current picture block.

14 . The apparatus according to claim 9 , further comprising:

determining the CIIP mode as the target merge mode, when the CIIP mode is allowed to be used, and any one of the following is not met:

a TPM mode is allowed to be used;

a type of a slice or slice group in which the current picture block is located is bi-directional;

a maximum quantity of candidate TPM modes supported by the slice or the slice group in which the current picture block is located is determined to be greater than or equal to 2;

a size of the current picture block meets a preset condition; and

a skip mode is not used to predict the current picture block.

15 . The apparatus according to claim 9 , wherein the syntax elements are at the sequence level.

16 . A non-transitory computer-readable medium for storing data associated with a video, comprising:

a bitstream stored in the non-transitory computer-readable medium, the bitstream comprising:

encoded data representing a current picture comprising a current picture block;

a first syntax element indicating whether a merge mode is used for the current picture block;

a second syntax element indicating whether a regular merge mode is available;

a fourth syntax element corresponding to a triangle partition mode (TPM), wherein the fourth syntax element indicates whether the TPM is forbidden to be used, and wherein the fourth syntax element sps_triangle_enabled_flag corresponding to the TPM is at a sequence level;

a third syntax element indicating whether a combined intra and inter prediction (CIIP) mode is applied as a target merge mode to the current picture block, wherein the third syntax element indicates that the CIIP mode is applied as a target merge mode to the current picture block when the merge mode is used for the current picture block, when the regular merge mode is unavailable and when the TPM is forbidden to be used;

wherein the third syntax element further indicates that the CIIP mode is applied as a target merge mode to the current picture when the merge mode is used for the current picture block, when the regular merge mode is unavailable, when the TPM is allowed to be used, when the CIIP mode is allowed to be used, and any one of the following is met:

a size of the current picture block meets a preset condition; or

a skip mode is not used to predict the current picture block.

17 . The non-transitory computer-readable medium according to claim 16 , wherein the size of the current picture block meets the preset condition when the current picture block meets the following:

(cdWidth*cbHeight)≥64;

cbWidth<128; and

cbHeight<128;

wherein the cdWidth is a width of the current picture block, and the cbHeight is a height of the current picture block.

18 . The non-transitory computer-readable medium according to claim 16 , wherein the third syntax element further indicates that the CIIP mode is applied as a target merge mode to the current picture when a type of a slice or slice group in which the current picture block is located is bi-directional, and

a maximum quantity of candidate TPM modes supported by the slice or slice group in which the current picture block is located is greater than or equal to 2.

Priority Claims (2)
CN 201910341218.6 · Apr 25, 2019 · national
CN 201910474007.X · Jun 2, 2019 · national
Continuity (3)
Continuation 17451992 · Oct 22, 2021
Continuation PCTCN2020086418 · Apr 23, 2020
Related Publication 20240291965A1 · Aug 29, 2024
References Cited (47)
US 10742972B1 · Li et al. · 2020 [cited by applicant]
US 20120320984A1 · Zhou · 2012 [cited by applicant]
US 20130016785A1 · Wang · 2013 [cited by examiner]
US 20160100189A1 · Pang et al. · 2016 [cited by applicant]
US 20180115787A1 · Koo et al. · 2018 [cited by applicant]
US 20180332305A1 · Lin · 2018 [cited by examiner]
US 20180343455A1 · Jang · 2018 [cited by examiner]
US 20190182505A1 · Chuang · 2019 [cited by examiner]
US 20210344969A1 · Zhang · 2021 [cited by examiner]
US 20220086429A1 · Ko · 2022 [cited by examiner]
US 20230115768A1 · Liao · 2023 [cited by examiner]
CN 105376577A · 2016 [cited by examiner]
CN 106303534A · 2017 [cited by applicant]
CN 109196864A · 2019 [cited by examiner]
CN 109587479A · 2019 [cited by applicant]
CN 111866515A · 2020 [cited by examiner]
CN 112204962B · 2021 [cited by applicant]
EP 3970378A1 · 2022 [cited by applicant]
GB 2582929A · 2020 [cited by examiner]
JP 2001136530A · 2001 [cited by applicant]
JP 2013236358A · 2013 [cited by applicant]
JP 2022518717A · 2022 [cited by applicant]
RU 2547240C1 · 2015 [cited by applicant]
WO WO2012097376A1 · 2012 [cited by examiner]
WO 2012177388A1 · 2012 [cited by applicant]
WO WO2013032074A1 · 2013 [cited by examiner]
WO 2017084512A1 · 2017 [cited by applicant]
WO WO2017204532A1 · 2017 [cited by examiner]
WO WO2020216294A1 · 2020 [cited by examiner]
WO WO2020228560A1 · 2020 [cited by examiner]
WO WO2021056219A1 · 2021 [cited by examiner]
ITU-T H.261 (Mar. 1993), Line Transmission of Non-Telephone Signals, Video Codec for Audiovisual Services at p×64 kbits, total 29 pages. [cited by applicant]
ITU-T H.263(Jan. 2005), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Video coding for low bit rate communication, total 226 pages. [cited by applicant]
ITU-T H.264(Apr. 2017), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services, total 812 pages. [cited by applicant]
ITU-T H.265(Feb. 2018), Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, total 692 pages. [cited by applicant]
Document: JVET-K0500_r4, Fabien Racap et al, CE3-related: Wide-angle intra prediction for non-square blocks, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI… [cited by applicant]
International Standard ISO/IEC 11172-2:1993 Technical Corrigendum 3, Published Nov. 1, 2003, total 6 pages. [cited by applicant]
Rob Koenen, MPEG-4 Overview—(V.21-Jeju Version), ISO/IEC JTC1/SC29/WG11 N4668, Mar. 2002, total 77 pages. [cited by applicant]
Ling Li et al.,“CE10-related: syntax clean-up on triangle prediction”, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, JVET-M0216-v2, total:4pages. [cited by applicant]
Benjamin Bross et al.,“Versatile Video Coding (Draft 4)”, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019,JVET-M1001-v7,total:299pages. [cited by applicant]
Yongjo Ahn et al.,“CE4-1.4: Syntax changes of merge data”, 14th Meeting: Geneva, CH, Mar. 19-27, 2019,JVET-N252,total:4pages. [cited by applicant]
Man-Shu Chiang et al.,“CE10-related: Simplification of MPM generation for CIIP”, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019,JVET-M0183-v1,total 6pages. [cited by applicant]
Huanbang Chen et al.,“Non-CE4: On Merge data signaling”, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019,JVET-00431-v2,total:8pages. [cited by applicant]
Chih-Wei Hsu et al., CE4-related: On merge list construction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, 19 Mar. 27, 2019, 7 pages. [cited by applicant]
Sullivan et al., “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012, pp. 1649-1668. (Year: 2012). [cited by applicant]
Yang et al., “Description of CE4: Inter prediction and motion vector coding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/I EC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, US, Apr. 10-20, 2018, Document: … [cited by applicant]
Hsu et al., “CE4-related: On merge list construction”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11; 14th Meeting : Geneva, CH, 19 Mar. 27, 2019, Document: JVET-N0851, Mar. 24, 2019 … [cited by applicant]