IP Library › Granted Patent US 12,363,285
Granted Patent B2
US 12,363,285 · App. 18/503,304 · Granted Jul 15, 2025

Image prediction method, apparatus, and system, device, and storage medium

Inventors: Yin Zhao (Hangzhou, CN); Haitao Yang (Shenzhen, CN); Jianle Chen (San Diego, CA); Lian Zhang (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
H04N19/107H04N19/157H04N19/176H04N19/186H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,363,285
App. No.
18/503,304
Granted
Jul 15, 2025
Kind
B2
Abstract

An image prediction method, apparatus, and system, a device, and a storage medium are provided. The method includes: (401) obtaining a split mode of a current node, where the current node is an image block in a coding tree unit in a current image; (402) determining, based on the split mode of the current node and a size of the current node, whether the current node satisfies a first condition; and (403) when it is determined that the current node satisfies the first condition, performing intra prediction on all coding blocks belonging to the current node, to obtain predictors of all the coding blocks belonging to the current node.

Claims (48)

1. A method of image prediction, comprising:

obtaining a split mode of a current node, wherein the current node is an image block in a coding tree unit in a current image;

determining whether the current node satisfies a preset condition based on the split mode of the current node, a size of the current node, and a chroma format of the current node; and

when it is determined that the current node satisfies the preset condition, performing, by using a same prediction mode, prediction on coding blocks belonging to the current node, to obtain predictors of the coding blocks belonging to the current node, wherein the prediction mode is intra prediction or inter prediction.

2. The method according to claim 1 , wherein performing the prediction on the coding blocks belonging to the current node comprises:

parsing a prediction mode status flag of the current node; and

when a value of the prediction mode status flag is a first value, performing inter prediction on the coding blocks belonging to the current node; or when a value of the prediction mode status flag is a second value, performing intra prediction on the coding blocks belonging to the current node.

3. The method according to claim 1 , wherein performing the inter prediction on the coding blocks belonging to the current node comprises:

splitting the current node in the split mode of the current node, to obtain a child node of the current node;

determining a split mode that is not allowed for the child node of the current node based on a size of the child node of the current node;

determining a block split policy of the child node of the current node based on the split mode that is not allowed for the child node of the current node; and

obtaining a coding block corresponding to the child node of the current node, and performing inter prediction on the corresponding coding block according to the block split policy of the child node of the current node.

4. The method according to claim 1 , wherein the size of the current node is determined based on a size of a coding tree node corresponding to the current node and the split mode that is used to obtain the current node.

5. The method according to claim 1 , wherein the preset condition comprises:

a quantity of samples of a luma block of the current node is 64, and the split mode is binary tree split.

6. The method according to claim 1 , wherein the preset condition comprises:

a quantity of samples of a luma block of the current node is 128, and the split mode is ternary tree split.

7. The method according to claim 1 , wherein the chroma format of the current node is YUV 4:2:0 or YUV 4:2:2.

8. The method according to claim 1 , wherein the preset condition includes at least one of:

a quantity of samples of a luma block of the current node is 64, the split mode is a binary tree split, and a chroma format is 4:2:0; or

a quantity of samples of a luma block of the current node is 128, the split mode is a ternary tree split, and the chroma format is 4:2:0.

9. A video coding device, comprising:

a processor; and

a memory coupled to the processor to store executable instructions, which when executed by the processor, cause the processor to perform operations, the operations comprising:

obtaining a split mode of a current node, wherein the current node is an image block in a coding tree unit in a current image;

determining whether the current node satisfies a preset condition based on the split mode of the current node, a size of the current node, and a chroma format of the current node; and

when it is determined that the current node satisfies the preset condition, performing, by using a same prediction mode, prediction on coding blocks belonging to the current node, to obtain predictors of the coding blocks belonging to the current node, wherein the prediction mode is intra prediction or inter prediction.

10. The device according to claim 9 , wherein performing prediction on the coding blocks belonging to the current node comprises:

parsing a prediction mode status flag of the current node; and

when a value of the prediction mode status flag is a first value, performing inter prediction on the coding blocks belonging to the current node; or when a value of the prediction mode status flag is a second value, performing intra prediction on the coding blocks belonging to the current node.

11. The device according to claim 9 , wherein performing inter prediction on the coding blocks belonging to the current node comprises:

splitting the current node in the split mode of the current node, to obtain a child node of the current node;

determining a split mode that is not allowed for the child node of the current node based on a size of the child node of the current node;

determining a block split policy of the child node of the current node based on the split mode that is not allowed for the child node of the current node; and

obtaining a coding block corresponding to the child node of the current node, and performing inter prediction on the corresponding coding block according to the block split policy of the child node of the current node.

12. The device according to claim 9 , wherein the size of the current node is determined based on a size of a coding tree node corresponding to the current node and the split mode that is used to obtain the current node.

13. The device according to claim 9 , wherein the preset condition comprises:

a quantity of samples of a luma block of the current node is 64, and the split mode is binary tree split.

14. The device according to claim 9 , wherein the preset condition comprises:

a quantity of samples of a luma block of the current node is 128, and the split mode is ternary tree split.

15. The device according to claim 9 , wherein the chroma format of the current node is YUV 4:2:0 or YUV 4:2:2.

16. The device according to claim 9 , wherein the preset condition includes at least one of:

a quantity of samples of a luma block of the current node is 64, the split mode is a binary tree split, and a chroma format is 4:2:0; or

a quantity of samples of a luma block of the current node is 128, the split mode is a ternary tree split, and the chroma format is 4:2:0.

17. A non-transitory storage medium including an encoded bitstream, the encoded bitstream being generated by using one or more processors to:

obtain a split mode of a current node, wherein the current node is an image block in a coding tree unit in a current image;

determine whether the current node satisfies a preset condition based on the split mode of the current node, a size of the current node, and a chroma format of the current node; and

when it is determined that the current node satisfies the preset condition, perform, by using a same prediction mode, prediction on coding blocks belonging to the current node, to obtain predictors of the coding blocks belonging to the current node, wherein the prediction mode is intra prediction or inter prediction.

Priority Claims (4)
CN 201910016466.3 · Jan 8, 2019 · national
CN 201910173454.1 · Mar 7, 2019 · national
CN 201910219440.9 · Mar 21, 2019 · national
CN 201910696741.0 · Jul 30, 2019 · national
Continuity (4)
Continuation 17843798 · Jun 17, 2022
Continuation 17369350 · Jul 7, 2021
Continuation PCTCN2020070976 · Jan 8, 2020
Related Publication 20240146909A1 · May 2, 2024
References Cited (91)
US 11388399B2 · Zhao et al. · 2022 [cited by applicant]
US 11849109B2 · Zhao · 2023 [cited by examiner]
US 20120117149A1 · Nagpal et al. · 2012 [cited by applicant]
US 20120230421A1 · Chen et al. · 2012 [cited by applicant]
US 20130107970A1 · Wang et al. · 2013 [cited by applicant]
US 20140161187A1 · Zhang et al. · 2014 [cited by applicant]
US 20150208094A1 · Lee et al. · 2015 [cited by applicant]
US 20160050421A1 · Minezawa et al. · 2016 [cited by applicant]
US 20170272782A1 · Li et al. · 2017 [cited by applicant]
US 20170347095A1 · Panusopone et al. · 2017 [cited by applicant]
US 20180131962A1 · Chen et al. · 2018 [cited by applicant]
US 20180270509A1 · Chuang · 2018 [cited by examiner]
US 20180367818A1 · Liu et al. · 2018 [cited by applicant]
US 20190182498A1 · Yamamoto et al. · 2019 [cited by applicant]
US 20190246128A1 · Xu · 2019 [cited by examiner]
US 20190246143A1 · Zhang et al. · 2019 [cited by applicant]
US 20190379914A1 · Misra et al. · 2019 [cited by applicant]
US 20210076034A1 · Misra et al. · 2021 [cited by applicant]
US 20210112248A1 · Zhang et al. · 2021 [cited by applicant]
US 20210112262A1 · Jang · 2021 [cited by applicant]
US 20210235079A1 · Chuang et al. · 2021 [cited by applicant]
US 20210289221A1 · Misra et al. · 2021 [cited by applicant]
US 20210337189A1 · Zhao et al. · 2021 [cited by applicant]
AU 2018233042A1 · 2020 [cited by examiner]
CN 1750658A · 2006 [cited by applicant]
CN 101394565A · 2009 [cited by applicant]
CN 103237216A · 2013 [cited by applicant]
CN 103347187A · 2013 [cited by applicant]
CN 103444177A · 2013 [cited by applicant]
CN 103748877A · 2014 [cited by applicant]
CN 103914527A · 2014 [cited by applicant]
CN 104081777A · 2014 [cited by applicant]
CN 104202602A · 2014 [cited by applicant]
CN 104247424A · 2014 [cited by applicant]
CN 105850131A · 2016 [cited by applicant]
CN 106716999A · 2017 [cited by applicant]
CN 106797478A · 2017 [cited by applicant]
CN 107079160A · 2017 [cited by applicant]
CN 107637081A · 2018 [cited by applicant]
CN 108632608A · 2018 [cited by applicant]
CN 108668136A · 2018 [cited by applicant]
CN 108781289A · 2018 [cited by applicant]
CN 109151468A · 2019 [cited by applicant]
CN 109151477A · 2019 [cited by applicant]
EP 2953352A1 · 2015 [cited by applicant]
JP 2008017229A · 2008 [cited by applicant]
JP 4921239B2 · 2012 [cited by applicant]
JP 2014509160A · 2014 [cited by applicant]
JP 2018191246A · 2018 [cited by applicant]
RU 2674332C2 · 2018 [cited by applicant]
WO 2016074147A1 · 2016 [cited by applicant]
WO 2017019656A1 · 2017 [cited by applicant]
WO 2017030260A1 · 2017 [cited by applicant]
WO 2017034331A1 · 2017 [cited by applicant]
WO 2017222331A1 · 2017 [cited by applicant]
WO 2018047952A1 · 2018 [cited by applicant]
WO 2018088805A1 · 2018 [cited by applicant]
WO 2018142903A1 · 2018 [cited by applicant]
WO 2018164505A1 · 2018 [cited by applicant]
WO 2018177254A1 · 2018 [cited by applicant]
WO 2020035022A1 · 2020 [cited by applicant]
WO 2020056757A1 · 2020 [cited by applicant]
WO WO2020056452A1 · 2020 [cited by examiner]
JVET-L0184, Jicheng An et al, CE1-related: Flexible Luma and Chroma Block Partitioning Trees Separation, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3… [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving idea, High efficiency video coding,” Recommendation of ITU-T H.265, ITU-T Telecommunication Standardization Sector o… [cited by applicant]
Bross et al,“Versatile Video Coding (Draft 2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC29 /WG 11, Document: JVET-K1001-v4, 11th Meeting: Ljubljana, SI, Total 84 pages (Jul. 10-18, 2018). [cited by applicant]
Jackie Ma et al., “Description of Core Experiment: Partitioning”,Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,10th Meeting: San Diego, US, 10 Apr. 20, 2018, Document: JVET-J1021,… [cited by applicant]
Kei Kawamura et al., “AHG7: Chroma coding structure/tools in HEVC fidelity range extension”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,11th Meeting: Shanghai, CN… [cited by applicant]
C. Rosewarne, et al., “CE1-related: Chroma block coding and size restriction”,joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, 3 Oct. 12, 2018, Document: JVET-L… [cited by applicant]
Y. Zhao et al.,“CE1-related: Constrained chroma block partitioning”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11.12th Meeting: Macao, CN, 3 Oct. 12, 2018, Document: JVET-L0372-v1, t… [cited by applicant]
Il-Koo Kim et al.,“Block Partitioning Structure in the HEVC Standard”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012, total 10 pages. [cited by applicant]
Document: JVET-L0548-v1, Chia-Ming Tsai et al., CE1-related: On maximum/minimum allowed QT/BT/TT sizes for chroma, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, … [cited by applicant]
ITU-T H.261 (Mar. 1993), Line Transmission of Non-Telephone Signals, Video Codec for Audiovisual Services at p x 64 kbits, total 29 pages. [cited by applicant]
ITU-T H.263(Jan. 2005), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Video coding for low bit rate communication, total 226 pages. [cited by applicant]
ITU-T H.264(Jun. 2019) , Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video , Advanced video coding for generic audiovisual services, total 836 pages. [cited by applicant]
ITU-T H.265(Feb. 2018), Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, total 692 pages. [cited by applicant]
Shan Nana, Research on Low Complexity Algorithm in High Effciency Video Coding, A Dissertation Submitted to Northwestern Polytechnical University In partial fulfillment of the requirement For the degree of Doctor of Ele… [cited by applicant]
Chapter 6 “H.264 Prediction”, In: Iain E. Richardson, The H.264 Advanced Video Compression Standard, 2nd Edition, Apr. 20, 2010, John Wiley and Sons, XP030001637, total 41 pages. [cited by applicant]
Document: JVET-O0359, Teruhiko Suzuki et al, AHG17: On identification of reference and non-reference picture, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, … [cited by applicant]
Document: JVET-L0184, Jicheng An et al, CEI-related: Flexible Luma and Chroma Block Partitioning Trees Separation, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 12th Meeting: Macao, C… [cited by applicant]
Document: JVET-L1001-v8, Benjamin Bross et al, Versatile Video Coding (Draft 3), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, total 227 pag… [cited by applicant]
Shan Nana et al., An Effective CU Splitting Algorithm in Inter Prediction of HEVC, Journal of Electronics and Information Technology, 2016, with an English Abstract, 8 pages. [cited by applicant]
Document: JVET-L1001-v1, Benjamin Bross et al., Versatile Video Coding (Draft 3), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 160 pages. [cited by applicant]
Document: JVET-J1001-v2, Benjamin Bross, Versatile Video Coding (Draft 1), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, US, Apr. 10-20, 2018, 40 pages. [cited by applicant]
Document: JVET-L0184, Jicheng An et al, CE1-related: Flexible Luma and Chroma Block Partitioning Trees Separation, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, … [cited by applicant]
Document: JVET-L0359_r4, Yukinobu Yasugi et al., AHG12: Flexible Tile Splitting, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 6 pages. [cited by applicant]
Ian Richardson. Video coding. H.264 and MPEG-4 are new generation standards Moscow: Technosfera, 2005, with the Abstract and the Translation, 10 pages. [cited by applicant]
Benjamin Bross, et al., Versatile Video Coding (Draft 6), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2001-v9, Jul. 16, 2019, pp. 22-26, 58-60, 130-132. [cited by applicant]
Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services Coding of moving video, High efficiency video coding, Recommendation ITU-T H.265, Apr. 2013, 317 Pages. [cited by applicant]
Richardson Iain E .: “Chapter 5: H.264 syntax”, The H.264 advanced video compression standard, Jan. 1, 2010 (Jan. 1, 2010), pages iii,iv,99-135, XP055808597, ISBN: 978-0-470-51692-8 [retrieved on May 28, 2021] , 39 page… [cited by applicant]
Chih-Wei Hsu et al: Description of SDR video coding technology proposal by MediaTek, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 10th Meeting: San Diego, US, Apr. 10-20, 2018, JVET-… [cited by applicant]
Cited By (1)
US 12,513,323